Senior Python Data Scraping Engineer (Freelance)

2 days, 18 hours ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites to deliver complete, accurate structured datasets.
  • Use Apify, OpenRouter, and custom workflows to speed up data collection, validation, and task execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and final verification.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain stability when websites change structure or behavior.
  • Clean, normalize, and structure extracted data for delivery in formats such as CSV, JSON, and Google Sheets.
  • Collaborate within a hybrid AI + human workflow while providing critical thinking and quality control.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping with BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to work with complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools.
  • Upper-intermediate English proficiency (B2) or above.
  • A GitHub link is a plus.
  • Ability to work independently with a methodical, detail-oriented approach.

Benefits

  • Remote part-time freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active phases.
  • Compensation up to $45 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects with a hybrid AI + human workflow.
  • Access to provided tools such as Apify and OpenRouter.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Middle Software Engineer (Java)

Exadel 1K-5K Internet Software & Services

Exadel is hiring a mid-level Backend Engineer to work on a major Brazilian financial institution’s secure digital banking platforms, focused on Java microservices, AWS-based event-driven systems, and Nasdaq Calypso integrations.

Agile AWS Java Microservices Scrum Spring Boot
17 hours, 45 minutes ago

Junior Java Developer (Managed Services)

AvePoint 1K-5K Internet Software & Services

AvePoint is seeking a Junior Java Developer to help design, develop, and maintain Java-based applications as part of its development team.

Agile CSS Git Hibernate HTML Java JavaScript REST API Scrum Spring Boot SQL
18 hours ago

Senior .NET Developer

AvePoint 1K-5K Internet Software & Services

AvePoint is seeking a Senior .NET Developer to join its engineering team and build scalable backend applications and microservices that support data security, governance, and resilience platforms.

AWS Azure C# CI/CD Docker ELK Stack GCP Git Grafana Kafka Kubernetes Microservices .NET PostgreSQL Prometheus RabbitMQ REST API SQL Server
18 hours ago

Backend Engineer - Connectivity

Verkada 1K-5K Professional Services

Verkada is hiring a backend engineer for its Connectivity Team to help build and operate systems that connect and remotely manage globally deployed security and environmental devices.

Agile AWS Computer Vision DynamoDB Go Kafka Kubernetes Linux Microservices PostgreSQL Python Redis REST API Terraform
18 hours, 15 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers