Senior Python Data Scraping Engineer (Freelance)

11 hours, 16 minutes ago
Freelance
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites to deliver complete and accurate structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection, validation, and task execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency checks, and verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while maintaining stability and monitoring failures.
  • Adapt scraping approaches to handle complex website structures, including archives, hierarchies, inconsistent HTML, and anti-bot mechanisms.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools, including dynamic content, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with experience delivering structured datasets in CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools for automation tasks.
  • English proficiency at Upper-intermediate B2 level or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $30 per hour equivalent, depending on contribution level and pace.
  • Work on AI projects through Mindrift’s hybrid AI plus human system.
  • Opportunity to use specialized tools and work on technical data scraping tasks.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Junior Java Consultant

Capco 5K-10K Internet Software & Services

Capco is hiring a Java developer to support its Capital Markets team in building and maintaining software interfaces and extensions for financial services clients.

Java SQL XML
11 hours, 1 minute ago

Mid-Level Backend Engineer – Java/Go

Verve Group 251-1K Media

Verve is hiring a backend software engineer to help build and operate its core ad exchange platform that powers privacy-focused advertising technology worldwide.

AWS CI/CD Docker GCP Go Java Kubernetes
11 hours, 1 minute ago

Senior Java Developer

Medium 51-250 Internet Software & Services

Nuvolar Works is hiring a Senior Java Developer for a long-term global healthcare data platform initiative focused on consolidating enterprise systems into a single scalable ecosystem.

AWS Azure GCP Git Java Microservices Spring Spring Boot SQL
11 hours, 16 minutes ago

Principal Java Developer Moldova (Java, React, AWS)

Amdaris 251-1K Internet Software & Services

Amdaris is hiring a Principal Java Developer for an international software development project, leading technical direction for a client focused on procurement solutions within a fast-growing, cross-functional environment.

AWS CI/CD DDD DynamoDB Java Kafka Kotlin Microservices MongoDB PostgreSQL React Spring Boot SQL
11 hours, 16 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers