Senior Python Data Scraping Engineer (Freelance)

3 days, 14 hours ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to accelerate data collection and execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization and maintain stability as sites change.
  • Handle data cleaning, normalization, and validation to produce structured outputs such as CSV, JSON, and Google Sheets.
  • Troubleshoot failures and adapt scraping approaches to complex site structures and anti-bot mechanisms.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping with BeautifulSoup, Selenium, or similar tools.
  • Experience scraping dynamic content such as JS, AJAX, and infinite scroll, including APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation with structured datasets such as CSV, JSON, and Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • Strong attention to detail and ability to work independently.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation up to $25 per hour equivalent, depending on level and pace of contribution.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Backend Engineer, Developer Platform (Horde)

Epic Games 5K-10K Internet Software & Services

Epic Games is hiring a senior programmer for its Unreal Engine developer platform team to work on Horde, the internal platform that supports CI/CD, remote execution, build health, storage, and developer workflows.

AWS Azure C# CI/CD gRPC MongoDB .NET Redis
14 hours, 12 minutes ago

Senior Staff Back-end Engineer (eCommerce Engineering)

Coupang 1K-5K Internet Software & Services

Coupang is hiring a Senior Staff Backend Engineer to lead the architecture and technical strategy for its core e-commerce platform services across global markets.

Apache Airflow Apache Spark AWS Cassandra Grafana Java Kafka Kotlin Kubernetes Microservices OpenTelemetry Prometheus Spring
14 hours, 27 minutes ago

Senior Ruby on Rails Developer (LLM)

OnTheGoSystems 51-250 Internet Software & Services

OTGS is hiring a Senior Ruby on Rails Developer to build and improve scalable products, with a focus on backend systems and practical AI/LLM features.

AWS CI/CD LLM React Ruby Ruby on Rails WordPress
14 hours, 57 minutes ago

Senior Ruby on Rails Developer (LLM)

OnTheGoSystems 51-250 Internet Software & Services

OTGS is hiring a senior Ruby on Rails developer to build scalable products and AI-assisted features for a widely used multilingual WordPress platform.

AWS CI/CD LLM React Ruby Ruby on Rails WordPress
14 hours, 57 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers