Senior Python Data Scraping Engineer (Freelance)

11 hours, 15 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets with full coverage and accuracy.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection, validation, and execution.
  • Build reliable scraping approaches for dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, formatting adherence, and verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and maintaining stability against site changes.
  • Handle data extraction from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Clean, normalize, and validate extracted data into structured formats such as CSV, JSON, and Google Sheets.
  • Work independently to troubleshoot issues and solve non-trivial technical problems in AI-assisted workflows.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Strong experience with Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to work with complex website structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools.
  • Upper-intermediate English proficiency (B2) or above.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $40 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work within a hybrid AI + human workflow on specialized data scraping tasks.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Junior Java Consultant

Capco 5K-10K Internet Software & Services

Capco is hiring a Java developer to support its Capital Markets team in building and maintaining software interfaces and extensions for financial services clients.

Java SQL XML
11 hours, 1 minute ago

Mid-Level Backend Engineer – Java/Go

Verve Group 251-1K Media

Verve is hiring a backend software engineer to help build and operate its core ad exchange platform that powers privacy-focused advertising technology worldwide.

AWS CI/CD Docker GCP Go Java Kubernetes
11 hours, 1 minute ago

Senior Java Developer

Medium 51-250 Internet Software & Services

Nuvolar Works is hiring a Senior Java Developer for a long-term global healthcare data platform initiative focused on consolidating enterprise systems into a single scalable ecosystem.

AWS Azure GCP Git Java Microservices Spring Spring Boot SQL
11 hours, 15 minutes ago

Principal Java Developer Moldova (Java, React, AWS)

Amdaris 251-1K Internet Software & Services

Amdaris is hiring a Principal Java Developer for an international software development project, leading technical direction for a client focused on procurement solutions within a fast-growing, cross-functional environment.

AWS CI/CD DDD DynamoDB Java Kafka Kotlin Microservices MongoDB PostgreSQL React Spring Boot SQL
11 hours, 15 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers