Senior Python Data Scraping Engineer (Freelance)

11 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection and validation.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification.
  • Scale scraping operations for large datasets using batching or parallelization and monitor failures.
  • Maintain stability when sites change slightly and adapt scraping approaches as needed.
  • Collaborate with AI-driven agents while providing critical thinking, domain expertise, and quality control.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping with BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to work with complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery in CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • Upper-intermediate English proficiency (B2) or above.
  • A GitHub link is a plus.
  • Ability to work independently with strong attention to detail and a methodical approach.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation up to $45 per hour equivalent, depending on level and pace of contribution.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

1148 | Middle/Senior Go Developer

Intetics 1K-5K Internet Software & Services

Intetics Inc. is seeking a Middle/Senior Go Developer to build and support backend services and integrations for a distributed international team.

Agile Docker Go Grafana gRPC Kafka Microservices PostgreSQL Prometheus RabbitMQ REST API Scrum
11 minutes ago

[Job-30273] Developer Tibco and/or Workato, Mexico

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Tibco/Workato Developer to design and maintain integration solutions that connect enterprise systems and improve business data flow.

Agile AWS Azure JSON REST API SOAP SQL XML
26 minutes ago

[Job-30548] Senior Developer GO, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a backend engineer to build and optimize Go-based services for high-volume, cloud-connected systems in a company applying AI across software delivery and business solutions.

AWS Azure CI/CD Datadog DevSecOps Docker DynamoDB GCP Go Grafana Kafka Kibana Kubernetes Microservices MongoDB MySQL New Relic PostgreSQL Prometheus RabbitMQ Redis REST API Solid.js
26 minutes ago

[Job - 30532] Senior Developer .NET, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Mid-Level .NET Engineer to develop and integrate back-end software solutions for a multicultural, English-speaking global team.

Agile Azure C# CI/CD .NET REST API SOAP SQL Server
26 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers