Senior Python Data Scraping Engineer (Freelance)

1 hour, 32 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection and task execution.
  • Extract data reliably from dynamic and interactive websites, including JavaScript-rendered content.
  • Validate outputs for quality, consistency, and formatting before delivery.
  • Perform cross-source checks and systematic verification to ensure data accuracy.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain stability when site structures change.
  • Work independently to troubleshoot issues and handle non-trivial data collection problems.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using tools such as BeautifulSoup, Selenium, or similar.
  • Experience scraping dynamic content such as JS, AJAX, and infinite scroll, including API access via proxies.
  • Proven ability to extract data from complex structures, archived pages, and inconsistent HTML.
  • Strong background in data cleaning, normalization, and validation for structured outputs such as CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar.
  • English proficiency at Upper-intermediate (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Compensation of up to $25 per hour equivalent, depending on contribution level and pace.
  • Estimated workload of around 10–20 hours per week during active project phases.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

[Job-29497] Senior Python Backend Developer (Generative AI), Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Python Backend Developer in Brazil to build and evolve generative AI backend solutions for insurance and digital customer service products in a remote environment, with occasional on-site presence required in the Campinas metro area.

AWS Azure Docker Kubernetes Microservices Python
58 minutes ago

Senior Backend Engineer - Golang Migration

Gramian Consultancy Group Professional Services

Gramian Consultancy is hiring a Senior Backend Engineer to build and improve the backend of a large-scale B2C product, with an emphasis on performance, reliability, and legacy Python-to-Go migrations.

Go Python System Design
1 hour, 11 minutes ago

[Job-29414] Senior Node Developer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Node Developer in Brazil to build and maintain systems for one of its projects, supporting scalable operations in a remote/hybrid work context.

Agile AWS Node.js
1 hour, 17 minutes ago

Java Spring Boot Developer

AssureSoft 51-250 Internet Software & Services

AssureSoft is hiring a Java Developer to build and support integrations and backend services for long-term projects with external systems and APIs in a remote environment.

HTML Java JavaScript REST API SOAP Spring Boot XML
1 hour, 22 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers