Senior Python Data Scraping Engineer (Freelance)

16 hours, 27 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection and task execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Validate extracted data through cross-source consistency checks, formatting verification, and systematic quality control before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and stability.
  • Adapt scraping approaches to handle minor site structure changes and maintain reliable output.
  • Work alongside AI agents by providing critical thinking, domain expertise, and quality assurance.
  • Collect, structure, clean, and validate data from diverse sources for project needs.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience handling dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets such as CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent, and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • Strong attention to detail and commitment to data accuracy.
  • Ability to work independently and troubleshoot problems self-directed.
  • Upper-intermediate English proficiency (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on a hybrid AI + human system with real-world data projects.
  • Access to provided tools such as Apify and OpenRouter for project work.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Java Developer

TWO95 International 51-250 Internet Software & Services

Java Developer for a 6+ month remote contract supporting the design, development, and maintenance of distributed web applications and REST-based services.

AJAX CSS GitHub GitHub Actions HTML Java JavaScript Jenkins JIRA jQuery JSON JUnit RabbitMQ REST API Spring XML
16 hours, 12 minutes ago

Senior Golang Developer

Monterail 251-1K Internet Software & Services

Senior Golang Developers are needed by a freelance network to design, build, and maintain high-load backend architecture on part-time or full-time B2B engagements.

Git Go GraphQL gRPC Microservices REST API WebSockets
16 hours, 12 minutes ago

Senior Java Developer

Coforge 10K-50K IT Services

Encora is seeking a Software Engineer to deliver business-facing project enhancements and backend system support for enterprise applications, from design through post-deployment verification.

Cybersecurity DevSecOps Git Hibernate Java Oracle REST API Spring Spring Boot SQL SVN
16 hours, 27 minutes ago

Python Developer (Vaga Exclusiva para Pessoa com Deficiência)

Coforge 10K-50K IT Services

Encora is hiring a full-time Python developer in Brazil to work remotely on cloud-based solutions that emphasize performance, scalability, and end-to-end delivery.

Agile AWS Django Kanban Python REST API Scrum SQL
16 hours, 27 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers