Senior Python Data Scraping Engineer (Freelance)

3 hours, 13 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites to deliver structured datasets with complete coverage and accuracy.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection, validation, and task execution.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using efficient batching or parallelization.
  • Monitor failures and maintain stability when sites change structure or behavior.
  • Apply technical precision to web extraction and processing tasks within a hybrid AI + human workflow.

Requirements

  • At least 5 years of relevant experience in data engineering, web scraping, automation, or software development.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation for structured outputs such as CSV, JSON, and Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • English proficiency at Upper-intermediate (B2) level or above.
  • A GitHub link is a plus.

Benefits

  • Work fully remote on your own schedule with just a laptop and stable internet connection.
  • Part-time freelance opportunity.
  • Gain hands-on experience in a hybrid environment where human experts collaborate with AI agents.
  • Participate in performance-based bonus programs for high-quality work and consistent delivery.
  • Compensation of up to $30 per hour equivalent, depending on level and pace of contribution.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Backend Engineer

Remote 251-1K Professional Services

Remote is hiring a software engineer to help build tools, APIs, and integrations for its HR and Payroll products on a fully remote, cross-functional engineering team.

Angular AWS CI/CD Clojure Docker Elixir Erlang GitHub GitLab Haskell Jenkins Kubernetes Next.js Phoenix PostgreSQL React Scala Vue.js
25 minutes ago

Senior Backend Engineer

Zeta Global 1K-5K Media

Zeta Global is seeking a Senior Backend Engineer to design and own distributed CRM and marketing platform services that power multichannel customer communications and high-throughput data-driven marketing workflows.

AWS Elasticsearch Java Kafka Python Ruby
25 minutes ago

Senior Backend Engineer

Remote 251-1K Professional Services

Remote is hiring a full-time engineer to build tools, APIs, and integrations for its HR and Payroll products as part of a globally distributed, fully remote team.

Angular AWS CI/CD Clojure Docker Elixir Erlang GitLab Haskell JavaScript Kubernetes Next.js Phoenix PostgreSQL React Scala Vue.js
25 minutes ago

Software Engineer 1 (Backend)

Sortly 11-50 Air Freight & Logistics

Sortly is hiring a Software Engineer 1 - Backend to help build and maintain reliable backend services for its remote-first inventory management platform.

30 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers