Senior Python Data Scraping Engineer (Freelance)

14 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use Apify, OpenRouter, and custom workflows to speed up data collection, validation, and task execution.
  • Extract reliably from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and stability issues.
  • Adapt scraping approaches to handle minor site structure changes and maintain reliable delivery.
  • Work with Tendem Agents in a hybrid AI-and-human workflow, providing critical thinking, domain expertise, and quality control.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of CSV, JSON, or Google Sheets datasets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar.
  • English proficiency at Upper-intermediate (B2) or above.
  • GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $25 per hour equivalent, depending on level and pace of contribution.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Fullstack Developer (C#/React), Migrate - ShareGate

ShareGate 1-10 Internet Software & Services

ShareGate, part of Workleap Technologies, is hiring a Senior Software Developer to help build a new Microsoft 365 migration web application and shape its technical foundation from the ground up.

C# .NET React TypeScript
14 minutes ago

Software Engineer I, Backend (Collections)

Affirm 1K-5K Diversified Financial Services

Affirm is hiring a software engineer for its Collections team in Poland to build reliable backend and platform systems that improve delinquency recovery across the loan lifecycle.

AWS Kotlin Kubernetes MySQL Python
14 minutes ago

.Net Developer with PLANISWARE

TWO95 International 51-250 Internet Software & Services

A .NET Developer with Planisware experience is needed to support enterprise applications and project portfolio management solutions for an organization using C#, ASP.NET, .NET Core, SQL Server, and Planisware.

Agile Azure C# CRM CSS ERP HTML JavaScript .NET REST API Scrum SQL Server
14 minutes ago

Senior Backend Engineer, Deployment Environments

GitLab 1K-5K Internet Software & Services

GitLab is hiring a Senior Backend Engineer for its Platform Enablement organization to improve how GitLab is deployed, validated, and operated across cloud-native, self-managed, and ephemeral environments.

CI/CD DevSecOps GitLab Kubernetes
29 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers