Senior Python Data Scraping Engineer (Freelance)

9 hours, 7 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver accurate, structured datasets.
  • Use tools and custom workflows to accelerate data collection, validation, and task execution.
  • Extract data from dynamic and interactive websites, including JavaScript-rendered content and changing site structures.
  • Apply validation, consistency checks, formatting standards, and systematic verification before delivery.
  • Scale scraping operations through batching or parallelization while monitoring failures and maintaining stability.
  • Collect, clean, normalize, and structure data from diverse sources in formats such as CSV, JSON, and Google Sheets.
  • Troubleshoot scraping and automation issues independently and adapt approaches to non-trivial technical problems.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Strong Python web-scraping experience with BeautifulSoup, Selenium, or similar tools.
  • Experience handling dynamic content such as JavaScript, AJAX, infinite scroll, and APIs through proxies.
  • Ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Experience with data cleaning, normalization, validation, and structured dataset delivery.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Practical experience with AWS or equivalent cloud infrastructure and Docker containerization.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation.
  • Strong attention to detail, data accuracy, independent troubleshooting, and self-directed work habits.
  • Upper-intermediate English proficiency (B2 or above); a technical bachelor’s or master’s degree and GitHub link are preferred.

Benefits

  • Remote, freelance opportunity with flexible project-based participation.
  • Estimated workload of 10–20 hours per week during active project phases.
  • Potential compensation of up to $45 per hour equivalent, depending on expertise and contribution pace.
  • Access to projects through Mindrift’s platform connecting specialists with AI technology initiatives.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

PHP Developer

Cleeng 51-250 Internet Software & Services

Cleeng is hiring a backend engineer to build and modernize its PHP-based subscriber retention platform, delivering reliable APIs and features across its remote-first international engineering team.

Agile Doctrine MySQL REST API Solid.js
9 hours, 7 minutes ago

Senior C# / .NET Developer

Margo Bank Professional Services

Senior developer role in a six-person technology unit supporting a global Retail Media company, focused on designing and building a Core User Platform and partner APIs from the ground up.

C# .NET
1 day, 8 hours ago

Senior Backend Engineer

Megaport 251-1K Diversified Telecommunication Services

Megaport is hiring a Senior Software Engineer to evolve its global Network as a Service platform by developing backend services, modernizing core systems, and guiding technical improvements.

CI/CD Hibernate Java Kotlin REST API SQL
1 day, 8 hours ago

Java Back End Developer Senior

MUTT DATA 51-250 Internet Software & Services

Mutt Data is seeking a Senior Java Backend Developer to build scalable data, reporting, and analytics systems for machine learning and data-driven client solutions in a remote startup environment.

Apache Airflow AWS Azure CI/CD Databricks dbt Deep Learning Docker GCP Generative AI Git GraphQL Java Kubernetes Machine Learning Python React Terraform TypeScript
1 day, 8 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers