Senior Python Data Scraping Engineer (Freelance)

10 hours, 46 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to speed up data collection, validation, and execution.
  • Handle reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and maintaining stability.
  • Adapt scraping approaches to complex website structures, including archived pages, hierarchies, inconsistent HTML, and minor site changes.
  • Work collaboratively with AI agents by providing critical thinking, domain expertise, and quality control.
  • Troubleshoot extraction and automation issues independently as needed.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation and practical experience with scripting, automation, and AI-assisted workflows.
  • Strong Python web scraping experience with BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JavaScript, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets such as CSV, JSON, and Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent, and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar applied to automation tasks.
  • Strong attention to detail and commitment to data accuracy.
  • Self-directed work ethic with the ability to troubleshoot independently.
  • English proficiency at upper-intermediate (B2) level or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Up to $30 per hour equivalent, depending on level and pace of contribution.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Opportunity to work on specialized data scraping workflows within a hybrid AI + human system.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Backend Engineer, Core APIs

Fingerprint 51-250 IT Services

Fingerprint is hiring a Senior Backend Engineer for its Core APIs team to build scalable fraud-detection backend systems and real-time data infrastructure for a globally distributed, remote-first company.

CI/CD ClickHouse Databricks Datadog dbt Docker DynamoDB Elasticsearch Express.js GCP Git Go Kubernetes Microservices Node.js Redis Shell Scripting Snowflake SQL Terraform TypeScript
10 hours, 31 minutes ago

Senior Software Engineer - Java (Contract, Poland)

NearForm 251-1K Internet Software & Services

Nearform is hiring a remote contract Senior Java Engineer in [Country] to design and build enterprise applications, work with clients and distributed teams, and deliver secure, high-performance digital solutions.

Agile CI/CD Git Java
11 hours, 1 minute ago

Sr .Net Software Engineer - 100% Remote WOrk

TWO95 International 51-250 Internet Software & Services

Sr. .Net Software Engineer for a 6+ month contract-to-hire role supporting remote application development, database work, and web service integration.

Agile C# CSS HTML JavaScript .NET REST API Scrum XML
11 hours, 1 minute ago

Principal Software Engineer - Node

Creative Chaos 251-1K Internet Software & Services

Creative Chaos is hiring a Principal Software Engineer (Node) to lead backend server application development, including RESTful APIs, while ensuring secure, high-performing, bug-free systems.

Cybersecurity Express.js GitHub JavaScript JIRA MongoDB MySQL NestJS Node.js PostgreSQL REST API
11 hours, 1 minute ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers