Senior Python Data Scraping Engineer (Freelance)

1 hour, 44 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection and task execution.
  • Extract data reliably from dynamic and interactive websites, including JavaScript-rendered content and changing site behavior.
  • Validate scraped data through quality checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain scraping stability when websites change structure slightly.
  • Apply data cleaning, normalization, and structured formatting to extracted data.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience handling dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets such as CSV, JSON, and Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar.
  • Upper-intermediate English proficiency (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated 10–20 hours per week during active project phases.
  • Compensation up to $25 per hour equivalent.
  • Work on projects using AI-assisted tools and workflows.
  • Opportunity to contribute to specialized data scraping work within a hybrid AI + human system.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Software Engineer - Backend Platform

Customer.io 11-50 Professional Services

Customer.io is hiring an experienced backend engineer for its Platform team to build and own the distributed infrastructure that powers a high-scale marketing automation platform processing billions of events and messages worldwide.

AWS DynamoDB Ember GCP Go MySQL PostgreSQL React System Design
1 hour, 14 minutes ago

Data Quality Engineer

MediaRadar 51-250 Media

MediaRadar is hiring a Data Quality Engineer to build and operate the automated tooling, monitoring, and dashboards that keep governed data accurate, measurable, and continuously validated across the company’s data pipelines and platforms.

Python SQL
1 hour, 29 minutes ago

Senior Data Engineer - Databricks

Intetics 1K-5K Internet Software & Services

Intetics Inc. is hiring a Databricks Data Engineer to support and evolve a global enterprise data platform across Azure and AWS, with primary ownership of production pipeline reliability, optimization, and customer onboarding.

Apache Spark AWS Azure CI/CD Databricks Git PostgreSQL Python Secrets Management Serverless SQL SQL Server
1 hour, 44 minutes ago

Senior SQL & Azure Data Factory developer - EST/ CST - Remote role

TWO95 International 51-250 Internet Software & Services

A 6-month contract-to-hire Senior SQL and Azure Data Factory Developer role at an enterprise data environment, focused on building and leading data solutions, pipelines, and API-driven database components.

SQL
1 hour, 44 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers