Senior Python Data Scraping Engineer (Freelance)

46 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets with complete coverage and accuracy.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection, validation, and task execution.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, formatting adherence, and systematic verification before delivery.
  • Scale scraping operations for large datasets using efficient batching or parallelization.
  • Monitor failures and maintain stability when sites change slightly or when extraction issues occur.
  • Collaborate with AI agents by handling the critical thinking, domain expertise, and quality control portions of the work.
  • Systematically collect, structure, and validate data from diverse sources while working independently.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets in CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools for automation tasks.
  • English proficiency at Upper-intermediate (B2) or above.
  • A GitHub link is a plus.
  • Ability to work methodically, independently, and troubleshoot issues without close supervision.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of 10–20 hours per week during active project phases.
  • Compensation of up to $25 per hour equivalent, depending on level and pace of contribution.
  • Opportunity to work on AI projects with major tech innovators through Mindrift’s platform.
  • Access to internal tools provided for the project, including Apify and OpenRouter.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Staff Backend Engineer

Kaseya 1K-5K IT Services

Kaseya is hiring a Staff Backend Engineer to build and evolve SaaS products powered by data, machine learning, and AI within a multi-tenant platform.

AWS Azure GCP Go Java LLM Machine Learning Microservices Node.js Pandas Python PyTorch Rust
2 hours, 30 minutes ago

SDET - Java/Angular

3Pillar Global 1K-5K Internet Software & Services

3Pillar Global is hiring a remote Software Development Engineer in Test to build and maintain automated testing frameworks, strengthen quality across Java and Angular product development, and support delivery in an Agile CI/CD environment.

Angular Appium AWS CI/CD Cypress Figma GitHub GitHub Actions iOS Java Jenkins JIRA JMeter JSON Playwright REST API SQL TDD UX Design
2 hours, 47 minutes ago

Lead Backend Developer

Resilient Co 11-50 Professional Services

Resilient Co. is hiring a Lead Backend Developer to modernize legacy supply chain management systems by transforming SOAP and WCF APIs into scalable .NET Core REST microservices.

API Gateway Azure C# Docker Kubernetes Microservices .NET OpenAPI OpenID Connect RabbitMQ REST API SOAP
2 hours, 52 minutes ago

Senior Software Engineer - Data Integration & JVM Ecosystem

ClickHouse 51-250 IT Services

ClickHouse is hiring a Senior Software Engineer to own JVM-based data connector and integration work that connects its database platform with the broader data ecosystem for high-scale analytics and data engineering use cases.

Apache Airflow Apache Spark Beam ClickHouse dbt Flink Grafana HTTP Java Kafka Metabase Pandas Power BI Python SQL Tableau TCP/IP
3 hours, 59 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers