Freelance Data Scraping Engineer (Python)

20 hours, 28 minutes ago
Part-time
Mid Level
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets with complete coverage and accuracy.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection, validation, and task execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content and sites with changing behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and formatting verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and maintaining stability.
  • Adapt scraping approaches to handle complex website structures and minor site structure changes.
  • Perform systematic verification to ensure reliable, actionable, and accurate results.

Requirements

  • At least 3 years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor's or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using tools such as BeautifulSoup, Selenium, or similar technologies.
  • Experience extracting data from dynamic content, including JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to work with complex data structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with experience delivering CSV, JSON, or Google Sheets datasets.
  • Hands-on experience with LLMs and AI frameworks to improve automation and problem-solving.
  • English proficiency at upper-intermediate level (B2) or above.
  • A GitHub link is a plus.
  • Self-directed work ethic with the ability to troubleshoot independently.

Benefits

  • Work fully remote on your own schedule with only a laptop and stable internet connection.
  • Performance-based bonus programs that reward high-quality work and consistent delivery.
  • Hands-on experience in a hybrid environment where human expertise and AI agents collaborate.
  • Opportunity to contribute to AI projects from major tech innovators through the Mindrift platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Python Developer

SPD Technology Internet Software & Services

SPD Technology is hiring a Senior Python Developer to own the API and async pipeline for an AI-powered legal content platform that helps law firms research, draft, and submit Chambers USA rankings.

API Gateway AWS Celery GitHub Actions Microservices OpenAPI PostgreSQL Pulumi Python REST API Terraform
19 hours, 43 minutes ago

Principal / Staff Software Engineer - Backend, MLOps and Cloud Infrastructure

Nacre Capital 11-50 Capital Markets

Seed-X is hiring a Principal / Staff Software Engineer to lead backend, MLOps, and cloud platform architecture for its AI-driven AgTech systems that analyze seed quality at scale.

AWS CI/CD Datadog DNS Docker Grafana Kubernetes Microservices MLOps OpenSearch Prometheus Python SQL
19 hours, 43 minutes ago

Senior Backend Engineer, Data Platform

Slack 1K-5K Internet Software & Services

LaunchDarkly is hiring a Senior Backend Engineer for its Data Platform team to build and operate distributed infrastructure that moves, stores, and serves large-scale product data for customer-facing features.

Apache Airflow Apache Spark AWS ClickHouse Databricks Datadog Elasticsearch Go Kafka PostgreSQL Python Scala SQL Terraform
20 hours, 13 minutes ago

Senior Software Engineer - Rust

Creative Chaos 251-1K Internet Software & Services

Creative Chaos is hiring a Senior Software Engineer specializing in Rust to design, develop, and maintain high-performance software systems while collaborating across teams to improve performance, reliability, and code quality.

Agile C++ CI/CD Python Rust
20 hours, 13 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers