Senior Python Data Scraping Engineer (Freelance)

18 hours, 36 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection and validation.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization and monitor failures.
  • Maintain stability when websites change structure and adapt scraping approaches as needed.
  • Clean, normalize, and structure extracted data into formats such as CSV, JSON, or Google Sheets.
  • Troubleshoot issues independently and support accurate, actionable project delivery.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using tools such as BeautifulSoup, Selenium, or similar.
  • Experience extracting data from dynamic content, including JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to work with complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar applied to automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • A methodical, detail-oriented, self-directed work style with the ability to troubleshoot independently.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on level and pace of contribution.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Python Developer

SPD Technology Internet Software & Services

SPD Technology is hiring a Senior Python Developer to own the API and async pipeline for an AI-powered legal content platform that helps law firms research, draft, and submit Chambers USA rankings.

API Gateway AWS Celery GitHub Actions Microservices OpenAPI PostgreSQL Pulumi Python REST API Terraform
17 hours, 51 minutes ago

Principal / Staff Software Engineer - Backend, MLOps and Cloud Infrastructure

Nacre Capital 11-50 Capital Markets

Seed-X is hiring a Principal / Staff Software Engineer to lead backend, MLOps, and cloud platform architecture for its AI-driven AgTech systems that analyze seed quality at scale.

AWS CI/CD Datadog DNS Docker Grafana Kubernetes Microservices MLOps OpenSearch Prometheus Python SQL
17 hours, 51 minutes ago

Senior Backend Engineer, Data Platform

Slack 1K-5K Internet Software & Services

LaunchDarkly is hiring a Senior Backend Engineer for its Data Platform team to build and operate distributed infrastructure that moves, stores, and serves large-scale product data for customer-facing features.

Apache Airflow Apache Spark AWS ClickHouse Databricks Datadog Elasticsearch Go Kafka PostgreSQL Python Scala SQL Terraform
18 hours, 21 minutes ago

Senior Software Engineer - Rust

Creative Chaos 251-1K Internet Software & Services

Creative Chaos is hiring a Senior Software Engineer specializing in Rust to design, develop, and maintain high-performance software systems while collaborating across teams to improve performance, reliability, and code quality.

Agile C++ CI/CD Python Rust
18 hours, 21 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers