RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

1 hour, 24 minutes ago
Japan, New Zealand, Singapore, South Korea
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 218

Description

  • Own end-to-end data extraction workflows across complex websites to produce complete, accurate structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection, validation, and execution.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and site changes.
  • Work within a hybrid AI + human system by collaborating with Tendem Agents and providing critical thinking, domain expertise, and quality control.
  • Adapt scraping approaches to handle complex structures such as hierarchies, archived pages, inconsistent HTML, and APIs via proxies.
  • Clean, normalize, and validate extracted data into structured formats such as CSV, JSON, or Google Sheets.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong Python web scraping experience with BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets in CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent, and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar applied to automation tasks.
  • Strong attention to detail, commitment to data accuracy, and ability to troubleshoot independently.
  • English proficiency at upper-intermediate level (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $40 per hour equivalent depending on level and pace of contribution.
  • Opportunity to work on AI projects through the Mindrift platform.
  • Access to internal tools provided for the project, including Apify and OpenRouter.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

SPD Technology

Senior Python Developer

SPD Technology Internet Software & Services

SPD Technology is hiring a Senior Python Developer to own the API and async pipeline for an AI-powered legal content platform that helps law firms research, draft, and submit Chambers USA rankings.

Poland Portugal Romania Spain Czech Republic Ukraine Full-time Senior Backend Engineer
API Gateway AWS Celery GitHub Actions Microservices OpenAPI PostgreSQL Pulumi Python REST API Terraform
1 hour, 9 minutes ago
Nacre Capital

Principal / Staff Software Engineer - Backend, MLOps and Cloud Infrastructure

Nacre Capital 11-50 Capital Markets

Seed-X is hiring a Principal / Staff Software Engineer to lead backend, MLOps, and cloud platform architecture for its AI-driven AgTech systems that analyze seed quality at scale.

Portugal Romania Bulgaria Spain Hungary Full-time Lead Backend Engineer Machine Learning Engineer
AWS CI/CD Datadog DNS Docker Grafana Kubernetes Microservices MLOps OpenSearch Prometheus Python SQL
1 hour, 9 minutes ago
Enroute

Data Engineer: Integration Migration

Enroute 51-250 Internet Software & Services

Enroute is seeking a Data Engineer to support a migration of data integrations to Azure Data Factory, with a focus on rebuilding pipelines, managing data movement, and stabilizing the new Azure-based platform.

Mexico Full-time Mid Level Data Engineer
CI/CD Oracle Snowflake SQL
1 hour, 9 minutes ago
MediaRadar

Senior Data Engineer

MediaRadar 51-250 Media

MediaRadar is seeking a Senior Data Engineer to lead a distributed team while architecting and modernizing its data delivery platform as it moves from a vendor-heavy stack to a flexible, open-source, AWS-based architecture.

United States Full-time Lead Data Engineer
Apache Airflow AWS ClickHouse Dagster dbt Docker Kafka Kubernetes PostgreSQL Python SQL SQL Server
1 hour, 24 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers