RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

1 hour, 54 minutes ago
United States
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 30

Description

  • Own end-to-end data extraction workflows across complex websites to ensure complete coverage and accurate structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection, validation, and task execution.
  • Handle data extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and maintaining stability.
  • Adapt scraping approaches to extract data from complex site structures, including hierarchies, archived pages, and inconsistent HTML.
  • Clean, normalize, and validate collected data into structured outputs such as CSV, JSON, or Google Sheets.
  • Handle anti-bot mechanisms and other technical obstacles encountered in scraping at scale.
  • Work independently to troubleshoot issues and deliver reliable results within project requirements.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using tools such as BeautifulSoup, Selenium, or similar.
  • Experience scraping dynamic content, including JavaScript, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation with structured dataset delivery.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Compensation of up to $45 per hour equivalent, depending on level and pace of contribution.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Opportunity to work on AI projects with major tech innovators through the Mindrift platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Kaseya

Staff Backend Engineer

Kaseya 1K-5K IT Services

Kaseya is hiring a Staff Backend Engineer to build and evolve SaaS products powered by data, machine learning, and AI within a multi-tenant platform.

Canada Full-time Lead Backend Engineer
$227k-$270k
AWS Azure GCP Go Java LLM Machine Learning Microservices Node.js Pandas Python PyTorch Rust
2 hours, 31 minutes ago
3Pillar Global

SDET - Java/Angular

3Pillar Global 1K-5K Internet Software & Services

3Pillar Global is hiring a remote Software Development Engineer in Test to build and maintain automated testing frameworks, strengthen quality across Java and Angular product development, and support delivery in an Agile CI/CD environment.

Mexico Full-time Senior Backend Engineer SDET (Software Development Engineer in Test)
Angular Appium AWS CI/CD Cypress Figma GitHub GitHub Actions iOS Java Jenkins JIRA JMeter JSON Playwright REST API SQL TDD UX Design
2 hours, 47 minutes ago
Resilient Co

Lead Backend Developer

Resilient Co 11-50 Professional Services

Resilient Co. is hiring a Lead Backend Developer to modernize legacy supply chain management systems by transforming SOAP and WCF APIs into scalable .NET Core REST microservices.

Argentina Brazil Colombia Costa Rica Peru Contract Lead Backend Engineer
API Gateway Azure C# Docker Kubernetes Microservices .NET OpenAPI OpenID Connect RabbitMQ REST API SOAP
2 hours, 53 minutes ago
ClickHouse

Senior Software Engineer - Data Integration & JVM Ecosystem

ClickHouse 51-250 IT Services

ClickHouse is hiring a Senior Software Engineer to own JVM-based data connector and integration work that connects its database platform with the broader data ecosystem for high-scale analytics and data engineering use cases.

Germany Full-time Senior Backend Engineer Data Engineer
Apache Airflow Apache Spark Beam ClickHouse dbt Flink Grafana HTTP Java Kafka Metabase Pandas Power BI Python SQL Tableau TCP/IP
4 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers