RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

1 hour, 30 minutes ago
United States
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 324

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to accelerate data collection and execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification.
  • Scale scraping operations for large datasets using batching or parallelization and maintain stability against minor site changes.
  • Monitor failures and adapt scraping approaches to changing site behavior and site structure.
  • Clean, normalize, and structure extracted data for delivery in formats such as CSV, JSON, and Google Sheets.
  • Work independently to troubleshoot technical issues and complete non-trivial automation tasks.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation with structured outputs such as CSV, JSON, and Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar automation tools.
  • Strong attention to detail and commitment to data accuracy.
  • Self-directed work ethic with the ability to troubleshoot independently.
  • English proficiency at Upper-intermediate (B2) or above.
  • A link to GitHub is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on level and pace of contribution.
  • Access to internal tools such as Apify and OpenRouter for the project.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Customer.io

Senior Software Engineer - Backend Platform

Customer.io 11-50 Professional Services

Customer.io is hiring an experienced backend engineer for its Platform team to build and own the distributed infrastructure that powers a high-scale marketing automation platform processing billions of events and messages worldwide.

Remote
Full-time Lead Backend Engineer
$150k-$200k
AWS DynamoDB Ember GCP Go MySQL PostgreSQL React System Design
1 hour, 15 minutes ago
MediaRadar

Data Quality Engineer

MediaRadar 51-250 Media

MediaRadar is hiring a Data Quality Engineer to build and operate the automated tooling, monitoring, and dashboards that keep governed data accurate, measurable, and continuously validated across the company’s data pipelines and platforms.

India Full-time Mid Level Data Engineer QA Engineer
Python SQL
1 hour, 30 minutes ago
Intetics

Senior Data Engineer - Databricks

Intetics 1K-5K Internet Software & Services

Intetics Inc. is hiring a Databricks Data Engineer to support and evolve a global enterprise data platform across Azure and AWS, with primary ownership of production pipeline reliability, optimization, and customer onboarding.

United Kingdom Poland Romania Slovakia Spain Germany Full-time Senior Data Engineer
Apache Spark AWS Azure CI/CD Databricks Git PostgreSQL Python Secrets Management Serverless SQL SQL Server
1 hour, 45 minutes ago
TWO95 International

Senior SQL & Azure Data Factory developer - EST/ CST - Remote role

TWO95 International 51-250 Internet Software & Services

A 6-month contract-to-hire Senior SQL and Azure Data Factory Developer role at an enterprise data environment, focused on building and leading data solutions, pipelines, and API-driven database components.

United States Contract Senior Data Engineer
$115k-$125k
SQL
1 hour, 45 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers