RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

1 hour, 30 minutes ago
United States
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 324

Description

  • Own end-to-end data extraction workflows across complex websites to ensure complete coverage, accuracy, and reliable delivery of structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection, validation, and task execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content and sites with changing behavior.
  • Validate outputs against quality standards through cross-source consistency checks, formatting checks, and systematic verification before delivery.
  • Scale scraping operations for large datasets using efficient batching or parallelization.
  • Monitor scraping failures and maintain stability when websites change structure slightly.
  • Handle technical precision for web extraction and data processing across diverse sources.
  • Collaborate within a hybrid AI + human workflow by applying critical thinking, domain expertise, and quality control.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools, including dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with experience delivering structured datasets in CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent, and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar, applied to automation tasks.
  • Upper-intermediate English proficiency (B2) or above is required.
  • Strong attention to detail and commitment to data accuracy.
  • Self-directed work ethic with the ability to troubleshoot independently.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation up to $45 per hour equivalent, depending on level and pace of contribution.
  • Work on AI projects through Mindrift’s platform with access to specialized project work.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Customer.io

Senior Software Engineer - Backend Platform

Customer.io 11-50 Professional Services

Customer.io is hiring an experienced backend engineer for its Platform team to build and own the distributed infrastructure that powers a high-scale marketing automation platform processing billions of events and messages worldwide.

Remote
Full-time Lead Backend Engineer
$150k-$200k
AWS DynamoDB Ember GCP Go MySQL PostgreSQL React System Design
1 hour, 15 minutes ago
MediaRadar

Data Quality Engineer

MediaRadar 51-250 Media

MediaRadar is hiring a Data Quality Engineer to build and operate the automated tooling, monitoring, and dashboards that keep governed data accurate, measurable, and continuously validated across the company’s data pipelines and platforms.

India Full-time Mid Level Data Engineer QA Engineer
Python SQL
1 hour, 30 minutes ago
Intetics

Senior Data Engineer - Databricks

Intetics 1K-5K Internet Software & Services

Intetics Inc. is hiring a Databricks Data Engineer to support and evolve a global enterprise data platform across Azure and AWS, with primary ownership of production pipeline reliability, optimization, and customer onboarding.

United Kingdom Poland Romania Slovakia Spain Germany Full-time Senior Data Engineer
Apache Spark AWS Azure CI/CD Databricks Git PostgreSQL Python Secrets Management Serverless SQL SQL Server
1 hour, 45 minutes ago
TWO95 International

Senior SQL & Azure Data Factory developer - EST/ CST - Remote role

TWO95 International 51-250 Internet Software & Services

A 6-month contract-to-hire Senior SQL and Azure Data Factory Developer role at an enterprise data environment, focused on building and leading data solutions, pipelines, and API-driven database components.

United States Contract Senior Data Engineer
$115k-$125k
SQL
1 hour, 45 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers