RemoteLeaf Logo
Log in Sign up

Senior Web Scraping Specialist (Python)

1 month, 3 weeks ago
United States
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 42

Description

  • Own end-to-end data extraction workflows across complex websites to deliver complete and accurate structured datasets.
  • Use Apify, OpenRouter, and custom workflows to accelerate data collection, validation, and task execution.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Apply data quality controls through validation checks, cross-source consistency checks, formatting adherence, and final verification.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and site changes.
  • Maintain stable scraping performance despite minor website structure changes.
  • Structure, clean, normalize, and validate extracted data before delivery.
  • Troubleshoot issues independently and adapt scraping approaches as needed.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping with BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery formats including CSV, JSON, and Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar automation tools.
  • Strong attention to detail and commitment to data accuracy.
  • Self-directed work ethic with the ability to troubleshoot independently.
  • English proficiency at Upper-intermediate (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on level and pace of contribution.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

M9 Solutions

Quantitative Engineer / Python Developer

M9 Solutions 51-250 Internet Software & Services

M9 Solutions is hiring a remote Quantitative Engineer / Python Developer to support a San Antonio, TX client by building and validating quantitative models and Python functions for a financial-data plug-in framework.

United States Full-time Junior Backend Engineer
$60k-$180k
AWS Python Statistics
5 hours, 7 minutes ago
Coforge

Javascript Backend Developer/Node.js

Coforge 10K-50K IT Services

Coforge is hiring a remote Javascript Backend Developer in Brazil to build and support backend API services across the development lifecycle.

Brazil Mid Level Backend Engineer
Agile AWS CI/CD Docker Git GraphQL JavaScript Kubernetes Node.js React REST API Scrum SQL TypeScript
5 hours, 37 minutes ago
Coforge

Senior .NET Azure AI Developer

Coforge 10K-50K IT Services

Coforge is hiring a Senior .NET Azure AI Developer to build and support cloud-based applications, AI integrations, and automation solutions across enterprise systems in a remote role for candidates in Costa Rica, Peru, Colombia, or Bolivia.

Peru Colombia Costa Rica Bolivia Senior AI Engineer Backend Engineer
Azure C# CI/CD Git JSON .NET Python REST API SQL
5 hours, 37 minutes ago
DEPT®

Senior Full Stack Rust Engineer, Contract - US

DEPT® 1K-5K Media

DEPT® is hiring a Full Stack Rust Engineer to build and maintain production Rust systems in a distributed, containerized environment with backend ownership at the core.

United States Contract Senior Backend Engineer Full-stack Engineer
$182k-$182k
CI/CD Grafana Jaeger Kubernetes Microservices MySQL OpenTelemetry PostgreSQL Prometheus React Rust SQL
5 hours, 52 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers