RemoteLeaf Logo
Log in Sign up

Senior Web Scraping Specialist (Python)

1 day ago
United States
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 112

Description

  • Own end-to-end data extraction workflows across complex websites to deliver complete and accurate structured datasets.
  • Use Apify, OpenRouter, and custom workflows to accelerate data collection, validation, and task execution.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Apply data quality controls through validation checks, cross-source consistency checks, formatting adherence, and final verification.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and site changes.
  • Maintain stable scraping performance despite minor website structure changes.
  • Structure, clean, normalize, and validate extracted data before delivery.
  • Troubleshoot issues independently and adapt scraping approaches as needed.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping with BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery formats including CSV, JSON, and Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar automation tools.
  • Strong attention to detail and commitment to data accuracy.
  • Self-directed work ethic with the ability to troubleshoot independently.
  • English proficiency at Upper-intermediate (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on level and pace of contribution.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Grafana

Senior Software Engineer - Grafana Cloud Observability Provider | Germany | Remote

Grafana 1K-5K IT Services

Grafana Labs is hiring a Senior Software Engineer to help design, build, and scale Grafana Cloud’s observability products for metrics and logs in a fully remote, open-source-driven environment.

Germany Spain United Kingdom Sweden Full-time Senior Backend Engineer DevOps Engineer
$105k-$126k
Go Grafana Java Kubernetes Microservices .NET OpenTelemetry Prometheus Python Rust
27 minutes ago
Nebius

Senior Software Developer: Models Team (Token Factory)

Nebius 51-250 Internet Software & Services

Nebius is hiring a backend and infrastructure engineer for the Models Team to help onboard and operate state-of-the-art open-source LLMs in Token Factory, its AI cloud platform for reliable large-scale production inference.

Netherlands Full-time Senior AI Engineer Backend Engineer
Go Kubernetes LLM Python Serverless
27 minutes ago
redbee

Senior Fullstack Developer | Java + React

redbee 51-250 Internet Software & Services

redbee busca un/a profesional senior de desarrollo para crear soluciones digitales estratégicas en la industria financiera, participando en la construcción de productos de misión crítica junto a clientes.

Argentina Brazil Full-time Senior Backend Engineer Full-stack Engineer
AWS DynamoDB Java Kafka Microservices React Redis Spring Boot
42 minutes ago
Intetics

PHP Technical Interviewer

Intetics 1K-5K Internet Software & Services

Intetics Inc. is seeking a Technical Interviewer to conduct and improve technical assessments for PHP developer roles within its custom software and distributed teams business.

Ukraine Senior Backend Engineer Training Specialist
Laravel PHP Symfony
42 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers