RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

4 hours, 44 minutes ago
Canada
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 30

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection, validation, and task execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Apply validation checks, cross-source consistency controls, and formatting verification to ensure data quality before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and stability.
  • Handle data extraction from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Clean, normalize, and validate collected data into structured formats such as CSV, JSON, or Google Sheets.
  • Work independently to troubleshoot issues, adapt scraping approaches, and maintain accuracy across diverse sources.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s Degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting dynamic content such as JS-rendered pages, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation.
  • Experience delivering structured datasets in formats such as CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • Strong attention to detail and commitment to data accuracy.
  • Self-directed work ethic with the ability to troubleshoot independently.
  • English proficiency at Upper-intermediate (B2) or above.
  • A link to GitHub is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Compensation of up to $45 per hour equivalent, depending on contribution level and pace.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Opportunity to work on specialized AI projects with a hybrid AI + human workflow.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Kaseya

Staff Backend Engineer

Kaseya 1K-5K IT Services

Kaseya is hiring a Staff Backend Engineer to build and evolve SaaS products powered by data, machine learning, and AI within a multi-tenant platform.

Canada Full-time Lead Backend Engineer
$227k-$270k
AWS Azure GCP Go Java LLM Machine Learning Microservices Node.js Pandas Python PyTorch Rust
47 minutes ago
3Pillar Global

SDET - Java/Angular

3Pillar Global 1K-5K Internet Software & Services

3Pillar Global is hiring a remote Software Development Engineer in Test to build and maintain automated testing frameworks, strengthen quality across Java and Angular product development, and support delivery in an Agile CI/CD environment.

Mexico Full-time Senior Backend Engineer SDET (Software Development Engineer in Test)
Angular Appium AWS CI/CD Cypress Figma GitHub GitHub Actions iOS Java Jenkins JIRA JMeter JSON Playwright REST API SQL TDD UX Design
1 hour, 4 minutes ago
Resilient Co

Lead Backend Developer

Resilient Co 11-50 Professional Services

Resilient Co. is hiring a Lead Backend Developer to modernize legacy supply chain management systems by transforming SOAP and WCF APIs into scalable .NET Core REST microservices.

Argentina Brazil Colombia Costa Rica Peru Contract Lead Backend Engineer
API Gateway Azure C# Docker Kubernetes Microservices .NET OpenAPI OpenID Connect RabbitMQ REST API SOAP
1 hour, 9 minutes ago
W

Data Engineer - FHIR Expertise

Walter Recruiting, staffing, remote hiring, talent acquisition

A forward-thinking healthcare AI client is seeking an SME with FHIR and/or Epic Clarity experience to help develop AI-powered medical assistants for health systems, with a focus on workflow support, policy integration, and data-driven operations.

United States Full-time Lead Data Engineer
Machine Learning
1 hour, 17 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers