RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

1 hour, 54 minutes ago
New Zealand, Japan, Singapore, South Korea
Freelance
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 57

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection and validation.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content.
  • Enforce data quality through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain stability when site structures change.
  • Work collaboratively with Tendem Agents while providing critical thinking, domain expertise, and quality control.
  • Adapt scraping approaches to meet defined requirements and handle changing site behavior.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping with tools such as BeautifulSoup and Selenium, including dynamic content, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets in CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • Upper-intermediate English proficiency (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $40 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects with real-world expertise through the Mindrift platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CoLab

Senior 3D & AI Systems Software Developer

CoLab 51-250 Construction & Engineering

CoLab is seeking a backend engineer to help build its 3D AutoReview platform, powering intelligent design analysis and AI-assisted review for leading mechanical engineering organizations.

North America Full-time Senior Backend Engineer Machine Learning Engineer
Hugging Face LLM Machine Learning PyTorch SageMaker Scikit-learn SQL
2 hours, 6 minutes ago
3Pillar Global

SDET - Java/Angular

3Pillar Global 1K-5K Internet Software & Services

3Pillar Global is hiring a remote Software Development Engineer in Test to build and maintain automated testing frameworks, strengthen quality across Java and Angular product development, and support delivery in an Agile CI/CD environment.

Mexico Full-time Senior Backend Engineer SDET (Software Development Engineer in Test)
Angular Appium AWS CI/CD Cypress Figma GitHub GitHub Actions iOS Java Jenkins JIRA JMeter JSON Playwright REST API SQL TDD UX Design
2 hours, 45 minutes ago
W

React/Node Developer

Walter Recruiting, staffing, remote hiring, talent acquisition

Toptal is hiring a freelance front-end engineer for a global media and technology company to modernize its Mail platform across web and mobile web experiences.

United States Canada Contract Lead Backend Engineer
CI/CD CSS HTML JavaScript Node.js React TDD TypeScript
4 hours, 4 minutes ago
Fieldwire

Senior Backend Engineer

Fieldwire 251-1K Construction & Engineering

Fieldwire is hiring a Senior Backend Engineer to help build and scale the core platform services and integrations behind its growing construction software platform.

United States Full-time Senior Backend Engineer
$170k-$195k
AWS Docker Microservices Ruby on Rails
4 hours, 32 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers