RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

3 hours, 33 minutes ago
Azerbaijan, Georgia, Kazakhstan, Uzbekistan, Armenia
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 102

Description

  • Own end-to-end data extraction workflows across complex websites to ensure complete coverage and reliable delivery of structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection, validation, and task execution.
  • Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content and sites with changing behavior.
  • Apply quality control checks to validate data, enforce formatting requirements, and verify outputs before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and maintaining stability.
  • Handle complex web structures such as hierarchies, archived pages, inconsistent HTML, and API-based sources.
  • Troubleshoot scraping issues independently and adapt approaches when site structures change or anti-bot mechanisms are encountered.
  • Collaborate within a hybrid AI + human workflow by providing critical thinking, domain expertise, and review of AI-generated outputs.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Strong Python web scraping experience using tools such as BeautifulSoup, Selenium, or similar libraries.
  • Experience extracting data from dynamic content such as JavaScript, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to work with complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with experience delivering datasets in CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools.
  • Upper-intermediate English proficiency (B2) or above.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • GitHub profile link is a plus.
  • Methodical, detail-oriented, self-directed work style with the ability to troubleshoot independently.

Benefits

  • Remote freelance, part-time opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $30 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects through Mindrift’s platform with major tech innovators.
  • Work in a hybrid AI + human system that combines automation with expert review.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Stripe

Backend Engineer, Financial Connections

Stripe 5K-10K Diversified Financial Services

Stripe is hiring Backend Engineers to build scalable bank integration infrastructure for its Financial Connections team, enabling secure banking data access and new connectivity experiences for businesses worldwide.

Canada Full-time Lead Backend Engineer
System Design
3 hours, 3 minutes ago
Cato Networks

Software Engineer – RBI

Cato Networks 251-1K Diversified Telecommunication Services

Cato Networks is hiring an experienced Software Engineer for its RBI team to help build a new SaaS product from the ground up and deliver scalable infrastructure for a cloud-based enterprise platform.

Israel Senior Backend Engineer
AWS CI/CD Go GraphQL Java Microservices Play Framework Spring Boot
3 hours, 3 minutes ago
SecurityScorecard

Senior Data Engineer

SecurityScorecard 251-1K IT Services

SecurityScorecard is hiring a Senior Data Engineer to build and maintain scalable data products and platform capabilities for its cybersecurity ratings business.

Latin America Full-time Senior Data Engineer
$75k-$92k
Agile Apache Airflow Apache Spark AWS ClickHouse Cybersecurity Docker Git Hive Java Jenkins Kafka PostgreSQL Python Redis REST API Scala Scrum Terraform
3 hours, 17 minutes ago
payabl.

Python Backend Developer (File processing)

payabl. 51-250 Diversified Financial Services

payabl. is hiring a Mid-Level Backend Developer to help modernize legacy file-processing and payment-orchestration systems into a Python-based fintech platform.

Portugal Ukraine Full-time Mid Level Backend Engineer
Agile Apache Airflow AWS Grafana MySQL Perl Prefect Python
3 hours, 17 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers