RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

1 hour, 27 minutes ago
United States
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 57

Description

  • Own end-to-end data extraction workflows across complex websites and deliver complete, accurate structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection, validation, and task execution.
  • Extract reliable data from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, formatting compliance, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and maintaining stability.
  • Adapt scraping approaches to handle complex structures, archived pages, inconsistent HTML, and minor site structure changes.
  • Handle anti-bot mechanisms and other challenges that arise in high-volume scraping workflows.
  • Collaborate with AI agents by providing critical thinking, domain expertise, and quality control for delivered results.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets such as CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • A GitHub link is a plus.
  • Methodical, detail-oriented, and able to work independently while troubleshooting issues on your own.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects with major tech innovators through the Mindrift platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Margo Bank

Senior C# Developer with Fintech experience

Margo Bank Professional Services

Senior C# Developer role at a global financial institution on a distributed team modernizing core financial systems and user tools for front-office operations.

Poland Contract Senior Backend Engineer
$74k-$96k
Ansible Bitbucket C# Git HTML JavaScript Jenkins LLM .NET React TeamCity TypeScript
1 hour, 51 minutes ago
Attadale Partners

Full Stack Java Developers (CONTRACT ROLE)

Attadale Partners 11-50 Professional Services

Attadale Partners, LLC is hiring early-career Java Developers for a remote contractor role supporting enterprise transformation work for commercial and government clients across communications, AI workflows, and cloud telephony.

United States Contract Junior Backend Engineer Full-stack Engineer
Agile AWS CI/CD DynamoDB GitHub Actions Java Kafka Mockito OAuth OpenAPI OpenID Connect REST API Spring Boot
2 hours, 39 minutes ago
Inter

IA Engineer (Python + LLM)

Inter 51-250 Banks

Inter is hiring a Python backend engineer to develop AI agents and related platform integrations for its global financial super app.

Brazil Full-time Senior AI Engineer Backend Engineer
Agile AWS Azure CI/CD GCP Kafka Microservices Python RabbitMQ REST API
3 hours, 23 minutes ago
Resilient Co

Lead Backend Developer

Resilient Co 11-50 Professional Services

Resilient Co. is hiring a Lead Backend Developer to modernize legacy supply chain management systems by transforming SOAP and WCF APIs into scalable .NET Core REST microservices.

Argentina Brazil Colombia Costa Rica Peru Contract Lead Backend Engineer
API Gateway Azure C# Docker Kubernetes Microservices .NET OpenAPI OpenID Connect RabbitMQ REST API SOAP
3 hours, 31 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers