RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

1 hour, 26 minutes ago
Germany
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 43

Description

  • Own end-to-end extraction workflows across complex websites and deliver accurate, structured datasets.
  • Use tools and custom workflows to accelerate data collection, validation, and task execution.
  • Extract data from dynamic and interactive sources, including JavaScript-rendered content, while adapting to site changes.
  • Validate data quality through formatting checks, cross-source consistency controls, and systematic verification.
  • Scale scraping for large datasets using batching or parallelization, monitor failures, and maintain workflow stability.
  • Troubleshoot scraping and processing issues independently and ensure reliable delivery.

Requirements

  • 5+ years of experience in data engineering, web scraping, automation, or software development.
  • Strong Python web scraping experience with BeautifulSoup, Selenium, or similar tools, including JavaScript, AJAX, infinite scroll, and APIs via proxies.
  • Experience extracting data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Experience cleaning, normalizing, and validating data into CSV, JSON, or Google Sheets formats.
  • Experience handling anti-bot mechanisms and dynamic website structures at scale.
  • Experience with AWS or equivalent cloud infrastructure and Docker containerization.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar.
  • Upper-intermediate English proficiency (B2+) and ability to work independently with strong attention to detail.
  • Bachelor’s or Master’s degree in a technical field is preferred; GitHub portfolio is a plus.

Benefits

  • Part-time, fully remote freelance opportunity.
  • Estimated workload of 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on experience and contribution pace.
  • Access to Mindrift’s platform and opportunities to contribute to AI technology projects.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

MKS2 Technologies

Ruby Developer

MKS2 Technologies 51-250 Internet Software & Services

MKS2 Technologies is hiring a remote U.S.-based Ruby Developer to build and maintain secure, scalable APIs for mission-critical applications on the VA Lighthouse platform.

United States Full-time Senior Backend Engineer
$140k-$150k
Agile Docker Encryption Git GraphQL Helm Java Kubernetes Microservices MySQL OAuth PostgreSQL REST API RSpec Ruby Ruby on Rails Sidekiq Spring Boot
11 minutes ago
Twilio

Software Engineer L2-Messaging API

Twilio 5K-10K Diversified Telecommunication Services

Twilio is hiring a remote Software Engineer (L2) for its Comms Engineering team to build, operate, and maintain scalable backend services and APIs powering global Messaging API communications.

United States Full-time Mid Level Backend Engineer
$117k-$172k
AWS Docker DynamoDB Go Java Kubernetes
25 minutes ago
Scopely

Senior Software Engineer (Gaming Backend) - WWE Champions

Scopely 1K-5K Internet Software & Services

Scopely is hiring a Senior Software Engineer for the WWE Champions team to own backend systems that support core gameplay and live-service operations for a mobile game.

Mexico United States Canada Full-time Senior Backend Engineer Game Developer
AWS C# CI/CD Game Design Microservices Unity
1 day ago
Livefront

Java Engineer [Zeal]

Livefront 11-50 Internet Software & Services

Zeal, now part of Livefront, is hiring a Java Engineer in Peru to help Fortune 1000 clients solve business problems through custom software delivery and consulting.

Peru Junior Backend Engineer
Angular Apache Airflow C# Databricks dbt Entity Framework Flutter GitHub GitHub Actions Grafana Jaeger Java JavaScript Jenkins Kafka Looker MongoDB .NET New Relic Next.js Oracle PostgreSQL Power BI Prometheus Python React Snowflake Spring Boot SQL Server Terraform TypeScript Xamarin
1 day ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers