RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

59 minutes ago
Spain
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 30

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection and task execution.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content.
  • Validate results through quality checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor scraping failures and maintain stability when site structures change.
  • Collect, structure, and validate data from diverse sources.
  • Work independently to troubleshoot issues and solve non-trivial scraping and automation problems.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping, using tools such as BeautifulSoup, Selenium, or similar.
  • Experience extracting data from dynamic content such as JS, AJAX, and infinite scroll, as well as APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets in CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • Upper-intermediate English proficiency (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Remote freelance part-time work.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $40 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects with a hybrid AI + human workflow.
  • Access to internal tools such as Apify and OpenRouter for the project.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Wellhub

Senior Backend Software Engineer | AI Engine

Wellhub 1-10 Gas Utilities

Wellhub is hiring a Senior Backend Software Engineer for its CARE - AI Engine team in Brazil to build and operate production AI-powered backend services that deliver reliable, observable, and fast experiences to real users.

Brazil Full-time Senior AI Engineer Backend Engineer
Apache Airflow AWS DynamoDB Go Grafana Java Kafka Kotlin LLM Microservices OpenSearch OpenTelemetry PostgreSQL Prometheus Python SQL
24 minutes ago
Sweet

Backend Engineer

Sweet

Sweet Security is hiring a Senior Backend Engineer to build and scale the core systems of its cloud-native detection and response platform.

Israel Senior Backend Engineer
Kafka Microservices REST API TypeScript
1 hour, 2 minutes ago
Slingshot Aerospace

Senior Backend Engineer, Space Operations Intelligence & Autonomy (SOIA)

Slingshot Aerospace 51-250 Diversified Telecommunication Services

Slingshot is hiring a Senior Backend Software Engineer to build the distributed systems, data platforms, and real-time services behind its Space Operations Intelligence & Autonomy products for national security and commercial space customers.

United States United Kingdom Full-time Senior Backend Engineer
$150k-$200k
Agile AWS CI/CD Docker Git GitHub Actions GraphQL Helm Java Kafka Kotlin Kubernetes LLM Microservices MongoDB PostgreSQL Python React REST API Three.js
1 hour, 5 minutes ago
CI&T

[Job-29414] Senior Node Developer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Node Developer in Brazil to build and maintain systems for one of its projects, supporting scalable operations in a remote/hybrid work context.

Brazil Full-time Senior Backend Engineer Cloud Engineer
Agile AWS Node.js
1 hour, 13 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers