RemoteLeaf Logo
Log in Sign up

Senior Data Scraping Engineer (Python)

3 months, 3 weeks ago
Anywhere
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 13

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection and task execution.
  • Ensure reliable scraping from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Validate extracted data for quality, cross-source consistency, and formatting accuracy before delivery.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain scraping stability when site structures change.
  • Clean, normalize, and structure data for delivery in formats such as CSV, JSON, and Google Sheets.
  • Collaborate with AI agents by providing critical thinking, domain expertise, and quality control.
  • Troubleshoot complex scraping and automation issues independently.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience scraping dynamic content such as JavaScript-rendered pages, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation with structured output formats such as CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools for automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • A GitHub link is a plus.
  • Ability to work independently with a methodical, detail-oriented approach.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects through Mindrift’s platform with major tech innovators.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Elastic

Core/ Infra - Senior Java Engineer - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Senior Software Engineer for its Elasticsearch team to build and improve shared platform infrastructure, enabling secure, scalable, observable, and maintainable Elasticsearch across cloud, serverless, and on-premises environments.

Spain Full-time Senior Backend Engineer
$72k-$114k
Argo CD Buildkite CI/CD Elasticsearch GitOps Go Gradle Java Kubernetes Maven OpenTelemetry Serverless
2 hours, 18 minutes ago
Moniepoint

Senior Backend Engineer (Java)

Moniepoint 1K-5K Diversified Financial Services

Moniepoint Inc. is hiring a backend software engineer to build and scale reliable Java and Spring Boot services supporting its high-volume financial platform in Africa.

Spain Full-time Senior Backend Engineer
Agile Angular AWS CI/CD Docker DynamoDB Elasticsearch Hibernate Java Kubernetes Microservices PostgreSQL React REST API Spring Spring Boot System Design
2 hours, 32 minutes ago
Kunai

C1: GPN - Java Engineers for ARP/ETB Integration

Kunai 51-250 Professional Services

Kunai is seeking a Senior Software Engineer to modernize digital payment systems by integrating a major card network with a leading U.S. financial institution across legacy and cloud-native infrastructure.

United States Full-time Senior Backend Engineer
AWS Java JWT Kafka Kubernetes Microservices Next.js OAuth OpenShift Oracle PostgreSQL React Spring Boot TypeScript
2 hours, 32 minutes ago
CI&T

[Job 31840] Developer Backend Java Pleno (Foco em IA))

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa desenvolvedora backend Java em nível mid-level para construir e sustentar soluções de microsserviços integradas a inteligência artificial, contribuindo para projetos de transformação tecnológica em uma empresa global.

Brazil Full-time Mid Level AI Engineer Backend Engineer
Angular CI/CD Docker Generative AI Java JUnit Kafka Kubernetes Microservices Mockito NLP RabbitMQ REST API Spring Boot SQL
2 hours, 32 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers