Senior Python Data Scraping Engineer (Freelance)

3 hours, 1 minute ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites.
  • Use tools and custom workflows to accelerate data collection, validation, and execution.
  • Extract data from dynamic and interactive websites, including JavaScript-rendered content and changing site structures.
  • Apply validation, cross-source consistency checks, formatting standards, and verification before delivery.
  • Scale scraping operations through batching or parallelization while monitoring failures and maintaining stability.
  • Clean, normalize, structure, and deliver datasets in formats such as CSV, JSON, and Google Sheets.
  • Troubleshoot scraping and automation issues independently and adapt workflows to anti-bot mechanisms.

Requirements

  • 5+ years of experience in data engineering, web scraping, automation, or software development.
  • Strong Python web scraping experience with BeautifulSoup, Selenium, or similar tools.
  • Experience handling JavaScript, AJAX, infinite scroll, APIs, proxies, and complex or inconsistent HTML structures.
  • Experience with data cleaning, normalization, validation, and structured dataset delivery.
  • Experience handling anti-bot mechanisms and dynamic website structures at scale.
  • Experience with AWS or equivalent cloud infrastructure and Docker containerization.
  • Hands-on experience with LangChain, OpenRouter, or similar LLM frameworks for automation.
  • Strong attention to detail, data accuracy, independent troubleshooting, and self-directed work habits.
  • Upper-intermediate English proficiency (B2) or above.
  • Bachelor’s or Master’s degree in a relevant technical field and a GitHub portfolio are preferred.

Benefits

  • Part-time, fully remote freelance opportunity.
  • Estimated workload of 10–20 hours per week during active project phases.
  • Earning potential of up to $45 per hour equivalent, depending on experience and contribution.
  • Opportunity to contribute to AI technology development through the Mindrift platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Core/ Infra - Senior Java Engineer - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Senior Software Engineer for its Elasticsearch team to build and improve shared platform infrastructure, enabling secure, scalable, observable, and maintainable Elasticsearch across cloud, serverless, and on-premises environments.

Argo CD Buildkite CI/CD Elasticsearch GitOps Go Gradle Java Kubernetes Maven OpenTelemetry Serverless
2 hours, 16 minutes ago

Senior Backend Engineer (Java)

Moniepoint 1K-5K Diversified Financial Services

Moniepoint Inc. is hiring a backend software engineer to build and scale reliable Java and Spring Boot services supporting its high-volume financial platform in Africa.

Agile Angular AWS CI/CD Docker DynamoDB Elasticsearch Hibernate Java Kubernetes Microservices PostgreSQL React REST API Spring Spring Boot System Design
2 hours, 31 minutes ago

C1: GPN - Java Engineers for ARP/ETB Integration

Kunai 51-250 Professional Services

Kunai is seeking a Senior Software Engineer to modernize digital payment systems by integrating a major card network with a leading U.S. financial institution across legacy and cloud-native infrastructure.

AWS Java JWT Kafka Kubernetes Microservices Next.js OAuth OpenShift Oracle PostgreSQL React Spring Boot TypeScript
2 hours, 31 minutes ago

[Job 31840] Developer Backend Java Pleno (Foco em IA))

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa desenvolvedora backend Java em nível mid-level para construir e sustentar soluções de microsserviços integradas a inteligência artificial, contribuindo para projetos de transformação tecnológica em uma empresa global.

Angular CI/CD Docker Generative AI Java JUnit Kafka Kubernetes Microservices Mockito NLP RabbitMQ REST API Spring Boot SQL
2 hours, 31 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers