Senior Python Data Scraping Engineer (Freelance)

3 hours, 24 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end extraction workflows across complex websites and deliver accurate, structured datasets.
  • Use tools and custom workflows to accelerate data collection, validation, and task execution.
  • Extract data from dynamic and interactive sources, including JavaScript-rendered content, while adapting to site changes.
  • Apply quality controls, formatting standards, cross-source checks, and verification before delivery.
  • Scale scraping operations through batching or parallelization, monitor failures, and maintain workflow stability.
  • Clean, normalize, structure, and validate data for delivery in CSV, JSON, or Google Sheets formats.
  • Troubleshoot scraping and automation issues independently and handle anti-bot mechanisms at scale.

Requirements

  • 5+ years of experience in data engineering, web scraping, automation, or software development.
  • Strong Python web scraping experience with BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content, APIs, proxies, hierarchies, archived pages, and inconsistent HTML.
  • Proficiency in data cleaning, normalization, and validation.
  • Experience handling anti-bot mechanisms and changing website structures at scale.
  • Hands-on experience with AWS or equivalent cloud infrastructure and Docker containerization.
  • Experience with LangChain, OpenRouter, or similar LLM frameworks for automation tasks.
  • Strong attention to detail, data accuracy, independent troubleshooting, and self-directed work habits.
  • Upper-intermediate English proficiency (B2 or above).
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related field is preferred; GitHub link is a plus.

Benefits

  • Part-time freelance remote work.
  • Estimated workload of 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on experience, contribution level, project scope, and pace.
  • Opportunity to contribute to AI technology development through the Mindrift platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior .NET Developer [Short-Term Contractor]

ArcTouch 251-1K Internet Software & Services

ArcTouch, an AKQA Group specialty studio, is seeking a Senior .NET Developer to build resilient, cloud-native publishing and query services for an enterprise Knowledge Graph supporting a global leader.

Azure C# CI/CD JSON Neo4j .NET REST API
3 hours, 9 minutes ago

Python Engineer PL

Coforge 10K-50K IT Services

Coforge is hiring a remote Python Engineer PL in Brazil to develop, test, and support scalable software solutions in collaboration with product and agile development teams.

Agile Celery CSS Django Docker ELK Stack FastAPI Flask Git HTML JavaScript Jenkins Linux OpenAPI Postman Pytest Python React REST API
1 day, 2 hours ago

Backend Developer (Node.js)

VIONICA LIMITED IT services

Join the backend team as a Middle+/Senior Backend Developer, focusing primarily on casino operator and partner integrations while also contributing to platform services and game logic development.

Argo CD AWS CI/CD Docker Git GitOps Grafana HTTP Kafka Kubernetes Microservices Node.js PostgreSQL RabbitMQ Redis REST API SOAP System Design TypeScript XML
1 day, 3 hours ago

Junior Backend Engineer (Europe)

Kalepa 11-50 Insurance

Kalepa is hiring a software engineer to build backend services, data pipelines, and applied AI systems that support commercial insurance underwriting workflows.

Machine Learning Python
2 days, 2 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers