Senior Python Data Scraping Engineer (Freelance)

2 days, 18 hours ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to speed up data collection, validation, and execution.
  • Handle dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality through validation checks, cross-source consistency controls, formatting adherence, and final verification.
  • Scale scraping operations for large datasets using batching or parallelization and monitor failures.
  • Maintain stability of scraping workflows when websites experience minor structure changes.
  • Collaborate with AI agents by providing critical thinking, domain expertise, and quality control.
  • Collect, structure, and validate data from diverse sources independently.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field preferred.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to work with complex page structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery in CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • Upper-intermediate English proficiency (B2) or above.
  • GitHub profile link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active phases.
  • Compensation of up to $25 per hour equivalent.
  • Opportunity to work on AI projects with major tech innovators.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Middle Software Engineer (Java)

Exadel 1K-5K Internet Software & Services

Exadel is hiring a mid-level Backend Engineer to work on a major Brazilian financial institution’s secure digital banking platforms, focused on Java microservices, AWS-based event-driven systems, and Nasdaq Calypso integrations.

Agile AWS Java Microservices Scrum Spring Boot
17 hours, 45 minutes ago

Cyber Data Engineer

D2 Technical Services 11-50 IT services and consulting

D2 Technical Services is hiring a systems engineer to support national security cybersecurity operations by managing infrastructure, data pipelines, and SIEM environments.

AWS Bash Cybersecurity DHCP DNS Elasticsearch GCP Linux PowerShell Python SIEM Splunk
17 hours, 45 minutes ago

Junior Java Developer (Managed Services)

AvePoint 1K-5K Internet Software & Services

AvePoint is seeking a Junior Java Developer to help design, develop, and maintain Java-based applications as part of its development team.

Agile CSS Git Hibernate HTML Java JavaScript REST API Scrum Spring Boot SQL
18 hours ago

Senior .NET Developer

AvePoint 1K-5K Internet Software & Services

AvePoint is seeking a Senior .NET Developer to join its engineering team and build scalable backend applications and microservices that support data security, governance, and resilience platforms.

AWS Azure C# CI/CD Docker ELK Stack GCP Git Grafana Kafka Kubernetes Microservices .NET PostgreSQL Prometheus RabbitMQ REST API SQL Server
18 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers