Senior Python Data Scraping Engineer (Freelance)

22 hours, 45 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets with complete coverage and accuracy.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection, validation, and execution.
  • Ensure reliable scraping from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Apply data quality checks, cross-source consistency controls, and formatting verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor scraping failures and maintain stability when sites change structure.
  • Work collaboratively within a hybrid AI + human system by providing critical thinking, domain expertise, and quality control.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience handling dynamic content such as JavaScript, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation for structured outputs such as CSV, JSON, and Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation up to $30 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects with a hybrid AI + human workflow.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Staff Back-end Engineer

Coupang 1K-5K Internet Software & Services

Coupang’s Ecommerce Engineering team is hiring a hands-on engineering leader to shape scalable purchase and logistics systems that support fast business growth and reliable customer experiences.

System Design
21 hours, 45 minutes ago

Python - Senior Developers - AI Training - Portland, USA

Prolific 51-250 Professional Services

Prolific is seeking senior Python developers in the USA to join its Expert Network and help train and evaluate AI models using paid technical tasks.

Django FastAPI Flask GraphQL Pytest Python REST API Unittest
21 hours, 45 minutes ago

Senior Back End Engineer

You.com 11-50 Professional Services

You.com is hiring a Senior Backend Engineer to build the scalable backend systems and infrastructure that power its LLM-based generative AI assistant and AI search platform.

Kubernetes LLM REST API SQL
22 hours ago

Senior Back-end Engineer (Coupang Ads Engineering)

Coupang 1K-5K Internet Software & Services

쿠팡 Ads 조직의 백엔드 개발자로서 광고 플랫폼의 신규 기능과 핵심 인프라를 설계·개발하는 역할입니다.

Agile Apache Spark AWS Azure Docker Elasticsearch GCP GraphQL gRPC Hadoop Hive Java Kafka Kotlin Kubernetes Machine Learning Microservices Node.js Redis REST API Spring SQL
22 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers