Senior Python Data Scraping Engineer (Freelance)

9 hours, 37 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets with complete coverage and accuracy.
  • Use provided tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection, validation, and execution.
  • Handle dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Apply data quality checks, cross-source consistency controls, and format validation before delivery.
  • Scale scraping operations for large datasets using batching or parallelization while monitoring failures and maintaining stability.
  • Troubleshoot extraction issues and adapt approaches to complex site structures and anti-bot measures.
  • Work collaboratively with AI agents by providing critical thinking, domain expertise, and quality control.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery in CSV, JSON, or Google Sheets formats.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent, and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar automation tools.
  • Strong attention to detail and commitment to data accuracy.
  • Self-directed work ethic with ability to troubleshoot independently.
  • English proficiency at Upper-intermediate (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $30 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects with major tech innovators.
  • Access to provided tools and internal workflow support, including Apify and OpenRouter.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Software Engineer - PHP

Creative Chaos 251-1K Internet Software & Services

PHP Developer at an unspecified company, responsible for building and maintaining server-side web applications, integrating back-end systems with external services, and supporting front-end work.

AJAX GitHub JavaScript JIRA jQuery MySQL PHP REST API WordPress Yii
9 hours, 7 minutes ago

Software Engineer - .NET

Creative Chaos 251-1K Internet Software & Services

Creative Chaos is hiring a Software Engineer (.NET) to develop server-side applications and RESTful APIs while ensuring functionality, security, and performance align with design requirements.

AWS Azure GitHub JIRA MongoDB MySQL .NET Oracle PostgreSQL REST API SQL Server
9 hours, 7 minutes ago

Python Technical Interviewer.

Intetics 1K-5K Internet Software & Services

Intetics Inc. is seeking Technical Interviewers to assess candidates for Python developer roles as part of its custom software and distributed teams business.

Django FastAPI Flask Python
9 hours, 7 minutes ago

Senior Software Engineer - .NET

Creative Chaos 251-1K Internet Software & Services

Creative Chaos is hiring a Senior Software Engineer (.Net) to develop secure, high-performing server applications and RESTful APIs while mentoring team members and supporting team growth.

AWS Azure GitHub JIRA MongoDB MySQL .NET Oracle PostgreSQL REST API SQL Server
9 hours, 7 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers