Senior Python Data Scraping Engineer (Freelance)

11 hours, 37 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites, ensuring complete coverage and accurate structured datasets.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to speed up data collection, validation, and task execution.
  • Ensure reliable extraction from dynamic and interactive websites, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, formatting compliance, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization, while monitoring failures and maintaining stability as sites change.
  • Work collaboratively with AI agents by providing critical thinking, domain expertise, and quality control for assigned tasks.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong Python web scraping experience using tools such as BeautifulSoup and Selenium, including dynamic content, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets in CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar automation tools.
  • Upper-intermediate English proficiency (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $40 per hour equivalent, depending on level and pace of contribution.
  • Opportunity to work on AI projects with a hybrid AI + human system.
  • Access to provided tools such as Apify and OpenRouter on the project.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Software Engineer - PHP

Creative Chaos 251-1K Internet Software & Services

PHP Developer at an unspecified company, responsible for building and maintaining server-side web applications, integrating back-end systems with external services, and supporting front-end work.

AJAX GitHub JavaScript JIRA jQuery MySQL PHP REST API WordPress Yii
10 hours, 52 minutes ago

Software Engineer - .NET

Creative Chaos 251-1K Internet Software & Services

Creative Chaos is hiring a Software Engineer (.NET) to develop server-side applications and RESTful APIs while ensuring functionality, security, and performance align with design requirements.

AWS Azure GitHub JIRA MongoDB MySQL .NET Oracle PostgreSQL REST API SQL Server
10 hours, 52 minutes ago

Python Technical Interviewer.

Intetics 1K-5K Internet Software & Services

Intetics Inc. is seeking Technical Interviewers to assess candidates for Python developer roles as part of its custom software and distributed teams business.

Django FastAPI Flask Python
10 hours, 52 minutes ago

Senior Software Engineer - .NET

Creative Chaos 251-1K Internet Software & Services

Creative Chaos is hiring a Senior Software Engineer (.Net) to develop secure, high-performing server applications and RESTful APIs while mentoring team members and supporting team growth.

AWS Azure GitHub JIRA MongoDB MySQL .NET Oracle PostgreSQL REST API SQL Server
10 hours, 52 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers