Senior Python Data Scraping Engineer (Freelance)

11 hours, 59 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use available tools and custom workflows to speed up data collection, validation, and task execution.
  • Extract data reliably from dynamic, interactive, and JavaScript-rendered web sources.
  • Adapt scraping approaches to changing site behavior and minor site structure changes.
  • Enforce data quality through validation checks, cross-source consistency controls, and formatting verification.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain stability across scraping workflows.
  • Collect, structure, and validate data from diverse sources with a methodical approach.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content, including JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • Upper-intermediate English proficiency (B2) or above.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of 10–20 hours per week during active phases.
  • Compensation of up to $40 per hour equivalent.
  • Opportunity to work on innovative AI technology projects.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Sr. Data Engineer

Teachable 51-250 Internet Software & Services

Teachable is hiring a Senior Data Engineering leader to guide data architecture and pipelines for a remote Brazil-based team supporting company-wide decision-making across engineering, product, finance, and business functions.

Apache Airflow AWS dbt Kafka Terraform
10 hours, 59 minutes ago

Principal, Engineer (Java/SAP) - EMEA/AMER CAN

DEPT® 1K-5K Media

DEPT® is hiring a senior SAP Ariba integration lead to architect and support a Java-based connector and related backend services for a financial client on a 3-month contract with extension potential.

AWS DynamoDB ERP Java OAuth SAP Spring Boot
10 hours, 59 minutes ago

Senior, Engineer (Java/SAP) - CAN

DEPT® 1K-5K Media

DEPT® is hiring an SAP Generalist Consultant for a 3-month contract supporting a financial client’s Java-based SAP integration work, with potential extension into 2027.

AWS CSS HTML Java JavaScript Node.js React SAP Spring Boot TypeScript
11 hours, 14 minutes ago

SQL Developer II

Precision AQ 1001-5000 Business Consulting and Services

Precision Medicine Group is hiring a SQL Engineer II to build and support Microsoft SQL Server data solutions that power client deliverables and internal products in a collaborative healthcare access environment.

Azure C# CI/CD Git HTML JavaScript .NET SQL Server
11 hours, 29 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers