Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Information Technology

53 open positions

Links

View All Jobs

Senior Python Data Scraping Engineer (Freelance)

6 hours, 38 minutes ago

India

Part-time

Senior

Backend Engineer

Software Development

AJAX AWS Docker GitHub JavaScript JSON Python Selenium

Apply Now

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

View All Jobs 53

Description

Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
Use available tools and custom workflows to speed up data collection, validation, and task execution.
Extract data reliably from dynamic and interactive web sources, including JavaScript-rendered content.
Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification.
Scale scraping operations for large datasets using batching or parallelization.
Monitor failures and maintain stability when sites change structure.
Work with tools such as Apify, OpenRouter, and related technologies to support scraping workflows.

Requirements

At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
Strong experience in Python web scraping with BeautifulSoup, Selenium, or similar tools.
Experience handling dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
Solid background in data cleaning, normalization, and validation.
Experience handling anti-bot mechanisms and dynamic site structures at scale.
Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar.
Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
English proficiency at Upper-intermediate (B2) level or above.
A GitHub link is a plus.

Benefits

Part-time remote freelance opportunity.
Estimated workload of 10–20 hours per week during active project phases.
Compensation up to $30 per hour equivalent.
Opportunity to work on a specialized Tendem project through the Mindrift platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Innodata is hiring a hands-on GCP/Data Platform Engineer to support and improve large-scale production data platforms on Google Cloud, with a focus on reliability, troubleshooting, and operational enhancement.

Canada Mid Level Data Engineer

$64k-$120k

Apache Airflow CI/CD GCP Generative AI LLM Python SQL Terraform Vertex AI

5 hours, 38 minutes ago

Apply

5 hours, 38 minutes ago

Senior Software Engineer - Crawler

ZoomInfo 1K-5K Professional Services

ZoomInfo is hiring a Senior Software Engineer to help build its large-scale web crawling and data extraction infrastructure for the Web Data team.

United States Full-time Senior Data Engineer Software Engineer

$140k-$220k

Apache Airflow AWS GCP HTML Java Kafka Kubernetes LLM Python Snowflake Terraform Trino Vertex AI

5 hours, 53 minutes ago

Apply

5 hours, 53 minutes ago

Senior Data Engineer

Kunai 51-250 Professional Services

Kunai is seeking a Senior Data Engineer to help modernize and scale financial services platforms by building data pipelines and systems for high-volume transactional and operational data.