Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Information Technology

54 open positions

Links

View All Jobs

Senior Python Data Scraping Engineer (Freelance)

1 hour, 30 minutes ago

Italy

Part-time

Senior

Backend Engineer

Software Development

AJAX AWS Docker GitHub JavaScript JSON Python Selenium

Apply Now

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

View All Jobs 54

Description

Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
Use available tools and custom workflows to accelerate data collection, validation, and execution.
Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content.
Enforce data quality standards through validation, consistency checks, and final verification.
Scale scraping operations for large datasets using batching or parallelization.
Monitor failures and maintain stability when site structures change.
Work with data extraction, data processing, and automation workflows for accurate delivery.

Requirements

At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
Solid background in data cleaning, normalization, and validation with outputs in CSV, JSON, or Google Sheets.
Experience handling anti-bot mechanisms and dynamic site structures at scale.
Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar.
English proficiency at Upper-intermediate (B2) or above.
Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related field is a plus.
GitHub link is a plus.

Benefits

Part-time remote freelance opportunity.
Estimated workload of 10–20 hours per week during active phases.
Compensation up to $40 per hour equivalent.
Project-based work through the Mindrift platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Business Systems Engineer

TLATech Specialized Consumer Services

Syllo is hiring a Senior Business Systems Engineer to connect internal systems, third-party tools, and data pipelines that support operations across Revenue Operations, Finance, and Customer Success.

United States Full-time Senior Business Analyst Data Engineer

$160k-$200k

CRM FastAPI GCP Microservices Python React

1 hour ago

Apply

1 hour ago

Senior Data Engineer

Xebia 1K-5K Internet Software & Services

Xebia is hiring Data Engineers for an AWS-based data mesh platform project where product engineering teams will own and run the data they produce and consume.

Moldova Romania Slovakia Bulgaria Czech Republic Hungary Lead Data Engineer

AWS Azure Databricks DynamoDB Flink GCP Generative AI Kafka Kubernetes Python Snowflake SQL

1 hour, 15 minutes ago

Apply

1 hour, 15 minutes ago

Data Platform Engineer III

Mozn 51-250 Internet Software & Services

Mozn is hiring a Data Platform Engineer III to design, operate, and improve the data infrastructure that powers analytics, real-time processing, and AI workloads across cloud-native and hybrid environments.

Egypt Full-time Senior Data Engineer

Apache Spark AWS Azure Bash ClickHouse Druid Flink GCP GitOps Go Grafana Helm Kafka Kubernetes MySQL OpenSearch PostgreSQL Presto Prometheus Python SQL Terraform Trino

1 hour, 30 minutes ago

Apply

1 hour, 30 minutes ago