RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

1 hour, 26 minutes ago
Bahrain, Qatar, Saudi Arabia, United Arab Emirates, Kuwait, Oman
Freelance
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 60

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection and validation.
  • Extract reliably from dynamic and interactive web sources, including JavaScript-rendered content and sites with changing behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using efficient batching or parallelization.
  • Monitor failures and maintain stability against minor website structure changes.
  • Work with AI-assisted workflows and collaborate with Tendem Agents on repetitive tasks while providing critical thinking and quality control.
  • Structure, clean, normalize, and validate data from diverse sources for output in formats such as CSV, JSON, or Google Sheets.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience scraping dynamic content such as JS, AJAX, and infinite scroll pages, including API access via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation for structured datasets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar for automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of 10–20 hours per week during active project phases.
  • Compensation of up to $37 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects with major tech innovators through the Mindrift platform.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job-29313] Senior Fullstack (React/Node) Developer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Fullstack Developer in Brazil for a remote/home office role supporting client work on scalable web solutions.

Brazil Full-time Senior Backend Engineer Full-stack Engineer
AWS CI/CD Express.js Git Jenkins Jest JIRA Next.js Node.js React TypeScript
17 minutes ago
AssetWatch®

Director of Data Platforms & Governance

AssetWatch® 51-250 Construction & Engineering

AssetWatch is seeking a Director of Data Platforms & Governance to define and lead its cloud data platform and governance function in support of predictive maintenance, analytics, and AI-driven growth.

United States Canada Full-time Lead Data Architect Data Engineer
AWS Encryption ERP Machine Learning NetSuite Salesforce SQL
47 minutes ago
Leadfeeder

Senior Data Engineer, Platform Data

Leadfeeder 51-250 Professional Services

Leadfeeder is seeking a Senior Data Engineer to help power its B2B lead generation platform by building and operating the production data pipelines and cloud systems that turn web visit signals into near real-time customer data.

Europe Full-time Lead Data Engineer
AWS AWS CDK CI/CD CRM Databricks dbt Flink GCP Kafka Machine Learning Python Snowflake SQL Terraform
1 hour, 32 minutes ago
Motional

Senior Software Engineer - Map Creator (Backend)

Motional 1K-5K Automotive

Motional is seeking a Senior Backend Software Engineer for Map Creator to develop the backend services and data pipelines that support high-definition maps for autonomous vehicles.

Singapore Full-time Senior Backend Engineer
Apache Spark AWS C# C++ CloudFormation Git GitLab CI Hadoop Kubernetes Machine Learning PostgreSQL Python REST API Terraform
1 hour, 37 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers