Senior Python Data Scraping Engineer (Freelance)

50 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection, validation, and task execution.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain stability when site structures change.
  • Collect, structure, and validate data from diverse sources as part of AI-assisted workflows.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools, including dynamic content and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets in CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar applied to automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • A GitHub link is a plus.

Benefits

  • Part-time freelance remote opportunity.
  • Compensation of up to $30 per hour equivalent, depending on level and pace of contribution.
  • Estimated workload of 10–20 hours per week during active project phases.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Backend Software Engineer | AI Engine

Wellhub 1-10 Gas Utilities

Wellhub is hiring a Senior Backend Software Engineer for its CARE - AI Engine team in Brazil to build and operate production AI-powered backend services that deliver reliable, observable, and fast experiences to real users.

Apache Airflow AWS DynamoDB Go Grafana Java Kafka Kotlin LLM Microservices OpenSearch OpenTelemetry PostgreSQL Prometheus Python SQL
23 minutes ago

Backend Engineer

Sweet Security is hiring a Senior Backend Engineer to build and scale the core systems of its cloud-native detection and response platform.

Kafka Microservices REST API TypeScript
1 hour, 1 minute ago

Senior Backend Engineer, Space Operations Intelligence & Autonomy (SOIA)

Slingshot Aerospace 51-250 Diversified Telecommunication Services

Slingshot is hiring a Senior Backend Software Engineer to build the distributed systems, data platforms, and real-time services behind its Space Operations Intelligence & Autonomy products for national security and commercial space customers.

Agile AWS CI/CD Docker Git GitHub Actions GraphQL Helm Java Kafka Kotlin Kubernetes LLM Microservices MongoDB PostgreSQL Python React REST API Three.js
1 hour, 4 minutes ago

[Job-29414] Senior Node Developer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Node Developer in Brazil to build and maintain systems for one of its projects, supporting scalable operations in a remote/hybrid work context.

Agile AWS Node.js
1 hour, 12 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers