RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

50 minutes ago
India
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 30

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection, validation, and task execution.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain stability when site structures change.
  • Collect, structure, and validate data from diverse sources as part of AI-assisted workflows.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools, including dynamic content and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of structured datasets in CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar applied to automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • A GitHub link is a plus.

Benefits

  • Part-time freelance remote opportunity.
  • Compensation of up to $30 per hour equivalent, depending on level and pace of contribution.
  • Estimated workload of 10–20 hours per week during active project phases.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Wellhub

Senior Backend Software Engineer | AI Engine

Wellhub 1-10 Gas Utilities

Wellhub is hiring a Senior Backend Software Engineer for its CARE - AI Engine team in Brazil to build and operate production AI-powered backend services that deliver reliable, observable, and fast experiences to real users.

Brazil Full-time Senior AI Engineer Backend Engineer
Apache Airflow AWS DynamoDB Go Grafana Java Kafka Kotlin LLM Microservices OpenSearch OpenTelemetry PostgreSQL Prometheus Python SQL
23 minutes ago
Sweet

Backend Engineer

Sweet

Sweet Security is hiring a Senior Backend Engineer to build and scale the core systems of its cloud-native detection and response platform.

Israel Senior Backend Engineer
Kafka Microservices REST API TypeScript
1 hour, 1 minute ago
Slingshot Aerospace

Senior Backend Engineer, Space Operations Intelligence & Autonomy (SOIA)

Slingshot Aerospace 51-250 Diversified Telecommunication Services

Slingshot is hiring a Senior Backend Software Engineer to build the distributed systems, data platforms, and real-time services behind its Space Operations Intelligence & Autonomy products for national security and commercial space customers.

United States United Kingdom Full-time Senior Backend Engineer
$150k-$200k
Agile AWS CI/CD Docker Git GitHub Actions GraphQL Helm Java Kafka Kotlin Kubernetes LLM Microservices MongoDB PostgreSQL Python React REST API Three.js
1 hour, 4 minutes ago
CI&T

[Job-29414] Senior Node Developer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Node Developer in Brazil to build and maintain systems for one of its projects, supporting scalable operations in a remote/hybrid work context.

Brazil Full-time Senior Backend Engineer Cloud Engineer
Agile AWS Node.js
1 hour, 12 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers