RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

30 minutes ago
India
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 326

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to speed up collection, validation, and execution.
  • Ensure reliable scraping from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Apply data quality checks, cross-source consistency controls, and formatting verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain stability when site structures change.
  • Work collaboratively with AI agents while providing critical thinking, domain expertise, and quality control.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping with BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content, including JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, validation, and structured output formats such as CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar automation tools.
  • English proficiency at Upper-intermediate (B2) or above.
  • Strong attention to detail, ability to work independently, and self-directed troubleshooting skills.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active phases.
  • Compensation of up to $30 per hour equivalent, depending on contribution level and pace.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Capco

Python Data Analyst

Capco 5K-10K Internet Software & Services

Capco, a Wipro company, is seeking a Python Data Analyst/Backend Developer to build scalable API-driven applications for financial services clients, with a focus on backend development, data handling, and secure integrations.

India Mid Level Backend Engineer Data Analyst
AWS Azure CI/CD Django Docker FastAPI GCP JWT Kafka Kubernetes Microservices MySQL NumPy OAuth Pandas PostgreSQL Python RabbitMQ REST API SQL SQL Server
0 minutes ago
Railroad19

Senior Node Software Engineer (NodeJS, React/Angular & GCP)U.S. Remote

Railroad19 51-250 Internet Software & Services

Railroad19 is hiring a Senior Node.js Software Engineer to build and maintain backend systems, microservices, and APIs for client projects in a distributed U.S.-based team.

United States Full-time Senior Backend Engineer Full-stack Engineer
$125k-$160k
Angular API Gateway AWS CI/CD Datadog Docker GCP Git JavaScript Jenkins JIRA Microservices Node.js React REST API Shell Scripting Splunk TypeScript
15 minutes ago
3Pillar Global

Senior Python Backend Developer

3Pillar Global 1K-5K Internet Software & Services

3Pillar is hiring a Software Engineer to help build enterprise software and AI-driven products for clients in industries like financial services, healthcare, media, and technology.

Canada Full-time Lead Backend Engineer
Agile Apache Airflow Flask Git GitHub GitLab HTTP JSON Pytest Python REST API SQL XML
15 minutes ago
R

Senior Platform Engineer - Data Platform

Rockstar 1-10 Professional Services

Rockstar is recruiting a Senior Backend Engineer for an innovative data platform company to build and scale secure core services for identity, access control, content sharing, and data access on a graph database platform.

United States Full-time Lead Backend Engineer Data Engineer
Go Python
15 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers