RemoteLeaf Logo
Log in Sign up

Senior Data Scraping Engineer (Python)

3 months, 1 week ago
Anywhere
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 14

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to accelerate data collection and task execution.
  • Ensure reliable scraping from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Validate extracted data for quality, cross-source consistency, and formatting accuracy before delivery.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor failures and maintain scraping stability when site structures change.
  • Clean, normalize, and structure data for delivery in formats such as CSV, JSON, and Google Sheets.
  • Collaborate with AI agents by providing critical thinking, domain expertise, and quality control.
  • Troubleshoot complex scraping and automation issues independently.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience scraping dynamic content such as JavaScript-rendered pages, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation with structured output formats such as CSV, JSON, or Google Sheets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker in real workflows.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools for automation tasks.
  • English proficiency at Upper-intermediate (B2) level or above.
  • A GitHub link is a plus.
  • Ability to work independently with a methodical, detail-oriented approach.
  • Strong technical foundation with practical experience in scripting, automation, and AI-assisted workflows.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active project phases.
  • Compensation of up to $45 per hour equivalent, depending on contribution level and pace.
  • Opportunity to work on AI projects through Mindrift’s platform with major tech innovators.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Caseware

Java Staff Software Developer IV

Caseware 251-1K Internet Software & Services

Caseware is hiring a Staff Software Developer in Colombia to provide hands-on technical leadership for its global accounting and audit software platform, shaping scalable architecture and improving engineering practices across teams.

Colombia Full-time Lead Backend Engineer
Agile AWS Azure CI/CD Docker GCP GitHub Java JIRA Kubernetes Microservices MongoDB New Relic REST API SQL Server Terraform Visual Studio
1 day, 15 hours ago
Caseware

Java Senior Software Developer

Caseware 251-1K Internet Software & Services

Caseware is hiring a Senior Software Developer III in Colombia to provide technical leadership while evolving distributed SaaS architecture, engineering practices, and AI-augmented development workflows.

Colombia Full-time Lead Backend Engineer
Angular Apache Spark AWS CI/CD CSS Cypress Design Systems Docker DynamoDB GitHub GitHub Actions GraphQL Hadoop HTML Java Jest JIRA JMeter Kubernetes Microservices Playwright Presto REST API Sass Spring Boot Storybook TypeScript
1 day, 15 hours ago
CI&T

[Job - 31387] Developer .NET Mid-Level, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Mid-Level .NET Developer in Brazil to build and integrate reliable back-end solutions for a multinational client project in collaboration with teams across Brazil, Colombia, the UK, and the USA.

Brazil Full-time Mid Level Backend Engineer
Agile Azure C# CI/CD .NET REST API SOAP SQL Server
1 day, 15 hours ago
CI&T

[Job-30904] Mid level Java Developer, Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa desenvolvedora Java Pleno para atuar em um cliente do setor de benefícios, evoluindo aplicações e processos para melhorar a experiência dos usuários finais.

Brazil Full-time Mid Level Backend Engineer
AWS Docker Java Kanban MongoDB Oracle Scrum SonarQube Spring Boot
1 day, 15 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers