RemoteLeaf Logo
Log in Sign up

Senior Python Data Scraping Engineer (Freelance)

16 hours, 27 minutes ago
Brazil
Part-time
Senior
Backend Engineer
Software Development
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
Apply Now
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services
View All Jobs 192

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to accelerate data collection and validation.
  • Ensure reliable extraction from dynamic, interactive, and JavaScript-rendered web sources.
  • Validate outputs against data quality standards, including cross-source consistency and formatting checks.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor extraction failures and maintain stability when sites change structure.
  • Adapt scraping approaches to changing site behavior and site-specific technical constraints.
  • Collect, structure, and verify data from diverse sources with a methodical, independent approach.

Requirements

  • At least 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Strong experience in Python web scraping with BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to handle complex structures, including hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of CSV, JSON, or Google Sheets datasets.
  • Demonstrated experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS or equivalent, and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar automation tools.
  • Upper-intermediate English proficiency (B2) or above.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of around 10–20 hours per week during active phases.
  • Compensation up to $25 per hour equivalent, depending on level and pace of contribution.
  • Opportunity to work on AI projects through Mindrift’s hybrid AI + human system.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

TWO95 International

Java Developer

TWO95 International 51-250 Internet Software & Services

Java Developer for a 6+ month remote contract supporting the design, development, and maintenance of distributed web applications and REST-based services.

India Contract Mid Level Backend Engineer
AJAX CSS GitHub GitHub Actions HTML Java JavaScript Jenkins JIRA jQuery JSON JUnit RabbitMQ REST API Spring XML
16 hours, 12 minutes ago
Monterail

Senior Golang Developer

Monterail 251-1K Internet Software & Services

Senior Golang Developers are needed by a freelance network to design, build, and maintain high-load backend architecture on part-time or full-time B2B engagements.

Poland Contract Lead Backend Engineer
Git Go GraphQL gRPC Microservices REST API WebSockets
16 hours, 12 minutes ago
Coforge

Senior Java Developer

Coforge 10K-50K IT Services

Encora is seeking a Software Engineer to deliver business-facing project enhancements and backend system support for enterprise applications, from design through post-deployment verification.

Malaysia Full-time Senior Backend Engineer
Cybersecurity DevSecOps Git Hibernate Java Oracle REST API Spring Spring Boot SQL SVN
16 hours, 27 minutes ago
Coforge

Senior Data Engineer - Qlik Replicate

Coforge 10K-50K IT Services

The company is hiring a Qlik Replicate specialist to build and support data replication and pipeline operations across enterprise systems as part of migration, modernization, and integration work.

Malaysia Senior Data Engineer
CI/CD DB2 Hadoop Oracle
16 hours, 27 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers