Senior Python Data Scraping Engineer (Freelance)

8 hours, 25 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to speed up data collection and validation.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content and changing site behavior.
  • Enforce data quality standards through validation checks, cross-source consistency controls, and systematic verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization and monitor failures.
  • Maintain stability of scraping workflows against minor site structure changes.
  • Collaborate with AI agents by providing critical thinking, domain expertise, and quality control.
  • Troubleshoot extraction, automation, and workflow issues independently.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting dynamic content such as JS, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation with structured outputs such as CSV, JSON, or Google Sheets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools for automation.
  • English proficiency at Upper-intermediate (B2) or above.
  • A GitHub link is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Up to $40 per hour equivalent, depending on level and pace of contribution.
  • Estimated workload of around 10–20 hours per week during active phases.
  • Opportunity to work on AI projects with major tech innovators.
  • Access to provided tools such as Apify and OpenRouter.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer

Resident Home 251-1K Specialty Retail

Ashley Digital is hiring a Data Engineer in Tel Aviv to build and evolve the data foundations supporting product, finance, operations, and business teams across its global e-commerce portfolio.

Apache Airflow AWS Azure CI/CD dbt GCP SQL
7 hours, 55 minutes ago

Data Engineer II

Tripadvisor 1K-5K Consumer Services

Tripadvisor is hiring a Data Engineer II to build and maintain the data platform infrastructure that powers analytics, experimentation, and data-driven initiatives across its global travel products.

Apache Airflow Apache Spark AWS BERT CI/CD CSS Flink GCP Generative AI Gradle GraphQL Hadoop Hive HTML Java JavaScript Kafka Linux Machine Learning PostgreSQL Python React REST API Snowflake SQL
8 hours, 10 minutes ago

Sr .Net Developer | Contract | King of Prussia, PA

TWO95 International 51-250 Internet Software & Services

Sr. .NET Developer at a company in King of Prussia, PA, supporting and enhancing database-driven applications on a 6+ month contract basis with remote work during COVID.

Azure C# jQuery
8 hours, 10 minutes ago

Dataiku Developer – Data Analytics & Reporting

Capco 5K-10K Internet Software & Services

Capco, a Wipro company, is hiring a Data Warehousing specialist to design and operationalize end-to-end analytics solutions for the BNP Paribas group’s Data Analytics & Reporting team.

Agile Apache Airflow Apache Spark CI/CD Confluence Docker Elasticsearch GitLab JIRA Kafka Kibana Kubernetes Pandas PostgreSQL Python SQL SQLAlchemy Tableau Teradata
8 hours, 25 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers