Senior Python Data Scraping Engineer (Freelance)

11 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter alongside custom workflows to collect, validate, and execute scraping tasks.
  • Extract reliable data from dynamic and interactive web sources, including JavaScript-rendered content.
  • Enforce data quality through validation checks, consistency controls, formatting adherence, and final verification.
  • Scale scraping operations for large datasets using batching or parallelization.
  • Monitor scraping failures and maintain stability when sites change structure.
  • Work with AI-assisted workflows and provide critical thinking, domain expertise, and quality control.
  • Troubleshoot issues independently and adapt scraping approaches to changing site behavior.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience extracting data from dynamic content such as JavaScript, AJAX, infinite scroll, and APIs via proxies.
  • Proven ability to extract data from complex structures such as hierarchies, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation, with delivery of CSV, JSON, or Google Sheets datasets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar tools.
  • Upper-intermediate English proficiency (B2) or above.
  • Strong attention to detail, methodical problem-solving, and ability to work independently.
  • GitHub profile link is a plus.

Benefits

  • Part-time remote freelance work.
  • Up to $25 per hour equivalent, depending on level and pace of contribution.
  • Estimated workload of around 10–20 hours per week during active phases.
  • Opportunity to work on AI projects from major tech innovators.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is seeking a Data Engineer to design and maintain cloud data pipelines and Snowflake-based analytics solutions for client projects in a fast-growing software consultancy.

Agile Apache Spark Azure CI/CD Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
11 minutes ago

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is seeking a Data Engineer to design and maintain cloud-based data pipelines and Snowflake solutions for client projects in a fast-growing software consultancy.

Agile Apache Spark Azure Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
11 minutes ago

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight, a growing software consultancy, is hiring a data engineer to design and maintain cloud-based data pipelines and Snowflake solutions for client projects.

Agile Apache Spark Azure Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
11 minutes ago

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is hiring a Data Engineer to design and support cloud-based data pipelines and Snowflake-driven data solutions for clients in a fast-growing software consultancy.

Agile Apache Spark Azure CI/CD Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
11 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers