Senior Python Data Scraping Engineer (Freelance)

11 minutes ago
Part-time
Senior
Software Development
Mindrift.ai: Be the “I” in AI

Mindrift.ai: Be the “I” in AI

Join 10,000+ experts earning $15-50/hr training AI models remotely. Flexible freelance work, weekly payments. No AI experience required. Apply in 5 minutes.

Internet Software & Services

Description

  • Own end-to-end data extraction workflows across complex websites and deliver structured datasets.
  • Use internal tools such as Apify and OpenRouter, along with custom workflows, to speed up data collection and task execution.
  • Ensure reliable extraction from dynamic and interactive web sources, including JavaScript-rendered content.
  • Validate outputs through quality checks, cross-source consistency controls, and formatting verification before delivery.
  • Scale scraping operations for large datasets using batching or parallelization and monitor failures.
  • Maintain stability when sites change by adapting scraping approaches to minor structure changes.
  • Clean, normalize, and structure data for delivery in formats such as CSV, JSON, and Google Sheets.
  • Troubleshoot extraction issues independently and work methodically across diverse sources.

Requirements

  • 5+ years of relevant experience in data engineering, web scraping, automation, or software development.
  • Bachelor’s or Master’s degree in Engineering, Applied Mathematics, Computer Science, or a related technical field is a plus.
  • Strong experience in Python web scraping using BeautifulSoup, Selenium, or similar tools.
  • Experience scraping dynamic content such as JS, AJAX, and infinite scroll, including APIs via proxies.
  • Proven ability to extract data from complex structures, archived pages, and inconsistent HTML.
  • Solid background in data cleaning, normalization, and validation for structured datasets.
  • Experience handling anti-bot mechanisms and dynamic site structures at scale.
  • Experience with cloud infrastructure such as AWS and containerization with Docker.
  • Hands-on experience with LLM frameworks such as LangChain, OpenRouter, or similar.
  • Upper-intermediate English proficiency (B2) or above is required.
  • A link to GitHub is a plus.

Benefits

  • Part-time remote freelance opportunity.
  • Estimated workload of 10–20 hours per week during active phases.
  • Compensation of up to $40 per hour equivalent, depending on level and pace of contribution.
  • Work on AI projects with a hybrid AI + human workflow.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is seeking a Data Engineer to design and maintain cloud data pipelines and Snowflake-based analytics solutions for client projects in a fast-growing software consultancy.

Agile Apache Spark Azure CI/CD Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
11 minutes ago

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is seeking a Data Engineer to design and maintain cloud-based data pipelines and Snowflake solutions for client projects in a fast-growing software consultancy.

Agile Apache Spark Azure Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
11 minutes ago

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight, a growing software consultancy, is hiring a data engineer to design and maintain cloud-based data pipelines and Snowflake solutions for client projects.

Agile Apache Spark Azure Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
11 minutes ago

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is hiring a Data Engineer to design and support cloud-based data pipelines and Snowflake-driven data solutions for clients in a fast-growing software consultancy.

Agile Apache Spark Azure CI/CD Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
11 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers