RemoteLeaf Logo
Log in Sign up

Senior Scraping Engineer (Web scraping & Anti-bot)

2 months, 2 weeks ago
Spain
Full-time
Senior
DevOps Engineer
Software Development
CI/CD Cloudflare Docker Go Grafana Helm HTTP Kubernetes Microservices Playwright Prometheus Puppeteer Python Redis Selenium TLS
Apply Now
Infatica

Infatica

Infatica is a global proxy network providing residential, mobile, and datacenter proxies for professional use, offering secure web scraping services with over 10 million IP addresses in 250+ locations.

Internet Software & Services
1-10
Founded 2019
View All Jobs 12

Description

  • Design the platform architecture across the data plane, control plane, and infrastructure layers.
  • Build and optimize a high-parallel crawler, session management, CAPTCHA solving, and anti-bot bypass capabilities.
  • Develop and maintain the API, authorization, billing, quotas, and monitoring components.
  • Lead microservices-based infrastructure using Docker, Kubernetes, CI/CD, and observability tools.
  • Establish development workflows, release processes, and technical decision-making standards.
  • Own code quality control and provide oversight for major engineering decisions.
  • Research and implement browser- and network-level fingerprinting and protection bypass techniques.
  • Set up and support DevOps/SRE processes, including Helm charts, scaling, monitoring, and SLA workflows.
  • Collaborate on the evolution of the scraping infrastructure and help shape future technical direction.

Requirements

  • 4-6+ years of experience in backend, data engineering, automation, or high-load systems.
  • Strong production web scraping experience with protected, dynamic, or JavaScript-heavy websites.
  • Experience with Python async stacks; Go experience is a plus.
  • Hands-on experience with Playwright, Puppeteer, Selenium, Scrapy, browser automation, or CDP.
  • Strong understanding of HTTP, TLS, HTTP/2, cookies, sessions, headers, and proxies.
  • Experience with Redis, queues/message brokers, Docker, CI/CD, and observability tools.
  • Kubernetes experience is preferred; deep Kubernetes/SRE expertise is a plus but not required.
  • Ability to write clear technical documentation in English.
  • Ownership mindset with experience in reliability, monitoring, incident debugging, and cost control.

Benefits

  • Competitive compensation package.
  • Remote work flexibility.
  • High autonomy and influence over architecture and team decisions.
  • Budget for conferences, courses, and work tools.
  • Opportunity to develop a key product from scratch.
  • Chance to become a key technical decision-maker in a rapidly growing company.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Pinterest

Senior Software Engineer

Pinterest 1K-5K Internet Software & Services

Pinterest is hiring a backend engineer to build and evolve large-scale, distributed systems that support user-facing applications and improve the end-to-end product experience.

United States Full-time Senior Software Engineer
$252k-$320k
Apache Airflow Apache Spark AWS C++ CI/CD Docker Elasticsearch Flink Grafana Java Kafka Kubernetes Memcached MySQL Node.js PostgreSQL Python Redis
15 hours, 54 minutes ago
G

Senior Software Development Engineer

GoDaddy 5001-10000 Technology, Information and Internet

GoDaddy is hiring a remote Growth team engineer in Colombia to build and operate production AI agent systems and full-stack applications that support customers at scale.

Colombia Full-time Senior Software Engineer
AWS Azure CI/CD Docker Elasticsearch Go Kubernetes LLM Microservices MongoDB Node.js PostgreSQL Python React Redis SQL Vue.js
16 hours, 9 minutes ago
Scale AI

SWE Fellow - Human Frontier Collective (UK)

Scale AI 251-1K Diversified Consumer Services

The Human Frontier Collective Fellowship at Scale is a fully remote contract role supporting AI research by designing, evaluating, and interpreting advanced generative AI systems with interdisciplinary experts and partner labs.

United Kingdom Contract Senior AI (Artificial Intelligence) Software Engineer
C++ Generative AI Java JavaScript Machine Learning Python Rust Swift
16 hours, 9 minutes ago
Avo

Integrations Engineer

Avo 11-50 Internet Software & Services

Avo is hiring an Integrations Engineer to build and maintain hospital EHR integrations that power clinical AI workflows inside production healthcare environments.

United States Full-time Mid Level Software Engineer
$160k-$185k
AWS Azure Celery Django Docker GitHub Actions HIPAA JavaScript LLM PostgreSQL Python React Redis REST API Tailwind CSS Terraform TypeScript
16 hours, 24 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers