RemoteLeaf Logo
Log in Sign up

Anti-Bot Engineer (Remote, Full-Time) [HR177]

1 month ago
India
Full-time
Senior
Backend Engineer
Software Development
Docker Go HTTP JavaScript Kubernetes Playwright Puppeteer Python Rust Selenium
Apply Now
Smart Working

Smart Working

Smart Working is a company that specializes in software development outsourcing and staff augmentation. They offer nearshore software development services, outsourcing solutions, and staff augmentation with a focus on providing highly skilled Indian de...

Internet Software & Services
View All Jobs 17

Description

  • Design, build, and maintain large-scale Python-based scraping systems for highly protected websites.
  • Architect resilient extraction systems for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches.
  • Continuously adapt scraping systems to page structure changes, request flow changes, and anti-bot mechanisms.
  • Build production-grade data extraction pipelines with a focus on accuracy, observability, and fault tolerance.
  • Implement proxy rotation, fingerprinting, session management, and request routing strategies to support stability at scale.
  • Monitor system health, detect anomalies proactively, and debug complex production failures across distributed systems.
  • Optimize scraping infrastructure for performance, cost efficiency, and reliability.
  • Collaborate with data engineering and product teams to ensure scraped data is structured, validated, and trusted.
  • Operate and improve systems running continuously in cloud environments.
  • Document system architecture, scraping logic, and operational procedures for long-term maintainability.

Requirements

  • 7+ years of professional software engineering experience, with a focus on backend systems, data engineering, or distributed systems.
  • Proven experience building and operating large-scale production web scraping systems.
  • Deep hands-on experience scraping Google or similarly complex, heavily protected anti-bot environments.
  • Strong expertise in Python or comparable production languages such as Go, Rust, or JavaScript.
  • Strong understanding of HTTP internals, including headers, cookies, TLS, redirects, sessions, and browser networking behaviour.
  • Experience with browser automation frameworks such as Playwright, Selenium, Puppeteer, or equivalent.
  • Strong knowledge of HTML parsing, DOM traversal, and high-performance data extraction techniques.
  • Proven experience handling anti-bot systems, including rate limiting, CAPTCHAs, IP rotation, and fingerprinting.
  • Experience designing asynchronous and concurrent systems for high-throughput workloads.
  • Strong debugging skills across distributed, failure-prone production systems.
  • Experience running cloud-based systems at scale with strong operational ownership.
  • Comfortable working in highly adversarial and fast-changing technical environments.
  • Experience with Docker and Kubernetes in production environments (nice to have).
  • Exposure to distributed task queues or large-scale job orchestration systems (nice to have).
  • Experience with monitoring, anomaly detection, or data quality validation systems (nice to have).
  • Background in search intelligence, advertising tech, or competitive intelligence platforms (nice to have).
  • Familiarity with observability tooling and production-grade system monitoring (nice to have).
  • Exposure to AI-assisted development workflows or agentic coding tools (nice to have).

Benefits

  • Fixed shifts: 12:00 PM - 9:30 PM IST in summer and 1:00 PM - 10:30 PM IST in winter.
  • No weekend work.
  • Laptop provided from day one.
  • Full medical insurance provided from day one.
  • Mentorship, community support, and forums for sharing ideas.
  • Long-term career opportunity where contributions are valued.
  • Remote-first work with a focus on work-life balance.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Fingerprint

Senior Backend Engineer, Core APIs

Fingerprint 51-250 IT Services

Fingerprint is hiring a Senior Backend Engineer for its Core APIs team to build scalable fraud-detection backend systems and real-time data infrastructure for a globally distributed, remote-first company.

Anywhere Full-time Senior Backend Engineer
$150k-$200k
CI/CD ClickHouse Databricks Datadog dbt Docker DynamoDB Elasticsearch Express.js GCP Git Go Kubernetes Microservices Node.js Redis Shell Scripting Snowflake SQL Terraform TypeScript
14 hours, 44 minutes ago
Keywords Studios

Active Directory / Identity Engineer

Keywords Studios 10K-50K Internet Software & Services

Keywords Group is seeking an experienced Active Directory SME and Azure Identity Lead to guide company-wide identity architecture and support global IT across on-premises and cloud environments.

United Kingdom Full-time Lead Security Engineer
Active Directory Cybersecurity DHCP DNS PowerShell
14 hours, 59 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Chatbot Developer (WhatsApp / Telegram / Discord)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a freelance, part-time remote Bot Developer for the Tendem project to build and refine messaging-platform bots in a hybrid AI + human workflow for real-user use cases.

Philippines Malaysia South Africa Indonesia Part-time Mid Level Backend Engineer
Up to $73k
Docker Node.js OAuth Python REST API Serverless
14 hours, 59 minutes ago
Mindrift.ai: Be the “I” in AI

Senior Python Data Scraping Engineer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a Senior Python Data Scraping Engineer for the Tendem freelance project to manage end-to-end web data extraction and deliver accurate structured datasets within a hybrid AI + human workflow.

India Part-time Senior Backend Engineer
$62k-$62k
AJAX AWS Docker GitHub JavaScript JSON LLM Python Selenium
14 hours, 59 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers