Anti-Bot Engineer (Remote, Full-Time), PK [HR177]

2 hours, 22 minutes ago
Full-time
Senior
Software Development
Smart Working

Smart Working

Smart Working is a company that specializes in software development outsourcing and staff augmentation. They offer nearshore software development services, outsourcing solutions, and staff augmentation with a focus on providing highly skilled Indian de...

Internet Software & Services

Description

  • Design, build, and maintain large-scale Python-based scraping systems for highly protected websites.
  • Architect resilient extraction systems for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches.
  • Continuously adapt scraping systems to frequent page structure changes, request flow changes, and anti-bot mechanisms.
  • Build production-grade data extraction pipelines with strong accuracy, observability, and fault tolerance.
  • Implement proxy rotation, fingerprinting, session management, and request routing strategies to improve stability at scale.
  • Monitor system health, detect anomalies proactively, and debug complex failures across distributed systems.
  • Optimize scraping infrastructure for performance, cost efficiency, and reliability.
  • Collaborate with data engineering and product teams to ensure scraped data is structured, validated, and trusted.
  • Operate and improve systems running continuously in cloud environments.
  • Document system architecture, scraping logic, and operational procedures for maintainability.

Requirements

  • 7+ years of professional software engineering experience, with a strong focus on backend systems, data engineering, or distributed systems.
  • Proven experience building and operating large-scale production web scraping systems.
  • Deep hands-on experience scraping Google or similarly complex, heavily protected anti-bot environments.
  • Strong expertise in Python or comparable production languages such as Go, Rust, or JavaScript.
  • Strong understanding of HTTP internals, including headers, cookies, TLS, redirects, sessions, and browser networking behaviour.
  • Experience with browser automation frameworks such as Playwright, Selenium, Puppeteer, or equivalent.
  • Strong knowledge of HTML parsing, DOM traversal, and high-performance data extraction techniques.
  • Proven experience handling anti-bot systems, including rate limiting, CAPTCHAs, IP rotation, and fingerprinting.
  • Experience designing asynchronous and concurrent systems for high-throughput workloads.
  • Experience running cloud-based systems at scale with strong operational ownership.
  • Comfortable working in highly adversarial and fast-changing technical environments.
  • Experience with Docker and Kubernetes in production environments, preferred.
  • Exposure to distributed task queues or large-scale job orchestration systems, preferred.
  • Experience with monitoring, anomaly detection, or data quality validation systems, preferred.
  • Background in search intelligence, advertising tech, or competitive intelligence platforms, preferred.
  • Familiarity with observability tooling and production-grade system monitoring, preferred.
  • Exposure to AI-assisted development workflows or agentic coding tools, preferred.

Benefits

  • Fixed shifts: 12:00 PM - 9:30 PM IST (Summer) and 1:00 PM - 10:30 PM IST (Winter).
  • No weekend work for better work-life balance.
  • Laptop and full medical insurance provided from day one.
  • Mentorship, community, and forums for support and idea sharing.
  • Long-term remote career opportunity where contributions are valued.
  • Remote-first work environment with a global team.
  • Culture that celebrates integrity, excellence, and ambition.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

SOC Engineer

Kyivstar 1K-5K Wireless Telecommunication Services

Kyivstar.Tech is hiring a SOC Engineer to strengthen its Security Operations team by improving monitoring, threat detection, and incident response processes for the company’s IT environment.

Active Directory Cybersecurity Elasticsearch Linux SIEM Splunk
1 hour, 6 minutes ago

Junior Java Developer/Consultant

European Dynamics 251-1K IT Services

European Dynamics is hiring a Junior Java Developer/Consultant to work on international software projects for major public organizations from Athens, Crete, or remotely.

Git Java JSON Maven REST API XML
1 hour, 21 minutes ago

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking a part-time freelance Python Data Scraping Engineer for the Tendem project to build and validate reliable web data extraction workflows within a hybrid AI + human environment.

AJAX GitHub JavaScript JSON LLM Python Selenium
1 hour, 25 minutes ago

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time remote Python Data Scraping Engineer for the Tendem project to deliver accurate, structured data extraction workflows in a hybrid AI + human environment.

AJAX GitHub JavaScript JSON LLM Python Selenium
1 hour, 45 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers