RemoteLeaf Logo
Log in Sign up

Experienced Web Scraping Engineer - Python (Remote)

1 week, 4 days ago
Poland
Full-time
Senior
Backend Engineer
Software Development
C++ Docker Elasticsearch FastAPI Git Go Grafana Kafka Kibana Kubernetes Machine Learning MySQL Prometheus Python Redis SQLAlchemy TLS
Apply Now
Oxylabs

Oxylabs

Oxylabs is a leading provider of premium proxy services with a vast network of residential and datacenter IP proxies. They offer industry-leading web scraping solutions and a trusted ethical proxy network for global clients.

IT Services
251-1K
Founded 2015
View All Jobs 4

Description

  • Develop scalable web scrapers.
  • Define resilient scraping strategies and unblock websites for data collection.
  • Improve system observability.
  • Develop backend solutions for scraping and parsing challenges of varying scale.
  • Maintain existing scraping and parsing systems and deliver related features.
  • Collaborate with an experienced team to learn and apply advanced scraping techniques.

Requirements

  • Professional experience with Python.
  • Understanding of computer science fundamentals, including data structures, algorithms, computability, and complexity.
  • Proficiency with Git version control.
  • Knowledge of techniques for unblocking websites for scraping.
  • Experience using scraping techniques and open-source tools to build scrapers.
  • Comfort using browser developer tools.
  • Knowledge of networking, including TLS/SSL.
  • Experience with browser automation and asynchronous programming.
  • Web development knowledge, CSS selectors, and XPath parsing experience preferred.
  • Experience with Go, C++, browser source code, front-end frameworks, or scraping-focused machine learning preferred.
  • Experience with Pydantic, FastAPI, SQLAlchemy, Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, Grafana, Prometheus, or other monitoring tools preferred.
  • Experience building scalable systems preferred.

Benefits

  • Gross salary from 23,000 PLN per month, negotiable based on skills and experience.
  • Opportunity to work on infrastructure processing 60PB+ of monthly traffic, 300,000+ service requests per second, and 500,000+ Kafka messages per second.
  • Work with a global scraping and parsing product used by e-commerce, market intelligence, and AI companies.
  • Support and knowledge sharing from an experienced, international team.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Tailscale

Backend Engineer, Control Plane

Tailscale 51-250 Diversified Telecommunication Services

Tailscale is hiring a full-time Software Engineer for its fully distributed Control Plane Team to build and operate secure control-plane software, relay infrastructure, identity integrations, and related services.

United Kingdom Full-time Mid Level Backend Engineer
$164k-$227k
Go SQL
26 minutes ago
Harford County Public Library

[Crédito] Software Engineer III - C#

Harford County Public Library 51-250 Diversified Consumer Services

A Stone busca uma pessoa Software Engineer Pleno para desenvolver soluções em C# e atuar na resolução de problemas complexos relacionados a produtos financeiros e plataformas de engenharia.

Brazil Full-time Mid Level Backend Engineer
Azure C# CI/CD Datadog Docker Elasticsearch GCP Git GitFlow Kafka Kanban Microservices RabbitMQ Scrum Solid.js
41 minutes ago
HighLevel

Staff Engineer - Backend

HighLevel 251-1K Internet Software & Services

HighLevel is hiring a Staff Engineer–Backend to design and evolve the distributed systems powering its global, high-scale CRM platform.

India Full-time Lead Backend Engineer
AWS Elasticsearch Firestore GCP Go Grafana Java Kafka Kubernetes Microservices MongoDB MySQL Node.js OpenSearch OpenTelemetry PostgreSQL Prometheus RabbitMQ Redis REST API System Design TypeScript
1 hour, 41 minutes ago
HighLevel

Senior SDE - Conversations

HighLevel 251-1K Internet Software & Services

HighLevel is hiring a remote Backend Engineer for its Conversations organization to build and operate reliable, high-throughput services supporting multi-channel messaging and inbox systems for millions of businesses.

India Senior Backend Engineer
ClickHouse Docker Elasticsearch Firestore GCP GitHub Actions Go Kubernetes Microservices MongoDB Node.js Redis SQL TypeScript
1 hour, 41 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers