RemoteLeaf Logo
Log in Sign up

Experienced Web Scraping Engineer - Python (Remote)

1 month ago
Poland
Full-time
Senior
Backend Engineer
Software Development
C++ Docker Elasticsearch FastAPI Git Go Grafana Kafka Kibana Kubernetes Machine Learning MySQL Prometheus Python Redis SQLAlchemy TLS
Apply Now
Oxylabs

Oxylabs

Oxylabs is a leading provider of premium proxy services with a vast network of residential and datacenter IP proxies. They offer industry-leading web scraping solutions and a trusted ethical proxy network for global clients.

IT Services
251-1K
Founded 2015
View All Jobs 3

Description

  • Develop scalable web scrapers.
  • Define resilient scraping strategies and unblock websites for data collection.
  • Improve system observability.
  • Develop backend solutions for scraping and parsing challenges of varying scale.
  • Maintain existing scraping and parsing systems and deliver related features.
  • Collaborate with an experienced team to learn and apply advanced scraping techniques.

Requirements

  • Professional experience with Python.
  • Understanding of computer science fundamentals, including data structures, algorithms, computability, and complexity.
  • Proficiency with Git version control.
  • Knowledge of techniques for unblocking websites for scraping.
  • Experience using scraping techniques and open-source tools to build scrapers.
  • Comfort using browser developer tools.
  • Knowledge of networking, including TLS/SSL.
  • Experience with browser automation and asynchronous programming.
  • Web development knowledge, CSS selectors, and XPath parsing experience preferred.
  • Experience with Go, C++, browser source code, front-end frameworks, or scraping-focused machine learning preferred.
  • Experience with Pydantic, FastAPI, SQLAlchemy, Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, Grafana, Prometheus, or other monitoring tools preferred.
  • Experience building scalable systems preferred.

Benefits

  • Gross salary from 23,000 PLN per month, negotiable based on skills and experience.
  • Opportunity to work on infrastructure processing 60PB+ of monthly traffic, 300,000+ service requests per second, and 500,000+ Kafka messages per second.
  • Work with a global scraping and parsing product used by e-commerce, market intelligence, and AI companies.
  • Support and knowledge sharing from an experienced, international team.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Ottimate

Software Engineer - Python

Ottimate IT Services

Ottimate is seeking a Backend Engineer to build and scale Django-based products that simplify accounts payable and payments for businesses.

India Full-time Mid Level Backend Engineer
Angular AWS Django Microservices PostgreSQL Python
11 hours, 18 minutes ago
Coforge

Mid-Level Java Engineer

Coforge 10K-50K IT Services

Coforge is seeking a remote Mid-Level Java Engineer in Brazil to build, maintain, and support backend services and APIs throughout the software development lifecycle.

Brazil Mid Level Backend Engineer
AWS Docker Generative AI Git Hibernate Java Microservices MongoDB MySQL REST API Spring Spring Boot SQL
1 day, 10 hours ago
Coforge

Senior Backend Java Engineer

Coforge 10K-50K IT Services

Coforge is seeking a remote Senior Backend Java Engineer in Bolivia to design, develop, and maintain scalable cloud-native backend applications and microservices.

Bolivia Senior Backend Engineer
Agile AWS CI/CD Docker DynamoDB Git Java JIRA Linux Microservices REST API Spring Boot SQL
1 day, 10 hours ago
Coforge

Senior Backend Java Engineer

Coforge 10K-50K IT Services

Coforge is seeking a Senior Backend Java Engineer in Peru to remotely design, develop, and maintain scalable cloud-native backend applications and microservices.

Peru Senior Backend Engineer
Agile AWS CI/CD Docker DynamoDB Git Java JIRA Linux Microservices REST API Spring Boot SQL
1 day, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers