RemoteLeaf Logo
Log in Sign up

Experienced Web Scraping Engineer - Python

1 month, 4 weeks ago
Poland
Full-time
Senior
Backend Engineer
Software Development
C++ Docker Elasticsearch FastAPI Git Go Grafana Kafka Kibana Kubernetes Machine Learning MySQL Prometheus Python Redis SQLAlchemy
Apply Now
Oxylabs

Oxylabs

Oxylabs is a leading provider of premium proxy services with a vast network of residential and datacenter IP proxies. They offer industry-leading web scraping solutions and a trusted ethical proxy network for global clients.

IT Services
251-1K
Founded 2015
View All Jobs 7

Description

  • Develop scalable scrapers for high-volume web data extraction.
  • Define resilient scraping strategies and unblock websites for scraping.
  • Improve system observability and monitoring.
  • Develop backend solutions for scraping and parsing problems of varying scale.
  • Maintain the current scraping and parsing system.
  • Build new features related to scraping and parsing.
  • Work with the team to create and improve scrapers using shared tips and best practices.

Requirements

  • Experience working with Python.
  • Strong understanding of computer science fundamentals, including data structures, algorithms, computability, and complexity.
  • Version control experience using Git.
  • Knowledge of techniques for unblocking websites for scraping.
  • Experience using different scraping techniques and open-source tools to build scrapers.
  • Comfort using browser DevTools.
  • Knowledge of networking concepts, including TLS/SSL.
  • Experience with browser automation.
  • Comfort with asynchronous programming.
  • Nice to have: web development knowledge.
  • Nice to have: experience using CSS selectors and XPaths for parsing.
  • Nice to have: experience with Go and C++.
  • Nice to have: experience working on browser source code.
  • Nice to have: familiarity with front-end frameworks.
  • Nice to have: experience with Pydantic, FastAPI, and SQLAlchemy.
  • Nice to have: experience with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, Grafana, Prometheus, or similar monitoring tools.
  • Nice to have: experience with machine learning in domain-specific scraping.
  • Nice to have: experience building scalable systems.

Benefits

  • Remote full-time position.
  • Gross salary from 20,000 PLN per month.
  • Open to discussing a different salary based on skills and experience.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

MORO TECH

Senior Software Engineer - Java

MORO TECH 51-250 Road & Rail

MORO TECH is hiring a Senior Java Software Engineer to help build backend solutions for an Energy Management division supporting smart mobility and electric vehicle connected services for a major global OEM.

Greece Portugal Full-time Senior Backend Engineer
Java MongoDB REST API Spring Boot
25 minutes ago
Wellhub

Senior Backend Software Engineer | BASE

Wellhub 1-10 Gas Utilities

Wellhub is hiring a Senior Software Engineer for its BASE Focus Area Tagus team in Brazil to help build and scale the core systems behind subscriptions, commercial conditions, and source-of-truth data for its global wellness platform.

Brazil Full-time Senior Backend Engineer
Agile AWS C++ DynamoDB GCP Go HTTP Java Kotlin Microservices MySQL PostgreSQL REST API Ruby SQL
1 hour, 12 minutes ago
Zendesk

Senior Software Engineer - PerfectScale by DoiT, Portugal(Remote)

Zendesk 5K-10K Professional Services

DoiT is hiring a remote Senior Software Engineer to help lead the design, development, and technical direction of its PerfectScale Kubernetes optimization platform for cloud-driven customers across EMEA.

United Kingdom Netherlands Portugal Sweden Estonia Ireland Israel Full-time Senior Backend Engineer Platform Engineer
Apache Spark AWS Azure CI/CD ClickHouse dbt Docker GCP GitOps Go Java Kubernetes Microservices PostgreSQL Python Rust Trino
3 hours ago
AssureSoft

Senior Backend Engineer (Platform | AWS)

AssureSoft 51-250 Internet Software & Services

AssureSoft is hiring a remote software engineer to build platform and integration capabilities for long-term client projects in a collaborative, continuously learning environment.

Latin America Full-time Senior Backend Engineer
API Gateway AWS CI/CD DynamoDB Go GraphQL HIPAA Kafka Microservices Node.js OAuth Python RabbitMQ Ruby SAML SQL WebSockets
5 hours, 23 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers