RemoteLeaf Logo
Log in Sign up

Experienced Web Scraping Engineer - Python

3 weeks ago
Poland
Full-time
Senior
Backend Engineer
Software Development
C++ Docker Elasticsearch FastAPI Git Go Grafana Kafka Kibana Kubernetes Machine Learning MySQL Prometheus Python Redis SQLAlchemy
Apply Now
Oxylabs

Oxylabs

Oxylabs is a leading provider of premium proxy services with a vast network of residential and datacenter IP proxies. They offer industry-leading web scraping solutions and a trusted ethical proxy network for global clients.

IT Services
251-1K
Founded 2015
View All Jobs 8

Description

  • Develop scalable scrapers for high-volume web data extraction.
  • Define resilient scraping strategies and unblock websites for scraping.
  • Improve system observability and monitoring.
  • Develop backend solutions for scraping and parsing problems of varying scale.
  • Maintain the current scraping and parsing system.
  • Build new features related to scraping and parsing.
  • Work with the team to create and improve scrapers using shared tips and best practices.

Requirements

  • Experience working with Python.
  • Strong understanding of computer science fundamentals, including data structures, algorithms, computability, and complexity.
  • Version control experience using Git.
  • Knowledge of techniques for unblocking websites for scraping.
  • Experience using different scraping techniques and open-source tools to build scrapers.
  • Comfort using browser DevTools.
  • Knowledge of networking concepts, including TLS/SSL.
  • Experience with browser automation.
  • Comfort with asynchronous programming.
  • Nice to have: web development knowledge.
  • Nice to have: experience using CSS selectors and XPaths for parsing.
  • Nice to have: experience with Go and C++.
  • Nice to have: experience working on browser source code.
  • Nice to have: familiarity with front-end frameworks.
  • Nice to have: experience with Pydantic, FastAPI, and SQLAlchemy.
  • Nice to have: experience with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, Grafana, Prometheus, or similar monitoring tools.
  • Nice to have: experience with machine learning in domain-specific scraping.
  • Nice to have: experience building scalable systems.

Benefits

  • Remote full-time position.
  • Gross salary from 20,000 PLN per month.
  • Open to discussing a different salary based on skills and experience.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Galaxy

Vice President, Software Engineer - Finance Engineering

Galaxy 251-1K Capital Markets

Galaxy is hiring a Python developer for its Financial Engineering team to build and support reporting solutions that inform finance and accounting decisions in a fast-paced digital assets environment.

United Kingdom Full-time Lead Backend Engineer Software Engineer
Apache Spark AWS Blockchain C# Databricks Docker Go Java Kubernetes Pandas Python SQL
47 minutes ago
CI&T

[Job - 29146] Sênior Fullstack Developer, Brazil (Java e Angular)

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Senior Fullstack Developer in Brazil to work remotely on scalable technology solutions, supporting the end-to-end software development lifecycle for client projects.

Brazil Full-time Senior Backend Engineer Full-stack Engineer
Angular CI/CD Java Kanban Microservices Node.js Scrum Spring Boot
1 hour, 3 minutes ago
Airalo

Backend/PHP Engineer

Airalo 51-250 Airlines

Airalo is hiring a Mid-Level Backend/PHP Engineer in a fully remote role to help build and scale the global eSIM platform that keeps travelers connected across more than 200 countries and regions.

Spain United Kingdom Romania Full-time Mid Level Backend Engineer
AWS CI/CD Docker Laravel Memcached Microservices PHP Redis SQL Symfony
1 hour, 47 minutes ago
Ethics Code

Java Engineer - Mid to Senior

Ethics Code Diversified Consumer Services

ETHICS CODE is seeking a Mid to Senior Java Engineer to design, develop, and maintain business-critical Java applications within a collaborative engineering team.

Dominican Republic Full-time Mid Level Backend Engineer
Agile Git Hibernate Java MySQL Oracle PostgreSQL REST API Spring
2 hours, 51 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers