RemoteLeaf Logo
Log in Sign up

Principal Software Engineer, Web Data - Tech Lead

1 month ago
United States
Full-time
Lead
Software Engineer
Software Development
Apache Airflow Apache Spark GCP Java Kafka Kubernetes Python Snowflake Terraform Trino Vertex AI
Apply Now
ZoomInfo

ZoomInfo

ZoomInfo provides a comprehensive B2B database that offers accurate and actionable contact and company intelligence, enabling sales and marketing teams to enhance their campaigns and improve prospecting efforts through access to direct dial phone numbe...

Professional Services
1K-5K
Founded 2000
View All Jobs 14

Description

  • Serve as the de facto technical lead for the Web Data Acquisition team.
  • Own the architectural direction for web crawling systems and data extraction infrastructure.
  • Design and lead the evolution of crawling platforms into a unified, best-in-class stack.
  • Solve complex distributed systems and large-scale data engineering challenges.
  • Build modular tooling that improves delivery speed and engineering productivity.
  • Set standards for observability, reliability, and operational excellence.
  • Mentor engineers and elevate team-wide technical practices.
  • Influence technical direction and drive complex initiatives from concept through execution.
  • Collaborate with product management to translate business needs into technical work.
  • Guide incremental improvements to production systems while maintaining reliability.

Requirements

  • 10+ years of software engineering experience.
  • 5+ years of experience focused on data engineering.
  • 3+ years in senior or principal-level technical leadership.
  • Experience building web crawling or large-scale data systems from scratch.
  • Strong architectural skills in designing scalable, fault-tolerant distributed systems.
  • Hands-on experience with cloud data warehouses such as BigQuery and Snowflake.
  • Experience with Apache Kafka, Kubernetes (GKE/EKS), and Airflow.
  • Familiarity with multi-cloud environments including GCP and AWS.
  • Deep expertise in web crawling and advanced scraping frameworks such as Scrapy.
  • Experience extracting structured and unstructured web data, including SERP extraction.
  • Knowledge of proxy infrastructure management, anti-bot detection, and ethical crawling.
  • Experience mentoring and coaching senior engineers, with startup or small-company experience preferred.
  • Strong computer science fundamentals in algorithms, data structures, and distributed systems.
  • Python and Java experience, with expertise in Apache Spark considered a plus.
  • B2B data company or data-as-a-product experience is preferred.

Benefits

  • US base salary range of $163,800 to $257,400.
  • Additional compensation may include bonus, commission, and equity.
  • Comprehensive benefits coverage.
  • Holistic mind, body, and lifestyle programs focused on overall well-being.
  • Remote-friendly role indicated by #LI-remote.
  • Opportunity to work at ZoomInfo with a high-impact, technically visible team.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Carvana

Senior Software Engineer

Carvana 10K-50K Automotive

Carvana is hiring a Software Engineer for its Next Generation Communications Platform team to build AI-powered microservices and conversational systems that improve the customer experience across the car-buying journey.

United States Full-time Senior Software Engineer
AWS Azure C# CI/CD Docker GCP Generative AI GraphQL Kafka Kubernetes Linux LLM Machine Learning Microservices OpenID Connect Python RabbitMQ Redis SQL
16 minutes ago
Speechify

Senior Software Engineer, Windows/Desktop Applications - Haifa, Israel

Speechify 51-250 Internet Software & Services

Speechify is hiring a Windows desktop software engineer to design and ship accessible, high-performance native applications that support its text-to-speech products used by millions of learners worldwide.

Israel Full-time Senior Software Engineer
C# C++ CI/CD .NET
53 minutes ago
STR

Associate Software Engineer

STR 251-1K Aerospace & Defense

STR’s SAAM Group is seeking a Software Engineer to develop and implement real-time software for advanced sensing and autonomy prototypes and operational systems supporting national security programs.

United States Full-time Junior Software Engineer
$93k-$115k
C++ CI/CD Git iOS Linux Machine Learning MATLAB Python
58 minutes ago
DoorDash

Senior Staff Software Engineer (Search)

DoorDash 10K-50K Air Freight & Logistics

DoorDash is hiring a Senior Staff Engineer to lead the technical strategy and architecture for its Search organization, shaping the core systems that power discovery, ranking, and next-generation consumer and agentic commerce experiences.

United States Full-time Lead Software Engineer
$231k-$340k
LLM Machine Learning
1 hour, 7 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers