RemoteLeaf Logo
Log in Sign up

Lead Data Engineer - Identity

11 hours, 12 minutes ago
Europe
Full-time
Lead
Data Engineer
Software Development
Apache Airflow Apache Spark Argo CD AWS ClickHouse GitHub Actions Grafana Kafka Kubernetes Prometheus Python Snowflake SQL
Apply Now
Kargo

Kargo

Kargo specializes in creating innovative advertising solutions that enhance mobile, CTV, social, and e-commerce campaigns, enabling brands to effectively connect with consumers through high-quality mobile ad experiences.

Media
251-1K
Founded 2003
View All Jobs 2

Description

  • Build and sequence a new identity graph, including identifier sync, translation, clustering, and opt-out handling.
  • Standardize partner and client onboarding across web, CTV, and mobile identifiers, including cleanroom onboarding.
  • Prepare the identity audience data layer for self-serve audience creation, activation, state, and reporting.
  • Own observability and alert response by centralizing signals, monitors, and alerts, and creating runbooks and triage context.
  • Lead and grow the domain’s data engineers through standards, code reviews, knowledge-sharing, and ADRs.
  • Set technical direction for the domain and raise engineering standards for testability and cost efficiency.
  • Collaborate with Product, Data Partnerships, and Data Science to turn ambiguity into a sequenced roadmap.
  • Develop and maintain data pipelines and transformations that support scalable ingestion and reporting.

Requirements

  • Experience designing and owning large-scale, interdependent data systems, including at least one built from scratch.
  • Experience leading engineers while staying hands-on, including setting direction, reviewing work, and developing people.
  • Strong Python, Airflow, and Spark skills, with idiomatic, testable, cost- and performance-tuned transformations.
  • Strong SQL skills, especially in Snowflake.
  • Experience with AWS and Kubernetes, including reading infrastructure logs to diagnose failures and slowness.
  • Experience working with third-party APIs inside ingestion pipelines.
  • Fluency with AI tooling in day-to-day work and an understanding of how to make codebases legible to AI tools.
  • Preferred: identity resolution or graph work in AdTech, including matching and device/household graphs.
  • Preferred: experience with privacy and consent obligations such as opt-outs, deletion, GDPR, and CCPA.
  • Preferred: experience with data cleanrooms for partner or client onboarding.
  • Preferred: CI/CD with GitHub Actions or ArgoCD, and monitoring with VictoriaMetrics, Prometheus, or Grafana.
  • Nice to have: production-scale Iceberg or a comparable table format.
  • Nice to have: streaming or near-real-time processing tools such as Kafka or Redpanda.
  • Nice to have: low-latency stores such as Aerospike.
  • Nice to have: experience with OLAP databases like Clickhouse.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

May Mobility

Tech Lead, Simulation Engine

May Mobility 251-1K Transportation

May Mobility is seeking a Lead Simulation Engineer to architect and scale the autonomous vehicle simulation platform that supports vehicle dynamics, physics, rendering, sensor simulation, and evaluation for its AV stack.

United States Full-time Lead Technical Lead
$189k-$272k
C++ Machine Learning Python
10 hours, 27 minutes ago
Inca Digital

Senior Data Engineer, Blockchain data and/or NLP pipelines

Inca Digital 11-50 Internet Software & Services

Inca Digital is hiring a Data Engineer to build and operate data pipelines and intelligence products that transform blockchain, market, and unstructured text data into client-facing analytics, alerts, and APIs.

United States Full-time Senior Data Engineer
Apache Airflow AWS AWS CDK Blockchain ClickHouse Dagster dbt Docker FastAPI Git GitHub Actions Go Kafka Kong Kubernetes LLM MongoDB Neo4j NLP OpenSearch PostgreSQL Prefect Python Snowflake SQL Terraform
10 hours, 27 minutes ago
Nansen

Senior Data Engineer

Nansen 51-250 Internet Software & Services

Nansen is hiring a data engineer to build and operate the data infrastructure behind its onchain analytics product, with a clear path from individual contributor to Engineering Manager.

Europe Full-time Senior Data Engineer
Blockchain ClickHouse dbt PostgreSQL Python SQL
10 hours, 41 minutes ago
Eltropy

Lead Data Engineer

Eltropy 51-250 Communications Equipment

Lead Data Engineer at a remote India-based company to architect and deliver scalable data platforms and pipelines that support reporting, analytics, and self-service BI.

India Full-time Lead Data Engineer
Apache Airflow Apache Spark AWS Kafka Python SQL
11 hours, 12 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers