Staff Data Platform Engineer

11 hours, 12 minutes ago
Lead
Software Development
Kargo

Kargo

Kargo specializes in creating innovative advertising solutions that enhance mobile, CTV, social, and e-commerce campaigns, enabling brands to effectively connect with consumers through high-quality mobile ad experiences.

Media
251-1K
Founded 2003

Description

  • Build the data control plane for data products, including schemas, lineage, ownership, freshness commitments, quality, and access.
  • Build the paved road for creating data products with libraries, SDKs, templates, and data-specific CI/CD.
  • Build the enforcement layer for data standards, including schema registry, contract validation, and automated certification.
  • Make data products observable by default with instrumentation for freshness, volume, schema conformance, and quality.
  • Integrate platform observability with Kargo's existing monitoring and metadata for AI-assisted triage.
  • Set the platform's technical direction, including architecture, roadmap, and build-versus-buy decisions.
  • Run design reviews with producers and consumers of data to gather input and align the platform.
  • Create modular platform capabilities that other teams across Kargo can contribute back to.
  • Work directly with the Sr. Director of Data Engineering to shape standards and grow the team over time.

Requirements

  • Built loosely coupled production services, APIs, and SDKs in Python used by multiple teams.
  • Experience building metadata-driven platforms that integrate with catalogs and automatically check lineage, contracts, and quality.
  • Experience building observability that other teams depend on.
  • Ability to drive adoption through architecture reviews, mentorship, and clear communication.
  • Strong AWS, Terraform, and Kubernetes experience.
  • Experience moving from batch to streaming, including understanding cost tradeoffs (strongly preferred).
  • Experience with Spark and Iceberg at significant scale, and Snowflake in production (strongly preferred).
  • Experience in ad tech or another high-volume event-data domain with multiple consumers (strongly preferred).
  • Experience building tooling and data structures that AI agents operate against (strongly preferred).
  • Experience standing up the first generation of a platform team’s capabilities (nice to have).
  • Experience with data catalog, semantic layer, or governance tooling (nice to have).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer, Blockchain data and/or NLP pipelines

Inca Digital 11-50 Internet Software & Services

Inca Digital is hiring a Data Engineer to build and operate data pipelines and intelligence products that transform blockchain, market, and unstructured text data into client-facing analytics, alerts, and APIs.

Apache Airflow AWS AWS CDK Blockchain ClickHouse Dagster dbt Docker FastAPI Git GitHub Actions Go Kafka Kong Kubernetes LLM MongoDB Neo4j NLP OpenSearch PostgreSQL Prefect Python Snowflake SQL Terraform
10 hours, 27 minutes ago

Senior Data Engineer

Nansen 51-250 Internet Software & Services

Nansen is hiring a data engineer to build and operate the data infrastructure behind its onchain analytics product, with a clear path from individual contributor to Engineering Manager.

Blockchain ClickHouse dbt PostgreSQL Python SQL
10 hours, 42 minutes ago

Lead Data Engineer

Eltropy 51-250 Communications Equipment

Lead Data Engineer at a remote India-based company to architect and deliver scalable data platforms and pipelines that support reporting, analytics, and self-service BI.

Apache Airflow Apache Spark AWS Kafka Python SQL
11 hours, 12 minutes ago

Sr. Data Engineer

Teachable 51-250 Internet Software & Services

Teachable is hiring a Senior Data Engineering leader to guide data architecture and pipelines for a remote Brazil-based team supporting company-wide decision-making across engineering, product, finance, and business functions.

Apache Airflow AWS dbt Kafka Terraform
1 day, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers