RemoteLeaf Logo
Log in Sign up

Senior Software Engineer, Data Governance & Foundations

1 week, 5 days ago
United States
Full-time
Senior
Software Engineer
Software Development
Apache Airflow Apache Spark ClickHouse Databricks dbt Flink Kafka PostgreSQL Python Scala Snowflake SQL Trino
Apply Now
instacart.careers

instacart.careers

Instacart is a leading grocery technology company in North America that works with grocers and retailers to transform how people shop. They partner with over 1,000 national, regional, and local retail banners to facilitate online shopping, delivery, an...

Internet Software & Services
1K-5K
View All Jobs 118

Description

  • Define and drive multi-year architecture roadmaps for large-scale data ingestion and processing infrastructure.
  • Own end-to-end platform initiatives, including build-versus-buy decisions, migration design, production rollout, and risk management.
  • Partner with vendors such as Snowflake, Databricks, and Confluent on technical integration, contract evaluation, and TCO modeling.
  • Embed governance and compliance controls for SOX, CPRA, and GDPR into platform architecture and data lifecycle management.
  • Optimize infrastructure spend across compute, storage, and pipeline efficiency while managing multi-million dollar budgets.
  • Write architecture documents, strategy memos, and proposals that align engineering leadership and senior stakeholders.
  • Mentor engineers and help grow a high-performing data infrastructure organization.
  • Collaborate with Data Science, ML Platform, Ads Infrastructure, Finance Engineering, and Product teams to support evolving platform needs.

Requirements

  • 5+ years of software engineering experience focused on data infrastructure or distributed systems at scale in a high-growth, data-intensive environment.
  • Experience with modern data lakehouse architectures and open table formats such as Apache Iceberg, Delta Lake, or Hudi.
  • Hands-on experience with distributed query and compute systems such as Trino, Spark, or ClickHouse, including performance tuning and production reliability work.
  • Strong experience with Kafka-based ingestion and Flink or equivalent stream processing systems.
  • Proven experience leading major platform transitions, including migration design, phased rollout, and risk management.
  • Experience building business cases for infrastructure investments, including cost-benefit analysis and TCO modeling.
  • Exceptional written technical communication skills for architecture docs, strategy memos, and cross-team proposals.
  • Strong ownership and comfort operating in ambiguity across large, multi-team initiatives.
  • Preferred experience with data governance and compliance frameworks such as SOX, CPRA, and GDPR.
  • Preferred experience with FinOps, large infrastructure budgets, and enterprise vendor contract negotiation.
  • Deep SQL expertise and strong proficiency in Python or Scala.
  • Experience with Apache Airflow and dbt in large-scale production environments.
  • Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience.

Benefits

  • Remote role with flexibility to work from home, an office, or a coffee shop under Instacart's Flex First approach.
  • Highly market-competitive compensation based on permanent work location.
  • Base salary range in the US from $166,000 to $210,000 depending on location.
  • Eligible for a new hire equity grant and annual refresh grants.
  • Benefits offerings available through Instacart's employee benefits program.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Anduril Industries

Senior Software Engineer, Manufacturing Test

Anduril Industries 1K-5K Aerospace & Defense

Anduril Industries is hiring a Senior Software Engineer for its Manufacturing Test organization to develop software and automation that improve product testing, deployment, and data-driven quality across land, sea, and air systems.

United States Full-time Senior Software Engineer
$191k-$253k
AWS Azure C# CI/CD DB2 Embedded Systems Git Linux Python SQL Server
3 hours, 5 minutes ago
Anduril Industries

Senior Software Engineer, Manufacturing Test

Anduril Industries 1K-5K Aerospace & Defense

Anduril Industries is hiring a Senior Software Engineer for its Manufacturing Test organization to develop software and automation that improves testing, analytics, and quality across defense products in land, sea, and air domains.

United States Full-time Senior Software Engineer
$209k-$276k
AWS Azure C# CI/CD DB2 Embedded Systems Git Linux Python SQL Server
3 hours, 5 minutes ago
Kaseya

Staff Software Engineer

Kaseya 1K-5K IT Services

Kaseya is hiring a Staff Software Engineer to lead the design and delivery of a unified Identity and Access Management platform for a large portfolio of cloud products.

India Lead Software Engineer
Active Directory HIPAA JWT SAML Secrets Management
3 hours, 20 minutes ago
Anduril Industries

Senior Software Engineer, Manufacturing Test

Anduril Industries 1K-5K Aerospace & Defense

Anduril Industries is hiring a Senior Software Engineer for its Manufacturing Test organization to develop software and automation that improves product testing, deployment, and analytics across land, sea, and air systems.

United States Full-time Senior Software Engineer
$191k-$253k
AWS Azure C# CI/CD DB2 Embedded Systems Git Linux Python SQL Server
3 hours, 20 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers