RemoteLeaf Logo
Log in Sign up

Senior Software Engineer, Data Governance & Foundations

1 month ago
United States
Full-time
Senior
Software Engineer
Software Development
Apache Airflow Apache Spark ClickHouse Databricks dbt Flink Kafka PostgreSQL Python Scala Snowflake SQL Trino
Apply Now
instacart.careers

instacart.careers

Instacart is a leading grocery technology company in North America that works with grocers and retailers to transform how people shop. They partner with over 1,000 national, regional, and local retail banners to facilitate online shopping, delivery, an...

Internet Software & Services
1K-5K
View All Jobs 122

Description

  • Define and drive multi-year architecture roadmaps for large-scale data ingestion and processing infrastructure.
  • Own end-to-end platform initiatives, including build-versus-buy decisions, migration design, production rollout, and risk management.
  • Partner with vendors such as Snowflake, Databricks, and Confluent on technical integration, contract evaluation, and TCO modeling.
  • Embed governance and compliance controls for SOX, CPRA, and GDPR into platform architecture and data lifecycle management.
  • Optimize infrastructure spend across compute, storage, and pipeline efficiency while managing multi-million dollar budgets.
  • Write architecture documents, strategy memos, and proposals that align engineering leadership and senior stakeholders.
  • Mentor engineers and help grow a high-performing data infrastructure organization.
  • Collaborate with Data Science, ML Platform, Ads Infrastructure, Finance Engineering, and Product teams to support evolving platform needs.

Requirements

  • 5+ years of software engineering experience focused on data infrastructure or distributed systems at scale in a high-growth, data-intensive environment.
  • Experience with modern data lakehouse architectures and open table formats such as Apache Iceberg, Delta Lake, or Hudi.
  • Hands-on experience with distributed query and compute systems such as Trino, Spark, or ClickHouse, including performance tuning and production reliability work.
  • Strong experience with Kafka-based ingestion and Flink or equivalent stream processing systems.
  • Proven experience leading major platform transitions, including migration design, phased rollout, and risk management.
  • Experience building business cases for infrastructure investments, including cost-benefit analysis and TCO modeling.
  • Exceptional written technical communication skills for architecture docs, strategy memos, and cross-team proposals.
  • Strong ownership and comfort operating in ambiguity across large, multi-team initiatives.
  • Preferred experience with data governance and compliance frameworks such as SOX, CPRA, and GDPR.
  • Preferred experience with FinOps, large infrastructure budgets, and enterprise vendor contract negotiation.
  • Deep SQL expertise and strong proficiency in Python or Scala.
  • Experience with Apache Airflow and dbt in large-scale production environments.
  • Bachelor's, Master's, or PhD in Computer Science, Computer Engineering, Electrical Engineering, or equivalent practical experience.

Benefits

  • Remote role with flexibility to work from home, an office, or a coffee shop under Instacart's Flex First approach.
  • Highly market-competitive compensation based on permanent work location.
  • Base salary range in the US from $166,000 to $210,000 depending on location.
  • Eligible for a new hire equity grant and annual refresh grants.
  • Benefits offerings available through Instacart's employee benefits program.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Workato

Intern, Forward Deployed Engineering

Workato 251-1K IT Services

Workato is hiring a Forward Deployed Engineering intern to support AI-driven automation initiatives by helping build intelligent agents and enterprise workflow integrations on its Agentic AI platform.

India Internship Entry Level AI Engineer Software Engineer
JavaScript JSON LLM Python REST API Salesforce
14 hours, 14 minutes ago
Black Duck Inn

Software Engineer 3

Black Duck Inn 1K-5K Internet Software & Services

Black Duck Software is seeking a License Developer to evolve legacy licensing systems and build reliable, production-ready services for secure 24/7 customer use.

India Full-time Senior Software Engineer
CI/CD DevSecOps Java Kubernetes Linux REST API Ruby on Rails
14 hours, 14 minutes ago
eClinical Solutions

Statistical Programmer Sr

eClinical Solutions 251-1K Professional Services

Experienced Statistical Programmer role at a clinical research organization focused on delivering compliant statistical programming outputs for multiple clinical studies and regulatory submissions.

India Senior Software Engineer
Git GitHub GitLab R SAP Shell Scripting
14 hours, 14 minutes ago
Career TEAM

Data Conversion Software Engineer

Career TEAM 251-1K Professional Services

Career Team is hiring a Data Conversion Software Engineer to build data transformation and integration software for government-funded workforce development programs across the United States.

United States Full-time Mid Level Data Engineer Software Engineer
$60k-$100k
Agile Angular CI/CD Docker Express.js JavaScript JSON MongoDB NestJS Next.js Node.js React Scrum TypeScript XML
14 hours, 29 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers