RemoteLeaf Logo
Log in Sign up

Principal Software Engineer - Data Platform (Iceberg/Trino)

3 weeks, 2 days ago
United States
Full-time
Lead
Data Engineer
Software Development
Apache Spark AWS GCP Java Kubernetes Microservices Python REST API Snowflake SQL Trino
Apply Now
Innovaccer

Innovaccer

Innovaccer is a top data platform for value-based care, providing unified patient data solutions to revolutionize healthcare outcomes worldwide.

IT Services
1K-5K
Founded 2014
$379M raised
View All Jobs 24

Description

  • Own the lakehouse reference architecture, including Iceberg table design, Trino cluster topology, catalog services, Spark transform compute, and object-storage layout.
  • Design on-premise replacements for cloud-managed warehouse capabilities such as change-data-capture streams, scheduled tasks, and write-back paths.
  • Validate the catalog and query engine through proof-of-concept testing at expected data volumes and define placement decision criteria.
  • Set platform-wide standards for table layout, partitioning, file sizing, and Iceberg maintenance operations.
  • Lead the SQL dialect strategy for porting warehouse workloads to Trino and Spark SQL.
  • Mentor senior engineers across data workstreams and review designs to improve engineering quality.
  • Partner with platform engineering on storage sizing, resource isolation, and capacity planning for the lakehouse footprint.

Requirements

  • B.E., B.Tech., M.Sc. degree in Computer Science or a related technical field.
  • 12+ years of industry experience building and operating large-scale data platforms or distributed systems.
  • Deep hands-on expertise with distributed SQL engines such as Trino/Presto or Spark SQL internals, query planning, and performance engineering.
  • Production experience with Apache Iceberg, or Delta Lake/Hudi with willingness to go deep on Iceberg.
  • Working knowledge of Iceberg catalog services such as REST catalogs (Polaris or Nessie) or Hive Metastore, and S3-compatible object storage.
  • Strong understanding of cloud warehouse internals such as Snowflake, BigQuery, or Redshift.
  • Professional software development experience with Java and/or Python.
  • Experience delivering data platforms in on-premise, regulated, or air-gapped environments is a strong plus.
  • Healthcare data experience is a plus.

Benefits

  • 20 days of fixed time off per year plus company holidays.
  • Best-in-class parental leave.
  • Monetary incentives and company-wide recognition for impact and dedication.
  • Medical, dental, and vision insurance.
  • 100% company-paid short- and long-term disability insurance.
  • 100% company-paid basic life insurance.
  • Optional discounted legal aid and pet insurance.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

H

Lead Appian Associate (DISA)

Horizon Industries Construction

Horizon Industries Limited is seeking a Lead Appian Associate to remotely lead Appian software development projects supporting the Defense Information Systems Agency (DISA), with occasional travel and US citizenship required.

United States Full-time Lead Technical Lead
Agile
11 hours, 33 minutes ago
CI&T

[Job - 31429] Data Engineer Specialist

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Data Engineer to own the Foundation Pod’s end-to-end data platform, building reliable pipelines, governed models, and analytics solutions for enterprise transformation initiatives.

Colombia Brazil Full-time Lead Data Engineer
Azure CI/CD Power BI Terraform
11 hours, 48 minutes ago
Wpromote

Senior Software Engineer II (Data Pipelines)

Wpromote 251-1K Media

Wpromote is seeking a Senior Engineer to lead the development, automation, and optimization of scalable data pipelines supporting Polaris, its marketing intelligence and operational data platform.

United States Full-time Senior Data Engineer
$155k-$180k
Agile Apache Airflow CI/CD dbt GCP Git GitHub Actions Grafana Hive Kubernetes Looker PostgreSQL Prometheus Python Scrum SQL Terraform
11 hours, 48 minutes ago
CI&T

[Job - 31568] Squad Lead, São Paulo or Campinas only.

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Squad Leader to lead cross-functional teams delivering digital solutions for global enterprise clients, with responsibility for collaboration, team development, and successful project execution.

Brazil Full-time Lead Technical Lead
Agile Scrum
11 hours, 48 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers