RemoteLeaf Logo
Log in Sign up

Principal Software Engineer - Data Platform (Iceberg/Trino)

1 hour, 7 minutes ago
United States
Full-time
Lead
Data Engineer
Software Development
Apache Spark AWS GCP Java Kubernetes Microservices Python REST API Snowflake SQL Trino
Apply Now
Innovaccer

Innovaccer

Innovaccer is a top data platform for value-based care, providing unified patient data solutions to revolutionize healthcare outcomes worldwide.

IT Services
1K-5K
Founded 2014
$379M raised
View All Jobs 23

Description

  • Own the lakehouse reference architecture, including Iceberg table design, Trino cluster topology, catalog services, Spark transform compute, and object-storage layout.
  • Design on-premise replacements for cloud-managed warehouse capabilities such as change-data-capture streams, scheduled tasks, and write-back paths.
  • Validate the catalog and query engine through proof-of-concept testing at expected data volumes and define placement decision criteria.
  • Set platform-wide standards for table layout, partitioning, file sizing, and Iceberg maintenance operations.
  • Lead the SQL dialect strategy for porting warehouse workloads to Trino and Spark SQL.
  • Mentor senior engineers across data workstreams and review designs to improve engineering quality.
  • Partner with platform engineering on storage sizing, resource isolation, and capacity planning for the lakehouse footprint.

Requirements

  • B.E., B.Tech., M.Sc. degree in Computer Science or a related technical field.
  • 12+ years of industry experience building and operating large-scale data platforms or distributed systems.
  • Deep hands-on expertise with distributed SQL engines such as Trino/Presto or Spark SQL internals, query planning, and performance engineering.
  • Production experience with Apache Iceberg, or Delta Lake/Hudi with willingness to go deep on Iceberg.
  • Working knowledge of Iceberg catalog services such as REST catalogs (Polaris or Nessie) or Hive Metastore, and S3-compatible object storage.
  • Strong understanding of cloud warehouse internals such as Snowflake, BigQuery, or Redshift.
  • Professional software development experience with Java and/or Python.
  • Experience delivering data platforms in on-premise, regulated, or air-gapped environments is a strong plus.
  • Healthcare data experience is a plus.

Benefits

  • 20 days of fixed time off per year plus company holidays.
  • Best-in-class parental leave.
  • Monetary incentives and company-wide recognition for impact and dedication.
  • Medical, dental, and vision insurance.
  • 100% company-paid short- and long-term disability insurance.
  • 100% company-paid basic life insurance.
  • Optional discounted legal aid and pet insurance.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

TLATech

Senior Business Systems Engineer

TLATech Specialized Consumer Services

Syllo is hiring a Senior Business Systems Engineer to connect internal systems, third-party tools, and data pipelines that support operations across Revenue Operations, Finance, and Customer Success.

United States Full-time Senior Business Analyst Data Engineer
$160k-$200k
CRM FastAPI GCP Microservices Python React
37 minutes ago
Xebia

Senior Data Engineer

Xebia 1K-5K Internet Software & Services

Xebia is hiring Data Engineers for an AWS-based data mesh platform project where product engineering teams will own and run the data they produce and consume.

Moldova Romania Slovakia Bulgaria Czech Republic Hungary Lead Data Engineer
AWS Azure Databricks DynamoDB Flink GCP Generative AI Kafka Kubernetes Python Snowflake SQL
52 minutes ago
Mozn

Data Platform Engineer III

Mozn 51-250 Internet Software & Services

Mozn is hiring a Data Platform Engineer III to design, operate, and improve the data infrastructure that powers analytics, real-time processing, and AI workloads across cloud-native and hybrid environments.

Egypt Full-time Senior Data Engineer
Apache Spark AWS Azure Bash ClickHouse Druid Flink GCP GitOps Go Grafana Helm Kafka Kubernetes MySQL OpenSearch PostgreSQL Presto Prometheus Python SQL Terraform Trino
1 hour, 7 minutes ago
Spirit Omega

Senior Fabric Data Engineer

Spirit Omega 11-50 human resources

Spirit Omega is hiring a Senior Fabric Data Engineer to modernize and migrate learning-platform data into the Cornerstone Galaxy ecosystem using Microsoft Fabric and Azure-based data pipelines.

Canada Contract Senior Data Engineer
Agile Apache Spark Azure CI/CD Databricks Feature Engineering Git Python SQL
1 hour, 7 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers