RemoteLeaf Logo
Log in Sign up

Principal Software Engineer - Data Platform (Iceberg/Trino)

1 month, 2 weeks ago
United States
Full-time
Lead
Data Engineer
Software Development
Apache Spark AWS GCP Java Kubernetes Microservices Python REST API Snowflake SQL Trino
Apply Now
Innovaccer

Innovaccer

Innovaccer is a top data platform for value-based care, providing unified patient data solutions to revolutionize healthcare outcomes worldwide.

IT Services
1K-5K
Founded 2014
$379M raised
View All Jobs 15

Description

  • Own the lakehouse reference architecture, including Iceberg table design, Trino cluster topology, catalog services, Spark transform compute, and object-storage layout.
  • Design on-premise replacements for cloud-managed warehouse capabilities such as change-data-capture streams, scheduled tasks, and write-back paths.
  • Validate the catalog and query engine through proof-of-concept testing at expected data volumes and define placement decision criteria.
  • Set platform-wide standards for table layout, partitioning, file sizing, and Iceberg maintenance operations.
  • Lead the SQL dialect strategy for porting warehouse workloads to Trino and Spark SQL.
  • Mentor senior engineers across data workstreams and review designs to improve engineering quality.
  • Partner with platform engineering on storage sizing, resource isolation, and capacity planning for the lakehouse footprint.

Requirements

  • B.E., B.Tech., M.Sc. degree in Computer Science or a related technical field.
  • 12+ years of industry experience building and operating large-scale data platforms or distributed systems.
  • Deep hands-on expertise with distributed SQL engines such as Trino/Presto or Spark SQL internals, query planning, and performance engineering.
  • Production experience with Apache Iceberg, or Delta Lake/Hudi with willingness to go deep on Iceberg.
  • Working knowledge of Iceberg catalog services such as REST catalogs (Polaris or Nessie) or Hive Metastore, and S3-compatible object storage.
  • Strong understanding of cloud warehouse internals such as Snowflake, BigQuery, or Redshift.
  • Professional software development experience with Java and/or Python.
  • Experience delivering data platforms in on-premise, regulated, or air-gapped environments is a strong plus.
  • Healthcare data experience is a plus.

Benefits

  • 20 days of fixed time off per year plus company holidays.
  • Best-in-class parental leave.
  • Monetary incentives and company-wide recognition for impact and dedication.
  • Medical, dental, and vision insurance.
  • 100% company-paid short- and long-term disability insurance.
  • 100% company-paid basic life insurance.
  • Optional discounted legal aid and pet insurance.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Babylist

Senior Data Engineer

Babylist 251-1K Internet Software & Services

Babylist is hiring a senior Data Engineering individual contributor to build scalable data infrastructure and AI-native systems that automate pipeline generation, testing, and maintenance across its growing e-commerce platform.

Canada Full-time Senior Data Engineer
Apache Airflow AWS dbt Python Snowflake
2 hours, 20 minutes ago
Alimentiv

Senior Data Engineer (India)

Alimentiv 251-1K Professional Services

The Lead Data Engineer will architect and operationalize enterprise-scale data solutions for analytics and AI/ML initiatives, ensuring integrated, governed, and production-ready data platforms while providing technical leadership.

India Full-time Senior Data Engineer
$25k-$43k
Apache Spark Azure CI/CD Databricks Git HIPAA JSON Looker Power BI REST API SQL Tableau Terraform
2 hours, 20 minutes ago
Xsolla

Staff Software Engineer Smart Wallet & Account Abstraction

Xsolla 251-1K Internet Software & Services

Xsolla is seeking a Staff Engineer to own the smart wallet and account abstraction layer powering its Web3 platform, defining secure account, signing, custody, and recovery systems for millions of players.

Russia Full-time Lead Technical Lead
Blockchain CI/CD Ethereum Expo Git Go JWT Kafka Kubernetes NATS OpenID Connect PostgreSQL React Native TypeScript
2 hours, 20 minutes ago
Bellese Technologies

Senior Engineer, Data

Bellese Technologies 51-250 Internet Software & Services

Bellese is seeking an Engineer II to build and improve backend systems, data integrations, APIs, and user interfaces that support digital solutions for civic healthcare and better public health outcomes.

United States Full-time Senior Data Engineer
$129k-$153k
Agile Apache Spark AWS CI/CD Databricks Python R
2 hours, 20 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers