RemoteLeaf Logo
Log in Sign up

Lead Data Engineer

1 month, 1 week ago
Anywhere
Full-time
Lead
Data Engineer
Software Development
Apache Spark CI/CD GCP GitHub Actions Salesforce Snowflake Terraform
Apply Now
Egen.ai

Egen.ai

Egen.ai specializes in providing technology services that leverage cloud computing, data analytics, and artificial intelligence to enhance document intelligence and drive productivity and growth for its clients.

IT Services
Founded 2000
View All Jobs 10

Description

  • Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone.
  • Design and build unified batch and streaming pipelines for high-volume, mission-critical workloads.
  • Lead infrastructure-as-code practices to keep environments repeatable, secure, and version-controlled.
  • Implement open table formats to support cross-cloud and cross-engine data interoperability.
  • Establish automated data quality, metadata, and lineage practices across the data estate.
  • Partner with data scientists, analysts, and product teams to translate business needs into reliable data products.
  • Mentor engineers, review designs, and raise engineering standards.
  • Drive the technical direction for open, interoperable data architectures.

Requirements

  • 7+ years of experience in data engineering.
  • At least 2 years of experience in a lead or senior individual contributor role on Google Cloud-based platforms.
  • Advanced knowledge of BigQuery architecture, including partitioning, clustering, slot management, storage optimization, and query execution tuning.
  • Strong hands-on experience building unified streaming and batch pipelines using Dataflow (Apache Beam), Dataproc, and Pub/Sub.
  • Production experience developing and managing cloud infrastructure with Terraform.
  • Working knowledge of Apache Iceberg and its role in enabling cloud and engine interoperability across BigQuery, Spark, and Snowflake.
  • Experience with Dataplex and Data Catalog for automated data quality checks, metadata tagging, and column-level lineage from source to destination.
  • Experience leading or mentoring data engineering teams (preferred).
  • Familiarity with CI/CD for data pipelines, such as Cloud Build or GitHub Actions (preferred).
  • Exposure to multi-cloud or hybrid data architectures (preferred).
  • Background in regulated industries such as healthcare or financial services where governance and lineage are critical (preferred).

Benefits

  • Competitive salary range of $143,400 to $168,650 per year.
  • Comprehensive health insurance.
  • Paid leave, including vacation/PTO.
  • Paid holidays.
  • Sick leave.
  • Parental leave.
  • Bereavement leave.
  • 401(k) employer match.
  • Employee referral bonuses.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Dan.com - a GoDaddy brand

Data Engineer IV (6249)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a Data Engineer IV to build and optimize AWS-based data infrastructure and pipelines that support AI infrastructure and inference initiatives in a remote role.

United States Contract Lead Data Engineer
AWS
1 day, 19 hours ago
Xebia

Senior Data Engineer (GCP)

Xebia 1K-5K Internet Software & Services

Xebia is hiring a data engineer to support a BigQuery migration by building and maintaining scalable data pipelines for production reporting, analytics, and business intelligence solutions.

Romania Bulgaria Poland Europe Senior Data Engineer
Apache Airflow CI/CD Databricks dbt Git Python Snowflake SQL
1 day, 19 hours ago
Coupang

Staff Data Engineer (Coupang Pay)

Coupang 1K-5K Internet Software & Services

쿠팡페이 핀테크 데이터 플랫폼 팀의 Staff Data Engineer로서 실시간 결제·주문 데이터를 기반으로 데이터 파이프라인과 분석 인프라를 구축·고도화하는 역할입니다.

South Korea Full-time Lead Data Engineer
Apache Spark AWS ClickHouse Flink Hive Java Presto Python Scala SQL Tableau
1 day, 19 hours ago
Cresteo

Data Migration Engineer (SQL Server / TSQL)

Cresteo 51-200 information technology & services

Cresteo is hiring a Data Migration Engineer to own end-to-end SQL Server data migrations from legacy schemas into reconciled, production-ready data for US-based clients and international teams.

Latin America Full-time Senior Database Administrator Data Engineer
JSON SQL Server
1 day, 19 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers