RemoteLeaf Logo
Log in Sign up

Lead Data Engineer

1 month ago
Anywhere
Full-time
Lead
Data Engineer
Software Development
Apache Spark CI/CD GCP GitHub Actions Salesforce Snowflake Terraform
Apply Now
Egen.ai

Egen.ai

Egen.ai specializes in providing technology services that leverage cloud computing, data analytics, and artificial intelligence to enhance document intelligence and drive productivity and growth for its clients.

IT Services
Founded 2000
View All Jobs 11

Description

  • Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone.
  • Design and build unified batch and streaming pipelines for high-volume, mission-critical workloads.
  • Lead infrastructure-as-code practices to keep environments repeatable, secure, and version-controlled.
  • Implement open table formats to support cross-cloud and cross-engine data interoperability.
  • Establish automated data quality, metadata, and lineage practices across the data estate.
  • Partner with data scientists, analysts, and product teams to translate business needs into reliable data products.
  • Mentor engineers, review designs, and raise engineering standards.
  • Drive the technical direction for open, interoperable data architectures.

Requirements

  • 7+ years of experience in data engineering.
  • At least 2 years of experience in a lead or senior individual contributor role on Google Cloud-based platforms.
  • Advanced knowledge of BigQuery architecture, including partitioning, clustering, slot management, storage optimization, and query execution tuning.
  • Strong hands-on experience building unified streaming and batch pipelines using Dataflow (Apache Beam), Dataproc, and Pub/Sub.
  • Production experience developing and managing cloud infrastructure with Terraform.
  • Working knowledge of Apache Iceberg and its role in enabling cloud and engine interoperability across BigQuery, Spark, and Snowflake.
  • Experience with Dataplex and Data Catalog for automated data quality checks, metadata tagging, and column-level lineage from source to destination.
  • Experience leading or mentoring data engineering teams (preferred).
  • Familiarity with CI/CD for data pipelines, such as Cloud Build or GitHub Actions (preferred).
  • Exposure to multi-cloud or hybrid data architectures (preferred).
  • Background in regulated industries such as healthcare or financial services where governance and lineage are critical (preferred).

Benefits

  • Competitive salary range of $143,400 to $168,650 per year.
  • Comprehensive health insurance.
  • Paid leave, including vacation/PTO.
  • Paid holidays.
  • Sick leave.
  • Parental leave.
  • Bereavement leave.
  • 401(k) employer match.
  • Employee referral bonuses.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Empower Pharmacy

Senior Data Engineer

Empower Pharmacy 251-1K Health Care Providers & Services

Empower Pharmacy is hiring a Senior Data Engineer to build and govern enterprise data platforms and pipelines that improve analytics, compliance, and operational decision-making in a highly regulated, fast-growing pharmacy environment.

United States Full-time Lead Data Engineer
AWS Git Python REST API Serverless Snowflake SQL
21 hours, 26 minutes ago
ENSCO, Inc.

Data Engineer III

ENSCO, Inc. 501-1000 information technology & services

ENSCO is seeking a Data Scientist/Engineer to join its Machine Learning Data team in Seismic and Acoustics, supporting the engineering and analysis of acoustic sensor data for machine learning and operational analytics applications.

United States Full-time Mid Level Data Engineer
$74k-$131k
Apache Spark AWS Azure CI/CD CloudFormation Docker GCP Git GitHub GitLab Jenkins Kafka Kubernetes Machine Learning MLOps MQTT Python RabbitMQ SQL Terraform
21 hours, 56 minutes ago
Livefront

Data Engineer (Databricks)

Livefront 11-50 Internet Software & Services

Livefront is seeking a senior Databricks Data Engineer to join its data practice and build the data and AI foundations behind client digital products and intelligent experiences, with the opportunity to work remotely in Peru.

Peru Full-time Senior Data Engineer
Apache Spark AWS Azure CI/CD Databricks dbt GCP Git GitHub Go Java Kafka MLflow MLOps Python Scala SQL
21 hours, 56 minutes ago
S

Senior Data Engineer Interviewer

Sedona Digital IT Services and IT Consulting

Sedona Digital is hiring a part-time Senior Data Engineer in Romania or Serbia to conduct structured technical interviews for senior data engineering candidates and help evaluate their practical and architectural expertise.

Serbia Romania Contract Lead Data Engineer Training Specialist
Apache Airflow Apache Spark AWS Azure CI/CD Databricks dbt GCP Python Snowflake SQL
22 hours, 11 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers