RemoteLeaf Logo
Log in Sign up

Lead Data Engineer

3 weeks, 2 days ago
Anywhere
Full-time
Lead
Data Engineer
Software Development
Apache Spark CI/CD GCP GitHub Actions Salesforce Snowflake Terraform
Apply Now
Egen.ai

Egen.ai

Egen.ai specializes in providing technology services that leverage cloud computing, data analytics, and artificial intelligence to enhance document intelligence and drive productivity and growth for its clients.

IT Services
Founded 2000
View All Jobs 10

Description

  • Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone.
  • Design and build unified batch and streaming pipelines for high-volume, mission-critical workloads.
  • Lead infrastructure-as-code practices to keep environments repeatable, secure, and version-controlled.
  • Implement open table formats to support cross-cloud and cross-engine data interoperability.
  • Establish automated data quality, metadata, and lineage practices across the data estate.
  • Partner with data scientists, analysts, and product teams to translate business needs into reliable data products.
  • Mentor engineers, review designs, and raise engineering standards.
  • Drive the technical direction for open, interoperable data architectures.

Requirements

  • 7+ years of experience in data engineering.
  • At least 2 years of experience in a lead or senior individual contributor role on Google Cloud-based platforms.
  • Advanced knowledge of BigQuery architecture, including partitioning, clustering, slot management, storage optimization, and query execution tuning.
  • Strong hands-on experience building unified streaming and batch pipelines using Dataflow (Apache Beam), Dataproc, and Pub/Sub.
  • Production experience developing and managing cloud infrastructure with Terraform.
  • Working knowledge of Apache Iceberg and its role in enabling cloud and engine interoperability across BigQuery, Spark, and Snowflake.
  • Experience with Dataplex and Data Catalog for automated data quality checks, metadata tagging, and column-level lineage from source to destination.
  • Experience leading or mentoring data engineering teams (preferred).
  • Familiarity with CI/CD for data pipelines, such as Cloud Build or GitHub Actions (preferred).
  • Exposure to multi-cloud or hybrid data architectures (preferred).
  • Background in regulated industries such as healthcare or financial services where governance and lineage are critical (preferred).

Benefits

  • Competitive salary range of $143,400 to $168,650 per year.
  • Comprehensive health insurance.
  • Paid leave, including vacation/PTO.
  • Paid holidays.
  • Sick leave.
  • Parental leave.
  • Bereavement leave.
  • 401(k) employer match.
  • Employee referral bonuses.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Bioptimus

Clinical Data Manager (Senior)

Bioptimus 11-50 research

Bioptimus is seeking a Senior Clinical Data Manager to help structure and harmonize real-world clinical data for its STELA program and support the development of AI-ready biomedical datasets.

France Europe Full-time Senior Database Administrator Data Engineer
AWS GCP Git NumPy Pandas Python Statistics
1 hour, 6 minutes ago
Inspiren

Manager, Data/ML Platform

Inspiren 11-50 Internet Software & Services

Inspiren is seeking a Senior Manager to lead its Data + ML Platform group, building the core infrastructure that turns multimodal resident and care data into real-time insights and powers analytics, ML, and next-generation product capabilities.

United States Canada Full-time Lead Data Engineer Machine Learning Engineer
$200k-$230k
LLM Machine Learning MLOps
1 hour, 6 minutes ago
Exadel

Senior Data Engineer

Exadel 1K-5K Internet Software & Services

Exadel is hiring a Senior Data Engineer to help build and lead scalable data ingestion and curation platforms for an international transportation technology client modernizing rail operations.

Poland Lead Data Engineer
Agile Apache Airflow Apache Spark AWS Cassandra CI/CD Elasticsearch GCP Hadoop Hive Java MySQL PostgreSQL Python Scala SQL Teradata
1 hour, 21 minutes ago
AB InBev

Intermediate Data Engineer

AB InBev 100K+ Beverages

An early-career Data Engineer role focused on supporting the development, reliability, and governance of data pipelines and analytics workflows at the company.

Brazil Junior Data Engineer
Apache Spark AWS Azure CI/CD Databricks dbt GCP Git GitHub Actions JSON Python Secrets Management SQL
1 hour, 21 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers