RemoteLeaf Logo
Log in Sign up

Lead Data Engineer

2 months ago
Anywhere
Full-time
Lead
Data Engineer
Software Development
Apache Spark CI/CD GCP GitHub Actions Salesforce Snowflake Terraform
Apply Now
Egen.ai

Egen.ai

Egen.ai specializes in providing technology services that leverage cloud computing, data analytics, and artificial intelligence to enhance document intelligence and drive productivity and growth for its clients.

IT Services
Founded 2000
View All Jobs 13

Description

  • Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone.
  • Design and build unified batch and streaming pipelines for high-volume, mission-critical workloads.
  • Lead infrastructure-as-code practices to keep environments repeatable, secure, and version-controlled.
  • Implement open table formats to support cross-cloud and cross-engine data interoperability.
  • Establish automated data quality, metadata, and lineage practices across the data estate.
  • Partner with data scientists, analysts, and product teams to translate business needs into reliable data products.
  • Mentor engineers, review designs, and raise engineering standards.
  • Drive the technical direction for open, interoperable data architectures.

Requirements

  • 7+ years of experience in data engineering.
  • At least 2 years of experience in a lead or senior individual contributor role on Google Cloud-based platforms.
  • Advanced knowledge of BigQuery architecture, including partitioning, clustering, slot management, storage optimization, and query execution tuning.
  • Strong hands-on experience building unified streaming and batch pipelines using Dataflow (Apache Beam), Dataproc, and Pub/Sub.
  • Production experience developing and managing cloud infrastructure with Terraform.
  • Working knowledge of Apache Iceberg and its role in enabling cloud and engine interoperability across BigQuery, Spark, and Snowflake.
  • Experience with Dataplex and Data Catalog for automated data quality checks, metadata tagging, and column-level lineage from source to destination.
  • Experience leading or mentoring data engineering teams (preferred).
  • Familiarity with CI/CD for data pipelines, such as Cloud Build or GitHub Actions (preferred).
  • Exposure to multi-cloud or hybrid data architectures (preferred).
  • Background in regulated industries such as healthcare or financial services where governance and lineage are critical (preferred).

Benefits

  • Competitive salary range of $143,400 to $168,650 per year.
  • Comprehensive health insurance.
  • Paid leave, including vacation/PTO.
  • Paid holidays.
  • Sick leave.
  • Parental leave.
  • Bereavement leave.
  • 401(k) employer match.
  • Employee referral bonuses.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Mindrift.ai: Be the “I” in AI

Senior Python Data Scraping Engineer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a freelance, part-time Senior Python Data Scraping Engineer for the Tendem project to build and maintain specialized web data extraction workflows for real-world applications.

France Part-time Senior Backend Engineer Data Engineer
Up to $0k
AJAX AWS Docker GitHub JavaScript JSON Python Selenium
13 hours, 25 minutes ago
phData

Senior Data Engineer

phData 251-1K IT Services

phData is hiring a Data Engineer in India to design and deliver secure, scalable cloud data solutions for enterprise clients as part of its remote-first consulting team.

India Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Azure Cassandra Databricks dbt Elasticsearch GCP Hadoop HDFS Kafka Luigi Python Scala Snowflake Solr SQL
1 day, 12 hours ago
Figma

Manager, Software Engineering - Data Platform

Figma 1K-5K Internet Software & Services

Figma is hiring a Data Platform engineering leader to scale the systems that power core business metrics, product analytics, and applied AI and experimentation across the company.

United States Full-time Lead Data Engineer Engineering Manager
$258k-$376k
Machine Learning
1 day, 12 hours ago
Natera

Lead Bioinformatician/Engineer (Pipelines and Infrastructure)

Natera 1K-5K Pharmaceuticals

Natera is hiring a Lead Bioinformatics Engineer to own pipeline and infrastructure engineering for a research informatics team developing cfDNA screening workflows in women’s and organ health.

United States Full-time Senior Data Engineer
$131k-$164k
AWS Git Linux Python Terraform
1 day, 12 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers