Egen.ai

Egen.ai

Egen.ai specializes in providing technology services that leverage cloud computing, data analytics, and artificial intelligence to enhance document intelligence and drive productivity and growth for its clients.

IT Services
Founded 2000

Description

  • Architect and optimize large-scale data platforms on Google Cloud, with BigQuery as the analytical backbone.
  • Design and build unified batch and streaming pipelines for high-volume, mission-critical workloads.
  • Lead infrastructure-as-code practices to keep environments repeatable, secure, and version-controlled.
  • Implement open table formats to support cross-cloud and cross-engine data interoperability.
  • Establish automated data quality, metadata, and lineage practices across the data estate.
  • Partner with data scientists, analysts, and product teams to translate business needs into reliable data products.
  • Mentor engineers, review designs, and raise engineering standards.
  • Drive the technical direction for open, interoperable data architectures.

Requirements

  • 7+ years of experience in data engineering.
  • At least 2 years of experience in a lead or senior individual contributor role on Google Cloud-based platforms.
  • Advanced knowledge of BigQuery architecture, including partitioning, clustering, slot management, storage optimization, and query execution tuning.
  • Strong hands-on experience building unified streaming and batch pipelines using Dataflow (Apache Beam), Dataproc, and Pub/Sub.
  • Production experience developing and managing cloud infrastructure with Terraform.
  • Working knowledge of Apache Iceberg and its role in enabling cloud and engine interoperability across BigQuery, Spark, and Snowflake.
  • Experience with Dataplex and Data Catalog for automated data quality checks, metadata tagging, and column-level lineage from source to destination.
  • Experience leading or mentoring data engineering teams (preferred).
  • Familiarity with CI/CD for data pipelines, such as Cloud Build or GitHub Actions (preferred).
  • Exposure to multi-cloud or hybrid data architectures (preferred).
  • Background in regulated industries such as healthcare or financial services where governance and lineage are critical (preferred).

Benefits

  • Competitive salary range of $143,400 to $168,650 per year.
  • Comprehensive health insurance.
  • Paid leave, including vacation/PTO.
  • Paid holidays.
  • Sick leave.
  • Parental leave.
  • Bereavement leave.
  • 401(k) employer match.
  • Employee referral bonuses.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lead Data Platform Engineer

PR Newswire 1K-5K Internet Software & Services

INFOnline, part of saas.group, is seeking a Lead Data Platform Engineer to own and evolve its GCP-native data platform that powers digital audience measurement for the German and Austrian media industry.

CI/CD dbt Docker GCP Go Serverless SQL Terraform
20 hours, 58 minutes ago

OFSAA - Basel Technical Consultant

Unison Group Technology consulting

An experienced OFSAA Basel Technical Consultant is needed to design, develop, and support Basel regulatory reporting solutions for Oracle Financial Services Analytical Applications at a banking environment.

21 hours, 13 minutes ago

Data Engineer for AI Product

Qonto 1K-5K Banks

Qonto is hiring a Data Engineer for AI Product to build the data layer and production infrastructure that powers machine learning products for its finance workspace serving SMEs across Europe.

Apache Airflow Apache Spark CI/CD dbt Machine Learning Python
21 hours, 28 minutes ago

Senior Azure Data Consultant

Trility Consulting 51-250 Internet Software & Services

Trility Consulting is hiring a Senior Azure Data Consultant to work remotely with U.S. clients and lead data architecture and engineering efforts from initial discovery through production delivery.

Agile Azure CI/CD Databricks SQL
21 hours, 28 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers