Data Engineer

1 hour, 17 minutes ago
Full-time
Mid Level
Software Development
Egen.ai

Egen.ai

Egen.ai specializes in providing technology services that leverage cloud computing, data analytics, and artificial intelligence to enhance document intelligence and drive productivity and growth for its clients.

IT Services
Founded 2000

Description

  • Design, develop, and deploy large-scale batch and streaming data processing pipelines.
  • Build data pipelines using technologies such as Dataflow, Apache Beam, Spark, Akka, and Pub/Sub.
  • Work with stakeholders to understand business problems and translate them into technical solutions.
  • Design appropriate data schemas based on domain understanding.
  • Manage data lineage and help ensure data security using appropriate tools and methodologies.
  • Collaborate with data scientists, architects, and other stakeholders to align technical work with business strategy.
  • Monitor, refine, and report on the performance of data management systems.
  • Mentor junior data engineers and review their work.
  • Support data storage and processing needs across technologies such as Bigtable/HBase, BigQuery, Spanner, and Cloud SQL/Postgres.

Requirements

  • 2-5 years of experience in data engineering, with a focus on designing and developing data pipelines.
  • Proven expertise with Dataflow, Apache Beam, Spark, Akka, and Pub/Sub.
  • Experience with data storage technologies such as Bigtable/HBase, BigQuery, Spanner, and Cloud SQL/Postgres.
  • Ability to design data schemas based on an understanding of the domain problem.
  • Experience with data security and data lineage methodologies and tools is preferred.
  • Familiarity with agile development methodologies.
  • Exceptional communication skills and the ability to explain complex technical concepts clearly.
  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent work experience.
  • Nice to have: experience with data migration projects.
  • Nice to have: knowledge of dbt, Airflow, or similar orchestration tools, multi-cloud environments, and data modeling or analytics use cases.

Benefits

  • Competitive salary of $76,500 - $105,300 per year.
  • Comprehensive health insurance.
  • Paid leave, including vacation/PTO.
  • Paid holidays.
  • Sick leave.
  • Parental leave.
  • Bereavement leave.
  • 401(k) employer match.
  • Employee referral bonuses.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer

Age of Learning 251-1K Internet Software & Services

Age of Learning is seeking a Senior Data Engineer to lead its Data and Analytics platform, ensuring trusted data systems that support education products and cross-functional decision-making.

dbt Python Snowflake SQL
3 hours, 26 minutes ago

Oracle Data Engineer (with German Language)

Soname Solutions 11-50 Internet Software & Services

Soname Solutions is seeking a Senior Data Warehouse Developer to support a German telecom client by designing, optimizing, and evolving its multi-layer data warehouse environment.

Oracle PostgreSQL Power BI SQL
5 hours, 13 minutes ago

Data Engineer II

Samsara 1K-5K IT Services

Samsara is hiring a remote Data Engineer II to build and scale the Databricks-based data platforms that power its Revenue Operations AI and data infrastructure for GTM analytics and generative AI applications.

Apache Spark AWS Databricks dbt Generative AI Machine Learning Python Salesforce Snowflake SQL
7 hours, 33 minutes ago

Synthetic Data Engineer (AI Data/Training)

Hyphen Connect 1-10 staffing & recruiting

A Synthetic Data Engineer at the organization will design and manage domain-specific synthetic data pipelines that support data processing and model training workflows.

Apache Airflow Apache Spark
8 hours, 10 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers