Zencore Group

Zencore Group

Zencore Group, LLC is a premier consulting firm founded by former senior Google Cloud engineers, offering expert solutions in Google Cloud Technology and Tools for businesses seeking managed services, cloud migrations, and smart analytics.

Internet Software & Services
11-50
Founded 2021

Description

  • Design, build, and optimize large-scale distributed data pipelines using Apache Beam, Google Cloud Dataflow, Apache Spark, or Apache Flink.
  • Develop ETL and ELT workflows on Google Cloud Platform that integrate structured and unstructured data sources.
  • Address schema, type conversion, and performance challenges when migrating data warehouses to BigQuery.
  • Implement observability, monitoring, logging, and error handling within data pipelines.
  • Collaborate with data analysts to add validation rules, QA checks, and automated testing to the pipeline lifecycle.
  • Support large-scale data migrations and tune performance for high-volume workloads.
  • Provide trusted-advisor guidance to customer teams during cloud data modernization engagements.

Requirements

  • 4+ years of experience as a Data Engineer in modern cloud environments.
  • 2+ years of hands-on experience with Google Cloud Platform.
  • Experience with GCP services such as BigQuery, Dataflow, Dataform, Composer, Dataproc, and Pub/Sub.
  • Strong experience with at least one distributed data processing framework, such as Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink.
  • Proficiency in Python for pipeline development.
  • Proficiency in SQL, with Oracle and BigQuery dialects preferred.
  • Experience with Apache Airflow or similar orchestration tools.
  • Experience with big data workloads, batch and streaming pipelines, and large-scale data migrations.
  • Experience with data warehousing platforms such as BigQuery, with Snowflake or Databricks as a plus.
  • Familiarity with CI/CD, MLOps, or data quality frameworks is an advantage.

Benefits

  • Fully remote work environment.
  • Competitive compensation.
  • Competitive benefits package.
  • Opportunity to work with former Google Cloud leaders and engineers.
  • Equal opportunity employer committed to diversity and inclusion.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Data Engineer

Influur 11-50 Media

Influur is hiring an AI Data Engineer in New York/remote to own the full data-to-agent pipeline behind its autonomous viral marketing system for influencer campaigns.

AWS GCP LLM Python
57 minutes ago

Data Observability Consultant - Dynatrace

Lingaro 5K-10K IT Services

Dynatrace India’s Consulting and Advisory Data Consulting Practice is hiring a remote Data Observability Consultant to support data-focused consulting work.

1 hour, 57 minutes ago

Senior Data Engineer

Lodgify 251-1K Internet Software & Services

Lodgify is hiring a Senior Data Engineer in Barcelona to build and optimize the company’s modern data platform that powers data-driven decisions across its vacation rental business.

Apache Airflow AWS Azure dbt GCP JavaScript Machine Learning Python SQL
1 hour, 57 minutes ago

Principal Java Data Engineer

PointClickCare 1K-5K Health Care Providers & Services

PointClickCare is hiring a Principal Java Data Engineer to lead the design and evolution of large-scale data platforms and pipelines in a remote or Mississauga-based healthcare technology environment.

Apache Spark AWS Azure CI/CD Databricks dbt Docker GCP HDFS Java Microservices Scrum
2 hours, 27 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers