Zencore Group

Zencore Group

Zencore Group, LLC is a premier consulting firm founded by former senior Google Cloud engineers, offering expert solutions in Google Cloud Technology and Tools for businesses seeking managed services, cloud migrations, and smart analytics.

Internet Software & Services
11-50
Founded 2021

Description

  • Design, build, and optimize large-scale distributed data pipelines using Apache Beam, Google Cloud Dataflow, Apache Spark, or Apache Flink.
  • Develop ETL and ELT workflows on Google Cloud Platform that integrate structured and unstructured data sources.
  • Address schema, type conversion, and performance challenges when migrating data warehouses to BigQuery.
  • Implement observability, monitoring, logging, and error handling within data pipelines.
  • Collaborate with data analysts to add validation rules, QA checks, and automated testing to the pipeline lifecycle.
  • Support large-scale data migrations and tune performance for high-volume workloads.
  • Provide trusted-advisor guidance to customer teams during cloud data modernization engagements.

Requirements

  • 4+ years of experience as a Data Engineer in modern cloud environments.
  • 2+ years of hands-on experience with Google Cloud Platform.
  • Experience with GCP services such as BigQuery, Dataflow, Dataform, Composer, Dataproc, and Pub/Sub.
  • Strong experience with at least one distributed data processing framework, such as Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink.
  • Proficiency in Python for pipeline development.
  • Proficiency in SQL, with Oracle and BigQuery dialects preferred.
  • Experience with Apache Airflow or similar orchestration tools.
  • Experience with big data workloads, batch and streaming pipelines, and large-scale data migrations.
  • Experience with data warehousing platforms such as BigQuery, with Snowflake or Databricks as a plus.
  • Familiarity with CI/CD, MLOps, or data quality frameworks is an advantage.

Benefits

  • Fully remote work environment.
  • Competitive compensation.
  • Competitive benefits package.
  • Opportunity to work with former Google Cloud leaders and engineers.
  • Equal opportunity employer committed to diversity and inclusion.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is seeking a Data Engineer to design and maintain cloud data pipelines and Snowflake-based analytics solutions for client projects in a fast-growing software consultancy.

Agile Apache Spark Azure CI/CD Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
13 minutes ago

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is seeking a Data Engineer to design and maintain cloud-based data pipelines and Snowflake solutions for client projects in a fast-growing software consultancy.

Agile Apache Spark Azure Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
13 minutes ago

Data Engineer (Senior) - ETL (Python+Snowflake) - Remote, Latin América

Bluelight Consulting 11-50 Internet Software & Services

Bluelight, a growing software consultancy, is hiring a data engineer to design and maintain cloud-based data pipelines and Snowflake solutions for client projects.

Agile Apache Spark Azure Git Machine Learning Power BI Python REST API Snowflake SQL Tableau Terraform
13 minutes ago

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time remote Python Data Scraping Engineer for the Tendem project to help deliver accurate, structured data through a hybrid AI + human workflow.

AJAX GitHub JavaScript JSON LLM Python Selenium
13 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers