RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

4 months ago
Latin America
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark CI/CD Databricks GCP MLOps Oracle Python Snowflake SQL
Apply Now
Zencore Group

Zencore Group

Zencore Group, LLC is a premier consulting firm founded by former senior Google Cloud engineers, offering expert solutions in Google Cloud Technology and Tools for businesses seeking managed services, cloud migrations, and smart analytics.

Internet Software & Services
11-50
Founded 2021
View All Jobs 22

Description

  • Design, build, and optimize large-scale distributed data pipelines using Apache Beam, Google Cloud Dataflow, Apache Spark, or Apache Flink.
  • Develop ETL and ELT workflows on Google Cloud Platform that integrate structured and unstructured data sources.
  • Address schema, type conversion, and performance challenges when migrating data warehouses to BigQuery.
  • Implement observability, monitoring, logging, and error handling within data pipelines.
  • Collaborate with data analysts to add validation rules, QA checks, and automated testing to the pipeline lifecycle.
  • Support large-scale data migrations and tune performance for high-volume workloads.
  • Provide trusted-advisor guidance to customer teams during cloud data modernization engagements.

Requirements

  • 4+ years of experience as a Data Engineer in modern cloud environments.
  • 2+ years of hands-on experience with Google Cloud Platform.
  • Experience with GCP services such as BigQuery, Dataflow, Dataform, Composer, Dataproc, and Pub/Sub.
  • Strong experience with at least one distributed data processing framework, such as Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink.
  • Proficiency in Python for pipeline development.
  • Proficiency in SQL, with Oracle and BigQuery dialects preferred.
  • Experience with Apache Airflow or similar orchestration tools.
  • Experience with big data workloads, batch and streaming pipelines, and large-scale data migrations.
  • Experience with data warehousing platforms such as BigQuery, with Snowflake or Databricks as a plus.
  • Familiarity with CI/CD, MLOps, or data quality frameworks is an advantage.

Benefits

  • Fully remote work environment.
  • Competitive compensation.
  • Competitive benefits package.
  • Opportunity to work with former Google Cloud leaders and engineers.
  • Equal opportunity employer committed to diversity and inclusion.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Teachable

Sr. Data Engineer

Teachable 51-250 Internet Software & Services

Teachable is hiring a Senior Data Engineering leader to guide data architecture and pipelines for a remote Brazil-based team supporting company-wide decision-making across engineering, product, finance, and business functions.

Brazil Contract Senior Data Engineer
Apache Airflow AWS dbt Kafka Terraform
10 hours, 50 minutes ago
P

SQL Developer II

Precision AQ 1001-5000 Business Consulting and Services

Precision Medicine Group is hiring a SQL Engineer II to build and support Microsoft SQL Server data solutions that power client deliverables and internal products in a collaborative healthcare access environment.

United States Full-time Mid Level Data Engineer
$75k-$95k
Azure C# CI/CD Git HTML JavaScript .NET SQL Server
11 hours, 20 minutes ago
CI&T

[Job - 30940] Sênior Data Developer (Dabricks / Azure), Brazil

CI&T 5K-10K Internet Software & Services

CI&T is hiring a Senior Data Engineer to support customer registration transformation by building and maintaining Azure-based data pipelines and data engineering solutions.

Brazil Full-time Senior Data Engineer
Apache Spark Azure CI/CD Databricks Git GitHub MLflow Python SQL
11 hours, 35 minutes ago
WISEcode

VP, Data Platform & Engineering

WISEcode 11-50 Internet Software & Services

WISEcode is hiring a VP of Data Platform & Engineering to lead its data platform, engineering operations, and governance foundation for safely shipping trustworthy food intelligence data.

United States Full-time Executive Data Engineer DevOps Engineer
PostgreSQL SQL
11 hours, 49 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers