RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

4 months, 4 weeks ago
Latin America
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark CI/CD Databricks GCP MLOps Oracle Python Snowflake SQL
Apply Now
Zencore Group

Zencore Group

Zencore Group, LLC is a premier consulting firm founded by former senior Google Cloud engineers, offering expert solutions in Google Cloud Technology and Tools for businesses seeking managed services, cloud migrations, and smart analytics.

Internet Software & Services
11-50
Founded 2021
View All Jobs 21

Description

  • Design, build, and optimize large-scale distributed data pipelines using Apache Beam, Google Cloud Dataflow, Apache Spark, or Apache Flink.
  • Develop ETL and ELT workflows on Google Cloud Platform that integrate structured and unstructured data sources.
  • Address schema, type conversion, and performance challenges when migrating data warehouses to BigQuery.
  • Implement observability, monitoring, logging, and error handling within data pipelines.
  • Collaborate with data analysts to add validation rules, QA checks, and automated testing to the pipeline lifecycle.
  • Support large-scale data migrations and tune performance for high-volume workloads.
  • Provide trusted-advisor guidance to customer teams during cloud data modernization engagements.

Requirements

  • 4+ years of experience as a Data Engineer in modern cloud environments.
  • 2+ years of hands-on experience with Google Cloud Platform.
  • Experience with GCP services such as BigQuery, Dataflow, Dataform, Composer, Dataproc, and Pub/Sub.
  • Strong experience with at least one distributed data processing framework, such as Apache Beam / Google Cloud Dataflow, Apache Spark, or Apache Flink.
  • Proficiency in Python for pipeline development.
  • Proficiency in SQL, with Oracle and BigQuery dialects preferred.
  • Experience with Apache Airflow or similar orchestration tools.
  • Experience with big data workloads, batch and streaming pipelines, and large-scale data migrations.
  • Experience with data warehousing platforms such as BigQuery, with Snowflake or Databricks as a plus.
  • Familiarity with CI/CD, MLOps, or data quality frameworks is an advantage.

Benefits

  • Fully remote work environment.
  • Competitive compensation.
  • Competitive benefits package.
  • Opportunity to work with former Google Cloud leaders and engineers.
  • Equal opportunity employer committed to diversity and inclusion.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Binance

Senior Financial AI Engineer (Data & Knowledge Engineering)

Binance 5K-10K Capital Markets

Binance is hiring an AI Data Processing and Knowledge Services Engineer to build production-grade financial data, knowledge bases, and RAG services supporting its equities business and AI products.

Hong Kong Taiwan Full-time Senior Data Engineer Machine Learning Engineer
Blockchain Java Machine Learning Python
10 hours, 15 minutes ago
Lingaro

Data Engineer GCP Mexico

Lingaro 5K-10K IT Services

Data Engineer responsible for designing, building, and deploying cloud-based data infrastructure and pipelines on GCP to support reliable data integration, transformation, and analysis.

Mexico Full-time Mid Level Cloud Engineer Data Engineer
Apache Airflow Apache Spark Azure Confluence Databricks dbt GCP Git JIRA Looker Power BI Python SQL Tableau
10 hours, 30 minutes ago
Celerion

Application & Data Integration Developer

Celerion 251-1K Pharmaceuticals

Celerion is seeking a fully remote Application & Data Integration Developer in the Central or Eastern U.S. time zones to build and support reliable integrations, data pipelines, and models connecting enterprise applications and analytics systems.

United States Full-time Mid Level Data Engineer Software Engineer
Oracle Perl Python REST API Snowflake SQL SQL Server
10 hours, 30 minutes ago
MyFitnessPal

Staff Data Engineer

MyFitnessPal 10K-50K Health Care Providers & Services

MyFitnessPal is seeking a Staff Data Engineer to lead the development and modernization of scalable data platforms, pipelines, and governance systems that power analytics, product insights, and the company’s health and fitness ecosystem.

United States Full-time Lead Data Engineer
$170k-$230k
Amplitude Apache Airflow AWS CI/CD dbt Docker DynamoDB Elasticsearch GitHub Kafka Kubernetes Microservices MongoDB MySQL PlanetScale Python Redis REST API Scala Snowflake SOAP SQL Terraform
11 hours, 15 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers