Data Platform Engineer (GCP)

5 hours, 26 minutes ago
Mid Level
Software Development
Innodata

Innodata

Innodata Inc. is a global leader in data engineering, offering end-to-end AI solutions and platforms for businesses worldwide, combining AI and human expertise to solve complex data challenges.

IT Services
1K-5K
Founded 1988

Description

  • Support and maintain production GCP data platforms, pipelines, and workflows across batch and streaming workloads.
  • Troubleshoot Cloud Composer/Apache Airflow DAG failures, dependencies, scheduling issues, retries, and SLA or data-latency problems.
  • Optimize orchestration workflows to improve reliability, execution time, recoverability, and operational efficiency.
  • Diagnose pipeline failures, data latency, performance degradation, configuration issues, and infrastructure-related problems.
  • Work with Cloud Spanner, BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Monitoring and Logging, IAM, and related GCP services.
  • Monitor platform health and proactively improve reliability, scalability, performance, and stability.
  • Perform root-cause analysis for recurring production issues and implement sustainable fixes.
  • Support access controls, monitoring, alerting, logging, and operational governance.
  • Collaborate with client and cross-functional engineering teams on production issues and enhancements.
  • Create and maintain technical documentation, runbooks, troubleshooting guides, and support procedures.

Requirements

  • 3-7 years of experience in Data Engineering, Cloud Engineering, Platform Engineering, or a related role.
  • Strong hands-on experience supporting production workloads on Google Cloud Platform (GCP).
  • Strong experience with BigQuery and Cloud Spanner.
  • Hands-on experience with Dataflow, Pub/Sub, batch/streaming pipelines, and Cloud Composer/Apache Airflow.
  • Strong Python and SQL skills.
  • Good understanding of GCP IAM, service accounts, permissions, monitoring, logging, alerting, and production operations.
  • Experience troubleshooting complex production environments and performing root-cause analysis.
  • Understanding of data ingestion, transformation, orchestration, data quality, performance optimization, and reliability.
  • Ability to quickly understand existing systems, codebases, pipelines, configurations, and client-specific tools and workflows.
  • Strong communication and collaboration skills across engineering and business teams.
  • Preferred: experience supporting large-scale, business-critical data platforms with high availability, reliability, and data-freshness requirements.
  • Preferred: experience with App Engine and other GCP-hosted applications.
  • Preferred: experience with Cloud Run, GKE, or other GCP application services.
  • Preferred: experience with CI/CD and DevOps practices on GCP.
  • Preferred: Infrastructure as Code experience, particularly Terraform.
  • Preferred: experience with data observability and automated data-quality monitoring.
  • Preferred: experience supporting AI/ML, GenAI, or LLM-based applications on GCP, including Vertex AI.
  • Preferred: ability to quickly learn enterprise-specific analytics, engineering, and operational tooling.

Benefits

  • Expected salary range of $80,000 - $150,000 CAD per year, based on experience, skills, and qualifications.
  • Opportunity to work on large-scale production data platforms in a global AI/data engineering company.
  • Work within an environment focused on operational reliability and continuous improvement.
  • Exposure to enterprise GCP systems and complex production environments.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Software Engineer - Crawler

ZoomInfo 1K-5K Professional Services

ZoomInfo is hiring a Senior Software Engineer to help build its large-scale web crawling and data extraction infrastructure for the Web Data team.

Apache Airflow AWS GCP HTML Java Kafka Kubernetes LLM Python Snowflake Terraform Trino Vertex AI
5 hours, 41 minutes ago

Senior Data Engineer

Kunai 51-250 Professional Services

Kunai is seeking a Senior Data Engineer to help modernize and scale financial services platforms by building data pipelines and systems for high-volume transactional and operational data.

Apache Spark AWS Cassandra CI/CD CloudFormation Docker Kubernetes Python Serverless Terraform
5 hours, 41 minutes ago

Staff Data Engineer - Integrations

Dragos 251-1K Professional Services

Dragos is hiring a remote-first Data Engineer to work on data pipeline and structure design for critical-infrastructure cybersecurity products.

Cybersecurity Docker Go Kubernetes Node.js Python SIEM Splunk
5 hours, 56 minutes ago

Senior Data Engineer - Product

Feedzai 251-1K Diversified Financial Services

Feedzai is hiring a Senior Data Engineer to design, build, and operate the core data platform that powers its AI-driven financial crime detection products.

Apache Airflow Apache Spark AWS CI/CD Java Jupyter Kafka Kubernetes Linux Machine Learning Microservices Python Snowflake Trino
5 hours, 56 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers