RemoteLeaf Logo
Log in Sign up

GCP Data Engineer- Senior Consultant

3 weeks ago
India
Full-time
Lead
Data Engineer
Data Science and Analytics
Apache Airflow GCP Python SQL
Apply Now
Lingaro

Lingaro

Lingaro Group is a leading end-to-end data services partner specializing in Business Intelligence and Data Warehouse solutions. With a focus on digital transformation, Lingaro provides technology-enabled solutions to Fortune 500 enterprises and global ...

IT Services
5K-10K
Founded 2008
View All Jobs 82

Description

  • Model data from multiple sources and technologies.
  • Troubleshoot and support complex, high-impact data issues.
  • Design and optimize data storage architectures, including data lakes, data warehouses, and distributed file systems.
  • Implement storage optimization techniques such as partitioning, compression, and indexing.
  • Identify and resolve bottlenecks, tune queries, and implement caching strategies to improve data retrieval and system efficiency.
  • Diagnose and resolve issues related to data processing, storage, and infrastructure.
  • Monitor system performance, identify anomalies, and perform root cause analysis to ensure uninterrupted operations.
  • Design, build, and deploy cloud data pipelines to ingest data from databases, APIs, and streaming platforms.
  • Implement data quality checks and support data integration and transformation workflows.
  • Train and mentor junior data engineers and provide knowledge transfer.

Requirements

  • At least 9+ years of experience as a data engineer.
  • Strong hands-on experience with Python, SQL, object-oriented programming, and GCP.
  • Experience with BigQuery is a must.
  • Strong knowledge of cloud computing platforms, especially Google Cloud.
  • Experience building cloud-based data pipelines to ingest data from multiple sources.
  • Experience with Composer or Apache Airflow is a plus.
  • Knowledge of Dataplex is a plus.
  • Experience implementing data quality checks using frameworks such as CloudDQ or PyDeequ.
  • Good knowledge of data quality dimensions.
  • Experience with GCP cloud-based infrastructure and systems.
  • Proficiency in data modeling techniques and database optimization.
  • Knowledge of query optimization, indexing, and performance tuning.
  • Proficiency with SQL and NoSQL database management systems.
  • Experience designing, configuring, and managing databases for performance and reliability.
  • Experience with ETL and ELT data integration techniques.

Benefits

  • Stable employment with a company on the market since 2008.
  • Remote work or office work available under an “office as an option” model.
  • Flexible working hours and flexibility in contract type.
  • Comprehensive online onboarding with a Buddy from day one.
  • Unlimited access to the Udemy learning platform from day one.
  • Certificate training programs and support for earning technology certifications.
  • Upskilling support through capability development programs, competency centers, knowledge sharing sessions, and community webinars.
  • Access to an internal Gallup Certified Strengths Coach for growth support.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Galaxy

Head of Market Data

Galaxy 251-1K Capital Markets

Galaxy is hiring a Head of Market Data to lead the acquisition, governance, and optimization of market data supporting trading, research, risk, and related systems across digital and traditional assets.

United Kingdom Full-time Lead Data Engineer Operations Manager
Generative AI
16 minutes ago
NEORIS

Senior Data Engineer

NEORIS 5K-10K Internet Software & Services

NEORIS, del grupo EPAM, busca un Senior Data Engineer para diseñar y operar soluciones de datos en entornos cloud y apoyar proyectos de modernización y escalado de arquitecturas de datos.

Spain Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Azure CI/CD CloudFormation dbt Docker FastAPI GCP Git Linux Microservices Pandas Python REST API Snowflake SQL Terraform
16 minutes ago
SecurityScorecard

Staff Data Engineer

SecurityScorecard 251-1K IT Services

SecurityScorecard is hiring a Staff Engineer for its Data Engineering team to lead high-scale Scala and Spark-based data infrastructure that powers its cybersecurity ratings platform.

Canada Latin America Full-time Lead Data Engineer
$104k-$118k
Apache Airflow Apache Spark AWS ClickHouse Cybersecurity Docker Git Hive Jenkins JSON Kafka Microservices PostgreSQL Python Redis Scala System Design Terraform XML
1 hour, 16 minutes ago
Valtech

Senior Google Cloud Data Engineer

Valtech 5K-10K Professional Services

Valtech is seeking a Senior Data Engineer to build and support cloud-based data pipelines and analytics solutions for digital marketing and customer experience data.

Brazil Senior Data Engineer
Agile Apache Pig Apache Spark CI/CD dbt GCP Google Ads GraphQL Hive Impala Looker Microservices Python REST API SQL Terraform
1 hour, 16 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers