RemoteLeaf Logo
Log in Sign up

Data Engineer (Mid Level)-Orbit

3 hours, 53 minutes ago
India
Full-time
Mid Level
Data Engineer
DevOps and Infrastructure
Apache Airflow Apache Spark AWS Azure CI/CD Databricks Encryption GCP Git Power BI Python SQL
Apply Now
Irth

Irth

Irth Solutions is a leading provider of SaaS cloud-based asset protection solutions that focus on damage prevention, risk analysis, and network infrastructure resilience. With nearly three decades of experience, Irth Solutions offers a wide range of fe...

Diversified Telecommunication Services
51-250
Founded 1985
View All Jobs 3

Description

  • Build and maintain batch and streaming ingestion pipelines across AWS, Azure, and GCP.
  • Develop Bronze-to-Silver-to-Gold medallion architecture solutions using Databricks, Spark, PySpark, SQL, Delta Live Tables, and Lakeflow.
  • Implement CDC, SCD Type 1 and Type 2, schema evolution, validation, reconciliation, and data-quality rules.
  • Configure and optimize Delta Lake tables, schemas, partitions, and storage using OPTIMIZE, Z-ORDER, and VACUUM.
  • Implement metadata, cataloging, lineage, RBAC, security controls, and classification using Unity Catalog and Microsoft Purview.
  • Build, schedule, monitor, and troubleshoot production workflows using Databricks Workflows, Delta Live Tables, Azure Data Factory, and other orchestration tools.
  • Contribute to Git-based CI/CD, automated testing, deployment, and DEV-to-QA-to-PROD promotion processes.
  • Tune Spark jobs, SQL workloads, Delta tables, and pipelines for reliability, scalability, and cost efficiency.
  • Collaborate with architects, data scientists, ML engineers, analysts, product teams, and engineering stakeholders.
  • Document pipelines, data flows, transformation logic, quality rules, test cases, schedules, and operational procedures.

Requirements

  • 3–5 years of experience in data engineering, ETL development, or cloud data-platform engineering.
  • Hands-on experience with Databricks, Apache Spark, PySpark, or distributed data-processing technologies.
  • Strong SQL proficiency, including transformations, joins, aggregations, and performance-aware query development.
  • Experience with at least one major cloud platform; Microsoft Azure is preferred, with AWS or GCP also valuable.
  • Understanding of data modeling, data quality, schema evolution, validation, monitoring, and troubleshooting.
  • Basic knowledge of RBAC, encryption, credential and secret management, and secure cloud-resource access.
  • Working knowledge of Delta Lake, medallion architecture, and modern lakehouse practices.
  • Experience with Unity Catalog, Microsoft Purview, AWS Glue Data Catalog, or similar governance tools.
  • Experience with orchestration tools such as Azure Data Factory, Databricks Workflows, Airflow, or DBX, plus Git, CI/CD, and DevOps practices.
  • Preferred experience with GIS, Power BI semantic layers, AI/ML data preparation, relevant certifications, or asset-integrity and utility/pipeline data.

Benefits

  • Competitive compensation based on experience and qualifications.
  • Health insurance coverage.
  • Remote work from India.
  • Opportunity to work at a growing, established industry company.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Apryse

Director, Data Platforms and Operations

Apryse 251-1K Internet Software & Services

Apryse is seeking a Director of Data Platform & Operations to lead its data engineering, governance, and BI/analytics functions while building the trusted data foundation for business reporting and Glean-powered AI tools.

United States Full-time Executive Data Architect Data Engineer
$110k-$160k
Apache Spark AWS Azure Databricks NetSuite Power BI Python Salesforce SQL Tableau
3 hours, 23 minutes ago
Cloudbeds

Tech Lead Data Engineer

Cloudbeds 251-1K Internet Software & Services

Cloudbeds is seeking a Tech Lead Data Engineer & Data Architect to shape the architecture, governance, reliability, and AI readiness of its fully remote, Snowflake-based analytics platform serving hospitality operations worldwide.

Canada Latin America Full-time Lead Data Architect Data Engineer
Agile Apache Airflow CI/CD Dagster dbt Git JIRA MLOps Prefect Python Snowflake SQL
3 hours, 38 minutes ago
Cloudbeds

Tech Lead Data Engineer

Cloudbeds 251-1K Internet Software & Services

Cloudbeds is seeking a Tech Lead Data Engineer & Data Architect to define the architecture, governance, and engineering practices for its fully remote, Snowflake-based analytics platform supporting hospitality operations worldwide.

Canada Full-time Lead Data Architect Data Engineer
Agile Apache Airflow CI/CD Dagster dbt Git JIRA Machine Learning MLOps Prefect Python Snowflake SQL
3 hours, 38 minutes ago
Cloudbeds

Tech Lead Data Engineer

Cloudbeds 251-1K Internet Software & Services

Cloudbeds is seeking a hands-on Tech Lead Data Engineer & Data Architect to set the technical direction, governance, and AI-readiness of its fully remote Snowflake-based analytics platform supporting hospitality operations worldwide.

Latin America Mexico Chile Costa Rica Ecuador Honduras Peru Full-time Lead Data Architect Data Engineer
Agile Apache Airflow CI/CD Dagster dbt Git JIRA Prefect Python Snowflake
3 hours, 38 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers