RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

1 month, 3 weeks ago
India
Full-time
Senior
Data Engineer
Software Development
Apache Spark Azure CI/CD ClickHouse Databricks Feature Engineering Generative AI Python SQL Terraform
Apply Now
Resil

Resil

Resil specializes in providing AI-powered supply chain risk management solutions that enable organizations to detect threats in real time and take proactive measures to enhance supply chain resiliency.

Internet Software & Services
251-1K
Founded 2010
View All Jobs 10

Description

  • Partner with enterprise customers and business stakeholders to understand data challenges and define requirements.
  • Own technical delivery from discovery and solution design through implementation and adoption.
  • Design, build, and maintain scalable batch and real-time data pipelines and data products.
  • Architect cloud-native data platforms using Databricks, Delta Lake, Azure Data Services, and distributed processing technologies.
  • Develop ETL/ELT frameworks, data models, and data quality monitoring processes.
  • Optimize storage, query performance, scalability, reliability, and cost efficiency across large datasets.
  • Build data products that support analytics, reporting, operational workflows, and AI/ML applications.
  • Collaborate with Product, Engineering, Solutions Consulting, and Customer Success to deliver customer outcomes.
  • Drive best practices in data governance, security, observability, reliability, and operational excellence.
  • Mentor junior engineers and contribute to engineering best practices and architecture decisions.

Requirements

  • BE/MS in Computer Science, Information Technology, Engineering, or a related field.
  • 5+ years of experience in data engineering, data platform development, or related disciplines.
  • Strong experience with Databricks, Apache Spark, Delta Lake, or similar distributed data processing technologies.
  • Experience with cloud-based data platforms and services, including Azure (preferred) or equivalent cloud ecosystems.
  • Experience designing and operating analytical data platforms using ClickHouse or similar high-performance analytical databases.
  • Advanced proficiency in Python and SQL, with strong software engineering fundamentals.
  • Experience building scalable ETL/ELT pipelines, orchestration workflows, and modern data architectures.
  • Strong understanding of data modeling, data warehousing, and analytics platform design.
  • Experience implementing CI/CD, infrastructure automation, and DevOps practices for data platforms.
  • Excellent communication and stakeholder management skills, with the ability to translate business requirements into technical solutions.
  • Ability to navigate ambiguity, drive outcomes independently, and succeed in customer-facing environments.
  • Experience in a Forward Deployed Engineer, Solutions Engineer, Solutions Architect, Technical Consultant, or other customer-facing engineering role (preferred).
  • Experience working with Supply Chain, Logistics, Manufacturing, or Enterprise SaaS platforms (preferred).
  • Familiarity with data governance, lineage, metadata management, and data catalog solutions (preferred).
  • Experience with Infrastructure as Code tools such as Terraform (preferred).
  • Exposure to AI/ML platforms, feature engineering pipelines, and data infrastructure supporting Generative AI applications (preferred).
  • Experience designing and operating real-time data processing systems and streaming architectures (preferred).

Benefits

  • Fully remote work with opportunities to connect in person.
  • Full-stack benefits for health, wealth, and wellbeing.
  • A culture centered on ownership, purpose, and technical growth.
  • A voice in shaping impactful technology.
  • Equal opportunity employer status.
  • Support for applicants with disabilities during the application process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

CI&T

[Job-31682] Senior Data Engineer [Databricks]

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa engenheira de dados para estruturar e acelerar a plataforma de dados de um grande varejista farmacêutico brasileiro, modernizando a orquestração, a qualidade dos dados e a distribuição de produtos baseados em Databricks.

Brazil Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Databricks SFTP Terraform
9 minutes ago
payabl.

Data Engineer

payabl. 51-250 Diversified Financial Services

As a Data Engineer at payabl., you will build and maintain reliable data pipelines and business-ready datasets that support analytics and decision-making across the company’s global payments platform.

Cyprus Poland Portugal Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS ClickHouse Dagster Databricks dbt Docker Git Kafka Kubernetes MariaDB MongoDB MySQL PostgreSQL Power BI Python Snowflake SQL Tableau Terraform
9 minutes ago
Terrific

Product Engineer — Monetization & Commerce Data

Terrific 1-10 Internet Software & Services

Terrific is hiring a remote Product Engineer in Europe to define and build its monetization and commerce-data platform for retailer and publisher advertising, turning first-party shopper interactions into measurable revenue.

Europe Contract Senior Data Engineer Full-stack Engineer
E-commerce GCP Node.js SQL TypeScript
9 minutes ago
CI&T

[Job-31419] Mid-level Data Developer, Colombia

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Data Developer to build and maintain ingestion pipelines into OneLake for ATL Technology’s Foundation Pod across multiple enterprise source systems, supporting the Data Engineer Lead.

Colombia Full-time Mid Level Data Engineer
Apache Spark CI/CD Databricks Python SQL
9 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers