RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

2 months, 1 week ago
India
Full-time
Senior
Data Engineer
Software Development
Apache Spark Azure CI/CD ClickHouse Databricks Feature Engineering Generative AI Python SQL Terraform
Apply Now
Resil

Resil

Resil specializes in providing AI-powered supply chain risk management solutions that enable organizations to detect threats in real time and take proactive measures to enhance supply chain resiliency.

Internet Software & Services
251-1K
Founded 2010
View All Jobs 9

Description

  • Partner with enterprise customers and business stakeholders to understand data challenges and define requirements.
  • Own technical delivery from discovery and solution design through implementation and adoption.
  • Design, build, and maintain scalable batch and real-time data pipelines and data products.
  • Architect cloud-native data platforms using Databricks, Delta Lake, Azure Data Services, and distributed processing technologies.
  • Develop ETL/ELT frameworks, data models, and data quality monitoring processes.
  • Optimize storage, query performance, scalability, reliability, and cost efficiency across large datasets.
  • Build data products that support analytics, reporting, operational workflows, and AI/ML applications.
  • Collaborate with Product, Engineering, Solutions Consulting, and Customer Success to deliver customer outcomes.
  • Drive best practices in data governance, security, observability, reliability, and operational excellence.
  • Mentor junior engineers and contribute to engineering best practices and architecture decisions.

Requirements

  • BE/MS in Computer Science, Information Technology, Engineering, or a related field.
  • 5+ years of experience in data engineering, data platform development, or related disciplines.
  • Strong experience with Databricks, Apache Spark, Delta Lake, or similar distributed data processing technologies.
  • Experience with cloud-based data platforms and services, including Azure (preferred) or equivalent cloud ecosystems.
  • Experience designing and operating analytical data platforms using ClickHouse or similar high-performance analytical databases.
  • Advanced proficiency in Python and SQL, with strong software engineering fundamentals.
  • Experience building scalable ETL/ELT pipelines, orchestration workflows, and modern data architectures.
  • Strong understanding of data modeling, data warehousing, and analytics platform design.
  • Experience implementing CI/CD, infrastructure automation, and DevOps practices for data platforms.
  • Excellent communication and stakeholder management skills, with the ability to translate business requirements into technical solutions.
  • Ability to navigate ambiguity, drive outcomes independently, and succeed in customer-facing environments.
  • Experience in a Forward Deployed Engineer, Solutions Engineer, Solutions Architect, Technical Consultant, or other customer-facing engineering role (preferred).
  • Experience working with Supply Chain, Logistics, Manufacturing, or Enterprise SaaS platforms (preferred).
  • Familiarity with data governance, lineage, metadata management, and data catalog solutions (preferred).
  • Experience with Infrastructure as Code tools such as Terraform (preferred).
  • Exposure to AI/ML platforms, feature engineering pipelines, and data infrastructure supporting Generative AI applications (preferred).
  • Experience designing and operating real-time data processing systems and streaming architectures (preferred).

Benefits

  • Fully remote work with opportunities to connect in person.
  • Full-stack benefits for health, wealth, and wellbeing.
  • A culture centered on ownership, purpose, and technical growth.
  • A voice in shaping impactful technology.
  • Equal opportunity employer status.
  • Support for applicants with disabilities during the application process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

RevStar

Databricks Engineer

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, US-based Databricks Engineer to build and optimize cloud-agnostic Lakehouse data pipelines and MLOps frameworks for enterprise AI projects across AWS, Azure, and GCP.

United States Mexico Argentina Brazil Chile Colombia Venezuela Contract Mid Level Data Engineer
Agile Apache Airflow Apache Spark AWS Azure CI/CD Databricks Feature Engineering HIPAA Kafka MLflow MLOps Prefect Python SQL Terraform
5 hours, 33 minutes ago
phData

Senior Data Engineer

phData 251-1K IT Services

Data Engineer at phData, a remote-first global data and AI consultancy, designing and delivering secure, scalable cloud data solutions for enterprise clients.

India Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS Azure Cassandra Databricks dbt Elasticsearch GCP Hadoop HDFS Kafka Luigi Python REST API Scala Snowflake Solr SQL System Design
1 day, 5 hours ago
Abacus Insights

Forward Deployed Data Engineer

Abacus Insights 51-250 Insurance

Abacus Insights is hiring a Forward Deployed Data Engineer to work alongside health plan clients, building governed data foundations, pipelines, and integrations that turn fragmented payer data into analytics-ready products.

United States Full-time Senior Data Engineer
Apache Spark Databricks Snowflake SQL
1 day, 5 hours ago
Azumo

Data Engineer

Azumo 51-250 Internet Software & Services

Azumo is hiring a fully remote Latin America-based Data Engineer to build and operate production ingestion, transformation, storage, warehouse, and retrieval infrastructure that supports client AI systems.

Mexico Argentina Brazil Chile Colombia Peru Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Azure CI/CD Dagster Databricks dbt Docker Flink GCP Git GitHub Actions HIPAA Jupyter Kafka Prefect Python Snowflake SQL Terraform
1 day, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers