RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

1 month ago
India
Full-time
Senior
Data Engineer
Software Development
Apache Spark Azure CI/CD ClickHouse Databricks Feature Engineering Generative AI Python SQL Terraform
Apply Now
Resil

Resil

Resil specializes in providing AI-powered supply chain risk management solutions that enable organizations to detect threats in real time and take proactive measures to enhance supply chain resiliency.

Internet Software & Services
251-1K
Founded 2010
View All Jobs 5

Description

  • Partner with enterprise customers and business stakeholders to understand data challenges and define requirements.
  • Own technical delivery from discovery and solution design through implementation and adoption.
  • Design, build, and maintain scalable batch and real-time data pipelines and data products.
  • Architect cloud-native data platforms using Databricks, Delta Lake, Azure Data Services, and distributed processing technologies.
  • Develop ETL/ELT frameworks, data models, and data quality monitoring processes.
  • Optimize storage, query performance, scalability, reliability, and cost efficiency across large datasets.
  • Build data products that support analytics, reporting, operational workflows, and AI/ML applications.
  • Collaborate with Product, Engineering, Solutions Consulting, and Customer Success to deliver customer outcomes.
  • Drive best practices in data governance, security, observability, reliability, and operational excellence.
  • Mentor junior engineers and contribute to engineering best practices and architecture decisions.

Requirements

  • BE/MS in Computer Science, Information Technology, Engineering, or a related field.
  • 5+ years of experience in data engineering, data platform development, or related disciplines.
  • Strong experience with Databricks, Apache Spark, Delta Lake, or similar distributed data processing technologies.
  • Experience with cloud-based data platforms and services, including Azure (preferred) or equivalent cloud ecosystems.
  • Experience designing and operating analytical data platforms using ClickHouse or similar high-performance analytical databases.
  • Advanced proficiency in Python and SQL, with strong software engineering fundamentals.
  • Experience building scalable ETL/ELT pipelines, orchestration workflows, and modern data architectures.
  • Strong understanding of data modeling, data warehousing, and analytics platform design.
  • Experience implementing CI/CD, infrastructure automation, and DevOps practices for data platforms.
  • Excellent communication and stakeholder management skills, with the ability to translate business requirements into technical solutions.
  • Ability to navigate ambiguity, drive outcomes independently, and succeed in customer-facing environments.
  • Experience in a Forward Deployed Engineer, Solutions Engineer, Solutions Architect, Technical Consultant, or other customer-facing engineering role (preferred).
  • Experience working with Supply Chain, Logistics, Manufacturing, or Enterprise SaaS platforms (preferred).
  • Familiarity with data governance, lineage, metadata management, and data catalog solutions (preferred).
  • Experience with Infrastructure as Code tools such as Terraform (preferred).
  • Exposure to AI/ML platforms, feature engineering pipelines, and data infrastructure supporting Generative AI applications (preferred).
  • Experience designing and operating real-time data processing systems and streaming architectures (preferred).

Benefits

  • Fully remote work with opportunities to connect in person.
  • Full-stack benefits for health, wealth, and wellbeing.
  • A culture centered on ownership, purpose, and technical growth.
  • A voice in shaping impactful technology.
  • Equal opportunity employer status.
  • Support for applicants with disabilities during the application process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Media.Monks

Lead Data Engineer

Media.Monks 5K-10K Media

Monks Technology Services is seeking a fully remote Lead Data Engineer for a fixed-term contract to lead the modernization of legacy Python/Spark ETL pipelines into dbt Core models on Databricks supporting analytics and business intelligence.

Colombia Contract Lead Data Engineer
Apache Spark CI/CD Databricks Git GitHub Actions Python SQL
16 hours, 55 minutes ago
Webflow

Staff Data Engineer

Webflow 251-1K Internet Software & Services

Webflow is hiring a Staff Data Engineer to lead data platform initiatives involving its data lake, event instrumentation, data quality, governance, and cloud infrastructure for modern web marketing operations.

United States Full-time Lead Data Engineer
$186k-$255k
Apache Airflow Apache Spark CI/CD Kafka SQL
16 hours, 55 minutes ago
Livefront

Data Engineer [Zeal]

Livefront 11-50 Internet Software & Services

Zeal, now part of Livefront, is hiring a Data Engineer across its U.S. hubs to build reliable data pipelines and architectures that support technology consulting engagements for Fortune 1000 companies.

United States Full-time Mid Level Data Engineer
$120k-$145k
Apache Airflow CI/CD Databricks dbt GCP Git Kafka Oracle PostgreSQL Power BI Python RabbitMQ Snowflake SQL SQL Server Tableau
17 hours, 10 minutes ago
Coderio

Sr Data Ops Engineer

Coderio 51-250 Internet Software & Services

Coderio is hiring a DataOps Engineer and Technical Referent to work with international customers on designing, implementing, and operating scalable cloud data infrastructure and automation solutions.

Argentina Uruguay Brazil Contract Senior Data Engineer DevOps Engineer
AWS Bash dbt Docker GitHub Python SQL Terraform
17 hours, 40 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers