RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

3 weeks ago
India
Full-time
Lead
Data Engineer
Software Development
Apache Spark AWS CI/CD Databricks dbt DynamoDB Git MLflow Python REST API SQL
Apply Now
Level Access

Level Access

Level Access provides a comprehensive digital accessibility platform, automated scans, and expert-led services to help organizations achieve and maintain accessibility compliance. With a focus on IT systems, Level Access has been a leader in the access...

Internet Software & Services
251-1K
Founded 1997
$72M raised
View All Jobs 20

Description

  • Design, build, and maintain a scalable data platform on Databricks and AWS using Medallion architecture principles.
  • Develop and manage data ingestion and ETL/ELT pipelines from core business systems.
  • Implement data quality monitoring and automated alerting for freshness, completeness, validity, and anomaly detection.
  • Establish and maintain Golden Record identity resolution and reverse synchronization across source systems.
  • Govern metadata, lineage, and permissions using Databricks Unity Catalog and platform standards.
  • Collaborate with cross-functional teams to deliver analytics- and AI-ready datasets.
  • Apply infrastructure-as-code, CI/CD, and version control best practices for data pipelines.
  • Communicate with stakeholders, manage ambiguity, and drive results in a fast-paced environment.

Requirements

  • 8+ years of experience in data engineering building production-grade ETL/ELT pipelines at scale.
  • Strong proficiency in Python, including PySpark, scripting, API integrations, and pipeline automation.
  • Hands-on experience with Databricks, including notebooks, jobs, workflows, and Unity Catalog.
  • Hands-on experience with AWS services including Lambda, ECS/Fargate, S3, Glue, Athena, DynamoDB, EventBridge, Step Functions, and IAM.
  • Expertise in data modeling and lakehouse architectures, including Medallion, Delta Lake, Parquet, schema evolution, and incremental upserts.
  • Proficiency in SQL and dbt for building modular, tested, and documented models.
  • Experience with REST API integration, entity resolution, and record matching strategies.
  • Familiarity with Git-based version control and CI/CD for data pipelines.
  • Preferred: experience with advanced Databricks features such as Delta Live Tables and MLflow integration.
  • Preferred: Salesforce API experience, including Bulk API 2.0, REST API, and SOQL.

Benefits

  • Full-time, salaried position.
  • Competitive benefits package.
  • Bonus opportunities.
  • Generous paid time off.
  • Paid holidays.
  • Programs that support employee well-being and work-life balance.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Rezilient Health

Senior Data Engineer

Rezilient Health 11-50 Health Care Providers & Services

Rezilient Health is seeking a Data Engineer to build the data platform that powers near-real-time healthcare insights, patient and provider experiences, and operational efficiency across its CloudClinic model.

United States Full-time Senior Data Engineer
Apache Airflow AWS Azure dbt GCP HIPAA Machine Learning Python Scala Snowflake SQL
17 minutes ago
CI&T

[Job - 29221] Senior Data Developer (Azure), Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Senior Data Developer (Azure) to build and evolve its cloud data platform in Brazil, turning architectural standards into reliable, scalable data pipelines and analytics-ready datasets.

Brazil Full-time Senior Data Engineer
Apache Airflow Apache Spark Azure CI/CD Databricks dbt Feature Engineering Git Prefect Python Snowflake SQL
1 hour, 2 minutes ago
P

Software Engineer I - Data

Precision AQ 1001-5000 Business Consulting and Services

Precision Medicine Group is hiring a data-focused application support professional to configure, maintain, and deliver client-facing healthcare applications and data flows across multiple environments.

India Full-time Junior Data Engineer
Agile Azure C# CI/CD HTML .NET Salesforce SQL SQL Server
1 hour, 36 minutes ago
Bluelight Consulting

Data Engineer, Azure - Remote, Latin America

Bluelight Consulting 11-50 Internet Software & Services

Bluelight is hiring a remote Data Engineer, Azure to develop and optimize data engineering pipelines and warehousing solutions for client projects across Latin America.

Latin America Panama Full-time Mid Level Data Engineer
Agile Apache Spark Azure Git Machine Learning Power BI Python REST API SQL Tableau
2 hours, 49 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers