RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

3 months ago
India
Full-time
Lead
Data Engineer
Software Development
Apache Spark AWS CI/CD Databricks dbt DynamoDB Git MLflow Python REST API SQL
Apply Now
Level Access

Level Access

Level Access provides a comprehensive digital accessibility platform, automated scans, and expert-led services to help organizations achieve and maintain accessibility compliance. With a focus on IT systems, Level Access has been a leader in the access...

Internet Software & Services
251-1K
Founded 1997
$72M raised
View All Jobs 5

Description

  • Design, build, and maintain a scalable data platform on Databricks and AWS using Medallion architecture principles.
  • Develop and manage data ingestion and ETL/ELT pipelines from core business systems.
  • Implement data quality monitoring and automated alerting for freshness, completeness, validity, and anomaly detection.
  • Establish and maintain Golden Record identity resolution and reverse synchronization across source systems.
  • Govern metadata, lineage, and permissions using Databricks Unity Catalog and platform standards.
  • Collaborate with cross-functional teams to deliver analytics- and AI-ready datasets.
  • Apply infrastructure-as-code, CI/CD, and version control best practices for data pipelines.
  • Communicate with stakeholders, manage ambiguity, and drive results in a fast-paced environment.

Requirements

  • 8+ years of experience in data engineering building production-grade ETL/ELT pipelines at scale.
  • Strong proficiency in Python, including PySpark, scripting, API integrations, and pipeline automation.
  • Hands-on experience with Databricks, including notebooks, jobs, workflows, and Unity Catalog.
  • Hands-on experience with AWS services including Lambda, ECS/Fargate, S3, Glue, Athena, DynamoDB, EventBridge, Step Functions, and IAM.
  • Expertise in data modeling and lakehouse architectures, including Medallion, Delta Lake, Parquet, schema evolution, and incremental upserts.
  • Proficiency in SQL and dbt for building modular, tested, and documented models.
  • Experience with REST API integration, entity resolution, and record matching strategies.
  • Familiarity with Git-based version control and CI/CD for data pipelines.
  • Preferred: experience with advanced Databricks features such as Delta Live Tables and MLflow integration.
  • Preferred: Salesforce API experience, including Bulk API 2.0, REST API, and SOQL.

Benefits

  • Full-time, salaried position.
  • Competitive benefits package.
  • Bonus opportunities.
  • Generous paid time off.
  • Paid holidays.
  • Programs that support employee well-being and work-life balance.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Accenture

Data Conversion Developer

Accenture 100K+ Professional Services

Accenture Federal Services is seeking a Data Conversion Developer to support migration of legacy enterprise data into Oracle Cloud ERP for federal mission systems.

United States Full-time Mid Level Data Engineer
$100k-$203k
SQL
59 minutes ago
D

Cyber Data Engineer

D2 Technical Services 11-50 IT services and consulting

D2 Technical Services is hiring a systems engineer to support national security cybersecurity operations by managing infrastructure, data pipelines, and SIEM environments.

United States Full-time Senior Data Engineer Security Engineer
$140k-$145k
AWS Bash Cybersecurity DHCP DNS Elasticsearch GCP Linux PowerShell Python SIEM Splunk
1 day ago
Voyager

Senior DataOps Engineer

Voyager Life Sciences Tools & Services

Voyager Technologies is hiring a remote US-based DataOps Engineer to own cloud-to-data platform migration and operations for mission-critical analytics in a regulated national security environment.

United States Full-time Senior Data Engineer
$150k-$180k
Ansible Apache Airflow Apache Spark AWS Azure Cassandra CloudFormation dbt Docker Git GitHub GitHub Actions GitLab GitLab CI Kafka Kubernetes MongoDB Pandas PostgreSQL PowerShell Python Redis Scala SQLAlchemy SQL Server Terraform
1 day ago
Dragos

Data Engineering Manager

Dragos 251-1K Professional Services

Dragos is seeking a Data Engineering Manager to lead the team building the core data layer that supports its cybersecurity products and threat-focused engineering work.

United States Full-time Lead Data Engineer Engineering Manager
$220k-$220k
Agile Apache Airflow ClickHouse Cybersecurity dbt Docker Kubernetes PostgreSQL Rust SOC
1 day ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers