RemoteLeaf Logo
Log in Sign up

Lead Consultant Data Engineer (DHS)

3 weeks, 4 days ago
United States
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS Azure CI/CD Databricks dbt GCP Git Kafka Kanban Machine Learning Python Scala Scrum SQL Terraform
Apply Now
Excella

Excella

Excella helps clients achieve their business objectives by offering exceptional software development, business intelligence, and program management solutions, transforming innovative ideas into effective technology applications.

Internet Software & Services
251-1K
Founded 2002
View All Jobs 2

Description

  • Develop and manage data processes to ensure data availability and usability.
  • Create and automate data pipelines and data platforms.
  • Write clean, efficient, and well-documented code for data engineering solutions.
  • Monitor and improve data quality through automated testing frameworks.
  • Collaborate with Architects, Product Owners, Data Scientists, and DevOps to design, build, and maintain scalable data solutions.
  • Research data acquisition sources and evaluate their suitability.
  • Integrate data management solutions into client environments.
  • Identify and mitigate data risks and ensure data recovery plans are in place.
  • Build and maintain data repositories, including data warehouses, data lakes, and operational data stores.

Requirements

  • 8+ years of professional experience in data engineering or a related field.
  • Proven ability to build robust, scalable data pipelines and production-grade ETL/ELT systems.
  • Strong proficiency in SQL, Python, and orchestration tools such as Airflow and dbt.
  • 2+ years of hands-on experience with Databricks in development, data processing, and pipeline optimization.
  • Hands-on experience with big data technologies such as Spark, Kafka, and file formats like Parquet, Delta Lake, and Iceberg.
  • Deep experience with AWS cloud data platforms such as AWS Glue, S3, Redshift, EMR, or Azure equivalents.
  • Solid understanding of data modeling, performance optimization, and secure, well-structured data stores.
  • Familiarity with data lake and analytical architecture patterns, including Star Schema, schema-on-read, and data quality frameworks.
  • Experience with CI/CD, Git, infrastructure-as-code such as Terraform, and NoSQL databases.
  • Effective communication skills and experience working in Agile environments such as Scrum or Kanban.
  • Strong problem-solving skills, a growth mindset, and a passion for learning new technologies.
  • One or more of the following certifications: AWS Certified Machine Learning - Specialty, DASCA certifications, Databricks Certified Machine Learning Associate, Databricks Certified Developer for Apache Spark, Databricks Certified Data Engineer Associate, Databricks Certified Data Engineer Professional, AWS Certified Data Analytics - Specialty, or Python/Scala Programming Certification.
  • Ability to hold and maintain a DHS Public Trust, which requires U.S. citizenship.

Benefits

  • Competitive base salary of $138,000 to $185,000 USD.
  • Annual bonus eligibility starting on day one.
  • Top-tier medical, dental, and vision coverage with multiple plan options.
  • Employer-contributed health savings account, infertility coverage, and orthodontia benefits.
  • 8 weeks of parental leave available from day one.
  • 15 days of paid vacation, 6 federal holidays, and 4 floating holidays.
  • Annual internet reimbursement of $25 per month.
  • 3 days of paid professional development each year, plus support for classes, conferences, and certifications.
  • Employee wellness events, Headspace membership, Talkspace access, and mental health coverage.
  • Flexible distributed work environment with support for home office or client site work.
  • Discounted pet insurance and Care.com membership with 3 emergency child or elder care days annually.
  • Equipment program with Mac or PC options and computer replacement every 3 years.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Dan.com - a GoDaddy brand

Data Engineer IV (6249)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a Data Engineer IV to build and optimize AWS-based data infrastructure and pipelines that support AI infrastructure and inference initiatives in a remote role.

United States Contract Lead Data Engineer
AWS
14 hours, 6 minutes ago
Xebia

Senior Data Engineer (GCP)

Xebia 1K-5K Internet Software & Services

Xebia is hiring a data engineer to support a BigQuery migration by building and maintaining scalable data pipelines for production reporting, analytics, and business intelligence solutions.

Romania Bulgaria Poland Europe Senior Data Engineer
Apache Airflow CI/CD Databricks dbt Git Python Snowflake SQL
14 hours, 6 minutes ago
Coupang

Staff Data Engineer (Coupang Pay)

Coupang 1K-5K Internet Software & Services

쿠팡페이 핀테크 데이터 플랫폼 팀의 Staff Data Engineer로서 실시간 결제·주문 데이터를 기반으로 데이터 파이프라인과 분석 인프라를 구축·고도화하는 역할입니다.

South Korea Full-time Lead Data Engineer
Apache Spark AWS ClickHouse Flink Hive Java Presto Python Scala SQL Tableau
14 hours, 21 minutes ago
Cresteo

Data Migration Engineer (SQL Server / TSQL)

Cresteo 51-200 information technology & services

Cresteo is hiring a Data Migration Engineer to own end-to-end SQL Server data migrations from legacy schemas into reconciled, production-ready data for US-based clients and international teams.

Latin America Full-time Senior Database Administrator Data Engineer
JSON SQL Server
14 hours, 22 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers