RemoteLeaf Logo
Log in Sign up

Lead Consultant Data Engineer (DHS)

5 days, 13 hours ago
United States
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS Azure CI/CD Databricks dbt GCP Git Kafka Kanban Machine Learning Python Scala Scrum SQL Terraform
Apply Now
Excella

Excella

Excella helps clients achieve their business objectives by offering exceptional software development, business intelligence, and program management solutions, transforming innovative ideas into effective technology applications.

Internet Software & Services
251-1K
Founded 2002
View All Jobs

Description

  • Develop and manage data processes to ensure data availability and usability.
  • Create and automate data pipelines and data platforms.
  • Write clean, efficient, and well-documented code for data engineering solutions.
  • Monitor and improve data quality through automated testing frameworks.
  • Collaborate with Architects, Product Owners, Data Scientists, and DevOps to design, build, and maintain scalable data solutions.
  • Research data acquisition sources and evaluate their suitability.
  • Integrate data management solutions into client environments.
  • Identify and mitigate data risks and ensure data recovery plans are in place.
  • Build and maintain data repositories, including data warehouses, data lakes, and operational data stores.

Requirements

  • 8+ years of professional experience in data engineering or a related field.
  • Proven ability to build robust, scalable data pipelines and production-grade ETL/ELT systems.
  • Strong proficiency in SQL, Python, and orchestration tools such as Airflow and dbt.
  • 2+ years of hands-on experience with Databricks in development, data processing, and pipeline optimization.
  • Hands-on experience with big data technologies such as Spark, Kafka, and file formats like Parquet, Delta Lake, and Iceberg.
  • Deep experience with AWS cloud data platforms such as AWS Glue, S3, Redshift, EMR, or Azure equivalents.
  • Solid understanding of data modeling, performance optimization, and secure, well-structured data stores.
  • Familiarity with data lake and analytical architecture patterns, including Star Schema, schema-on-read, and data quality frameworks.
  • Experience with CI/CD, Git, infrastructure-as-code such as Terraform, and NoSQL databases.
  • Effective communication skills and experience working in Agile environments such as Scrum or Kanban.
  • Strong problem-solving skills, a growth mindset, and a passion for learning new technologies.
  • One or more of the following certifications: AWS Certified Machine Learning - Specialty, DASCA certifications, Databricks Certified Machine Learning Associate, Databricks Certified Developer for Apache Spark, Databricks Certified Data Engineer Associate, Databricks Certified Data Engineer Professional, AWS Certified Data Analytics - Specialty, or Python/Scala Programming Certification.
  • Ability to hold and maintain a DHS Public Trust, which requires U.S. citizenship.

Benefits

  • Competitive base salary of $138,000 to $185,000 USD.
  • Annual bonus eligibility starting on day one.
  • Top-tier medical, dental, and vision coverage with multiple plan options.
  • Employer-contributed health savings account, infertility coverage, and orthodontia benefits.
  • 8 weeks of parental leave available from day one.
  • 15 days of paid vacation, 6 federal holidays, and 4 floating holidays.
  • Annual internet reimbursement of $25 per month.
  • 3 days of paid professional development each year, plus support for classes, conferences, and certifications.
  • Employee wellness events, Headspace membership, Talkspace access, and mental health coverage.
  • Flexible distributed work environment with support for home office or client site work.
  • Discounted pet insurance and Care.com membership with 3 emergency child or elder care days annually.
  • Equipment program with Mac or PC options and computer replacement every 3 years.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Career TEAM

Data Conversion Software Engineer

Career TEAM 251-1K Professional Services

Career Team is hiring a Data Conversion Software Engineer to build data transformation and integration software for government-funded workforce development programs across the United States.

United States Full-time Mid Level Data Engineer Software Engineer
$60k-$100k
Agile Angular CI/CD Docker Express.js JavaScript JSON MongoDB NestJS Next.js Node.js React Scrum TypeScript XML
12 hours, 56 minutes ago
TWO95 International

Sr. Associate Data Platform - Remote

TWO95 International 51-250 Internet Software & Services

Sr. Associate Data Platform is a contract role with a Los Angeles-based team supporting Adobe analytics and data platform implementation work across on-site and remote locations.

United States Contract Senior Data Engineer
CSS Digital Marketing HTML JavaScript jQuery Vue.js
13 hours, 11 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time remote Python Data Scraping Engineer for the Tendem project to deliver accurate, structured data extraction and processing within a hybrid AI-plus-human workflow.

Kuwait Qatar Saudi Arabia Turkey Israel Jordan Part-time Junior Backend Engineer Data Engineer
Up to $37k
AJAX GitHub JavaScript JSON LLM Python Selenium
13 hours, 11 minutes ago
Mindrift.ai: Be the “I” in AI

Freelance Data Scraping Engineer (Python)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is hiring a part-time freelance Python Data Scraping Engineer for the Tendem project to build and oversee data extraction workflows in a hybrid AI + human environment.

United States Part-time Mid Level Backend Engineer Data Engineer
AJAX GitHub JavaScript JSON LLM Python Selenium
13 hours, 11 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers