Lead Data Engineer

21 hours, 20 minutes ago
Full-time
Lead
Software Development
Redhorse

Redhorse

Redhorse Corporation specializes in transforming government interactions with data and technology, offering impactful solutions through trusted partnerships and expertise in National Security and Technology.

Aerospace & Defense
201-500
Founded 2008

Description

  • Provide daily task prioritization, technical direction, code reviews, and mentorship for engineering team members.
  • Elicit and translate government stakeholder requirements into technical specifications, interface designs, and scalable data models.
  • Architect, develop, and optimize high-throughput ETL/ELT workflows in Databricks.
  • Maintain, refactor, and enhance Python and SQL codebases for performance, stability, and security.
  • Diagnose pipeline bottlenecks, debug complex data workflows, and automate improvements to reliability and data integrity.
  • Collaborate with government product owners, data scientists, analysts, and technical peers on sprints, architecture, and engineering trade-offs.
  • Create and maintain pipeline architecture and configuration documentation to support reliability and onboarding.

Requirements

  • U.S. citizenship and a current active U.S. Government Secret clearance.
  • 8+ years of professional data engineering experience building enterprise-scale data platforms and pipelines.
  • Experience mentoring engineers, conducting code reviews, and overseeing day-to-day technical work.
  • Hands-on experience designing and optimizing Databricks data transformation workflows.
  • Advanced modular, object-oriented Python/PySpark development skills.
  • Extensive experience writing, tuning, and optimizing complex SQL queries.
  • Experience building user-centric reports and dashboards with modern data visualization tools.
  • Experience with Apache Spark and distributed computing frameworks (preferred).
  • Familiarity with GitLab, Jira, and modern Agile/DevOps tools (preferred).
  • Experience with DoD, defense, or intelligence data environments; data governance, metadata management, or data cataloging frameworks; and a relevant bachelor’s or master’s degree (preferred).

Benefits

  • Anticipated base salary determined by experience, education, certifications, skills, clearance level, location, market conditions, and internal equity.
  • Comprehensive benefits programs for eligible employees.
  • Potential performance-based or other incentive compensation.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Data Engineer - (Argentina or Uruguay)

Resilient Co 11-50 Professional Services

Join a growing consulting team as a Senior Data Engineer to design and deliver enterprise-scale data platforms and analytics solutions for multinational clients.

Apache Spark AWS Azure Databricks GCP Git Power BI Snowflake SQL
21 hours, 36 minutes ago

AWS Data Engineer

Resilient Co 11-50 Professional Services

Join Resilient Co. as a Senior AWS Data Engineer to design and deliver AWS- and Snowflake-based data platforms that support the project’s data integration and analytics needs.

AWS Snowflake
21 hours, 36 minutes ago

Data Engineering Intern - Summer 2027

Riot Games 1001-5000 Internet Software & Services

Join Riot Games as a Data Engineering Intern to help build reliable data products that enable teams to understand and improve player experiences worldwide.

Apache Airflow Apache Spark AWS C++ CI/CD Databricks Docker GCP Git Go Java Kafka Kubernetes Linux Luigi Python Scala SQL Terraform
22 hours, 6 minutes ago

Data Engineer

AHEAD 1001-5000 IT Services

AHEAD is seeking a hands-on Data Engineer, Data Platform to build and operate secure, reliable data pipelines and reusable data products that make trusted enterprise data available for analytics, applications, and automation.

CI/CD dbt Git GraphQL Kanban NetSuite Python REST API Salesforce Serverless Snowflake SQL Terraform
22 hours, 6 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers