RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

1 month, 2 weeks ago
United States
Full-time
Lead
Data Engineer
Software Development
Apache Spark AWS Databricks Git GitLab Machine Learning Python SQL
Apply Now
540

540

540 is a government-trusted tech consulting firm that breaks barriers to innovation and delivers impactful solutions like start-ups.

Internet Software & Services
51-250
Founded 2013
View All Jobs 2

Description

  • Design, develop, and maintain scalable production-ready data pipelines and data products in Spark and Databricks.
  • Lead the integration and transformation of complex data from DoW and federal health systems into reusable data products.
  • Design scalable data ingestion, integration, and exchange approaches, including API-based services.
  • Establish reusable data engineering patterns, standards, and best practices across the platform.
  • Provide technical guidance on data architecture, pipeline design, data modeling, integration, and engineering practices.
  • Monitor, troubleshoot, and optimize production workflows for performance, reliability, and scalability.
  • Define and implement data validation, quality, and governance practices.
  • Troubleshoot complex data integration issues, identify root causes, and drive sustainable solutions.
  • Collaborate with engineers, architects, analysts, and stakeholders to translate data needs into technical solutions.
  • Mentor other engineers and help improve engineering tools, processes, and patterns.

Requirements

  • 10+ years of data engineering, software engineering, or related technical experience.
  • Extensive hands-on experience designing, building, and operating production data pipelines and data products.
  • Advanced proficiency with Python and SQL.
  • Strong experience with Apache Spark and distributed data processing.
  • Experience with Databricks or similar modern data platforms.
  • Experience designing and maintaining ETL/ELT processes for complex, large-scale datasets.
  • Experience integrating data across disparate systems and building or consuming API-based integrations.
  • Strong understanding of data modeling, data architecture, data quality, and data governance principles.
  • Experience troubleshooting and optimizing complex production data pipelines for performance, reliability, and scalability.
  • Experience working with Git-based development workflows and terminal/command-line environments.
  • Demonstrated experience providing technical guidance, mentoring engineers, and influencing engineering practices.
  • Strong client and stakeholder communication skills, with the ability to explain technical concepts to technical and non-technical audiences.
  • Ability to work independently through ambiguity, identify technical risks, and drive issues to resolution.
  • Experience identifying security, privacy, and compliance issues and working with relevant stakeholders.
  • U.S. Citizenship and an active DoW Secret clearance or higher are required.
  • Bachelor’s degree in Computer Science, Engineering, Data Science, or a related technical field is preferred.
  • AWS cloud experience is preferred.
  • Experience with very large datasets, including billions of records, is preferred.
  • Experience with Palantir Foundry is preferred.
  • GitLab experience is preferred.
  • Experience with Advana or similar DoW data environments is preferred.
  • Experience working with federal health, financial, or other regulated and sensitive data is preferred.
  • Experience using AI/ML to accelerate work, including automation and debugging, is preferred.

Benefits

  • Flexible PTO plus all Federal holidays off.
  • Health, dental, and vision insurance plans.
  • Flexible Spending Account (FSA).
  • 401(k) with employer match.
  • Company-sponsored life insurance plus short- and long-term disability coverage.
  • Professional development support for training, certifications, and conferences.
  • Paid cloud developer accounts.
  • Referral bonuses.
  • HQ office perks including parking or metro reimbursement, nitro coffee, and lunches.
  • Access to Washington Capitals and Nationals tickets.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Apryse

Director, Data Platforms and Operations

Apryse 251-1K Internet Software & Services

Apryse is seeking a Director of Data Platform & Operations to lead its data engineering, governance, and BI/analytics functions while building the trusted data foundation for business reporting and Glean-powered AI tools.

United States Full-time Executive Data Architect Data Engineer
$110k-$160k
Apache Spark AWS Azure Databricks NetSuite Power BI Python Salesforce SQL Tableau
1 day, 2 hours ago
Cloudbeds

Tech Lead Data Engineer

Cloudbeds 251-1K Internet Software & Services

Cloudbeds is seeking a Tech Lead Data Engineer & Data Architect to shape the architecture, governance, reliability, and AI readiness of its fully remote, Snowflake-based analytics platform serving hospitality operations worldwide.

Canada Latin America Full-time Lead Data Architect Data Engineer
Agile Apache Airflow CI/CD Dagster dbt Git JIRA MLOps Prefect Python Snowflake SQL
1 day, 2 hours ago
Cloudbeds

Tech Lead Data Engineer

Cloudbeds 251-1K Internet Software & Services

Cloudbeds is seeking a Tech Lead Data Engineer & Data Architect to define the architecture, governance, and engineering practices for its fully remote, Snowflake-based analytics platform supporting hospitality operations worldwide.

Canada Full-time Lead Data Architect Data Engineer
Agile Apache Airflow CI/CD Dagster dbt Git JIRA Machine Learning MLOps Prefect Python Snowflake SQL
1 day, 2 hours ago
Cloudbeds

Tech Lead Data Engineer

Cloudbeds 251-1K Internet Software & Services

Cloudbeds is seeking a hands-on Tech Lead Data Engineer & Data Architect to set the technical direction, governance, and AI-readiness of its fully remote Snowflake-based analytics platform supporting hospitality operations worldwide.

Latin America Mexico Chile Costa Rica Ecuador Honduras Peru Full-time Lead Data Architect Data Engineer
Agile Apache Airflow CI/CD Dagster dbt Git JIRA Prefect Python Snowflake
1 day, 2 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers