RemoteLeaf Logo
Log in Sign up

Data Engineer

3 months ago
United States
Full-time
Senior
Data Engineer
Software Development
AWS CI/CD Cybersecurity Docker Generative AI GitOps Helm Kafka Kubernetes Machine Learning Pulumi Terraform
Apply Now
DefenseUnicorns

DefenseUnicorns

DefenseUnicorns specializes in providing continuous software delivery solutions tailored for national security missions, focusing on simplifying and securing the development and deployment of software and AI technologies for government operations.

Internet Software & Services
51-250
Founded 2021
$1M raised
View All Jobs 14

Description

  • Design data workflows, pipelines, and data pathways to support ETL/ELT across AWS cloud and on-prem environments.
  • Ensure data-quality and secure exchange of sensitive information across hybrid infrastructure.
  • Apply systems engineering principles to improve reliability, scalability, maintainability, backup, and recovery of data layer systems.
  • Architect, deploy, and operate data streaming technologies such as Kafka, Redpanda, and Kinesis on Kubernetes.
  • Implement declarative Kubernetes definitions to reduce day-2 operational complexity.
  • Work with the platform team to improve configuration management, security, and performance in Kubernetes and AWS environments.
  • Automate infrastructure provisioning, monitoring, and scaling using infrastructure-as-code tools such as Terraform.
  • Collaborate with cybersecurity subject matter experts to defend the data layer against potential threats.
  • Ensure data layer systems comply with industry and DoD regulations, standards, and best practices.
  • Stay current on trends and emerging technologies in Kubernetes, containerization, and data engineering.

Requirements

  • U.S. citizenship is required.
  • Minimum 5 years of demonstrated experience building and maintaining production data pipelines, databases, and data exchange services on Kubernetes.
  • Experience designing, deploying, and operating Kafka or Redpanda streaming solutions on Kubernetes.
  • Experience creating data pipelines from scratch and processing large data volumes while managing data stores.
  • Experience with containerization technologies such as Docker and orchestration platforms such as Kubernetes.
  • Knowledge of systems engineering principles for reliable, scalable, and maintainable data layer systems.
  • Familiarity with API security, container security, AWS cloud security, and cybersecurity best practices.
  • Ability to obtain and maintain a Secret-level DoD security clearance after a pre-employment background check.
  • Excellent problem-solving skills and the ability to work independently and as part of a team.
  • Excellent communication skills for conveying complex ideas to technical and non-technical stakeholders.
  • Experience with machine learning and generative AI models is preferred.
  • Willingness and ability to travel 6-10 times per year.

Benefits

  • Medical, dental, and vision coverage with 100% company-paid premiums.
  • Health Savings Account, life insurance, and disability insurance.
  • 401(k) retirement plan.
  • Company stock options.
  • Home office budget.
  • Flexible Time Off plus Federal Holidays, one week for Thanksgiving, and two weeks for Christmas and New Year’s.
  • Paid parental leave.
  • Reimbursement for approved trainings/subscriptions and conference travel, lodging, and fees.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Concurrency

Senior Data Engineer (Contract)

Concurrency 51-250 Internet Software & Services

Concurrency is hiring a Data Engineer for its Cloud, Data & AI Solutions Team to deliver end-to-end Microsoft Azure and Fabric data solutions that support client digital transformation.

United States Contract Senior Data Engineer
Apache Spark Azure CI/CD Git Machine Learning Power BI Python SQL
1 hour, 27 minutes ago
Netomi

Data Engineer II

Netomi 51-250 IT Services

Netomi is hiring a Data Engineer in Gurugram to build reliable data infrastructure and analytics solutions that improve AI-powered enterprise customer experiences and product operations.

India Full-time Mid Level Data Engineer
Apache Airflow Apache Spark CI/CD Databricks Docker HIPAA Kafka Kubernetes Luigi MySQL PostgreSQL Prefect Python RabbitMQ Snowflake SQL
1 hour, 27 minutes ago
CI&T

[Job-31682] Senior Data Engineer [Databricks]

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa engenheira de dados para estruturar e acelerar a plataforma de dados de um grande varejista farmacêutico brasileiro, modernizando a orquestração, a qualidade dos dados e a distribuição de produtos baseados em Databricks.

Brazil Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Databricks SFTP Terraform
1 hour, 42 minutes ago
payabl.

Data Engineer

payabl. 51-250 Diversified Financial Services

As a Data Engineer at payabl., you will build and maintain reliable data pipelines and business-ready datasets that support analytics and decision-making across the company’s global payments platform.

Cyprus Poland Portugal Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS ClickHouse Dagster Databricks dbt Docker Git Kafka Kubernetes MariaDB MongoDB MySQL PostgreSQL Power BI Python Snowflake SQL Tableau Terraform
1 hour, 42 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers