RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

1 month, 3 weeks ago
United States
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS CI/CD CloudFormation Databricks dbt Docker GitHub Hadoop Hive Java Kafka Kubernetes OpenSearch PostgreSQL Python Splunk SQL Terraform Trino
Apply Now
Capital Technology Group

Capital Technology Group

Capital Technology Group offers technical leadership and expert consulting services for enterprise architecture, application integration, custom development, big data, and search. With a focus on solving business problems through technology, CTG ensure...

Internet Software & Services
51-250
Founded 2010
View All Jobs 4

Description

  • Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models.
  • Develop and optimize AWS-native data platforms and orchestration workflows.
  • Build high-performance ingestion, transformation, and analytics solutions for structured and semi-structured data.
  • Integrate enterprise and external data sources across relational and NoSQL systems.
  • Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies.
  • Develop cloud infrastructure using Infrastructure as Code, CI/CD pipelines, and event-driven services.
  • Improve platform reliability, scalability, performance, and maintainability through monitoring and automation.
  • Support mission-critical analytics and reporting in AWS-based federal data environments.
  • Lead modernization efforts migrating legacy platforms to cloud-native AWS services.
  • Mentor junior engineers and collaborate with cross-functional teams in an Agile environment.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related technical field.
  • 9+ years of professional experience in data engineering or related domains.
  • Strong hands-on experience with Databricks, Apache Spark (PySpark), Python, SQL (PostgreSQL), and dbt.
  • Experience designing and maintaining AWS-native data platforms using AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), AWS Lambda, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, AWS DMS, and Amazon CloudWatch.
  • Experience developing scalable data pipelines, workflow orchestration, and data integration solutions.
  • Experience with Apache Iceberg and data formats such as Parquet, ORC, and Avro.
  • Experience designing and optimizing solutions using PostgreSQL, Redshift, Oracle, GraphDB, and other NoSQL platforms.
  • Experience with Java development and modern CI/CD practices using Harness.
  • Strong analytical and problem-solving skills.
  • Experience working in agile, iterative software development environments.
  • Ability to quickly learn and apply new technologies and domain knowledge.
  • Excellent written and verbal communication skills.
  • Must be a US citizen and able to obtain Public Trust clearance.
  • Experience with Kafka, Docker, Kubernetes, Splunk, or Terraform is preferred.
  • Experience supporting regulated environments such as financial regulators or capital markets is a plus.
  • Strong SQL skills, including performance tuning and complex query design, is preferred.

Benefits

  • Remote work; hybrid roles may be specified.
  • Competitive compensation package with an estimated salary range of $130k to $165k annually.
  • Medical, dental, and vision coverage.
  • Life insurance, short-term disability, and long-term disability coverage.
  • Employee Assistance Program.
  • 401(k) with 4% matching.
  • Liberal PTO vacation policy.
  • Generous annual continuing education budget.
  • Annual wellness budget.
  • Bonus incentive programs, including employee referrals and performance-based rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Concurrency

Senior Data Engineer (Contract)

Concurrency 51-250 Internet Software & Services

Concurrency is hiring a Data Engineer for its Cloud, Data & AI Solutions Team to deliver end-to-end Microsoft Azure and Fabric data solutions that support client digital transformation.

United States Contract Senior Data Engineer
Apache Spark Azure CI/CD Git Machine Learning Power BI Python SQL
1 hour, 28 minutes ago
Netomi

Data Engineer II

Netomi 51-250 IT Services

Netomi is hiring a Data Engineer in Gurugram to build reliable data infrastructure and analytics solutions that improve AI-powered enterprise customer experiences and product operations.

India Full-time Mid Level Data Engineer
Apache Airflow Apache Spark CI/CD Databricks Docker HIPAA Kafka Kubernetes Luigi MySQL PostgreSQL Prefect Python RabbitMQ Snowflake SQL
1 hour, 28 minutes ago
CI&T

[Job-31682] Senior Data Engineer [Databricks]

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa engenheira de dados para estruturar e acelerar a plataforma de dados de um grande varejista farmacêutico brasileiro, modernizando a orquestração, a qualidade dos dados e a distribuição de produtos baseados em Databricks.

Brazil Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Databricks SFTP Terraform
1 hour, 43 minutes ago
payabl.

Data Engineer

payabl. 51-250 Diversified Financial Services

As a Data Engineer at payabl., you will build and maintain reliable data pipelines and business-ready datasets that support analytics and decision-making across the company’s global payments platform.

Cyprus Poland Portugal Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS ClickHouse Dagster Databricks dbt Docker Git Kafka Kubernetes MariaDB MongoDB MySQL PostgreSQL Power BI Python Snowflake SQL Tableau Terraform
1 hour, 43 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers