RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

1 month ago
United States
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS CI/CD CloudFormation Databricks dbt Docker GitHub Hadoop Hive Java Kafka Kubernetes OpenSearch PostgreSQL Python Splunk SQL Terraform Trino
Apply Now
Capital Technology Group

Capital Technology Group

Capital Technology Group offers technical leadership and expert consulting services for enterprise architecture, application integration, custom development, big data, and search. With a focus on solving business problems through technology, CTG ensure...

Internet Software & Services
51-250
Founded 2010
View All Jobs 5

Description

  • Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models.
  • Develop and optimize AWS-native data platforms and orchestration workflows.
  • Build high-performance ingestion, transformation, and analytics solutions for structured and semi-structured data.
  • Integrate enterprise and external data sources across relational and NoSQL systems.
  • Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies.
  • Develop cloud infrastructure using Infrastructure as Code, CI/CD pipelines, and event-driven services.
  • Improve platform reliability, scalability, performance, and maintainability through monitoring and automation.
  • Support mission-critical analytics and reporting in AWS-based federal data environments.
  • Lead modernization efforts migrating legacy platforms to cloud-native AWS services.
  • Mentor junior engineers and collaborate with cross-functional teams in an Agile environment.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related technical field.
  • 9+ years of professional experience in data engineering or related domains.
  • Strong hands-on experience with Databricks, Apache Spark (PySpark), Python, SQL (PostgreSQL), and dbt.
  • Experience designing and maintaining AWS-native data platforms using AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), AWS Lambda, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, AWS DMS, and Amazon CloudWatch.
  • Experience developing scalable data pipelines, workflow orchestration, and data integration solutions.
  • Experience with Apache Iceberg and data formats such as Parquet, ORC, and Avro.
  • Experience designing and optimizing solutions using PostgreSQL, Redshift, Oracle, GraphDB, and other NoSQL platforms.
  • Experience with Java development and modern CI/CD practices using Harness.
  • Strong analytical and problem-solving skills.
  • Experience working in agile, iterative software development environments.
  • Ability to quickly learn and apply new technologies and domain knowledge.
  • Excellent written and verbal communication skills.
  • Must be a US citizen and able to obtain Public Trust clearance.
  • Experience with Kafka, Docker, Kubernetes, Splunk, or Terraform is preferred.
  • Experience supporting regulated environments such as financial regulators or capital markets is a plus.
  • Strong SQL skills, including performance tuning and complex query design, is preferred.

Benefits

  • Remote work; hybrid roles may be specified.
  • Competitive compensation package with an estimated salary range of $130k to $165k annually.
  • Medical, dental, and vision coverage.
  • Life insurance, short-term disability, and long-term disability coverage.
  • Employee Assistance Program.
  • 401(k) with 4% matching.
  • Liberal PTO vacation policy.
  • Generous annual continuing education budget.
  • Annual wellness budget.
  • Bonus incentive programs, including employee referrals and performance-based rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Media.Monks

Lead Data Engineer

Media.Monks 5K-10K Media

Monks Technology Services is seeking a fully remote Lead Data Engineer for a fixed-term contract to lead the modernization of legacy Python/Spark ETL pipelines into dbt Core models on Databricks supporting analytics and business intelligence.

Colombia Contract Lead Data Engineer
Apache Spark CI/CD Databricks Git GitHub Actions Python SQL
17 hours, 22 minutes ago
Webflow

Staff Data Engineer

Webflow 251-1K Internet Software & Services

Webflow is hiring a Staff Data Engineer to lead data platform initiatives involving its data lake, event instrumentation, data quality, governance, and cloud infrastructure for modern web marketing operations.

United States Full-time Lead Data Engineer
$186k-$255k
Apache Airflow Apache Spark CI/CD Kafka SQL
17 hours, 22 minutes ago
Livefront

Data Engineer [Zeal]

Livefront 11-50 Internet Software & Services

Zeal, now part of Livefront, is hiring a Data Engineer across its U.S. hubs to build reliable data pipelines and architectures that support technology consulting engagements for Fortune 1000 companies.

United States Full-time Mid Level Data Engineer
$120k-$145k
Apache Airflow CI/CD Databricks dbt GCP Git Kafka Oracle PostgreSQL Power BI Python RabbitMQ Snowflake SQL SQL Server Tableau
17 hours, 37 minutes ago
Coderio

Sr Data Ops Engineer

Coderio 51-250 Internet Software & Services

Coderio is hiring a DataOps Engineer and Technical Referent to work with international customers on designing, implementing, and operating scalable cloud data infrastructure and automation solutions.

Argentina Uruguay Brazil Contract Senior Data Engineer DevOps Engineer
AWS Bash dbt Docker GitHub Python SQL Terraform
18 hours, 7 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers