RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

51 minutes ago
United States
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS CI/CD CloudFormation Databricks dbt Docker GitHub Hadoop Hive Java Kafka Kubernetes OpenSearch PostgreSQL Python Splunk SQL Terraform Trino
Apply Now
Capital Technology Group

Capital Technology Group

Capital Technology Group offers technical leadership and expert consulting services for enterprise architecture, application integration, custom development, big data, and search. With a focus on solving business problems through technology, CTG ensure...

Internet Software & Services
51-250
Founded 2010
View All Jobs 5

Description

  • Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models.
  • Develop and optimize AWS-native data platforms and orchestration workflows.
  • Build high-performance ingestion, transformation, and analytics solutions for structured and semi-structured data.
  • Integrate enterprise and external data sources across relational and NoSQL systems.
  • Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies.
  • Develop cloud infrastructure using Infrastructure as Code, CI/CD pipelines, and event-driven services.
  • Improve platform reliability, scalability, performance, and maintainability through monitoring and automation.
  • Support mission-critical analytics and reporting in AWS-based federal data environments.
  • Lead modernization efforts migrating legacy platforms to cloud-native AWS services.
  • Mentor junior engineers and collaborate with cross-functional teams in an Agile environment.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related technical field.
  • 9+ years of professional experience in data engineering or related domains.
  • Strong hands-on experience with Databricks, Apache Spark (PySpark), Python, SQL (PostgreSQL), and dbt.
  • Experience designing and maintaining AWS-native data platforms using AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), AWS Lambda, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, AWS DMS, and Amazon CloudWatch.
  • Experience developing scalable data pipelines, workflow orchestration, and data integration solutions.
  • Experience with Apache Iceberg and data formats such as Parquet, ORC, and Avro.
  • Experience designing and optimizing solutions using PostgreSQL, Redshift, Oracle, GraphDB, and other NoSQL platforms.
  • Experience with Java development and modern CI/CD practices using Harness.
  • Strong analytical and problem-solving skills.
  • Experience working in agile, iterative software development environments.
  • Ability to quickly learn and apply new technologies and domain knowledge.
  • Excellent written and verbal communication skills.
  • Must be a US citizen and able to obtain Public Trust clearance.
  • Experience with Kafka, Docker, Kubernetes, Splunk, or Terraform is preferred.
  • Experience supporting regulated environments such as financial regulators or capital markets is a plus.
  • Strong SQL skills, including performance tuning and complex query design, is preferred.

Benefits

  • Remote work; hybrid roles may be specified.
  • Competitive compensation package with an estimated salary range of $130k to $165k annually.
  • Medical, dental, and vision coverage.
  • Life insurance, short-term disability, and long-term disability coverage.
  • Employee Assistance Program.
  • 401(k) with 4% matching.
  • Liberal PTO vacation policy.
  • Generous annual continuing education budget.
  • Annual wellness budget.
  • Bonus incentive programs, including employee referrals and performance-based rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Accenture

SCON_Oracle HCM Cloud Conversion Developer

Accenture 100K+ Professional Services

Accenture Federal Services is hiring an Oracle Cloud Conversion developer to support Oracle HCM Cloud data conversion and downstream transactional data loading for U.S. federal government clients.

United States Full-time Senior Data Engineer
$100k-$203k
21 minutes ago
Dragos

Senior Data Engineer

Dragos 251-1K Professional Services

Dragos is hiring a Data Engineer to work on its Data Visualization product team, building reporting engines and data systems that support analytics for critical infrastructure cybersecurity.

United States Full-time Senior Data Engineer
$165k-$165k
Cybersecurity Docker Go Kubernetes Node.js Python
1 hour, 6 minutes ago
Caylent

Senior Data Engineer

Caylent 251-1K IT Services

Caylent is hiring a Senior Data Engineer to help deliver AWS-based data management solutions, including ETL, data warehouse, and migration work for customer teams.

Brazil Full-time Senior Data Engineer
Agile Apache Spark AWS CI/CD Generative AI Python
1 hour, 6 minutes ago
Reltio

Sr. AI Engineer - Data Pipelines & Context Systems

Reltio 251-1K IT Services

Reltio is hiring a Sr. AI Engineer to build the governed data, context, and tooling foundation behind its Enterprise AI Hub and Context Intelligence Operating System.

India Senior AI Engineer Data Engineer
Confluence Docker JIRA Kubernetes NetSuite Next.js Node.js OAuth OpenSearch Python React Salesforce TypeScript Vercel
1 hour, 6 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers