RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

2 months, 1 week ago
United States
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS CI/CD CloudFormation Databricks dbt Docker GitHub Hadoop Hive Java Kafka Kubernetes OpenSearch PostgreSQL Python Splunk SQL Terraform Trino
Apply Now
Capital Technology Group

Capital Technology Group

Capital Technology Group offers technical leadership and expert consulting services for enterprise architecture, application integration, custom development, big data, and search. With a focus on solving business problems through technology, CTG ensure...

Internet Software & Services
51-250
Founded 2010
View All Jobs 4

Description

  • Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models.
  • Develop and optimize AWS-native data platforms and orchestration workflows.
  • Build high-performance ingestion, transformation, and analytics solutions for structured and semi-structured data.
  • Integrate enterprise and external data sources across relational and NoSQL systems.
  • Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies.
  • Develop cloud infrastructure using Infrastructure as Code, CI/CD pipelines, and event-driven services.
  • Improve platform reliability, scalability, performance, and maintainability through monitoring and automation.
  • Support mission-critical analytics and reporting in AWS-based federal data environments.
  • Lead modernization efforts migrating legacy platforms to cloud-native AWS services.
  • Mentor junior engineers and collaborate with cross-functional teams in an Agile environment.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related technical field.
  • 9+ years of professional experience in data engineering or related domains.
  • Strong hands-on experience with Databricks, Apache Spark (PySpark), Python, SQL (PostgreSQL), and dbt.
  • Experience designing and maintaining AWS-native data platforms using AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), AWS Lambda, AWS Step Functions, Amazon S3, Amazon Redshift, Amazon RDS, AWS DMS, and Amazon CloudWatch.
  • Experience developing scalable data pipelines, workflow orchestration, and data integration solutions.
  • Experience with Apache Iceberg and data formats such as Parquet, ORC, and Avro.
  • Experience designing and optimizing solutions using PostgreSQL, Redshift, Oracle, GraphDB, and other NoSQL platforms.
  • Experience with Java development and modern CI/CD practices using Harness.
  • Strong analytical and problem-solving skills.
  • Experience working in agile, iterative software development environments.
  • Ability to quickly learn and apply new technologies and domain knowledge.
  • Excellent written and verbal communication skills.
  • Must be a US citizen and able to obtain Public Trust clearance.
  • Experience with Kafka, Docker, Kubernetes, Splunk, or Terraform is preferred.
  • Experience supporting regulated environments such as financial regulators or capital markets is a plus.
  • Strong SQL skills, including performance tuning and complex query design, is preferred.

Benefits

  • Remote work; hybrid roles may be specified.
  • Competitive compensation package with an estimated salary range of $130k to $165k annually.
  • Medical, dental, and vision coverage.
  • Life insurance, short-term disability, and long-term disability coverage.
  • Employee Assistance Program.
  • 401(k) with 4% matching.
  • Liberal PTO vacation policy.
  • Generous annual continuing education budget.
  • Annual wellness budget.
  • Bonus incentive programs, including employee referrals and performance-based rewards.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

RevStar

Databricks Engineer

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, US-based Databricks Engineer to build and optimize cloud-agnostic Lakehouse data pipelines and MLOps frameworks for enterprise AI projects across AWS, Azure, and GCP.

United States Mexico Argentina Brazil Chile Colombia Venezuela Contract Mid Level Data Engineer
Agile Apache Airflow Apache Spark AWS Azure CI/CD Databricks Feature Engineering HIPAA Kafka MLflow MLOps Prefect Python SQL Terraform
5 hours, 1 minute ago
phData

Senior Data Engineer

phData 251-1K IT Services

Data Engineer at phData, a remote-first global data and AI consultancy, designing and delivering secure, scalable cloud data solutions for enterprise clients.

India Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS Azure Cassandra Databricks dbt Elasticsearch GCP Hadoop HDFS Kafka Luigi Python REST API Scala Snowflake Solr SQL System Design
1 day, 4 hours ago
Abacus Insights

Forward Deployed Data Engineer

Abacus Insights 51-250 Insurance

Abacus Insights is hiring a Forward Deployed Data Engineer to work alongside health plan clients, building governed data foundations, pipelines, and integrations that turn fragmented payer data into analytics-ready products.

United States Full-time Senior Data Engineer
Apache Spark Databricks Snowflake SQL
1 day, 4 hours ago
Azumo

Data Engineer

Azumo 51-250 Internet Software & Services

Azumo is hiring a fully remote Latin America-based Data Engineer to build and operate production ingestion, transformation, storage, warehouse, and retrieval infrastructure that supports client AI systems.

Mexico Argentina Brazil Chile Colombia Peru Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Azure CI/CD Dagster Databricks dbt Docker Flink GCP Git GitHub Actions HIPAA Jupyter Kafka Prefect Python Snowflake SQL Terraform
1 day, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers