RemoteLeaf Logo
Log in Sign up

Lead Data Engineer

1 week ago
United States
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS CI/CD CloudFormation Generative AI GitHub OpenSearch PostgreSQL Python SQL Trino
Apply Now
Capital Technology Group

Capital Technology Group

Capital Technology Group offers technical leadership and expert consulting services for enterprise architecture, application integration, custom development, big data, and search. With a focus on solving business problems through technology, CTG ensure...

Internet Software & Services
51-200
Founded 2010
View All Jobs 10

Description

  • Design, build, and maintain scalable data pipelines, ETL/ELT workflows, and data models.
  • Develop AWS-native data platforms using AWS Glue, EMR, MWAA, S3, RDS, and CloudWatch.
  • Build ingestion, transformation, and orchestration workflows for structured and semi-structured data using Iceberg and Parquet.
  • Design and optimize analytical platforms using Athena, Trino, Hive, OpenSearch, and enterprise data catalogs.
  • Build AI-enabled data solutions using Amazon Bedrock, RAG pipelines, and vector search technologies.
  • Develop cloud infrastructure as code with CloudFormation and support GitHub-based CI/CD pipelines.
  • Improve platform reliability, scalability, performance, and maintainability through monitoring, troubleshooting, automation, and optimization.
  • Support AWS-based federal data environments while implementing FedRAMP and NIST SP 800-53 security controls.
  • Mentor junior engineers through technical guidance, architecture discussions, and code reviews.
  • Collaborate with cross-functional Agile teams to define requirements and deliver data solutions.

Requirements

  • U.S. citizenship and ability to obtain Public Trust clearance.
  • Bachelor's degree in Computer Science, Engineering, or a related technical field.
  • 8+ years of professional experience in data engineering, data architecture, or related fields.
  • Strong hands-on experience with Apache Spark (PySpark), Python, SQL, relational databases, ETL/ELT development, and data modeling.
  • Experience with AWS Glue, Amazon EMR, Amazon MWAA (Apache Airflow), AWS Lambda, Amazon S3, and Amazon RDS.
  • Experience building scalable data pipelines, workflow orchestration, and enterprise data integration solutions.
  • Experience with data lake technologies and formats, including Parquet and Iceberg.
  • Experience designing solutions using relational and NoSQL databases and optimizing enterprise-scale data platforms.
  • Experience working in Agile software development environments, with strong analytical, communication, and problem-solving skills.
  • Experience in regulated financial environments, unstructured data processing, vector search, LLMs, generative AI, or lakehouse architectures (preferred).

Benefits

  • Estimated annual salary range of $165,000 to $225,000.
  • Remote work options.
  • Medical, dental, and vision insurance.
  • Life insurance and short- and long-term disability coverage.
  • 401(k) with 4% employer matching.
  • Liberal PTO vacation policy.
  • Annual continuing education funding and wellness budget.
  • Employee assistance program and referral/performance-based bonus incentives.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Inductive

Data Engineer

Inductive 51-200 Health Care Providers & Services

Join InductiveHealth as a Data Engineer to modernize and operate secure, scalable public health data pipelines that support disease surveillance and decision-making for public health agencies.

United States Full-time Mid Level Data Engineer
$130k-$145k
Agile AWS Azure CI/CD Docker Elasticsearch Encryption GitHub GitHub Actions Grafana Kafka Kubernetes OpenSearch Python Secrets Management SQL Terraform
10 hours, 8 minutes ago
Ampd Energy

Senior Engineer - Platform & Data Infrastructure

Ampd Energy 51-200 Electrical Equipment

Ampd Energy is seeking a hands-on senior software engineer to scale and stabilize Enernet, its cloud platform for monitoring and managing connected battery energy storage systems on construction sites.

India Full-time Senior Data Engineer
AWS ClickHouse Go Grafana GraphQL InfluxDB Kafka NestJS Node.js REST API SQL Terraform TimescaleDB TypeScript Vue.js
10 hours, 8 minutes ago
MUTT DATA

#8 Data Engineer Senior - Databricks - Mexico

MUTT DATA 51-200 Internet Software & Services

Muttdata is seeking a remote Data Engineer to build and govern scalable data products for a multinational beverage company in Mexico City.

Mexico Full-time Senior Data Engineer
Apache Spark AWS Azure Databricks dbt Deep Learning GCP Generative AI Looker Machine Learning Python Tableau
10 hours, 23 minutes ago
MUTT DATA

#8 Data Engineer Senior - Databricks - Latam

MUTT DATA 51-200 Internet Software & Services

Muttdata is seeking a remote Data Engineer to build and govern data products for a multinational beverage company in Mexico City, enabling scalable analytics and decision-making.

Latin America Full-time Senior Data Engineer
Apache Spark AWS Azure Databricks dbt Deep Learning GCP Generative AI Looker Machine Learning Python Tableau
10 hours, 23 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers