RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

1 month ago
Remote
Full-time
Senior
Data Engineer
Software Development
Ansible Apache Airflow Argo CD dbt Docker Helm Kafka Kubernetes Looker Presto Python SQL Terraform Trino
Apply Now
Alpaca

Alpaca

Alpaca is a developer-first API for stock and crypto trading, offering easy-to-use APIs for building apps and trading algorithms.

Capital Markets
51-250
Founded 2015
$87M raised
View All Jobs 62

Description

  • Design, build, and evolve core data platform infrastructure, including query engines, orchestration, warehousing, and cataloging.
  • Own lakehouse infrastructure as code using Terraform and Ansible, with deployments on Kubernetes.
  • Build and maintain low-latency streaming, CDC, and batch ingestion pipelines landing data in Apache Iceberg.
  • Develop and scale self-service BI access to lakehouse data for downstream teams and agents.
  • Implement reliability practices including monitoring, alerting, on-call rotations, incident response, maintenance windows, runbooks, and SLAs.
  • Partner with DevOps, Analytics Engineering, and other stakeholders to address infrastructure gaps and evolving data requirements.

Requirements

  • 5+ years of Data Engineering experience, including 2+ years operating scalable, low-latency platforms processing over 100 million events per day.
  • Hands-on experience running data infrastructure on Kubernetes with Docker and Helm.
  • Production experience with infrastructure as code, including Terraform, Ansible, and ArgoCD or equivalent tools.
  • Deep knowledge of distributed storage, transactions, and query processing, with experience operating Trino or Presto.
  • Strong experience with object storage and open table formats, specifically Apache Iceberg.
  • Experience with Kafka, Redpanda, and Debezium for streaming and CDC.
  • Experience with Airflow orchestration and Airbyte ELT pipelines.
  • Strong Python and SQL skills for pipeline and platform development.
  • Experience with Google Cloud Platform data services such as GCS, Cloud Build, Cloud SQL, and Dataproc, or equivalent cloud technologies.
  • Ability to work effectively in a fast-paced startup environment; experience with tools such as Cube, dbt, Looker, Hightouch, OpenMetadata, DataHub, or Apache Ranger is preferred.

Benefits

  • Competitive salary and stock options.
  • Health benefits.
  • $500 one-time new-hire home-office setup allowance.
  • $150 monthly stipend through a Brex Card.
  • Fully distributed, remote work environment.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

RevStar

Databricks Engineer

RevStar 51-250 Internet Software & Services

RevStar is seeking a remote, US-based Databricks Engineer to build and optimize cloud-agnostic Lakehouse data pipelines and MLOps frameworks for enterprise AI projects across AWS, Azure, and GCP.

United States Mexico Argentina Brazil Chile Colombia Venezuela Contract Mid Level Data Engineer
Agile Apache Airflow Apache Spark AWS Azure CI/CD Databricks Feature Engineering HIPAA Kafka MLflow MLOps Prefect Python SQL Terraform
5 hours ago
phData

Senior Data Engineer

phData 251-1K IT Services

Data Engineer at phData, a remote-first global data and AI consultancy, designing and delivering secure, scalable cloud data solutions for enterprise clients.

India Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS Azure Cassandra Databricks dbt Elasticsearch GCP Hadoop HDFS Kafka Luigi Python REST API Scala Snowflake Solr SQL System Design
1 day, 4 hours ago
Abacus Insights

Forward Deployed Data Engineer

Abacus Insights 51-250 Insurance

Abacus Insights is hiring a Forward Deployed Data Engineer to work alongside health plan clients, building governed data foundations, pipelines, and integrations that turn fragmented payer data into analytics-ready products.

United States Full-time Senior Data Engineer
Apache Spark Databricks Snowflake SQL
1 day, 4 hours ago
Azumo

Data Engineer

Azumo 51-250 Internet Software & Services

Azumo is hiring a fully remote Latin America-based Data Engineer to build and operate production ingestion, transformation, storage, warehouse, and retrieval infrastructure that supports client AI systems.

Mexico Argentina Brazil Chile Colombia Peru Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Azure CI/CD Dagster Databricks dbt Docker Flink GCP Git GitHub Actions HIPAA Jupyter Kafka Prefect Python Snowflake SQL Terraform
1 day, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers