RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

4 days, 16 hours ago
United States
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark ClickHouse dbt Docker Feature Engineering Flink GCP GitHub Actions Kafka Kubernetes Machine Learning Python REST API Snowflake SQL Vertex AI
Apply Now
Hack The Box

Hack The Box

Hack The Box serves as a premier Cybersecurity Performance Center, providing advanced training and certification resources for both aspiring security professionals and established teams to enhance their skills and drive peak cyber performance.

Internet Software & Services
51-250
Founded 2017
$70M raised
View All Jobs 11

Description

  • Own and evolve batch and streaming data pipelines on GCP end to end.
  • Design and build ELT/ETL processes using BigQuery, ClickHouse, Pub/Sub, Kafka, and Dataflow.
  • Orchestrate data workflows in Airflow, including SLAs, retries, and data quality gates.
  • Model and serve data for analytics, ML training, feature pipelines, and online inference.
  • Partner with ML engineers on feature stores, drift monitoring, and retraining workflows.
  • Support the migration from Snowflake to a GCP-native stack and retire legacy pipelines.
  • Consume and build REST APIs and integrate third-party SaaS data sources.
  • Improve data quality, reliability, observability, and cost efficiency.
  • Translate stakeholder requirements into well-scoped data products.
  • Treat infrastructure and deployment practices with an infrastructure-as-code and CI/CD mindset.

Requirements

  • Strong data modeling and warehouse architecture skills, including dimensional, event-driven, and lakehouse patterns.
  • Hands-on experience with GCP data services; BigQuery is required, with Pub/Sub, Dataflow, Bigtable, and Cloud Composer as strong pluses.
  • Production experience with streaming pipelines using Dataflow/Beam, Flink, or Spark Structured Streaming.
  • Experience ingesting data from Kafka and/or Pub/Sub.
  • Strong SQL skills and strong Python, with production-quality code experience.
  • Production experience with ClickHouse or another columnar OLAP engine.
  • Workflow orchestration experience with Airflow or similar tools such as Prefect or Dagster.
  • Comfort with dbt or equivalent transformation frameworks.
  • Experience migrating from legacy warehouses such as Snowflake, Redshift, or Synapse is a plus.
  • Working knowledge of ML production concepts such as feature engineering, feature stores, model deployment, drift monitoring, and retraining.
  • Docker and Kubernetes experience.
  • CI/CD mindset, infrastructure-as-code sensibility, and a bias toward simple, observable systems.
  • Bonus experience with CDC tooling such as Datastream or Debezium, and with Vertex AI / Feature Store.

Benefits

  • $140,000-$160,000 compensation.
  • Medical, dental, and vision coverage with employee premiums 100% paid by Hack The Box.
  • 401(k) with employer match.
  • Paid parental leave.
  • 25 annual leave days.
  • Home office allowance.
  • Dedicated budget for training, professional development, and conference participation.
  • State-of-the-art equipment and full access to Hack The Box lab offerings.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Dan.com - a GoDaddy brand

Data Engineer IV (6249)

Dan.com - a GoDaddy brand Internet Software & Services

itD is hiring a Data Engineer IV to build and optimize AWS-based data infrastructure and pipelines that support AI infrastructure and inference initiatives in a remote role.

United States Contract Lead Data Engineer
AWS
15 hours, 16 minutes ago
Xebia

Senior Data Engineer (GCP)

Xebia 1K-5K Internet Software & Services

Xebia is hiring a data engineer to support a BigQuery migration by building and maintaining scalable data pipelines for production reporting, analytics, and business intelligence solutions.

Romania Bulgaria Poland Europe Senior Data Engineer
Apache Airflow CI/CD Databricks dbt Git Python Snowflake SQL
15 hours, 16 minutes ago
Coupang

Staff Data Engineer (Coupang Pay)

Coupang 1K-5K Internet Software & Services

쿠팡페이 핀테크 데이터 플랫폼 팀의 Staff Data Engineer로서 실시간 결제·주문 데이터를 기반으로 데이터 파이프라인과 분석 인프라를 구축·고도화하는 역할입니다.

South Korea Full-time Lead Data Engineer
Apache Spark AWS ClickHouse Flink Hive Java Presto Python Scala SQL Tableau
15 hours, 31 minutes ago
Cresteo

Data Migration Engineer (SQL Server / TSQL)

Cresteo 51-200 information technology & services

Cresteo is hiring a Data Migration Engineer to own end-to-end SQL Server data migrations from legacy schemas into reconciled, production-ready data for US-based clients and international teams.

Latin America Full-time Senior Database Administrator Data Engineer
JSON SQL Server
15 hours, 31 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers