RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

2 months, 2 weeks ago
United States
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark ClickHouse dbt Docker Feature Engineering Flink GCP GitHub Actions Kafka Kubernetes Machine Learning Python REST API Snowflake SQL Vertex AI
Apply Now
Hack The Box

Hack The Box

Hack The Box serves as a premier Cybersecurity Performance Center, providing advanced training and certification resources for both aspiring security professionals and established teams to enhance their skills and drive peak cyber performance.

Internet Software & Services
51-250
Founded 2017
$70M raised
View All Jobs 10

Description

  • Own and evolve batch and streaming data pipelines on GCP end to end.
  • Design and build ELT/ETL processes using BigQuery, ClickHouse, Pub/Sub, Kafka, and Dataflow.
  • Orchestrate data workflows in Airflow, including SLAs, retries, and data quality gates.
  • Model and serve data for analytics, ML training, feature pipelines, and online inference.
  • Partner with ML engineers on feature stores, drift monitoring, and retraining workflows.
  • Support the migration from Snowflake to a GCP-native stack and retire legacy pipelines.
  • Consume and build REST APIs and integrate third-party SaaS data sources.
  • Improve data quality, reliability, observability, and cost efficiency.
  • Translate stakeholder requirements into well-scoped data products.
  • Treat infrastructure and deployment practices with an infrastructure-as-code and CI/CD mindset.

Requirements

  • Strong data modeling and warehouse architecture skills, including dimensional, event-driven, and lakehouse patterns.
  • Hands-on experience with GCP data services; BigQuery is required, with Pub/Sub, Dataflow, Bigtable, and Cloud Composer as strong pluses.
  • Production experience with streaming pipelines using Dataflow/Beam, Flink, or Spark Structured Streaming.
  • Experience ingesting data from Kafka and/or Pub/Sub.
  • Strong SQL skills and strong Python, with production-quality code experience.
  • Production experience with ClickHouse or another columnar OLAP engine.
  • Workflow orchestration experience with Airflow or similar tools such as Prefect or Dagster.
  • Comfort with dbt or equivalent transformation frameworks.
  • Experience migrating from legacy warehouses such as Snowflake, Redshift, or Synapse is a plus.
  • Working knowledge of ML production concepts such as feature engineering, feature stores, model deployment, drift monitoring, and retraining.
  • Docker and Kubernetes experience.
  • CI/CD mindset, infrastructure-as-code sensibility, and a bias toward simple, observable systems.
  • Bonus experience with CDC tooling such as Datastream or Debezium, and with Vertex AI / Feature Store.

Benefits

  • $140,000-$160,000 compensation.
  • Medical, dental, and vision coverage with employee premiums 100% paid by Hack The Box.
  • 401(k) with employer match.
  • Paid parental leave.
  • 25 annual leave days.
  • Home office allowance.
  • Dedicated budget for training, professional development, and conference participation.
  • State-of-the-art equipment and full access to Hack The Box lab offerings.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Babylist

Senior Data Engineer

Babylist 251-1K Internet Software & Services

Babylist is hiring a senior Data Engineering individual contributor to build scalable data infrastructure and AI-native systems that automate pipeline generation, testing, and maintenance across its growing e-commerce platform.

Canada Full-time Senior Data Engineer
Apache Airflow AWS dbt Python Snowflake
2 hours, 46 minutes ago
Alimentiv

Senior Data Engineer (India)

Alimentiv 251-1K Professional Services

The Lead Data Engineer will architect and operationalize enterprise-scale data solutions for analytics and AI/ML initiatives, ensuring integrated, governed, and production-ready data platforms while providing technical leadership.

India Full-time Senior Data Engineer
$25k-$43k
Apache Spark Azure CI/CD Databricks Git HIPAA JSON Looker Power BI REST API SQL Tableau Terraform
2 hours, 46 minutes ago
Bellese Technologies

Senior Engineer, Data

Bellese Technologies 51-250 Internet Software & Services

Bellese is seeking an Engineer II to build and improve backend systems, data integrations, APIs, and user interfaces that support digital solutions for civic healthcare and better public health outcomes.

United States Full-time Senior Data Engineer
$129k-$153k
Agile Apache Spark AWS CI/CD Databricks Python R
2 hours, 46 minutes ago
Capco

Desenvolvedor(a) de Integração AWS - COM INGLÊS - Remoto

Capco 5K-10K Internet Software & Services

A Capco busca um(a) Desenvolvedor(a) de Integração experiente para conectar uma plataforma ETRM a um Data Warehouse corporativo e sistemas downstream, desenvolvendo adaptadores e pipelines de dados em ambientes AWS.

Brazil Full-time Senior Cloud Engineer Data Engineer
AWS CI/CD Python Serverless SQL
3 hours, 16 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers