RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

1 month, 3 weeks ago
United States
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark ClickHouse dbt Docker Feature Engineering Flink GCP GitHub Actions Kafka Kubernetes Machine Learning Python REST API Snowflake SQL Vertex AI
Apply Now
Hack The Box

Hack The Box

Hack The Box serves as a premier Cybersecurity Performance Center, providing advanced training and certification resources for both aspiring security professionals and established teams to enhance their skills and drive peak cyber performance.

Internet Software & Services
51-250
Founded 2017
$70M raised
View All Jobs 12

Description

  • Own and evolve batch and streaming data pipelines on GCP end to end.
  • Design and build ELT/ETL processes using BigQuery, ClickHouse, Pub/Sub, Kafka, and Dataflow.
  • Orchestrate data workflows in Airflow, including SLAs, retries, and data quality gates.
  • Model and serve data for analytics, ML training, feature pipelines, and online inference.
  • Partner with ML engineers on feature stores, drift monitoring, and retraining workflows.
  • Support the migration from Snowflake to a GCP-native stack and retire legacy pipelines.
  • Consume and build REST APIs and integrate third-party SaaS data sources.
  • Improve data quality, reliability, observability, and cost efficiency.
  • Translate stakeholder requirements into well-scoped data products.
  • Treat infrastructure and deployment practices with an infrastructure-as-code and CI/CD mindset.

Requirements

  • Strong data modeling and warehouse architecture skills, including dimensional, event-driven, and lakehouse patterns.
  • Hands-on experience with GCP data services; BigQuery is required, with Pub/Sub, Dataflow, Bigtable, and Cloud Composer as strong pluses.
  • Production experience with streaming pipelines using Dataflow/Beam, Flink, or Spark Structured Streaming.
  • Experience ingesting data from Kafka and/or Pub/Sub.
  • Strong SQL skills and strong Python, with production-quality code experience.
  • Production experience with ClickHouse or another columnar OLAP engine.
  • Workflow orchestration experience with Airflow or similar tools such as Prefect or Dagster.
  • Comfort with dbt or equivalent transformation frameworks.
  • Experience migrating from legacy warehouses such as Snowflake, Redshift, or Synapse is a plus.
  • Working knowledge of ML production concepts such as feature engineering, feature stores, model deployment, drift monitoring, and retraining.
  • Docker and Kubernetes experience.
  • CI/CD mindset, infrastructure-as-code sensibility, and a bias toward simple, observable systems.
  • Bonus experience with CDC tooling such as Datastream or Debezium, and with Vertex AI / Feature Store.

Benefits

  • $140,000-$160,000 compensation.
  • Medical, dental, and vision coverage with employee premiums 100% paid by Hack The Box.
  • 401(k) with employer match.
  • Paid parental leave.
  • 25 annual leave days.
  • Home office allowance.
  • Dedicated budget for training, professional development, and conference participation.
  • State-of-the-art equipment and full access to Hack The Box lab offerings.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Binance

Senior Financial AI Engineer (Data & Knowledge Engineering)

Binance 5K-10K Capital Markets

Binance is hiring an AI Data Processing and Knowledge Services Engineer to build production-grade financial data, knowledge bases, and RAG services supporting its equities business and AI products.

Hong Kong Taiwan Full-time Senior Data Engineer Machine Learning Engineer
Blockchain Java Machine Learning Python
11 hours, 54 minutes ago
Lingaro

Data Engineer GCP Mexico

Lingaro 5K-10K IT Services

Data Engineer responsible for designing, building, and deploying cloud-based data infrastructure and pipelines on GCP to support reliable data integration, transformation, and analysis.

Mexico Full-time Mid Level Cloud Engineer Data Engineer
Apache Airflow Apache Spark Azure Confluence Databricks dbt GCP Git JIRA Looker Power BI Python SQL Tableau
12 hours, 9 minutes ago
Celerion

Application & Data Integration Developer

Celerion 251-1K Pharmaceuticals

Celerion is seeking a fully remote Application & Data Integration Developer in the Central or Eastern U.S. time zones to build and support reliable integrations, data pipelines, and models connecting enterprise applications and analytics systems.

United States Full-time Mid Level Data Engineer Software Engineer
Oracle Perl Python REST API Snowflake SQL SQL Server
12 hours, 9 minutes ago
MyFitnessPal

Staff Data Engineer

MyFitnessPal 10K-50K Health Care Providers & Services

MyFitnessPal is seeking a Staff Data Engineer to lead the development and modernization of scalable data platforms, pipelines, and governance systems that power analytics, product insights, and the company’s health and fitness ecosystem.

United States Full-time Lead Data Engineer
$170k-$230k
Amplitude Apache Airflow AWS CI/CD dbt Docker DynamoDB Elasticsearch GitHub Kafka Kubernetes Microservices MongoDB MySQL PlanetScale Python Redis REST API Scala Snowflake SOAP SQL Terraform
12 hours, 54 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers