RemoteLeaf Logo
Log in Sign up

Senior Data Engineer

3 weeks, 3 days ago
United States
Full-time
Senior
Data Engineer
Software Development
Apache Airflow Apache Spark ClickHouse dbt Docker Feature Engineering Flink GCP GitHub Actions Kafka Kubernetes Machine Learning Python REST API Snowflake SQL Vertex AI
Apply Now
Hack The Box

Hack The Box

Hack The Box serves as a premier Cybersecurity Performance Center, providing advanced training and certification resources for both aspiring security professionals and established teams to enhance their skills and drive peak cyber performance.

Internet Software & Services
51-250
Founded 2017
$70M raised
View All Jobs 12

Description

  • Own and evolve batch and streaming data pipelines on GCP end to end.
  • Design and build ELT/ETL processes using BigQuery, ClickHouse, Pub/Sub, Kafka, and Dataflow.
  • Orchestrate data workflows in Airflow, including SLAs, retries, and data quality gates.
  • Model and serve data for analytics, ML training, feature pipelines, and online inference.
  • Partner with ML engineers on feature stores, drift monitoring, and retraining workflows.
  • Support the migration from Snowflake to a GCP-native stack and retire legacy pipelines.
  • Consume and build REST APIs and integrate third-party SaaS data sources.
  • Improve data quality, reliability, observability, and cost efficiency.
  • Translate stakeholder requirements into well-scoped data products.
  • Treat infrastructure and deployment practices with an infrastructure-as-code and CI/CD mindset.

Requirements

  • Strong data modeling and warehouse architecture skills, including dimensional, event-driven, and lakehouse patterns.
  • Hands-on experience with GCP data services; BigQuery is required, with Pub/Sub, Dataflow, Bigtable, and Cloud Composer as strong pluses.
  • Production experience with streaming pipelines using Dataflow/Beam, Flink, or Spark Structured Streaming.
  • Experience ingesting data from Kafka and/or Pub/Sub.
  • Strong SQL skills and strong Python, with production-quality code experience.
  • Production experience with ClickHouse or another columnar OLAP engine.
  • Workflow orchestration experience with Airflow or similar tools such as Prefect or Dagster.
  • Comfort with dbt or equivalent transformation frameworks.
  • Experience migrating from legacy warehouses such as Snowflake, Redshift, or Synapse is a plus.
  • Working knowledge of ML production concepts such as feature engineering, feature stores, model deployment, drift monitoring, and retraining.
  • Docker and Kubernetes experience.
  • CI/CD mindset, infrastructure-as-code sensibility, and a bias toward simple, observable systems.
  • Bonus experience with CDC tooling such as Datastream or Debezium, and with Vertex AI / Feature Store.

Benefits

  • $140,000-$160,000 compensation.
  • Medical, dental, and vision coverage with employee premiums 100% paid by Hack The Box.
  • 401(k) with employer match.
  • Paid parental leave.
  • 25 annual leave days.
  • Home office allowance.
  • Dedicated budget for training, professional development, and conference participation.
  • State-of-the-art equipment and full access to Hack The Box lab offerings.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Cortex

Senior Data Engineer

Cortex 11-50 Internet Software & Services

Cortex is hiring a Senior Data Engineer to own internal data systems and pipelines that power company-wide reporting, product analytics, and AI-driven operations from a fully remote US-based team.

United States Full-time Senior Data Engineer
$175k-$205k
ClickHouse dbt GCP OpenTelemetry Python Segment SQL
16 hours, 8 minutes ago
Standard Metrics

Data Solutions Engineer

Standard Metrics 11-50 Capital Markets

Standard Metrics is hiring a Data Solutions Engineer to own customer-facing data workflows, integrations, and AI-driven automation for a financial data platform serving investors and portfolio companies.

United States Mid Level Data Engineer Solutions Engineer
dbt LLM Python REST API Snowflake SQL
1 day, 16 hours ago
Oportun

Senior Data Engineer (R13923)

Oportun 1K-5K Banks

Oportun is hiring a Senior Data Engineer to design and deliver scalable data platforms and solutions that support business and analytical needs across cross-functional initiatives.

Mexico Full-time Senior Data Engineer
Agile Apache Airflow Apache Spark AWS Azure Databricks GCP Hadoop Java Jenkins Kafka Kanban MariaDB PostgreSQL Python Scala Scrum SQL
2 days, 16 hours ago
Xebia

AWS Senior DevOps Engineer

Xebia 1K-5K Internet Software & Services

Xebia is hiring a Senior DevOps Engineer to provision and operate a multi-region AWS environment for a US expansion while maintaining parity with the existing EU setup and supporting analytics and security operations.

Bulgaria Romania Senior Data Engineer DevOps Engineer
AWS CI/CD Penetration Testing PostgreSQL
2 days, 16 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers