RemoteLeaf Logo
Log in Sign up

Senior Data Engineer: Data Lake (Remote)

15 hours, 46 minutes ago
Anywhere
Full-time
Senior
Data Engineer
DevOps and Infrastructure
Apache Spark AWS ClickHouse CloudFormation Databricks FastAPI LLM Machine Learning OpenTelemetry PagerDuty Prometheus Python Terraform Trino
Apply Now
Constructor

Constructor

The only site search and product discovery built for ecommerce KPIs. Delivering superior experiences with AI, NLP, data and personalization.

Internet Software & Services
View All Jobs 29

Description

  • Maintain the data pipeline job framework used by internal data teams.
  • Develop and improve the data quality framework for validating internal and external data sources.
  • Maintain and evolve the public-facing data ingestion service handling 17,000+ requests per second.
  • Build and support core data pipelines in both batch and streaming modes.
  • Provide last-line support for internal platform users and troubleshoot platform issues.
  • Participate in an on-call rotation for data platform incidents.
  • Work on public-facing APIs for event ingestion and real-time analytics.
  • Contribute to platform infrastructure, monitoring, and developer tooling for data pipelines.
  • Collaborate with data scientists, ML engineers, and analytics teams to gather feedback and improve reliability and usability.
  • Help migrate batch workloads to streaming solutions and improve timely data delivery.

Requirements

  • Fluent English.
  • 4+ years of experience building production services and data pipelines, in batch and/or streaming environments.
  • Strong experience with Python or the ability to ramp up quickly.
  • Hands-on experience with at least one MPP system such as Spark, Trino, or Redshift.
  • Hands-on experience operating services in a cloud environment, with AWS preferred.
  • Experience with Terraform, CloudFormation, or other infrastructure-as-code tools is preferred.
  • Experience with ClickHouse or similar analytical databases is preferred.
  • Experience with data quality or observability tools is preferred.

Benefits

  • Unlimited vacation time, with strong encouragement to take at least 3 weeks per year.
  • Fully remote work anywhere you choose.
  • Work-from-home stipend to support your home office setup.
  • Apple laptop provided for new employees.
  • Annual training and development budget.
  • Maternity and paternity leave for qualified employees.
  • Base salary of $80k–$120k USD, depending on knowledge, skills, experience, and interview results.
  • Stock options in addition to base salary.
  • Regular team offsites to connect and collaborate.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Orcrist Technologies

Data Engineer (Python)

Orcrist Technologies Internet Software & Services

Orcrist is seeking a Data Engineer to prototype and validate new data pipelines and connectors for its Kubernetes-based intelligence platform, with the goal of producing adoptable blueprints for productization.

Germany Full-time Mid Level Data Engineer
Hive Kafka Kubernetes PostgreSQL Python SQL Trino
16 minutes ago
Capital Rx

Data Engineer I

Capital Rx 251-1K Health Care Providers & Services

Judi Health is hiring a Data Engineer I (Analytics Engineering) to build analytics-ready datasets, trusted metrics, and scalable data models for Capital Rx’s healthcare data platform.

United States Full-time Entry Level Data Engineer
$100k-$120k
CI/CD dbt Git PostgreSQL Python Snowflake SQL
16 minutes ago
DataKind

Data Engineer (Remote-US)

DataKind 51-250 Diversified Consumer Services

DataKind is hiring a remote Data Engineer to support higher education institutions by building and maintaining the UDTS data platform and partnering directly with clients to improve student outcomes.

United States Full-time Mid Level Data Engineer
$106k-$120k
Databricks GCP JavaScript Python SQL
31 minutes ago
Mark43

Lead Data Engineer

Mark43 251-1K Professional Services

Mark43 is seeking a Lead Data Engineer to own strategic data infrastructure work for software used by first responders, combining technical leadership, hands-on execution, and cross-functional partnership.

United States Canada United Kingdom Full-time Lead Data Engineer
$170k-$210k
Apache Airflow AWS dbt MySQL Python SQL SQL Server Terraform
1 hour, 1 minute ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers