RemoteLeaf Logo
Log in Sign up

Data Engineer

1 month ago
United States
Full-time
Senior
Data Engineer
Software Development
Apache Spark AWS Docker Generative AI Grafana Hadoop Kafka Scala Snowflake
Apply Now
Resonate

Resonate

Resonate offers AI-powered consumer data intelligence and activation software that helps organizations understand and engage their audiences effectively, predicting and capitalizing on changing consumer preferences for growth and success.

Media
51-250
Founded 2007
$42M raised
View All Jobs 7

Description

  • Design, develop, and maintain ETL/ELT pipelines for the Resonate business on Spark and Scala in AWS EMR.
  • Work with terabyte-scale datasets across S3 and Snowflake.
  • Tune multi-terabyte and petabyte-scale Spark applications for performance and cost.
  • Debug production issues in the big data environment and fix root causes.
  • Partner with senior engineers and product management to move requests from design and planning into production pipelines.
  • Monitor pipeline health in Grafana and investigate data quality issues.
  • Write clean, testable code with thorough unit and integration tests.
  • Use generative AI tools across pipeline development, monitoring, and day-to-day engineering work.
  • Participate in code reviews, technical design discussions, and sprint planning.
  • Support production operations, including on-call rotation and incident response.

Requirements

  • Around 5+ years of professional experience in software engineering, data engineering, or a closely related field.
  • At least 3 years of hands-on experience with Spark and Scala, specifically the DataFrame and Dataset APIs.
  • Proven experience tuning Spark applications at multi-terabyte or petabyte scale.
  • Strong debugging and problem-solving experience in the big data ecosystem, including production failures.
  • Solid relational database experience.
  • Working knowledge of AWS (EMR, S3, Lambda), Kafka, Snowflake, Grafana, Hadoop, Elastic Stack, and Docker.
  • Strong understanding of the full software development lifecycle, solution architecture, data structures, and data modeling.
  • Genuine enthusiasm for using generative AI to accelerate data engineering work.
  • Hands-on experience building and maintaining big data pipelines with Gen AI (preferred).
  • Experience using probabilistic data structures or implementing high-cardinality data systems at scale (preferred).
  • Bachelor’s degree in computer science, computer engineering, or equivalent experience (preferred).

Benefits

  • Remote-first work environment with genuine flexibility.
  • Occasional travel for company and client events.
  • Competitive 401(k) match.
  • Open PTO policy encouraging real time off.
  • Comprehensive benefits package for employees and their families.
  • Uncapped growth potential.
  • Opportunity to make a meaningful impact on the company and its products.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Concurrency

Senior Data Engineer (Contract)

Concurrency 51-250 Internet Software & Services

Concurrency is hiring a Data Engineer for its Cloud, Data & AI Solutions Team to deliver end-to-end Microsoft Azure and Fabric data solutions that support client digital transformation.

United States Contract Senior Data Engineer
Apache Spark Azure CI/CD Git Machine Learning Power BI Python SQL
6 hours, 43 minutes ago
Netomi

Data Engineer II

Netomi 51-250 IT Services

Netomi is hiring a Data Engineer in Gurugram to build reliable data infrastructure and analytics solutions that improve AI-powered enterprise customer experiences and product operations.

India Full-time Mid Level Data Engineer
Apache Airflow Apache Spark CI/CD Databricks Docker HIPAA Kafka Kubernetes Luigi MySQL PostgreSQL Prefect Python RabbitMQ Snowflake SQL
6 hours, 43 minutes ago
CI&T

[Job-31682] Senior Data Engineer [Databricks]

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa engenheira de dados para estruturar e acelerar a plataforma de dados de um grande varejista farmacêutico brasileiro, modernizando a orquestração, a qualidade dos dados e a distribuição de produtos baseados em Databricks.

Brazil Full-time Senior Data Engineer
Apache Airflow Apache Spark AWS Databricks SFTP Terraform
6 hours, 58 minutes ago
payabl.

Data Engineer

payabl. 51-250 Diversified Financial Services

As a Data Engineer at payabl., you will build and maintain reliable data pipelines and business-ready datasets that support analytics and decision-making across the company’s global payments platform.

Cyprus Poland Portugal Full-time Mid Level Data Engineer
Apache Airflow Apache Spark AWS ClickHouse Dagster Databricks dbt Docker Git Kafka Kubernetes MariaDB MongoDB MySQL PostgreSQL Power BI Python Snowflake SQL Tableau Terraform
6 hours, 58 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers