RemoteLeaf Logo
Log in Sign up

Engineering Manager- Data Engineering

2 weeks, 6 days ago
India
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS Git Python Scala Scrum SQL
Apply Now
GroundTruth

GroundTruth

GroundTruth is a media platform that leverages real-world behavior to deliver marketing solutions that drive tangible business outcomes.

Media
251-1K
Founded 2009
View All Jobs 5

Description

  • Architect and deploy large-scale distributed data processing pipelines using PySpark on Amazon EMR and AWS Glue.
  • Build and evolve core data infrastructure for the audience platform and related analytics services.
  • Write production-ready Python and PySpark code, conduct code reviews, and optimize Spark performance and cost efficiency.
  • Coach and mentor data engineers on Python, Spark optimization, data modeling, and career growth.
  • Partner with stakeholders and engineering leadership to plan and deliver data-first initiatives across advertising, analytics, and reporting.
  • Apply Agile practices such as Scrum to support iterative delivery and cross-team collaboration.
  • Manage team performance through regular 1:1s, feedback, quarterly reviews, recognition, and performance management.
  • Support data quality, pipeline reliability, and modernized delivery through AI-assisted engineering practices.

Requirements

  • Bachelor’s degree in Computer Engineering, Data Science, or equivalent practical experience.
  • 8+ years of experience in technology, with a focus on data engineering, data warehousing, or big data architecture.
  • 2+ years of experience leading a data engineering team.
  • Deep expertise in Python and PySpark for distributed processing, data skew handling, and Spark memory optimization.
  • Strong AWS experience managing Amazon EMR for large-scale processing.
  • Experience building ETL systems with SQL and AWS big data technologies such as S3, EMR, Glue, Athena, and Lambda.
  • Expert-level SQL skills for complex transformations, performance tuning, and analytics.
  • Advanced proficiency with Airflow and Git.
  • Hands-on experience with AI-native tools such as Cursor, Claude, or GitHub Copilot, and using AI to improve data engineering workflows.
  • Preferred experience with debugging complex PySpark and/or Scala jobs, optimizing EMR Instance Fleets/Spot Instances, and event-driven architecture using AWS SQS.
  • AWS certification preferred.
  • Organized, collaborative, detail-oriented, and strong at communicating technical trade-offs to business partners.

Benefits

  • Parental leave for maternity and paternity.
  • Flexible time off, including earned leave, sick leave, birthday leave, bereavement leave, and company holidays.
  • Daily in-office catered breakfast, lunch, snacks, and beverages.
  • Health coverage for hospitalization, including coverage for the employee’s nuclear family and parents.
  • Free tele-med consultations plus discounts on health checkups and medicines.
  • Wellness and gym reimbursement.
  • Pet expense reimbursement.
  • Childcare expenses and reimbursements, including creche reimbursement.
  • Employee referral program and education/skill development reimbursement programs.
  • Cell phone and internet reimbursement options, plus meal card and retirement-related benefits such as provident fund and national pension contributions.
  • Co-working space reimbursement and special benefits on salary account.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Natera

Manager, Software Engineering

Natera 1K-5K Pharmaceuticals

Natera is seeking a Manager, Software Engineering to lead a distributed oncology software team supporting high-impact cancer testing products in a fast-growing biotech environment.

United States Full-time Lead Engineering Manager Project Manager
$129k-$162k
Agile Java
54 minutes ago
Samsara

Data Engineer II

Samsara 1K-5K IT Services

Samsara is hiring a remote Data Engineer II to build and scale the Databricks-based data platforms that power its Revenue Operations AI and data infrastructure for GTM analytics and generative AI applications.

United States Full-time Junior Data Engineer
$102k-$154k
Apache Spark AWS Databricks dbt Generative AI Machine Learning Python Salesforce Snowflake SQL
1 hour, 16 minutes ago
GitLab

Engineering Manager, Infrastructure Platforms

GitLab 1K-5K Internet Software & Services

GitLab is hiring an Engineering Manager for Infrastructure Platforms to lead a globally distributed team building secure, reliable, and scalable infrastructure that powers GitLab.com, GitLab Dedicated, and self-managed deployments.

United States Canada United Kingdom Netherlands Ireland Israel Full-time Lead Engineering Manager
$132k-$282k
Agile CI/CD GitLab Go Kubernetes
1 hour, 36 minutes ago
Spotify

Engineering Manager II - Analytics Platform

Spotify Media

Spotify is hiring an Engineering Manager II for its Analytics Platform team in Toronto to lead the Learning Infrastructure Studio in building foundational data science infrastructure and intelligence systems at scale.

Canada Full-time Lead Engineering Manager
7 hours, 16 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers