RemoteLeaf Logo
Log in Sign up

Engineering Manager- Data Engineering

3 months, 2 weeks ago
India
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS Git Python Scala Scrum SQL
Apply Now
GroundTruth

GroundTruth

GroundTruth is a media platform that leverages real-world behavior to deliver marketing solutions that drive tangible business outcomes.

Media
251-1K
Founded 2009
View All Jobs 14

Description

  • Architect and deploy large-scale distributed data processing pipelines using PySpark on Amazon EMR and AWS Glue.
  • Build and evolve core data infrastructure for the audience platform and related analytics services.
  • Write production-ready Python and PySpark code, conduct code reviews, and optimize Spark performance and cost efficiency.
  • Coach and mentor data engineers on Python, Spark optimization, data modeling, and career growth.
  • Partner with stakeholders and engineering leadership to plan and deliver data-first initiatives across advertising, analytics, and reporting.
  • Apply Agile practices such as Scrum to support iterative delivery and cross-team collaboration.
  • Manage team performance through regular 1:1s, feedback, quarterly reviews, recognition, and performance management.
  • Support data quality, pipeline reliability, and modernized delivery through AI-assisted engineering practices.

Requirements

  • Bachelor’s degree in Computer Engineering, Data Science, or equivalent practical experience.
  • 8+ years of experience in technology, with a focus on data engineering, data warehousing, or big data architecture.
  • 2+ years of experience leading a data engineering team.
  • Deep expertise in Python and PySpark for distributed processing, data skew handling, and Spark memory optimization.
  • Strong AWS experience managing Amazon EMR for large-scale processing.
  • Experience building ETL systems with SQL and AWS big data technologies such as S3, EMR, Glue, Athena, and Lambda.
  • Expert-level SQL skills for complex transformations, performance tuning, and analytics.
  • Advanced proficiency with Airflow and Git.
  • Hands-on experience with AI-native tools such as Cursor, Claude, or GitHub Copilot, and using AI to improve data engineering workflows.
  • Preferred experience with debugging complex PySpark and/or Scala jobs, optimizing EMR Instance Fleets/Spot Instances, and event-driven architecture using AWS SQS.
  • AWS certification preferred.
  • Organized, collaborative, detail-oriented, and strong at communicating technical trade-offs to business partners.

Benefits

  • Parental leave for maternity and paternity.
  • Flexible time off, including earned leave, sick leave, birthday leave, bereavement leave, and company holidays.
  • Daily in-office catered breakfast, lunch, snacks, and beverages.
  • Health coverage for hospitalization, including coverage for the employee’s nuclear family and parents.
  • Free tele-med consultations plus discounts on health checkups and medicines.
  • Wellness and gym reimbursement.
  • Pet expense reimbursement.
  • Childcare expenses and reimbursements, including creche reimbursement.
  • Employee referral program and education/skill development reimbursement programs.
  • Cell phone and internet reimbursement options, plus meal card and retirement-related benefits such as provident fund and national pension contributions.
  • Co-working space reimbursement and special benefits on salary account.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

BeyondTrust

Sr Software Development Manager

BeyondTrust 1K-5K Professional Services

BeyondTrust is seeking a Senior Software Development Manager to lead the Pathfinder NHI Governance team building secure, scalable services and a new platform-native module for identity security across cloud and on-premise environments.

United States Canada Full-time Lead Engineering Manager
Agile AWS Cybersecurity Microservices OAuth OpenID Connect
22 hours, 29 minutes ago
appflame

Engineering Manager – Engagement Stream

appflame 251-1K Internet Software & Services

appflame is hiring an Engineering Manager to lead multiple teams working on the Hily dating app and improve delivery, quality, and engineering execution across the business domain.

Ukraine Full-time Lead Engineering Manager
Agile Android iOS LLM PHP
22 hours, 44 minutes ago
Accenture

Data Conversion Developer

Accenture 100K+ Professional Services

Accenture Federal Services is seeking a Data Conversion Developer to support migration of legacy enterprise data into Oracle Cloud ERP for federal mission systems.

United States Full-time Mid Level Data Engineer
$100k-$203k
SQL
22 hours, 44 minutes ago
Zendesk

Engineering Manager -Analytics House

Zendesk 5K-10K Professional Services

DoiT is hiring a remote Engineering Manager for its Analytics House team to lead delivery and growth for cloud intelligence products in a global R&D organization.

United States United Kingdom Netherlands Sweden Estonia Ireland Israel Full-time Lead Engineering Manager
Agile AWS Azure GCP Generative AI Kubernetes REST API SQL
22 hours, 44 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers