RemoteLeaf Logo
Log in Sign up

Engineering Manager- Data Engineering

1 month, 1 week ago
India
Full-time
Lead
Data Engineer
Software Development
Agile Apache Airflow Apache Spark AWS Git Python Scala Scrum SQL
Apply Now
GroundTruth

GroundTruth

GroundTruth is a media platform that leverages real-world behavior to deliver marketing solutions that drive tangible business outcomes.

Media
251-1K
Founded 2009
View All Jobs 8

Description

  • Architect and deploy large-scale distributed data processing pipelines using PySpark on Amazon EMR and AWS Glue.
  • Build and evolve core data infrastructure for the audience platform and related analytics services.
  • Write production-ready Python and PySpark code, conduct code reviews, and optimize Spark performance and cost efficiency.
  • Coach and mentor data engineers on Python, Spark optimization, data modeling, and career growth.
  • Partner with stakeholders and engineering leadership to plan and deliver data-first initiatives across advertising, analytics, and reporting.
  • Apply Agile practices such as Scrum to support iterative delivery and cross-team collaboration.
  • Manage team performance through regular 1:1s, feedback, quarterly reviews, recognition, and performance management.
  • Support data quality, pipeline reliability, and modernized delivery through AI-assisted engineering practices.

Requirements

  • Bachelor’s degree in Computer Engineering, Data Science, or equivalent practical experience.
  • 8+ years of experience in technology, with a focus on data engineering, data warehousing, or big data architecture.
  • 2+ years of experience leading a data engineering team.
  • Deep expertise in Python and PySpark for distributed processing, data skew handling, and Spark memory optimization.
  • Strong AWS experience managing Amazon EMR for large-scale processing.
  • Experience building ETL systems with SQL and AWS big data technologies such as S3, EMR, Glue, Athena, and Lambda.
  • Expert-level SQL skills for complex transformations, performance tuning, and analytics.
  • Advanced proficiency with Airflow and Git.
  • Hands-on experience with AI-native tools such as Cursor, Claude, or GitHub Copilot, and using AI to improve data engineering workflows.
  • Preferred experience with debugging complex PySpark and/or Scala jobs, optimizing EMR Instance Fleets/Spot Instances, and event-driven architecture using AWS SQS.
  • AWS certification preferred.
  • Organized, collaborative, detail-oriented, and strong at communicating technical trade-offs to business partners.

Benefits

  • Parental leave for maternity and paternity.
  • Flexible time off, including earned leave, sick leave, birthday leave, bereavement leave, and company holidays.
  • Daily in-office catered breakfast, lunch, snacks, and beverages.
  • Health coverage for hospitalization, including coverage for the employee’s nuclear family and parents.
  • Free tele-med consultations plus discounts on health checkups and medicines.
  • Wellness and gym reimbursement.
  • Pet expense reimbursement.
  • Childcare expenses and reimbursements, including creche reimbursement.
  • Employee referral program and education/skill development reimbursement programs.
  • Cell phone and internet reimbursement options, plus meal card and retirement-related benefits such as provident fund and national pension contributions.
  • Co-working space reimbursement and special benefits on salary account.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Natera

Head of Data Engineering & Platform, Real-World Data (RWD)

Natera 1K-5K Pharmaceuticals

Natera is hiring a Head of Data Engineering & Platform for Real-World Data to lead the strategy, development, and delivery of a healthcare data platform that supports clinical, research, analytics, and business needs.

United States Full-time Lead Data Engineer
$154k-$193k
Agile AWS CI/CD Machine Learning PostgreSQL Python REST API Snowflake SQL
1 hour, 57 minutes ago
Knak

Senior Data Engineer

Knak 51-250 Internet Software & Services

Knak is hiring its first Data Engineer to architect the governed Snowflake data layer that powers company-wide self-serve analytics, AI agents, and department-specific data access.

Canada Full-time Senior Data Engineer
AWS Databricks dbt GCP Git LinkedIn Ads Looker Mixpanel Mode MySQL Pandas Python Salesforce Snowflake SQL Tableau
2 hours, 38 minutes ago
Remote

Engineering Team Leader

Remote 251-1K Professional Services

Remote is hiring a Team Leader to manage a small engineering team and drive efficient product delivery across a fully remote, globally distributed organization.

Remote
Full-time Lead Engineering Manager
$75k-$170k
Elixir Microservices Phoenix Ruby
3 hours, 42 minutes ago
Lingaro

SAP BW Lead

Lingaro 5K-10K IT Services

SAP BW Lead for Poland’s CC Data Engineering & Management team at SAP, responsible for leading SAP BW-related data engineering work in a full-time remote role.

Poland Full-time Lead Data Engineer
3 hours, 51 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers