RemoteLeaf Logo
Log in Sign up

Senior Software Engineer (Data Platform)

5 months ago
India
Full-time
Senior
Software Engineer
Software Development
Apache Spark Databricks Kafka
Apply Now
G-P/Globalization Partners

G-P/Globalization Partners

G P offers Employer of Record solutions for global team management in 180+ countries, combining EOR, Payroll, and HCM solutions for streamlined and compliant workforce expansion.

Professional Services
1K-5K
View All Jobs 13

Description

  • Lead the design and implementation of internal SDKs and self-service frameworks for distributed engineering teams.
  • Build reusable patterns for batch and real-time event processing as part of a broader platform engineering approach.
  • Own the performance and cost-effectiveness of the Databricks ecosystem, including Spark tuning and autoscaling strategies.
  • Optimize Spark execution plans, shuffle partitions, and DBU consumption to support platform scalability.
  • Ensure the data platform remains reliable and efficient as data volume and service count grow.
  • Implement schema-on-write validation and data contracts to enforce data quality before the Bronze layer.
  • Partner with data architects and data stewards to enforce data privacy, security, and metadata lineage standards.
  • Champion AI-assisted development tools to improve engineering speed and code quality.
  • Mentor engineers on distributed computing best practices.
  • Conduct deep code reviews focused on scalability and maintainability.

Requirements

  • 5+ years of experience building and operating production-grade data systems at massive scale.
  • Deep hands-on expertise with Databricks and Spark, including Delta Lake, DLT, Spark UI debugging, and performance tuning.
  • Proven experience building real-time or streaming architectures using Spark Structured Streaming, Kafka, or Kinesis.
  • Experience managing and optimizing cloud costs in a high-growth environment.
  • Experience building APIs, tools, or frameworks used by other internal engineering teams.
  • Experience working with AI-assisted development tools such as GitHub Copilot or Cursor (preferred).
  • Experience with data governance, privacy, security, and metadata lineage practices (preferred).

Benefits

  • Competitive compensation with base salary plus annual bonus for non-sales roles or commission structure for sales roles.
  • Generous paid parental leave.
  • Flexible time off.
  • Medical, dental, and vision insurance.
  • Sabbatical after 5 years.
  • Additional compensation may vary based on qualifications, experience, education, and geographic location.
  • Reasonable accommodations for individuals with disabilities during the interview process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Starburst

Senior Software Engineer, Control Plane

Starburst 251-1K IT Services

Starburst is hiring a Senior Software Engineer for its globally distributed Control Plane team to unify the platform supporting Starburst Enterprise, Starburst Galaxy, and Trino across SaaS, self-managed, and air-gapped environments.

Poland Full-time Senior Software Engineer
$185k-$215k
AWS Azure GitHub Java React REST API Trino TypeScript
2 hours, 17 minutes ago
JumpCloud

Staff Software Engineer, Privileged Access Management (PAM) / Password Manager (PWM) - India

JumpCloud 251-1K Internet Software & Services

JumpCloud is seeking a remote Staff Software Engineer to architect and guide secure, scalable core-platform microservices while aligning engineering teams around long-term technical strategy and AI-enabled delivery.

India Full-time Lead Software Engineer
AWS C# CI/CD GCP Go gRPC HashiCorp Vault Kubernetes Microservices .NET Playwright PostgreSQL SQL Server TypeScript
2 hours, 17 minutes ago
JumpCloud

Senior Software Engineer - Privileged Access Management (PAM / IAM)- India

JumpCloud 251-1K Internet Software & Services

JumpCloud is hiring a remote Senior/Lead Software Engineer to evolve its core AI-powered IT management platform through secure, scalable architecture, enterprise PAM integration, reliable delivery, and AI-assisted engineering practices.

India Full-time Lead Security Engineer Software Engineer
Agile AWS C# Docker Go gRPC HashiCorp Vault Kubernetes Linux macOS Microservices .NET Playwright PostgreSQL REST API SQL Server TypeScript
2 hours, 32 minutes ago
Mozilla

Senior Software Engineer, Add-Ons

Mozilla 251-1K Internet Software & Services

Mozilla is hiring a Senior Software Engineer – Operations to modernize and operate addons.mozilla.org, building reliable systems and tools that support reviewers, developers, and millions of Firefox add-on users.

Anywhere Full-time Senior Software Engineer
Django GCP MySQL Python React TypeScript
2 hours, 47 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers