G-P/Globalization Partners

G P offers Employer of Record solutions for global team management in 180+ countries, combining EOR, Payroll, and HCM solutions for streamlined and compliant workforce expansion.

Professional Services

Industrials

1K-5K (1326)

16 open positions

Links

View All Jobs

Senior Software Engineer (Data Platform)

3 months ago

India

Full-time

Senior

Software Engineer

Software Development

Apache Spark Databricks Kafka

Apply Now

G-P/Globalization Partners

G P offers Employer of Record solutions for global team management in 180+ countries, combining EOR, Payroll, and HCM solutions for streamlined and compliant workforce expansion.

Professional Services

1K-5K

View All Jobs 16

Description

Lead the design and implementation of internal SDKs and self-service frameworks for distributed engineering teams.
Build reusable patterns for batch and real-time event processing as part of a broader platform engineering approach.
Own the performance and cost-effectiveness of the Databricks ecosystem, including Spark tuning and autoscaling strategies.
Optimize Spark execution plans, shuffle partitions, and DBU consumption to support platform scalability.
Ensure the data platform remains reliable and efficient as data volume and service count grow.
Implement schema-on-write validation and data contracts to enforce data quality before the Bronze layer.
Partner with data architects and data stewards to enforce data privacy, security, and metadata lineage standards.
Champion AI-assisted development tools to improve engineering speed and code quality.
Mentor engineers on distributed computing best practices.
Conduct deep code reviews focused on scalability and maintainability.

Requirements

5+ years of experience building and operating production-grade data systems at massive scale.
Deep hands-on expertise with Databricks and Spark, including Delta Lake, DLT, Spark UI debugging, and performance tuning.
Proven experience building real-time or streaming architectures using Spark Structured Streaming, Kafka, or Kinesis.
Experience managing and optimizing cloud costs in a high-growth environment.
Experience building APIs, tools, or frameworks used by other internal engineering teams.
Experience working with AI-assisted development tools such as GitHub Copilot or Cursor (preferred).
Experience with data governance, privacy, security, and metadata lineage practices (preferred).

Benefits

Competitive compensation with base salary plus annual bonus for non-sales roles or commission structure for sales roles.
Generous paid parental leave.
Flexible time off.
Medical, dental, and vision insurance.
Sabbatical after 5 years.
Additional compensation may vary based on qualifications, experience, education, and geographic location.
Reasonable accommodations for individuals with disabilities during the interview process.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Software Engineer, Test Infrastructure

Skyline Eco-Adventures 11-50 Hotels, Restaurants & Leisure

Zipline is seeking a Senior Software Systems Validation Engineer to lead end-to-end validation of autonomous drone delivery software, from simulation through full-system flight testing, for safe deployment and operating-domain expansion.

United States Full-time Senior Software Engineer

$150k-$250k

C++ Python Rust SQL

1 day, 19 hours ago

Apply

1 day, 19 hours ago

Senior Software Engineer - UI/UX

Dragos 251-1K Professional Services

Dragos is hiring a Software Engineer to build the user-facing experiences that help security professionals detect, investigate, and respond to cyber threats against critical infrastructure.

United States Full-time Senior Frontend Engineer / Web Developer Software Engineer

$165k-$165k

Cybersecurity Design Systems React TypeScript

1 day, 19 hours ago

Apply

1 day, 19 hours ago