Lead Data Engineer – Backend (Python / Typescript / Big Data / AWS / Kubernetes)

1 hour, 52 minutes ago
Full-time
Lead
Software Development
Varicent

Varicent

Varicent provides industry-leading incentive compensation and sales performance management solutions to help businesses increase sales efficiency and effectiveness.

Professional Services
251-1K
Founded 2003
$35M raised

Description

  • Design, build, and scale new features for REST APIs and large-scale data processing pipelines.
  • Architect and optimize backend services for high-throughput, low-latency performance.
  • Develop data-intensive and event-driven applications using Python, Typescript, Spark, and AWS-native services.
  • Process and transform very large datasets using Spark, EMR, Glue, Kafka, or similar frameworks.
  • Improve system performance, reliability, and scalability across microservices and cloud infrastructure.
  • Partner with senior engineers, architects, DevOps, and QA across the full development lifecycle.
  • Mentor developers, lead code reviews, and raise engineering quality standards.
  • Automate deployments and CI/CD workflows using Terraform, Serverless Framework, and Kubernetes.

Requirements

  • 7+ years of backend or full-stack engineering experience with a strong backend focus.
  • 7+ years of hands-on Python experience, including APIs, automation, and large-scale data pipelines.
  • 3+ years of experience with Typescript / Node.js.
  • Advanced experience with AWS services such as EC2, EKS, Lambda, S3, DynamoDB, RDS, and Step Functions.
  • Strong practical experience deploying and optimizing production workloads on Kubernetes.
  • Proven experience working with large datasets, distributed computing, and batch or stream processing using Spark, Dask, EMR, Glue, Kafka, or similar tools.
  • Solid understanding of system design, distributed systems, scalability patterns, and cloud architecture.
  • Strong business-level English proficiency for cross-functional communication across regions.
  • Ability to collaborate, document solutions clearly, and participate in technical discussions with stakeholders.
  • Experience working within Eastern Standard Time (EST) business hours and adjusting working hours accordingly.

Benefits

  • Market-leading compensation package.
  • Remote work flexibility with the role fully remote.
  • Comprehensive employee insurance coverage, including medical, dental, vision, and life insurance.
  • Annual time off provided in accordance with applicable legislative requirements.
  • Wellness programs to support health and wellbeing.
  • Continuous development opportunities.
  • Opportunity to work with the latest tools and technologies in a fast-paced environment.
  • Global connected culture with hubs in Romania, the UK, the US, and Canada.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Middle Full Stack Node.JS Developer for UBO Team

GR8 Tech 251-1K IT Services

GR8 Tech is hiring a Node.js Engineer to build and stabilize B2B iGaming web platforms that power large-scale player experiences and business growth.

AWS CI/CD Docker Express.js Fastify Grafana HTTP JavaScript Kubernetes Microservices NestJS Node.js Prometheus REST API SQL
7 minutes ago

Senior Software Engineer - Search Infrastructure

Algolia 251-1K Internet Software & Services

Algolia is hiring a Senior Software Engineer for its Metis team to help build and operate the cloud-based architecture behind NeuralSearch, the company’s AI search engine for keyword and vector search at scale.

Go Kubernetes
7 minutes ago

Data Infrastructure Operations Manager II (Starlink)

SpaceX 10K-50K Aerospace & Defense

SpaceX is hiring a Data Infrastructure Operations Manager II for Starlink to manage end-to-end sourcing, supplier operations, and delivery of high-quality datasets that support AI model training, validation, and improvement.

22 minutes ago

Senior Backend Engineer

Remote 251-1K Professional Services

Remote is hiring a full-time engineer to build tools, APIs, and integrations for its globally distributed HR and Payroll products within an async, fully remote team.

Angular AWS CI/CD Clojure Docker Elixir Erlang GitHub GitLab Haskell Jenkins Kubernetes Next.js Phoenix PostgreSQL React Scala Vue.js
22 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers