RemoteLeaf Logo
Log in Sign up

Staff Software Engineer, Stream Compute

2 months ago
United States, Canada
Full-time
Lead
Software Engineer
Software Development
Apache Spark AWS Go Hadoop Java Kafka Scala SQL Storm
Apply Now
Stripe

Stripe

Stripe is a global technology company that provides financial infrastructure for the internet. They offer a suite of APIs and tools for businesses to accept online and in-person payments, automate financial processes, and embed financial services in th...

Diversified Financial Services
5K-10K
Founded 2009
$8700M raised
View All Jobs 226

Description

  • Design, build, and operate stream compute infrastructure centered on Apache Flink and related technologies such as Kafka, Temporal, and AWS services.
  • Partner with product, platform, and infrastructure teams to understand needs, unblock Flink adoption, and improve end-to-end infrastructure usage.
  • Define and implement operational best practices to improve resilience, reliability, and scalability at fleet level.
  • Drive automation and standardization through self-service workflows, safer rollouts, and self-healing systems that reduce manual operations.
  • Lead initiatives to improve Flink availability and state durability, including multi-region strategies, disaster recovery readiness, and incident learning.
  • Evaluate and productionize Flink ecosystem capabilities such as SQL, connectors, and state backends to improve developer experience and scalability.
  • Work with the open source community to adopt new features and contribute improvements back to open source projects.
  • Set long-term technical direction for Stripe’s stream compute infrastructure to support reliable global operations.
  • Work on production challenges such as state management, exactly-once processing, performance isolation, and automated recovery.

Requirements

  • 10+ years of experience building, operating, and evolving large-scale production systems.
  • Experience as a technical lead for teams working on distributed systems in fast-moving environments.
  • Hands-on experience with big data technologies such as Flink, Spark, Kafka, Pulsar, or Pinot.
  • Experience developing, maintaining, and debugging distributed systems built with open source tools.
  • Experience building and scaling infrastructure as a product.
  • Strong software engineering skills and a passion for big data distributed systems.
  • Ability to write high-quality code in languages such as Go, Java, or Scala.
  • Comfort operating with high autonomy and ownership.
  • Growth mindset and willingness to learn quickly, explore ambiguous problem spaces, and dive deep when needed.
  • Strong written and verbal communication skills, including the ability to produce clear technical documentation.
  • Experience operating streaming infrastructure as a platform for internal customers at scale, preferred.
  • Deep hands-on experience with real-time processing frameworks such as Flink, Spark Streaming, Storm, or Kafka Streams, preferred.
  • Experience building or operating control planes for managing large-scale infrastructure, preferred.
  • Open source contributions to data processing or big data systems such as Hadoop, Spark, Celeborn, or Flink, preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

U

Senior Software Engineer

Unframe Inc. 51-200 Technology, Information and Internet

Unframe is hiring a deeply technical software engineer to own complex backend and system work that powers enterprise AI-native products and deployed LLM applications.

Israel Senior Software Engineer
CI/CD LLM Node.js PostgreSQL
5 hours, 52 minutes ago
Datadog

Staff Software Engineer - K9 Security

Datadog 5K-10K IT Services

Datadog is hiring a Staff Software Engineer on its Security Agent team to lead low-level Linux instrumentation and runtime security work that powers threat detection and workload protection across its security products.

Spain France Germany Ireland Italy Full-time Lead Security Engineer Software Engineer
Datadog Linux
5 hours, 52 minutes ago
Pinterest

Software Engineer II

Pinterest 5K-10K Internet Software & Services

Pinterest is hiring for an unspecified role focused on helping build the product and supporting the company’s AI-centered hiring approach.

United States Canada Full-time Mid Level Software Engineer
6 hours, 7 minutes ago
Twilio

Staff Software Engineer (L4)

Twilio 5K-10K Diversified Telecommunication Services

Twilio is hiring a Staff Engineer for its Segment Data platform and pipelines team to build and scale high-volume distributed systems that power customer data ingestion and processing.

India Full-time Lead Software Engineer
Apache Spark AWS CI/CD Datadog Docker Flink GCP Go Grafana Java Kafka Kubernetes Linux Prometheus Scala
6 hours, 7 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers