RemoteLeaf Logo
Log in Sign up

Staff Software Engineer, Search & Retrieval Infrastructure

7 minutes ago
United States
Full-time
Lead
Software Engineer
Software Development
C++ Elasticsearch GCP Go Java Kafka Kubernetes Lucene Python Rust Solr
Apply Now
TLATech

TLATech

Syllo is the litigation workspace for the AI era. See how our Agentic AI works and request a demo today.

Specialized Consumer Services
View All Jobs 12

Description

  • Lead the optimization and architectural evolution of the hybrid search stack, including lexical search and dense vector databases.
  • Design and implement data tiering strategies across hot, warm, and cold storage states.
  • Evolve distributed pipelines to run asynchronous, large-scale scans across petabytes of data.
  • Analyze bottlenecks and improve indexing, querying, and cloud infrastructure performance.
  • Reduce latency and cost-to-serve through system and infrastructure optimization.
  • Own the indexing and search ecosystem as a domain expert and technical leader.
  • Set the long-term technical vision for data storage and retrieval.
  • Guide engineering teams on data modeling and performance tuning best practices.
  • Ensure fault-tolerant and highly available operations during massive parallel ingest and concurrent querying.

Requirements

  • 8+ years of software engineering experience.
  • Proven Staff/Principal-level experience scaling highly distributed, high-throughput systems to petabyte-level data.
  • Deep production experience with Lucene-based search engines such as Elasticsearch or Solr.
  • Experience tuning and scaling modern vector indexing infrastructure.
  • Strong understanding of index internals, chunking strategies, and embedding retrieval optimization.
  • Experience designing cost-effective cold-storage scanning and hot-index architectures.
  • Extensive experience with distributed data pipelines and high-throughput event streaming tools such as Kafka or Kinesis.
  • Experience with distributed compute architectures handling billions of records.
  • Expert command of cloud primitives, preferably in GCP.
  • Experience with Kubernetes and infrastructure as code.
  • Expert-level proficiency in Go, Rust, Python, or Java/C++.

Benefits

  • Remote work in the United States.
  • Salary range of $190,000 to $230,000 USD.
  • Health insurance.
  • Equity.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Reddit

Staff People Integrations Engineer

Reddit 1K-5K Internet Software & Services

Reddit is seeking a Staff People Integrations Engineer to own and scale Workday integrations across its People technology ecosystem, ensuring reliable and secure movement of employee and workforce data.

United States Full-time Senior People Operations Software Engineer
$180k-$252k
GCP REST API SOAP SQL
7 minutes ago
DRW

Senior Software Engineer, Treasury (Ruby/Python)

DRW 1K-5K Capital Markets

DRW is hiring a Senior Software Engineer for its Treasury Development team to build and operate systems for secured financing, margin and collateral management, and cash and liquidity management.

United States Full-time Senior Software Engineer
$175k-$275k
Apache Airflow CI/CD FastAPI GitOps Kubernetes Prefect Python Ruby Ruby on Rails
7 minutes ago
Lucid Motors

Senior Behavior Planning Software Engineer - ADAS

Lucid Motors 1K-5K Automotive

Lucid Motors is hiring a Behavior Planning Engineer for its ADAS Autonomous Driving team to develop and bring planning and prediction software and algorithms for autonomous driving features into production.

United States Full-time Mid Level Machine Learning Engineer Software Engineer
$158k-$218k
C++ Machine Learning Python Reinforcement Learning
7 minutes ago
Discord

Senior Software Engineer, Application Security

Discord 1K-5K Internet Software & Services

Discord is hiring a Senior Software Engineer for its Application Security team to strengthen account, session, and authentication security for a large consumer platform used by millions of gamers.

United States Full-time Senior Software Engineer
$196k-$220k
C C++ GCP Go Java Python Rust
22 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers