RemoteLeaf Logo
Log in Sign up

Staff Software Engineer, Search & Retrieval Infrastructure

1 month, 2 weeks ago
United States
Full-time
Lead
Software Engineer
Software Development
C++ Elasticsearch GCP Go Java Kafka Kubernetes Lucene Python Rust Solr
Apply Now
TLATech

TLATech

Syllo is the litigation workspace for the AI era. See how our Agentic AI works and request a demo today.

Specialized Consumer Services
View All Jobs 15

Description

  • Lead the optimization and architectural evolution of the hybrid search stack, including lexical search and dense vector databases.
  • Design and implement data tiering strategies across hot, warm, and cold storage states.
  • Evolve distributed pipelines to run asynchronous, large-scale scans across petabytes of data.
  • Analyze bottlenecks and improve indexing, querying, and cloud infrastructure performance.
  • Reduce latency and cost-to-serve through system and infrastructure optimization.
  • Own the indexing and search ecosystem as a domain expert and technical leader.
  • Set the long-term technical vision for data storage and retrieval.
  • Guide engineering teams on data modeling and performance tuning best practices.
  • Ensure fault-tolerant and highly available operations during massive parallel ingest and concurrent querying.

Requirements

  • 8+ years of software engineering experience.
  • Proven Staff/Principal-level experience scaling highly distributed, high-throughput systems to petabyte-level data.
  • Deep production experience with Lucene-based search engines such as Elasticsearch or Solr.
  • Experience tuning and scaling modern vector indexing infrastructure.
  • Strong understanding of index internals, chunking strategies, and embedding retrieval optimization.
  • Experience designing cost-effective cold-storage scanning and hot-index architectures.
  • Extensive experience with distributed data pipelines and high-throughput event streaming tools such as Kafka or Kinesis.
  • Experience with distributed compute architectures handling billions of records.
  • Expert command of cloud primitives, preferably in GCP.
  • Experience with Kubernetes and infrastructure as code.
  • Expert-level proficiency in Go, Rust, Python, or Java/C++.

Benefits

  • Remote work in the United States.
  • Salary range of $190,000 to $230,000 USD.
  • Health insurance.
  • Equity.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Affirm

Senior Software Engineer, Backend (Identity International)

Affirm 1K-5K Diversified Financial Services

Affirm is hiring a Senior Software Engineer for its remote UK Identity team to build and operate reliable identity, KYC, and user lifecycle systems supporting international expansion and compliant customer checkout experiences.

United Kingdom Full-time Senior Software Engineer
$152k-$213k
AWS Kotlin Kubernetes MySQL Python
19 hours, 58 minutes ago
Northbeam

Staff Software Engineer, Python

Northbeam 11-50 Internet Software & Services

Northbeam is hiring a Staff Backend-leaning Software Engineer to architect scalable data, experimentation, and AI systems for its remote-friendly marketing intelligence platform.

Canada Full-time Lead Software Engineer
$190k-$220k
Machine Learning Microservices Python React TypeScript
19 hours, 58 minutes ago
Northbeam

Software Engineer, Data Systems (Python)

Northbeam 11-50 Internet Software & Services

Northbeam is hiring a data-focused software engineer to build reliable integrations, pipelines, and data products powering its marketing intelligence platform for eCommerce brands.

United States Full-time Mid Level Software Engineer
$140k-$155k
Apache Airflow Dagster Docker GCP GraphQL Kubernetes Prefect Python REST API Secrets Management Shopify Snowflake SQL
20 hours, 13 minutes ago
Northbeam

Staff Software Engineer, Python

Northbeam 11-50 Internet Software & Services

Northbeam is seeking a Staff Software Engineer with a backend focus to architect scalable data, experimentation, and AI systems for its remote-friendly marketing intelligence platform.

United States Full-time Lead Software Engineer
$190k-$220k
Machine Learning Microservices Python React TypeScript
20 hours, 13 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers