RemoteLeaf Logo
Log in Sign up

Staff Software Engineer, LLMs

1 hour, 41 minutes ago
United States, Canada
Full-time
Lead
Software Engineer
Software Development
Docker FastAPI Flask Generative AI Kubernetes LLM Machine Learning Python React System Design Terraform
Apply Now
Upstart

Upstart

Upstart Powered Loans: Personal, Car Refinance & Consolidation Through Upstart, apply online for a fast personal loan, auto refinancing, or debt consolidation. Try our quick rate check today with no impact to your credit! Founded by ex Googlers, Upstar...

Banks
1K-5K
Founded 2012
View All Jobs 17

Description

  • Design and build user-facing ML features that use LLMs and generative AI to add new product capabilities.
  • Partner with product, design, and ML research teams to prototype and deliver ML-powered experiences.
  • Own the technical architecture and implementation strategy for applied ML systems, balancing latency, observability, and iteration speed.
  • Build scalable services and APIs that deliver model outputs to users in trustworthy and intuitive ways.
  • Collaborate with platform, infrastructure, and legal/compliance teams to ensure safe, fair, and performant ML deployments.
  • Establish and promote best practices for prompt design, model evaluation, and experimentation across the organization.
  • Work closely with researchers, product managers, platform engineers, and designers to ship intelligent features.
  • Influence system design and technical direction for applied AI products and infrastructure.

Requirements

  • 6+ years of software engineering experience, including 2+ years working directly on ML-driven products or intelligent systems.
  • Proven ability to lead complex initiatives across engineering, product, and research stakeholders.
  • Strong backend development skills, such as Python with FastAPI or Flask.
  • Experience with cloud-native tooling such as Kubernetes, Docker, and Terraform.
  • Experience integrating LLMs or ML models into production systems, including APIs and user-facing applications.
  • Excellent communication skills and a collaborative, product-minded approach.
  • Ability to reason about system design, latency tradeoffs, and user impact for ML features.
  • Experience shipping GenAI or LLM-powered features using frameworks like LangChain, LlamaIndex, or OpenAI APIs (preferred).
  • Familiarity with retrieval-augmented generation (RAG), vector search such as FAISS or Pinecone, and real-time inference patterns (preferred).
  • Proficiency in full-stack development, including front-end work with React or similar frameworks (preferred).

Benefits

  • Anticipated base salary of $199,500 to $276,000 USD for US remote roles, or $177,700 to $220,000 CAD for Canada remote roles.
  • Target bonuses and equity compensation, including annual equity grants that vest quarterly.
  • Generous 401(k) plan with Upstart matching $2 for every $1 contributed, up to $15,000 per year.
  • Employee Stock Purchase Plan (ESPP) with discounted stock purchase options for eligible employees.
  • Affordable medical, dental, and vision coverage, with Upstart covering 90% to 100% of costs depending on plan selection.
  • Health Savings Account contributions for eligible plans.
  • Paid time off, sick and safe time, and company holidays.
  • Paid family and parental leave, plus family support benefits through Carrot and Cleo.
  • Employee Assistance Program (EAP) with mental health support and life-centered resources.
  • Annual wellness allowance and annual productivity allowance.
  • Financial wellness resources, including financial planning tools and a financial concierge service.
  • Travel expenses covered for required on-site collaboration sessions.
  • Onsite perks such as catered lunches and stocked micro-kitchens at office locations.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Wellhub

Wellhub Talent Pool | Software Engineer

Wellhub 1-10 Gas Utilities

Wellhub is building a talent pool for future Backend and Frontend Software Engineer roles on its Technology and Product team, focused on developing global-scale wellbeing technology products.

Portugal Full-time Senior Software Engineer
Agile AWS CI/CD CSS Design Systems DynamoDB GCP Go GraphQL HTTP Java Kotlin MySQL Node.js PostgreSQL React SQL TypeScript
11 minutes ago
Affirm

Senior Software Engineer, Back-end (Fraud)

Affirm 1K-5K Diversified Financial Services

Affirm is hiring a Senior Software Engineer in its remote Europe-based Fraud Engineering team to build backend systems and fraud tooling that help detect, mitigate, and respond to fraud across the user journey.

Poland Full-time Senior Software Engineer
$36k-$49k
Apache Airflow AWS CI/CD dbt Kotlin Kubernetes Microservices MySQL PostgreSQL Python Snowflake SQL
11 minutes ago
Dropbox

Principal Software Engineer, Corporate AI

Dropbox 1K-5K Internet Software & Services

Dropbox is hiring a Principal Software Engineer to lead its intelligence, AI, and data initiatives, shaping scalable systems that improve customer, partner, and employee experiences while driving productivity and growth.

Canada Full-time Lead Software Engineer
Go Java Machine Learning NLP Python Scala
11 minutes ago
JetBrains

Senior Software Engineer (Toolbox App)

JetBrains 1K-5K Internet Software & Services

JetBrains is hiring a developer to work on the Toolbox App, building and improving the Kotlin-based application that helps users discover, install, update, and manage JetBrains IDEs and development tools.

Czech Republic Germany Poland Spain Cyprus Full-time Senior Software Engineer
Jetpack Compose Kotlin
11 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers