RemoteLeaf Logo
Log in Sign up

Principal Engineer, LLM (Platform and Tooling)

2 hours, 22 minutes ago
United States, Canada
Full-time
Lead
AI Engineer
Software Development
Docker FastAPI Generative AI Kotlin Kubernetes LLM Machine Learning Python React Spring Terraform TypeScript
Apply Now
Upstart

Upstart

Upstart Powered Loans: Personal, Car Refinance & Consolidation Through Upstart, apply online for a fast personal loan, auto refinancing, or debt consolidation. Try our quick rate check today with no impact to your credit! Founded by ex Googlers, Upstar...

Banks
1K-5K
Founded 2012
View All Jobs 69

Description

  • Define and drive the multi-year technical roadmap for the Core GenAI Platform.
  • Provide technical leadership across multiple cross-functional teams.
  • Shape the vision, architecture, and adoption strategy for the internal GenAI platform.
  • Collaborate with engineering leaders, ML researchers, and product stakeholders on platform direction and execution.
  • Lead architecture and design for large-scale systems for model inference, orchestration, and compliance.
  • Identify and resolve systemic technical risks affecting company-wide AI initiatives.
  • Establish operational standards for GenAI integrations focused on security, fairness, and reliability.
  • Build reusable platform components that accelerate engineering productivity across Upstart.
  • Represent Upstart as a thought leader in GenAI systems in executive reviews, cross-company forums, and industry venues.
  • Mentor senior engineers and help develop future technical leaders.

Requirements

  • Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field, or equivalent experience, plus 8 years of experience.
  • Deep expertise in LLM infrastructure, including inference optimization techniques such as quantization, ONNX, and streaming.
  • Experience designing scalable RAG architectures and managing models from experimentation through high-availability production, including vector databases.
  • Proven experience building automated evaluation pipelines using heuristic metrics and LLM-as-a-judge frameworks.
  • Hands-on experience with LLM toolchains such as LangChain, LlamaIndex, or OpenAI APIs.
  • Experience designing and operationalizing ML/LLM platforms at scale with attention to cost, latency, and reliability.
  • Deep knowledge of GenAI best practices and risks, including hallucination mitigation, fairness, explainability, and data privacy.
  • 12+ years of experience and 5+ years leading cross-functional technical initiatives preferred.
  • Experience guiding or executing model fine-tuning and alignment methods such as RLHF or DPO preferred.
  • Full-stack engineering experience with Python, FastAPI, Kotlin, Spring, React/TypeScript, or similar preferred.
  • Deep expertise in backend systems and infrastructure technologies such as Kubernetes, Docker, Terraform, and cloud-native architectures preferred.
  • Role is remote in the USA/Canada with quarterly travel, and the team operates across East/West coast time zones.

Benefits

  • Base salary range of $238,400 to $330,200 USD for the U.S. remote role.
  • Target bonuses and annual equity compensation, including equity grants that vest quarterly.
  • Generous 401(k) plan with Upstart matching $2 for every $1 contributed, up to $15,000 per year.
  • Affordable medical, dental, and vision coverage, with Upstart covering 90% to 100% of costs depending on plan.
  • Health Savings Account contributions for eligible plans.
  • Company-paid basic life, AD&D, and short- and long-term disability coverage, with supplemental coverage options.
  • Paid time off, sick and safe time, and company holidays.
  • Paid family and parental leave.
  • Employee Assistance Program with mental health support and life-centered resources.
  • Annual wellness allowance and annual productivity allowance.
  • Employee Stock Purchase Plan with discounted stock purchase options.
  • Family-centered benefits through Carrot and Cleo for fertility, parenthood, and caregiving.
  • Onsite perks such as catered lunches and stocked micro-kitchens at office locations.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Weekday

AI engineer

Weekday 11-50 Construction & Engineering

An AI Engineer role with one of Weekday's clients in India, focused on building and optimizing LLM-powered applications that solve business problems across product, data science, and engineering teams.

India Full-time Mid Level AI Engineer
$24k-$120k
AWS Azure CI/CD Deep Learning Docker GCP Generative AI Kubernetes LLM Machine Learning Microservices MLOps NLP Python PyTorch REST API TensorFlow
48 minutes ago
Nice Côte d'Azur

AI Senior Software Engineer

Nice Côte d'Azur Hotels, Restaurants & Leisure

NiCE is hiring an engineer to build production software for customer experience and contact center products, with a strong emphasis on using AI and LLMs to improve how the team works and ships.

United States Senior AI Engineer Software Engineer
LLM
52 minutes ago
redbee

Tech Lead React native

redbee 51-250 Internet Software & Services

Redbee is hiring a Tech Lead React Native to lead mobile development for financial digital products, driving scalable app delivery and technical decisions in a remote-first environment.

Argentina Full-time Lead React Native Developer Technical Lead
Agile NestJS React React Native
1 hour, 15 minutes ago
Smart Working

Mobile Platform Tech Lead (Remote, Full-Time) [AS227] Europe

Smart Working Internet Software & Services

Smart Working is hiring a Remote Mobile Platform Tech Lead to strengthen the technical foundations of a mobile banking app and enable product teams to deliver reliably in a regulated environment.

Bosnia and Herzegovina Bulgaria Greece Hungary Romania Serbia Ukraine Full-time Lead Technical Lead
Appium CI/CD Datadog Design Systems Detox Expo Java Jest Kotlin Objective-C React Native Swift TypeScript
1 hour, 48 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers