Senior Software Engineer II - Applied AI (Remote Eligible)

3 months, 2 weeks ago
Full-time
Lead
Software Development
Smartsheet

Smartsheet

Smartsheet provides an enterprise work management platform that enables teams to efficiently manage projects, automate processes, and enhance collaboration through a user-friendly interface that combines spreadsheet functionality with advanced workflow...

Internet Software & Services
1K-5K
Founded 2005

Description

  • Lead the design and ownership of the core AI platform infrastructure that supports Smartsheet AI experiences.
  • Build a robust, multi-tenant environment that enables internal teams to deploy scalable AI features reliably.
  • Architect high-level abstractions and Golden Path APIs that simplify AI development across product teams.
  • Create monitoring and quality assurance systems to evaluate AI-driven features for safety, privacy, and deterministic performance.
  • Design and maintain evaluation pipelines and scoring workflows for LLM-based systems.
  • Partner with principal engineers to define the technical roadmap for AI infrastructure.
  • Work with cross-functional teams to make architectural decisions and resolve technical trade-offs.
  • Communicate quality findings and technical issues clearly to technical and non-technical stakeholders.

Requirements

  • 8+ years of software engineering experience, including at least 2 years working directly with LLMs in production.
  • Deep hands-on experience with prompt engineering and context engineering.
  • Strong working knowledge of RAG architectures, including chunking strategies, embedding models, retrieval evaluation, and failure diagnosis.
  • Experience building or extending LLM evaluation frameworks, including scorers and golden datasets.
  • Strong Python skills and comfort working in data-heavy environments such as Databricks or Delta tables.
  • Ability to communicate complex quality findings clearly in both written and verbal form.
  • Strong cross-functional judgment and the ability to build credibility across engineering, product, and AI platform teams.
  • Bias for clarity in ambiguous situations and the ability to bring structure and a clear point of view to trade-offs.
  • Prior work in an Applied AI or LLMOps platform within a product company is a strong plus.
  • Experience with Kubernetes, including EKS or GKE, GPU scheduling, and autoscaling.
  • Experience with Infrastructure as Code tools such as Terraform, Pulumi, or AWS CDK.
  • Experience with vector databases such as Pinecone, Milvus, Weaviate, or Databricks Vector Search.
  • Experience building or configuring AI gateways such as LiteLLM or Kong AI Gateway.
  • Experience with LLM observability tools such as Langfuse, LangSmith, or MLflow.
  • Experience implementing model-based evaluation systems such as RAGAS or DeepEval.

Benefits

  • Employer-subsidized medical, vision, and dental coverage for full-time employees.
  • 401(k) match of 50% of contributions up to the first 6% of eligible pay.
  • Monthly stipend to support work and productivity.
  • Flexible Time Away Program plus sick time off.
  • Company-sponsored life insurance, short-term disability, and long-term disability coverage.
  • 12 paid holidays per year.
  • Up to 24 weeks of parental leave.
  • Personal paid Volunteer Day.
  • Professional growth and development, including access to Udemy online courses.
  • Counseling membership, local retail discounts, and a personal Smartsheet account.
  • Teleworking options from any registered U.S. location, role dependent.
  • Market-competitive incentive opportunity in addition to base salary.
  • US base salary range of $192,500 to $245,000 USD.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Software Engineer, Payments

Airbnb 5K-10K Hotels, Restaurants & Leisure

Airbnb is hiring a Senior Software Engineer for its Payments Risk Engineering team to build scalable, real-time systems that detect, mitigate, and resolve fraud and other risks across its global payments platform.

Java JavaScript Kotlin Machine Learning Python React
9 minutes ago

Senior Software Engineer, Digital Twin Platform

instacart.careers 1K-5K Internet Software & Services

Instacart is hiring a Senior Software Engineer for its Digital Twin Platform team to build scalable systems that provide real-time understanding of products on grocery store shelves and support product, logistics, and fulfillment experiences.

Apache Airflow Apache Spark AWS Azure Computer Vision GCP Go IoT Java Kafka Machine Learning Python Scala SQL
9 minutes ago

Senior Software Engineer, Front End / Full Stack

Grove Collaborative 251-1K Health Care Providers & Services

Grove Collaborative is hiring a senior front-end-focused individual contributor to lead full-stack web initiatives that improve its sustainable ecommerce experience from concept through measurement.

Alpine.js CI/CD Cypress Design Systems Git GitHub Actions GraphQL JavaScript Jest Playwright React Shopify Svelte System Design TypeScript Vue.js
24 minutes ago

Senior Software Engineer, Cloud Growth

Temporal 51-250 Internet Software & Services

Temporal is hiring a Senior Software Engineer to build and lead scalable billing, metering, customer-lifecycle, and revenue data systems that support its cloud platform and customer experience.

AWS CI/CD ClickHouse Go Kafka Kubernetes PostgreSQL Salesforce Segment
24 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers