Senior Software Engineer II - Applied AI (Remote Eligible)

1 hour, 20 minutes ago
Full-time
Lead
Software Development
Smartsheet

Smartsheet

Smartsheet provides an enterprise work management platform that enables teams to efficiently manage projects, automate processes, and enhance collaboration through a user-friendly interface that combines spreadsheet functionality with advanced workflow...

Internet Software & Services
1K-5K
Founded 2005

Description

  • Lead the design and ownership of the core AI platform infrastructure that supports Smartsheet AI experiences.
  • Build a robust, multi-tenant environment that enables internal teams to deploy scalable AI features reliably.
  • Architect high-level abstractions and Golden Path APIs that simplify AI development across product teams.
  • Create monitoring and quality assurance systems to evaluate AI-driven features for safety, privacy, and deterministic performance.
  • Design and maintain evaluation pipelines and scoring workflows for LLM-based systems.
  • Partner with principal engineers to define the technical roadmap for AI infrastructure.
  • Work with cross-functional teams to make architectural decisions and resolve technical trade-offs.
  • Communicate quality findings and technical issues clearly to technical and non-technical stakeholders.

Requirements

  • 8+ years of software engineering experience, including at least 2 years working directly with LLMs in production.
  • Deep hands-on experience with prompt engineering and context engineering.
  • Strong working knowledge of RAG architectures, including chunking strategies, embedding models, retrieval evaluation, and failure diagnosis.
  • Experience building or extending LLM evaluation frameworks, including scorers and golden datasets.
  • Strong Python skills and comfort working in data-heavy environments such as Databricks or Delta tables.
  • Ability to communicate complex quality findings clearly in both written and verbal form.
  • Strong cross-functional judgment and the ability to build credibility across engineering, product, and AI platform teams.
  • Bias for clarity in ambiguous situations and the ability to bring structure and a clear point of view to trade-offs.
  • Prior work in an Applied AI or LLMOps platform within a product company is a strong plus.
  • Experience with Kubernetes, including EKS or GKE, GPU scheduling, and autoscaling.
  • Experience with Infrastructure as Code tools such as Terraform, Pulumi, or AWS CDK.
  • Experience with vector databases such as Pinecone, Milvus, Weaviate, or Databricks Vector Search.
  • Experience building or configuring AI gateways such as LiteLLM or Kong AI Gateway.
  • Experience with LLM observability tools such as Langfuse, LangSmith, or MLflow.
  • Experience implementing model-based evaluation systems such as RAGAS or DeepEval.

Benefits

  • Employer-subsidized medical, vision, and dental coverage for full-time employees.
  • 401(k) match of 50% of contributions up to the first 6% of eligible pay.
  • Monthly stipend to support work and productivity.
  • Flexible Time Away Program plus sick time off.
  • Company-sponsored life insurance, short-term disability, and long-term disability coverage.
  • 12 paid holidays per year.
  • Up to 24 weeks of parental leave.
  • Personal paid Volunteer Day.
  • Professional growth and development, including access to Udemy online courses.
  • Counseling membership, local retail discounts, and a personal Smartsheet account.
  • Teleworking options from any registered U.S. location, role dependent.
  • Market-competitive incentive opportunity in addition to base salary.
  • US base salary range of $192,500 to $245,000 USD.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Software Engineer, Cash App Banking

Block 10K-50K Capital Markets

Cash App’s Banking server engineering team at Block is hiring a software engineer to build and improve customer-facing banking services that help users store, manage, and move money at scale.

AWS Datadog DynamoDB gRPC Hibernate HTTP Java JSON JUnit Kafka Kotlin Microservices MySQL Prometheus
5 minutes ago

Interview Engineer (Peru)

Karat 251-1K Internet Software & Services

Karat is seeking contractor Interview Engineers to facilitate and evaluate technical interviews for software developers through its platform, helping create more objective and inclusive hiring decisions.

20 minutes ago

Software Engineer, iOS Core Product - Glasgow, United Kingdom

Speechify 51-250 Internet Software & Services

Speechify is hiring a Senior iOS Engineer to help scale its fast-growing text-to-speech app, support a large user base, and shape new product experiences for a fully distributed team.

CI/CD Git Swift SwiftUI
28 minutes ago

Forward Deployed Engineer

Nice Côte d'Azur Hotels, Restaurants & Leisure

NiCE is seeking an AI Forward Deployed Engineer to design and deliver production AI agent solutions for enterprise customer engagement across voice and digital channels.

Go React TypeScript
35 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers