Senior Software Engineer II - Applied AI (Remote Eligible)

3 days, 7 hours ago
Full-time
Lead
Software Development
Smartsheet

Smartsheet

Smartsheet provides an enterprise work management platform that enables teams to efficiently manage projects, automate processes, and enhance collaboration through a user-friendly interface that combines spreadsheet functionality with advanced workflow...

Internet Software & Services
1K-5K
Founded 2005

Description

  • Lead the design and ownership of the core AI platform infrastructure that supports Smartsheet AI experiences.
  • Build a robust, multi-tenant environment that enables internal teams to deploy scalable AI features reliably.
  • Architect high-level abstractions and Golden Path APIs that simplify AI development across product teams.
  • Create monitoring and quality assurance systems to evaluate AI-driven features for safety, privacy, and deterministic performance.
  • Design and maintain evaluation pipelines and scoring workflows for LLM-based systems.
  • Partner with principal engineers to define the technical roadmap for AI infrastructure.
  • Work with cross-functional teams to make architectural decisions and resolve technical trade-offs.
  • Communicate quality findings and technical issues clearly to technical and non-technical stakeholders.

Requirements

  • 8+ years of software engineering experience, including at least 2 years working directly with LLMs in production.
  • Deep hands-on experience with prompt engineering and context engineering.
  • Strong working knowledge of RAG architectures, including chunking strategies, embedding models, retrieval evaluation, and failure diagnosis.
  • Experience building or extending LLM evaluation frameworks, including scorers and golden datasets.
  • Strong Python skills and comfort working in data-heavy environments such as Databricks or Delta tables.
  • Ability to communicate complex quality findings clearly in both written and verbal form.
  • Strong cross-functional judgment and the ability to build credibility across engineering, product, and AI platform teams.
  • Bias for clarity in ambiguous situations and the ability to bring structure and a clear point of view to trade-offs.
  • Prior work in an Applied AI or LLMOps platform within a product company is a strong plus.
  • Experience with Kubernetes, including EKS or GKE, GPU scheduling, and autoscaling.
  • Experience with Infrastructure as Code tools such as Terraform, Pulumi, or AWS CDK.
  • Experience with vector databases such as Pinecone, Milvus, Weaviate, or Databricks Vector Search.
  • Experience building or configuring AI gateways such as LiteLLM or Kong AI Gateway.
  • Experience with LLM observability tools such as Langfuse, LangSmith, or MLflow.
  • Experience implementing model-based evaluation systems such as RAGAS or DeepEval.

Benefits

  • Employer-subsidized medical, vision, and dental coverage for full-time employees.
  • 401(k) match of 50% of contributions up to the first 6% of eligible pay.
  • Monthly stipend to support work and productivity.
  • Flexible Time Away Program plus sick time off.
  • Company-sponsored life insurance, short-term disability, and long-term disability coverage.
  • 12 paid holidays per year.
  • Up to 24 weeks of parental leave.
  • Personal paid Volunteer Day.
  • Professional growth and development, including access to Udemy online courses.
  • Counseling membership, local retail discounts, and a personal Smartsheet account.
  • Teleworking options from any registered U.S. location, role dependent.
  • Market-competitive incentive opportunity in addition to base salary.
  • US base salary range of $192,500 to $245,000 USD.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Staff Engineer, Platform Engineering

Motional 1K-5K Automotive

Motional is hiring a Staff Engineer on its Platform Engineering team to lead the evolution of global cloud and hybrid infrastructure for a developer platform supporting autonomous vehicle deployment.

Apache Airflow AWS CI/CD CloudFormation Datadog GCP GitOps Grafana Kubernetes LLM Machine Learning OpenTelemetry Prometheus Terraform
7 minutes ago

Staff Software Engineer, Batch Processing Platform

Pinterest 5K-10K Internet Software & Services

Pinterest is hiring a Staff Software Engineer to build and optimize its batch processing platform and infrastructure for large-scale big data workloads.

Apache Spark Java Presto Python Scala Trino
22 minutes ago

Staff Software Engineer, Backend (Capacity Modeling)

Affirm 1K-5K Diversified Financial Services

Affirm is hiring a leader for its Capacity Modeling team to build and operationalize capacity plans that keep the company’s systems reliable during forecasted traffic spikes and peak sales events.

Apache Spark AWS DynamoDB Kotlin Kubernetes MySQL Python
22 minutes ago

Senior Agentic Systems Engineer

Natera 1K-5K Pharmaceuticals

Natera is seeking a Senior Agentic Systems Engineer to build and scale AI orchestration platforms that use multimodal data to support therapeutic development and clinical innovation.

AWS Generative AI LLM Python Terraform
27 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers