RemoteLeaf Logo
Log in Sign up

Senior Software Engineer II - Applied AI (Remote Eligible)

2 weeks, 2 days ago
United States
Full-time
Lead
AI Engineer
Software Development
Agile AWS AWS CDK Databricks GCP Kubernetes LLM Microservices MLflow Pulumi Python Terraform
Apply Now
Smartsheet

Smartsheet

Smartsheet provides an enterprise work management platform that enables teams to efficiently manage projects, automate processes, and enhance collaboration through a user-friendly interface that combines spreadsheet functionality with advanced workflow...

Internet Software & Services
1K-5K
Founded 2005
View All Jobs 103

Description

  • Lead the design and ownership of the core AI platform infrastructure that supports Smartsheet AI experiences.
  • Build a robust, multi-tenant environment that enables internal teams to deploy scalable AI features reliably.
  • Architect high-level abstractions and Golden Path APIs that simplify AI development across product teams.
  • Create monitoring and quality assurance systems to evaluate AI-driven features for safety, privacy, and deterministic performance.
  • Design and maintain evaluation pipelines and scoring workflows for LLM-based systems.
  • Partner with principal engineers to define the technical roadmap for AI infrastructure.
  • Work with cross-functional teams to make architectural decisions and resolve technical trade-offs.
  • Communicate quality findings and technical issues clearly to technical and non-technical stakeholders.

Requirements

  • 8+ years of software engineering experience, including at least 2 years working directly with LLMs in production.
  • Deep hands-on experience with prompt engineering and context engineering.
  • Strong working knowledge of RAG architectures, including chunking strategies, embedding models, retrieval evaluation, and failure diagnosis.
  • Experience building or extending LLM evaluation frameworks, including scorers and golden datasets.
  • Strong Python skills and comfort working in data-heavy environments such as Databricks or Delta tables.
  • Ability to communicate complex quality findings clearly in both written and verbal form.
  • Strong cross-functional judgment and the ability to build credibility across engineering, product, and AI platform teams.
  • Bias for clarity in ambiguous situations and the ability to bring structure and a clear point of view to trade-offs.
  • Prior work in an Applied AI or LLMOps platform within a product company is a strong plus.
  • Experience with Kubernetes, including EKS or GKE, GPU scheduling, and autoscaling.
  • Experience with Infrastructure as Code tools such as Terraform, Pulumi, or AWS CDK.
  • Experience with vector databases such as Pinecone, Milvus, Weaviate, or Databricks Vector Search.
  • Experience building or configuring AI gateways such as LiteLLM or Kong AI Gateway.
  • Experience with LLM observability tools such as Langfuse, LangSmith, or MLflow.
  • Experience implementing model-based evaluation systems such as RAGAS or DeepEval.

Benefits

  • Employer-subsidized medical, vision, and dental coverage for full-time employees.
  • 401(k) match of 50% of contributions up to the first 6% of eligible pay.
  • Monthly stipend to support work and productivity.
  • Flexible Time Away Program plus sick time off.
  • Company-sponsored life insurance, short-term disability, and long-term disability coverage.
  • 12 paid holidays per year.
  • Up to 24 weeks of parental leave.
  • Personal paid Volunteer Day.
  • Professional growth and development, including access to Udemy online courses.
  • Counseling membership, local retail discounts, and a personal Smartsheet account.
  • Teleworking options from any registered U.S. location, role dependent.
  • Market-competitive incentive opportunity in addition to base salary.
  • US base salary range of $192,500 to $245,000 USD.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Speechify

Senior Software Engineer, Windows/Desktop Applications - San Francisco, CA, USA

Speechify 51-250 Internet Software & Services

Speechify is hiring a Windows Desktop Engineer to design and build accessible, high-quality native Windows applications that support its text-to-speech products used by millions of people.

United States Full-time Senior Software Engineer
$140k-$200k
C# C++ CI/CD .NET
23 minutes ago
Redwood

Software Engineer

Redwood 251-1K Internet Software & Services

Redwood Software is hiring a Software Engineer, Platform & Integrations to help build and scale its JSCAPE Managed File Transfer SaaS platform for enterprise customers worldwide.

India Full-time Mid Level Software Engineer
Agile AWS CI/CD Docker Encryption Java JUnit Kubernetes Microservices Mockito MySQL PostgreSQL REST API Scrum SFTP Spring Boot SQL TLS
37 minutes ago
3Pillar Global

Senior PowerBuilder Developer

3Pillar Global 1K-5K Internet Software & Services

3Pillar is hiring a Senior PowerBuilder Developer for remote product delivery work in Guatemala to build and launch high-quality software solutions across client projects.

Guatemala Contract Senior Software Engineer
Agile HTTP JSON XML
40 minutes ago
Speechify

Go-to-Market Engineer - Norfolk, VA, USA

Speechify 51-250 Internet Software & Services

Speechify is hiring its first GTM Engineer for SIMBA Voice Agents to build the outbound systems, CRM infrastructure, and automation that help the Sales team generate pipeline for its AI voice agent product.

United States Full-time Senior Sales Operations Software Engineer
$105k-$140k
HubSpot REST API Salesforce
58 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers