RemoteLeaf Logo
Log in Sign up

Senior Software Engineer II - Applied AI (Remote Eligible)

1 month, 2 weeks ago
United States
Full-time
Lead
AI Engineer
Software Development
Agile AWS AWS CDK Databricks GCP Kubernetes LLM Microservices MLflow Pulumi Python Terraform
Apply Now
Smartsheet

Smartsheet

Smartsheet provides an enterprise work management platform that enables teams to efficiently manage projects, automate processes, and enhance collaboration through a user-friendly interface that combines spreadsheet functionality with advanced workflow...

Internet Software & Services
1K-5K
Founded 2005
View All Jobs 70

Description

  • Lead the design and ownership of the core AI platform infrastructure that supports Smartsheet AI experiences.
  • Build a robust, multi-tenant environment that enables internal teams to deploy scalable AI features reliably.
  • Architect high-level abstractions and Golden Path APIs that simplify AI development across product teams.
  • Create monitoring and quality assurance systems to evaluate AI-driven features for safety, privacy, and deterministic performance.
  • Design and maintain evaluation pipelines and scoring workflows for LLM-based systems.
  • Partner with principal engineers to define the technical roadmap for AI infrastructure.
  • Work with cross-functional teams to make architectural decisions and resolve technical trade-offs.
  • Communicate quality findings and technical issues clearly to technical and non-technical stakeholders.

Requirements

  • 8+ years of software engineering experience, including at least 2 years working directly with LLMs in production.
  • Deep hands-on experience with prompt engineering and context engineering.
  • Strong working knowledge of RAG architectures, including chunking strategies, embedding models, retrieval evaluation, and failure diagnosis.
  • Experience building or extending LLM evaluation frameworks, including scorers and golden datasets.
  • Strong Python skills and comfort working in data-heavy environments such as Databricks or Delta tables.
  • Ability to communicate complex quality findings clearly in both written and verbal form.
  • Strong cross-functional judgment and the ability to build credibility across engineering, product, and AI platform teams.
  • Bias for clarity in ambiguous situations and the ability to bring structure and a clear point of view to trade-offs.
  • Prior work in an Applied AI or LLMOps platform within a product company is a strong plus.
  • Experience with Kubernetes, including EKS or GKE, GPU scheduling, and autoscaling.
  • Experience with Infrastructure as Code tools such as Terraform, Pulumi, or AWS CDK.
  • Experience with vector databases such as Pinecone, Milvus, Weaviate, or Databricks Vector Search.
  • Experience building or configuring AI gateways such as LiteLLM or Kong AI Gateway.
  • Experience with LLM observability tools such as Langfuse, LangSmith, or MLflow.
  • Experience implementing model-based evaluation systems such as RAGAS or DeepEval.

Benefits

  • Employer-subsidized medical, vision, and dental coverage for full-time employees.
  • 401(k) match of 50% of contributions up to the first 6% of eligible pay.
  • Monthly stipend to support work and productivity.
  • Flexible Time Away Program plus sick time off.
  • Company-sponsored life insurance, short-term disability, and long-term disability coverage.
  • 12 paid holidays per year.
  • Up to 24 weeks of parental leave.
  • Personal paid Volunteer Day.
  • Professional growth and development, including access to Udemy online courses.
  • Counseling membership, local retail discounts, and a personal Smartsheet account.
  • Teleworking options from any registered U.S. location, role dependent.
  • Market-competitive incentive opportunity in addition to base salary.
  • US base salary range of $192,500 to $245,000 USD.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Upstart

Senior Software Engineer, Auto

Upstart 1K-5K Banks

Upstart is hiring a Senior Software Engineer to help scale its Auto Direct secured lending product by building customer-facing experiences, eligibility systems, and operational workflows in a digital-first environment.

United States Canada Full-time Senior Software Engineer
$153k-$231k
System Design
4 hours, 42 minutes ago
6sense

Software Engineer III

6sense 1K-5K IT Services

6sense is hiring a Software Engineer III to design, develop, and scale backend services and distributed systems for its AI-driven B2B account engagement platform.

United States Full-time Mid Level Software Engineer
$148k-$217k
AWS Azure GCP Go Java Microservices Python System Design TypeScript
4 hours, 42 minutes ago
Klaviyo

Senior Lead Software Engineer - Developer Infrastructure

Klaviyo 1K-5K IT Services

Klaviyo is hiring a Senior Lead Software Engineer to lead backend Dev Infrastructure architecture and platform strategy for dependencies, upgrades, and developer productivity across the engineering organization.

United States Full-time Lead DevOps Engineer Software Engineer
$216k-$324k
Apache Airflow Apache Spark AWS Azure Buildkite ClickHouse Django Docker FastAPI GCP Go Jest Kafka Kubernetes MySQL PostgreSQL Python RabbitMQ React Redis Terraform TypeScript
4 hours, 42 minutes ago
Natera

Principal Software Engineer

Natera 1K-5K Pharmaceuticals

Natera is hiring a Principal Software Engineer for its R&D Platform Infrastructure team to lead architecture and delivery of cloud, workflow, and data platforms that support scientific workloads.

United States Full-time Lead Software Engineer
$220k-$275k
Apache Airflow AWS Azure Dagster Django GCP Go Groovy Helm Java Kubernetes Python React Terraform
4 hours, 42 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers