Senior Software Engineer II - AI Engineering (Remote Eligible)

4 days ago
Full-time
Senior
Software Development
Smartsheet

Smartsheet

Smartsheet provides an enterprise work management platform that enables teams to efficiently manage projects, automate processes, and enhance collaboration through a user-friendly interface that combines spreadsheet functionality with advanced workflow...

Internet Software & Services
1K-5K
Founded 2005

Description

  • Design and build production-grade LLM-powered agents and workflows, including system design, data pipelines, and deployment strategy decisions.
  • Develop and optimize prompts, RAG pipelines, and agent reasoning patterns.
  • Build evaluation frameworks to measure accuracy, hallucination rates, and performance across model versions.
  • Implement, monitor, optimize, and support end-to-end AI systems on cloud infrastructure such as AWS, GCP, or Azure.
  • Collaborate with Engineering, Product, and cross-functional teams to translate business requirements into technical AI solutions.
  • Mentor and guide engineers on applied ML best practices, modern AI development patterns, and production considerations.
  • Establish best practices and standards for AI development, model governance, and responsible AI.
  • Stay current with emerging AI/LLM tools, frameworks, and techniques and assess their fit for Smartsheet.
  • Work within a critical area of SmartAssist as part of a team building toward a mature Agent Development Lifecycle (ADLC).

Requirements

  • 8+ years of software engineering experience, including at least 2 years working directly with LLMs in production.
  • Deep hands-on experience with prompt engineering and context engineering.
  • Strong working knowledge of RAG architectures, including chunking strategies, embedding models, retrieval evaluation, and failure diagnosis.
  • Experience building or extending LLM evaluation frameworks, including scorers and golden datasets.
  • Fluency in agent system design and the ability to engage on architectural tradeoffs.
  • Strong Python skills and comfort working in data-heavy environments such as Databricks and Delta tables, or equivalent.
  • Ability to communicate complex quality findings clearly to technical and non-technical stakeholders.
  • Strong cross-functional judgment and the ability to know when to escalate, resolve independently, and build credibility across teams.
  • A bias for clarity in ambiguous situations and the ability to bring structure and a clear point of view.
  • Legally eligible to work in the U.S. on an ongoing basis.
  • BS or MS in Computer Science, a related field, or equivalent industry experience.
  • Experience with MLflow or similar experiment tracking platforms is a plus.
  • Familiarity with CI-integrated evaluation pipelines is a plus.
  • Experience with multi-agent orchestration frameworks is a plus.
  • Prior work in an Applied AI or LLMOps function within a product company is a plus.

Benefits

  • Employer-subsidized medical, vision, and dental coverage for full-time employees.
  • 401(k) match of 50% of your contribution up to the first 6% of eligible pay.
  • Monthly stipend to support work and productivity.
  • Flexible Time Away Program plus Sick Time Off.
  • Company-sponsored life insurance, short-term disability, and long-term disability coverage for U.S. employees.
  • 12 paid holidays per year for U.S. employees.
  • Up to 24 weeks of parental leave.
  • Personal paid Volunteer Day.
  • Professional growth and development opportunities, including access to Udemy online courses.
  • Company-funded perks, including a counseling membership, local retail discounts, and a personal Smartsheet account.
  • Teleworking options from any registered U.S. location, role dependent.
  • Market-competitive incentive opportunity.
  • US base salary range of $175,000 to $245,000 USD.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior AI Engineer - Americas

ChainGPT 11-50 Internet Software & Services

ChainGPT is hiring a Senior AI Engineer to help build Brain by AIVM, a remote-first platform for verifiable, governed enterprise AI at the intersection of blockchain, AI, and agentic systems.

System Design
11 minutes ago

AI-Native Software Engineer - Early Career - Americas

ChainGPT 11-50 Internet Software & Services

ChainGPT is hiring an early-career AI-native software engineer to help build verifiable enterprise AI products through rapid feature development, prototyping, and close collaboration with the founding and senior engineering team.

Blockchain Microservices Serverless
11 minutes ago

Principal Digital Architect

Diversified Services Network 51-250 Construction & Engineering

Diversified Services Network, Inc. is hiring a fully remote Principal Digital Architect to lead end-to-end architecture for complex enterprise systems and help shape technology strategy for a Fortune 500 client.

AWS CI/CD Docker GraphQL gRPC Java Kubernetes LLM Machine Learning Microservices Python REST API Snowflake SQL
11 minutes ago

Full Stack Automation Engineer

AI-focused software engineer role at an Amazon brand management company, responsible for building and scaling internal systems that power communication, sales intelligence, content quality, and automation workflows.

AWS CI/CD Docker Linux LLM Microservices Next.js Node.js OAuth Playwright PostgreSQL React REST API Serverless SSH Terraform TypeScript
26 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers