RemoteLeaf Logo
Log in Sign up

Senior Software Engineer II - AI Engineering (Remote Eligible)

3 weeks, 4 days ago
United States
Full-time
Senior
AI Engineer
Software Development
AWS Azure CI/CD Databricks GCP LLM MLflow Python
Apply Now
Smartsheet

Smartsheet

Smartsheet provides an enterprise work management platform that enables teams to efficiently manage projects, automate processes, and enhance collaboration through a user-friendly interface that combines spreadsheet functionality with advanced workflow...

Internet Software & Services
1K-5K
Founded 2005
View All Jobs 64

Description

  • Design and build production-grade LLM-powered agents and workflows, including system design, data pipelines, and deployment strategy decisions.
  • Develop and optimize prompts, RAG pipelines, and agent reasoning patterns.
  • Build evaluation frameworks to measure accuracy, hallucination rates, and performance across model versions.
  • Implement, monitor, optimize, and support end-to-end AI systems on cloud infrastructure such as AWS, GCP, or Azure.
  • Collaborate with Engineering, Product, and cross-functional teams to translate business requirements into technical AI solutions.
  • Mentor and guide engineers on applied ML best practices, modern AI development patterns, and production considerations.
  • Establish best practices and standards for AI development, model governance, and responsible AI.
  • Stay current with emerging AI/LLM tools, frameworks, and techniques and assess their fit for Smartsheet.
  • Work within a critical area of SmartAssist as part of a team building toward a mature Agent Development Lifecycle (ADLC).

Requirements

  • 8+ years of software engineering experience, including at least 2 years working directly with LLMs in production.
  • Deep hands-on experience with prompt engineering and context engineering.
  • Strong working knowledge of RAG architectures, including chunking strategies, embedding models, retrieval evaluation, and failure diagnosis.
  • Experience building or extending LLM evaluation frameworks, including scorers and golden datasets.
  • Fluency in agent system design and the ability to engage on architectural tradeoffs.
  • Strong Python skills and comfort working in data-heavy environments such as Databricks and Delta tables, or equivalent.
  • Ability to communicate complex quality findings clearly to technical and non-technical stakeholders.
  • Strong cross-functional judgment and the ability to know when to escalate, resolve independently, and build credibility across teams.
  • A bias for clarity in ambiguous situations and the ability to bring structure and a clear point of view.
  • Legally eligible to work in the U.S. on an ongoing basis.
  • BS or MS in Computer Science, a related field, or equivalent industry experience.
  • Experience with MLflow or similar experiment tracking platforms is a plus.
  • Familiarity with CI-integrated evaluation pipelines is a plus.
  • Experience with multi-agent orchestration frameworks is a plus.
  • Prior work in an Applied AI or LLMOps function within a product company is a plus.

Benefits

  • Employer-subsidized medical, vision, and dental coverage for full-time employees.
  • 401(k) match of 50% of your contribution up to the first 6% of eligible pay.
  • Monthly stipend to support work and productivity.
  • Flexible Time Away Program plus Sick Time Off.
  • Company-sponsored life insurance, short-term disability, and long-term disability coverage for U.S. employees.
  • 12 paid holidays per year for U.S. employees.
  • Up to 24 weeks of parental leave.
  • Personal paid Volunteer Day.
  • Professional growth and development opportunities, including access to Udemy online courses.
  • Company-funded perks, including a counseling membership, local retail discounts, and a personal Smartsheet account.
  • Teleworking options from any registered U.S. location, role dependent.
  • Market-competitive incentive opportunity.
  • US base salary range of $175,000 to $245,000 USD.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

U

Applied AI Engineer

Unframe Inc. 51-200 Technology, Information and Internet

Unframe is hiring an Applied AI Engineer to work with enterprise customers and internal teams on deploying AI-driven solutions that connect business problems to production systems.

Israel Mid Level AI Engineer Machine Learning Engineer
Machine Learning Python React TypeScript
2 hours, 44 minutes ago
Consumer Edge

Senior Software Engineer - AI Products

Consumer Edge Professional Services

Consumer Edge is hiring a Senior Engineer to help build AI products that combine backend systems, data retrieval, and user-facing workflows into actionable intelligence for customers.

United States Full-time Senior AI Engineer Backend Engineer
$140k-$180k
Dagster dbt FastAPI GCP GraphQL Python REST API SQL Terraform
2 hours, 59 minutes ago
Natera

Senior Software Engineer

Natera 1K-5K Pharmaceuticals

Natera is hiring a Senior Software Engineer to build and evolve oncology web applications and services within a fast-growing biotech environment focused on scalable, compliant software delivery.

United States Full-time Senior Software Engineer
$138k-$172k
Agile AWS HIPAA JavaScript Next.js PostgreSQL React Snowflake System Design TypeScript
2 hours, 59 minutes ago
Elastic

Senior Software Engineer - Storage Engine - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is seeking a Senior Software Engineer for the globally distributed Elasticsearch Storage Engine team to improve core storage and query technologies for observability workloads.

Norway Full-time Senior Database Administrator Software Engineer
$86k-$136k
CI/CD Elasticsearch GitHub Java MongoDB PostgreSQL Prometheus Solr
2 hours, 59 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers