Applied AI Engineer - India

3 hours, 17 minutes ago
Full-time
Mid Level
Software Development
dscout

dscout

dscout is a real-time user research tool that captures insights on how users experience products and services, enabling organizations to make customer-centric decisions and drive innovation.

Professional Services
51-250
Founded 2011
$81M raised

Description

  • Own the production improvement cycle spanning agent behavior, feedback, evaluation, experimentation, and verified business outcomes.
  • Instrument agent workflows to make model interactions, tool use, decisions, failures, human edits, and outcomes observable.
  • Define quality standards, evaluation datasets, regression coverage, and production monitoring.
  • Investigate agent performance across context, knowledge, instructions, tools, routing, guardrails, and workflow design.
  • Design and ship improvements to prompting, context construction, decision logic, tool use, and human-review processes.
  • Build backend services, APIs, data models, and feedback pipelines for observable and reproducible agent behavior.
  • Run controlled experiments, production replays, and staged rollouts to measure quality and business impact.
  • Partner with Product, Data Science, and Sales to prioritize problems and define customer and business success.
  • Implement safeguards for privacy, security, reliability, human oversight, and safe operational rollout.

Requirements

  • 2–5 years of software engineering experience.
  • Hands-on experience building or operating production LLM-powered features or agents.
  • Strong fluency in prompting, context engineering, and tool definition.
  • Experience maintaining AI evaluation harnesses, including offline evaluations, LLM-as-judge or human scoring, and regression detection.
  • Ability to reason about nondeterministic agent behavior across real-world production traffic.
  • Experience running A/B tests, staged rollouts, or production replays to validate outcomes.
  • Track record of shipping and owning features used by real customers.
  • High-agency approach to investigating ambiguous performance problems.
  • Comfort using AI coding tools such as Cursor, Claude Code, or Copilot.
  • Preferred: experience with voice or real-time conversational AI, LLM observability tools, LangChain/LangGraph, or MCP-based workflows.

Benefits

  • Competitive compensation package with bonus and equity programs.
  • Flexible PTO, 15 company holidays, and 12 weeks of paid parental leave.
  • 401(k) match and benefits supporting employees and dependents.
  • Education stipend and remote work stipend.
  • Remote-first work environment with location flexibility, excluding Montana, Hawaii, Alaska, and Washington, DC.
  • Transparent, diverse, and inclusive company culture.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI DevOps Engineer

Zscaler 1K-5K Internet Software & Services

Zscaler is hiring a remote AI DevOps Engineer, with a hybrid preference in San Jose, to build and operate multi-cloud platform automation across AWS, GCP, and Azure while integrating AI-assisted workflows.

Argo CD AWS Azure Bash CI/CD GitOps Kubeflow Kubernetes MLflow MLOps Python Secrets Management Terraform Vertex AI
2 hours, 17 minutes ago

Senior Machine Learning Engineer, Digital Twin Platform

instacart.careers 1K-5K Internet Software & Services

Instacart is seeking a Senior Machine Learning Engineer to build and deploy real-time inventory and shelf-stocking intelligence for its Digital Twin Platform, supporting grocery products used by millions of customers.

AWS Azure Computer Vision GCP Machine Learning Python PyTorch Scikit-learn TensorFlow
3 hours, 17 minutes ago

Product & Technical Co-founder (CPTO) - AI Compliance Platform

FutureSight 11-50 Internet Software & Services

FutureSight is seeking a technical co-founder and CPTO to build and lead an explainable AI RegTech platform that automates compliance review for regulated financial firms and produces audit-ready evidence.

Encryption
3 hours, 32 minutes ago

Software Engineer II, MLOps Framework

Torc 251-1K Road & Rail

Torc is hiring a Software Engineer for its ML Ops Framework & Conversion team to build and maintain the pipelines that move autonomous trucking models from research to production on edge hardware.

C++ Embedded Systems
2 days, 3 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers