RemoteLeaf Logo
Log in Sign up

LLM Systems / AI Agent Engineer (Remote, Full-Time) [AS311]

10 hours, 14 minutes ago
India
Full-time
Senior
AI Engineer
Software Development
AWS Node.js OpenTelemetry PostgreSQL Serverless TypeScript Vertex AI
Apply Now
Smart Working

Smart Working

Smart Working is a company that specializes in software development outsourcing and staff augmentation. They offer nearshore software development services, outsourcing solutions, and staff augmentation with a focus on providing highly skilled Indian de...

Internet Software & Services
View All Jobs 24

Description

  • Build and evolve production AI agents on foundation models, currently AWS Bedrock.
  • Develop and maintain orchestration for production AI agents.
  • Apply context engineering to LLM and agent systems.
  • Build evaluation datasets and pipelines for tool selection, trajectory analysis, and LLM-as-judge evaluations.
  • Implement production observability, monitoring, tracing, and instrumentation for LLM systems.
  • Advise on retaining the custom orchestration layer or adopting frameworks such as LangGraph or LangChain.
  • Work as an individual contributor in a three-person product team alongside the AI function lead and a Full Stack Engineer.
  • Own and deliver measurable AI-agent engineering outcomes against roadmap timelines from onboarding.

Requirements

  • 2+ years of experience building production LLM agents, including tool-calling loops, streaming, context management, structured outputs, and orchestration frameworks.
  • Production experience with an agentic framework such as LangGraph, LangChain, or custom orchestration.
  • 1.5+ years of experience with evaluation-driven development, including evaluation datasets and pipelines for tool selection, trajectory evaluation, and LLM-as-judge workflows.
  • 1+ year of experience with LLM observability, tracing, and instrumentation using Langfuse, OpenTelemetry, or similar tools; hands-on agent-observability experience is required, with Langfuse strongly preferred.
  • 1+ year of experience with LLM cost optimization, including prompt caching, model selection and routing, and LLM FinOps.
  • 5+ years of backend engineering experience with TypeScript/Node, Postgres, and serverless AWS.
  • Experience shipping agentic AI systems to production, diagnosing failure modes, and implementing mitigations end to end.
  • 1+ year of AWS Bedrock or transferable foundation-model provider experience, such as OpenAI, Anthropic, Azure OpenAI, or Vertex AI.
  • 1+ year of experience with AI safety and guardrails, including prompt-injection screening, output validation, and untrusted-input handling; familiarity with MCP, multi-agent patterns, or geospatial data is a plus.

Benefits

  • Fixed shifts from 12:00 PM–9:30 PM IST in summer and 1:00 PM–10:30 PM IST in winter.
  • No weekend work.
  • Laptop and full medical insurance provided from day one.
  • Mentorship, community support, and knowledge-sharing forums.
  • Long-term remote-first career opportunities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Provectus

Python/GenAI Solutions Architect

Provectus 251-1K Professional Services

Provectus is seeking a Senior Software Engineer or Solutions Architect to embed with enterprise client teams and deliver production-ready Python, cloud, and generative AI systems from discovery through deployment.

United States Full-time Senior AI Engineer Solutions Architect
AWS CI/CD Django Docker FastAPI Flask GCP Generative AI GitHub Actions GitLab CI Go Kubernetes Machine Learning Microservices Node.js Pytest Python React REST API Rust SQL Vue.js
9 hours, 59 minutes ago
CI&T

[Job - 31015] Master Software Developer ( AI Generative)

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Master Software Developer to design, build, and scale secure, production-grade Generative AI and Agentic AI solutions for enterprise clients in a global delivery environment.

Colombia Brazil Full-time Senior AI Engineer
AWS Azure CI/CD Databricks Docker Generative AI Kubernetes MLOps Python Secrets Management Vertex AI
10 hours, 14 minutes ago
OnBoard

Senior AI Engineer - Observability

OnBoard 251-1K Internet Software & Services

OnBoard is seeking a remote Senior AI Engineer to build and operationalize reliable, measurable, cost-effective, and safe AI product experiences for its board intelligence platform.

United States Full-time Senior AI Engineer
Azure C# CI/CD Git Machine Learning Microservices .NET OpenTelemetry Python
10 hours, 14 minutes ago
CI&T

[Job-31101] Mid Level AI Developer | Fullstack (Java / Angular), Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa desenvolvedora Full Stack para criar e evoluir aplicações com Java/Spring Boot e Angular, incorporando IA e práticas modernas de desenvolvimento em soluções escaláveis e seguras.

Brazil Full-time Mid Level AI Engineer Full-stack Engineer
Angular GitLab Java Jenkins JIRA SonarQube Spring Boot
10 hours, 29 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers