RemoteLeaf Logo
Log in Sign up

Senior Backend Engineer- AI Agents (Remote)

4 hours, 19 minutes ago
United States
Full-time
Senior
AI Engineer
Software Development
AWS Azure Docker GCP gRPC Kubernetes LLM Microservices REST API SQL System Design
Apply Now
Level AI

Level AI

Level AI provides disruptive AI solutions for call centers, automating workflows and improving team performance with semantic intelligence and real-time insights.

IT Services
51-250
Founded 2018
$15M raised
View All Jobs 5

Description

  • Design and build scalable backend systems that power real-time AI Agents in enterprise environments.
  • Develop agent orchestration frameworks for multi-step reasoning, tool usage, and decision workflows.
  • Build systems for agent memory, context management, and state persistence across interactions.
  • Architect low-latency inference pipelines that integrate LLMs, SLMs, and external tools or services.
  • Implement evaluation frameworks to measure agent performance, accuracy, and reliability.
  • Design continuous improvement loops that move feedback into retraining and production deployment.
  • Build and manage event-driven, asynchronous workflows for complex agent tasks.
  • Develop robust REST and gRPC APIs and service layers for agent capabilities.
  • Partner with Applied AI and ML teams to productionize models and agent behaviors.
  • Collaborate with Product and Solutions teams to translate customer workflows into agentic systems.
  • Drive observability, monitoring, safety, and guardrail practices for AI systems.
  • Contribute to architecture decisions for scaling multi-tenant, enterprise-grade AI platforms.

Requirements

  • 5+ years of experience in backend engineering, distributed systems, or platform engineering.
  • Strong experience building high-scale, production-grade backend systems.
  • Experience designing systems for real-time processing, streaming, or event-driven architectures.
  • Strong understanding of API design using REST and gRPC, and microservices architectures.
  • Experience with SQL and NoSQL databases and data modeling for high-scale systems.
  • Hands-on experience with Docker, Kubernetes, and cloud platforms such as AWS, GCP, or Azure.
  • Strong fundamentals in system design, concurrency, and performance optimization.
  • Experience working with LLMs, conversational AI, or AI-powered products in production is a strong plus.
  • Familiarity with agent frameworks, tool calling, or multi-step reasoning systems is a strong plus.
  • Experience building or integrating RAG pipelines, vector databases, or retrieval systems is a strong plus.
  • Exposure to evaluation systems, including offline or online evals and A/B testing for AI systems, is a strong plus.
  • Understanding of prompting strategies, context windows, and model behavior optimization is a strong plus.
  • Experience with real-time decisioning systems or workflow orchestration engines is a strong plus.

Benefits

  • Competitive compensation with performance-based upside.
  • Flexible vacation policy.
  • Health insurance coverage.
  • Opportunity to work with a globally distributed, high-impact team.
  • Opportunity to build cutting-edge AI products at scale.
  • Regular team offsites and in-person collaboration.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Elastic

Senior Java Engineer - Distributed Systems - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Senior Software Engineer for the Elasticsearch Distributed Systems team to improve cluster-scale indexing, coordination, and resilience across a highly distributed search platform.

Spain Full-time Senior Backend Engineer
$72k-$114k
Elasticsearch Java Lucene
3 hours, 4 minutes ago
Elastic

Senior Java Engineer - Distributed Systems - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Senior Software Engineer for its Elasticsearch Distributed Systems team to improve the scale, performance, and resilience of clustered search infrastructure.

Portugal Full-time Senior Backend Engineer
$65k-$103k
Elasticsearch Java Lucene
3 hours, 4 minutes ago
Elastic

Senior Java Engineer - Distributed Systems - Elasticsearch

Elastic 1K-5K Internet Software & Services

Elastic is hiring a Senior Software Engineer for its Elasticsearch Distributed Systems team to help improve the scale, performance, and resilience of the cluster systems that handle indexing, allocation, replication, and node coordination.

Hungary Full-time Senior Backend Engineer
$20k-$32k
Elasticsearch Java Lucene
3 hours, 4 minutes ago
New Relic

Senior Software Engineer - Fullstack (Backend Focused)

New Relic 1K-5K Internet Software & Services

New Relic is hiring a backend engineer to help build a new observability experience and next-generation platform services for distributed systems in an AI-first environment.

India Full-time Senior Backend Engineer
Agile CI/CD Docker Git GraphQL Java Kafka Kubernetes Microservices React REST API Spring Boot TypeScript
3 hours, 4 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers