RemoteLeaf Logo
Log in Sign up

AI Inference Engineer

1 month, 4 weeks ago
United Kingdom
Full-time
Senior
AI Engineer
DevOps and Infrastructure
Kubernetes
Apply Now
Fuse Energy

Fuse Energy

Fuse Energy is a leading UK electricity supplier prioritizing affordability, service excellence, and sustainability through renewable energy projects and global reinvestment efforts.

Renewable Electricity
11-50
Founded 2014
$78M raised
View All Jobs 16

Description

  • Define Fuse's inference serving strategy and architecture from first principles.
  • Design and build the serving stack for request routing, batching, scheduling, and autoscaling.
  • Own model-level optimization for serving, including quantization, distillation, and speculative decoding.
  • Select and evaluate serving frameworks and orchestration tools such as vLLM, TensorRT-LLM, SGLang, and Triton Inference Server.
  • Translate throughput, latency, and uptime commitments into technical specifications and capacity plans.
  • Own inference performance and reliability for the serving layer.
  • Collaborate with CUDA and GPU engineering teams to integrate low-level performance improvements.
  • Set standards, tooling, and benchmarks for the function as it scales.

Requirements

  • 4+ years of experience building or operating large-scale inference serving systems, or equivalent strong project/industry experience.
  • Deep hands-on experience with inference serving frameworks and optimization techniques such as batching, KV-cache management, quantization, and speculative decoding.
  • Strong systems thinking across the full request-to-response path in a large cluster.
  • Comfort working directly with GPU/CUDA engineers to integrate low-level performance work.
  • Track record of making high-stakes architecture decisions and owning the outcome.
  • Ability to operate without a playbook in a founding, early-stage role.
  • Experience with Triton or custom ML inference/training frameworks (preferred).
  • Experience with autoscaling or capacity planning for large-scale inference workloads (preferred).
  • Exposure to multi-tenant serving or SLA-driven infrastructure (preferred).
  • Background at a hyperscaler, frontier AI lab, or large-scale distributed inference system (preferred).
  • Familiarity with Kubernetes or Slurm for cluster orchestration (preferred).
  • Interest or experience in energy markets, grid systems, or sustainability-focused compute (preferred).

Benefits

  • Competitive salary and an equity sign-on bonus.
  • Biannual bonus scheme.
  • Fully expensed tech to match your needs.
  • Breakfast and dinner allowance for office-based employees.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Caseware

Senior AI Software Engineer

Caseware 251-1K Internet Software & Services

Caseware is hiring a fully remote AI Platform Architect in Colombia to define, build, and operate scalable, secure, and trustworthy AI capabilities for its global accounting and audit software platform.

Colombia Full-time Lead AI Engineer
AWS AWS CDK Confluence DynamoDB GitHub GitHub Actions JIRA Microservices NestJS Python Terraform TypeScript
5 hours, 24 minutes ago
Agiloft

AI Ops Engineer GTM

Agiloft 51-250 Capital Markets

Agiloft is hiring an AI Ops Engineer, GTM to shape and deliver practical AI solutions across Sales, Marketing, Customer Success, and Revenue Operations, using customer and market insight to improve productivity, revenue outcomes, and customer experience.

United States Full-time Junior AI Engineer Sales Operations
CRM HubSpot Python Salesforce Snowflake
5 hours, 24 minutes ago
CI&T

[Job-31694] Tech Lead AI Engineer | Agentic SDLC, Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca uma pessoa Tech Lead – AI Engineer/Orchestrator para liderar tecnicamente soluções de software em uma operação estratégica do setor financeiro, conectando arquitetura, desenvolvimento e agentes de IA em um ambiente de Agentic SDLC.

Brazil Full-time Lead AI Engineer Technical Lead
API Gateway AWS CI/CD DevSecOps Generative AI Java Microservices REST API
5 hours, 24 minutes ago
Pavago

AI Systems Engineer (LLM & AI Agent Development)

Pavago IT Services

The company is seeking a remote AI Systems Engineer to build, integrate, and scale production AI applications, autonomous agents, and internal software systems in collaboration with the founder.

Philippines Full-time Senior AI Engineer
HubSpot Java Node.js Python Salesforce
5 hours, 39 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers