RemoteLeaf Logo
Log in Sign up

AI Inference Engineer

2 months, 2 weeks ago
United Kingdom
Full-time
Senior
AI Engineer
DevOps and Infrastructure
Kubernetes
Apply Now
Fuse Energy

Fuse Energy

Fuse Energy is a leading UK electricity supplier prioritizing affordability, service excellence, and sustainability through renewable energy projects and global reinvestment efforts.

Renewable Electricity
11-50
Founded 2014
$78M raised
View All Jobs 16

Description

  • Define Fuse's inference serving strategy and architecture from first principles.
  • Design and build the serving stack for request routing, batching, scheduling, and autoscaling.
  • Own model-level optimization for serving, including quantization, distillation, and speculative decoding.
  • Select and evaluate serving frameworks and orchestration tools such as vLLM, TensorRT-LLM, SGLang, and Triton Inference Server.
  • Translate throughput, latency, and uptime commitments into technical specifications and capacity plans.
  • Own inference performance and reliability for the serving layer.
  • Collaborate with CUDA and GPU engineering teams to integrate low-level performance improvements.
  • Set standards, tooling, and benchmarks for the function as it scales.

Requirements

  • 4+ years of experience building or operating large-scale inference serving systems, or equivalent strong project/industry experience.
  • Deep hands-on experience with inference serving frameworks and optimization techniques such as batching, KV-cache management, quantization, and speculative decoding.
  • Strong systems thinking across the full request-to-response path in a large cluster.
  • Comfort working directly with GPU/CUDA engineers to integrate low-level performance work.
  • Track record of making high-stakes architecture decisions and owning the outcome.
  • Ability to operate without a playbook in a founding, early-stage role.
  • Experience with Triton or custom ML inference/training frameworks (preferred).
  • Experience with autoscaling or capacity planning for large-scale inference workloads (preferred).
  • Exposure to multi-tenant serving or SLA-driven infrastructure (preferred).
  • Background at a hyperscaler, frontier AI lab, or large-scale distributed inference system (preferred).
  • Familiarity with Kubernetes or Slurm for cluster orchestration (preferred).
  • Interest or experience in energy markets, grid systems, or sustainability-focused compute (preferred).

Benefits

  • Competitive salary and an equity sign-on bonus.
  • Biannual bonus scheme.
  • Fully expensed tech to match your needs.
  • Breakfast and dinner allowance for office-based employees.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lingaro

Fullstack Data Scientist - freelancer

Lingaro 5K-10K IT Services

Lead GenAI engineering initiatives by designing, building, evaluating, and governing production-ready AI applications and architectures for enterprise use cases.

Poland Freelance Senior AI Engineer Data Scientist
Apache Spark AWS Azure CI/CD Databricks Docker Generative AI GitHub Actions GitLab Kubernetes Machine Learning Microservices Python
3 hours, 19 minutes ago
CI&T

[Job-00023] Senior AI Engineer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Senior AI Engineer to build reliable AI-powered information extraction solutions and enhance a web application using LLMs, document intelligence, and full-stack engineering.

Brazil Full-time Senior AI Engineer Full-stack Engineer
Next.js Python React
3 hours, 19 minutes ago
CI&T

[Job 32221] SR. AI Engineer -Foco em Criação e Orquestração de Agentes (Agentic SDLC)

CI&T 5K-10K Internet Software & Services

A CI&T busca um(a) Software Engineer Mid-Senior para arquitetar, construir e entregar soluções de software para clientes, usando agentic SDLC e IA aplicada da arquitetura ao código em produção.

Brazil Full-time Senior AI Engineer
CI/CD Microservices NestJS Node.js TypeScript
3 hours, 34 minutes ago
CareDx

Senior Data & AI Engineer

CareDx 251-1K Pharmaceuticals

CareDx is seeking a Senior Data and AI Engineer to build production data engineering and clinical NLP solutions that convert structured and unstructured EMR data into standardized, reliable transplant-focused clinical data for patient care, research, and business operations.

United States Full-time Senior AI Engineer
$126k-$158k
CI/CD Deep Learning Git HIPAA Machine Learning NLP Pandas Python PyTorch SQL TensorFlow
4 hours, 4 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers