RemoteLeaf Logo
Log in Sign up

AI Inference Engineer

5 days, 18 hours ago
United Kingdom
Full-time
Senior
AI Engineer
DevOps and Infrastructure
Kubernetes
Apply Now
Fuse Energy

Fuse Energy

Fuse Energy is a leading UK electricity supplier prioritizing affordability, service excellence, and sustainability through renewable energy projects and global reinvestment efforts.

Renewable Electricity
11-50
Founded 2014
$78M raised
View All Jobs 13

Description

  • Define Fuse's inference serving strategy and architecture from first principles.
  • Design and build the serving stack for request routing, batching, scheduling, and autoscaling.
  • Own model-level optimization for serving, including quantization, distillation, and speculative decoding.
  • Select and evaluate serving frameworks and orchestration tools such as vLLM, TensorRT-LLM, SGLang, and Triton Inference Server.
  • Translate throughput, latency, and uptime commitments into technical specifications and capacity plans.
  • Own inference performance and reliability for the serving layer.
  • Collaborate with CUDA and GPU engineering teams to integrate low-level performance improvements.
  • Set standards, tooling, and benchmarks for the function as it scales.

Requirements

  • 4+ years of experience building or operating large-scale inference serving systems, or equivalent strong project/industry experience.
  • Deep hands-on experience with inference serving frameworks and optimization techniques such as batching, KV-cache management, quantization, and speculative decoding.
  • Strong systems thinking across the full request-to-response path in a large cluster.
  • Comfort working directly with GPU/CUDA engineers to integrate low-level performance work.
  • Track record of making high-stakes architecture decisions and owning the outcome.
  • Ability to operate without a playbook in a founding, early-stage role.
  • Experience with Triton or custom ML inference/training frameworks (preferred).
  • Experience with autoscaling or capacity planning for large-scale inference workloads (preferred).
  • Exposure to multi-tenant serving or SLA-driven infrastructure (preferred).
  • Background at a hyperscaler, frontier AI lab, or large-scale distributed inference system (preferred).
  • Familiarity with Kubernetes or Slurm for cluster orchestration (preferred).
  • Interest or experience in energy markets, grid systems, or sustainability-focused compute (preferred).

Benefits

  • Competitive salary and an equity sign-on bonus.
  • Biannual bonus scheme.
  • Fully expensed tech to match your needs.
  • Breakfast and dinner allowance for office-based employees.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Fundraise Up

Senior AI Enablement Engineer

Fundraise Up 51-250 Capital Markets

Fundraise Up is hiring an AI Enablement Engineer in a remote role based in Turkey to drive adoption of AI-assisted development and build the internal integrations that improve engineering productivity across a global product team.

Turkey Full-time Senior AI Engineer Software Engineer
$65k-$70k
Bull CI/CD ClickHouse Elasticsearch Grafana Kafka Koa LLM MongoDB NestJS Node.js OpenTelemetry Prometheus React Redis Serverless TypeScript Vue.js
17 hours, 45 minutes ago
Locus Robotics

Technical Director, AI Enterprise Architect

Locus Robotics 251-1K Automotive

Locus Robotics is hiring a Technical Director, AI Enterprise Architect to lead an enterprise-wide AI transformation by defining strategy, architecting scalable AI solutions, and driving execution across the business.

United States Full-time Lead AI Engineer Solutions Architect
$200k-$300k
AWS Azure CRM Databricks ERP GCP LLM Machine Learning Python
18 hours ago
Caylent

Senior Forward Deployed Engineer

Caylent 251-1K IT Services

Caylent is hiring a Senior FDE to own end-to-end client AI engagements within its Anthropic Business Unit, from discovery through close, delivering production-grade AI and automation outcomes.

Mexico Full-time Senior AI Engineer Solutions Engineer
AWS Generative AI LLM Salesforce
18 hours, 15 minutes ago
UXBERT Labs

Senior AI Engineer

UXBERT Labs 51-250 Professional Services

UXBERT Labs is hiring an AI Engineer to build and deploy practical AI-powered full-stack applications and rapid prototypes for real-world use across its digital products and client work.

Saudi Arabia Full-time Lead AI Engineer
Agile Apache Airflow Apache Spark AWS Azure BERT CI/CD Django Docker FastAPI Flask GCP Git GPT Kubernetes Laravel LLM Node.js PHP Python PyTorch React SageMaker TensorFlow Vertex AI
18 hours, 30 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers