RemoteLeaf Logo
Log in Sign up

CUDA Engineer

2 months, 3 weeks ago
United Kingdom
Full-time
Senior
AI Engineer
Software Development
C++ Sass
Apply Now
Fuse Energy

Fuse Energy

Fuse Energy is a leading UK electricity supplier prioritizing affordability, service excellence, and sustainability through renewable energy projects and global reinvestment efforts.

Renewable Electricity
11-50
Founded 2014
$78M raised
View All Jobs 16

Description

  • Write and optimize custom CUDA kernels for core transformer inference operations.
  • Profile kernels to identify and eliminate bottlenecks in occupancy, memory throughput, and warp divergence.
  • Apply kernel fusion to reduce memory round-trips and launch overhead across inference pipelines.
  • Optimize memory access patterns and manage the memory hierarchy for maximum bandwidth utilization.
  • Implement quantisation-aware kernels and mixed-precision arithmetic to reduce latency and memory footprint.
  • Build and tune caching mechanisms for efficient autoregressive decoding.
  • Tune kernel launch configurations for target GPU architectures.
  • Benchmark kernels against existing baselines and drive measurable throughput and latency improvements.
  • Write tests for CUDA code to catch performance and correctness regressions.
  • Maintain internal CUDA libraries and contribute to coding standards and documentation.

Requirements

  • 4+ years writing production CUDA code, with a track record of shipping performance-critical kernels.
  • Deep understanding of GPU microarchitecture, warps, occupancy, register pressure, and memory hierarchy.
  • Strong CUDA C++ skills, including streams and asynchronous execution.
  • Hands-on experience profiling to diagnose compute-bound vs. memory-bound bottlenecks.
  • Experience with kernel fusion, memory coalescing, and avoiding warp divergence.
  • Experience writing quantised and mixed-precision kernels.
  • Solid grasp of parallel algorithm design and numerical precision tradeoffs.
  • Experience with transformer/attention-style kernels or autoregressive decoding (nice to have).
  • Experience building high-performance GPU libraries from scratch (nice to have).
  • Background in HPC or other latency-critical performance engineering (nice to have).
  • Exposure to multi-GPU or multi-node kernel-level optimisation (nice to have).
  • Comfortable reading PTX/SASS to validate kernel efficiency (nice to have).

Benefits

  • Competitive salary and an equity sign-on bonus.
  • Biannual bonus scheme.
  • Fully expensed tech to match your needs.
  • Breakfast and dinner allowance for office-based employees.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lingaro

Fullstack Data Scientist - freelancer

Lingaro 5K-10K IT Services

Lead GenAI engineering initiatives by designing, building, evaluating, and governing production-ready AI applications and architectures for enterprise use cases.

Poland Freelance Senior AI Engineer Data Scientist
Apache Spark AWS Azure CI/CD Databricks Docker Generative AI GitHub Actions GitLab Kubernetes Machine Learning Microservices Python
3 hours, 18 minutes ago
CI&T

[Job-00023] Senior AI Engineer, Brazil

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Senior AI Engineer to build reliable AI-powered information extraction solutions and enhance a web application using LLMs, document intelligence, and full-stack engineering.

Brazil Full-time Senior AI Engineer Full-stack Engineer
Next.js Python React
3 hours, 18 minutes ago
CI&T

[Job 32221] SR. AI Engineer -Foco em Criação e Orquestração de Agentes (Agentic SDLC)

CI&T 5K-10K Internet Software & Services

A CI&T busca um(a) Software Engineer Mid-Senior para arquitetar, construir e entregar soluções de software para clientes, usando agentic SDLC e IA aplicada da arquitetura ao código em produção.

Brazil Full-time Senior AI Engineer
CI/CD Microservices NestJS Node.js TypeScript
3 hours, 33 minutes ago
CareDx

Senior Data & AI Engineer

CareDx 251-1K Pharmaceuticals

CareDx is seeking a Senior Data and AI Engineer to build production data engineering and clinical NLP solutions that convert structured and unstructured EMR data into standardized, reliable transplant-focused clinical data for patient care, research, and business operations.

United States Full-time Senior AI Engineer
$126k-$158k
CI/CD Deep Learning Git HIPAA Machine Learning NLP Pandas Python PyTorch SQL TensorFlow
4 hours, 3 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers