RemoteLeaf Logo
Log in Sign up

CUDA Engineer

1 month, 1 week ago
United Kingdom
Full-time
Senior
AI Engineer
Software Development
C++ Sass
Apply Now
Fuse Energy

Fuse Energy

Fuse Energy is a leading UK electricity supplier prioritizing affordability, service excellence, and sustainability through renewable energy projects and global reinvestment efforts.

Renewable Electricity
11-50
Founded 2014
$78M raised
View All Jobs 16

Description

  • Write and optimize custom CUDA kernels for core transformer inference operations.
  • Profile kernels to identify and eliminate bottlenecks in occupancy, memory throughput, and warp divergence.
  • Apply kernel fusion to reduce memory round-trips and launch overhead across inference pipelines.
  • Optimize memory access patterns and manage the memory hierarchy for maximum bandwidth utilization.
  • Implement quantisation-aware kernels and mixed-precision arithmetic to reduce latency and memory footprint.
  • Build and tune caching mechanisms for efficient autoregressive decoding.
  • Tune kernel launch configurations for target GPU architectures.
  • Benchmark kernels against existing baselines and drive measurable throughput and latency improvements.
  • Write tests for CUDA code to catch performance and correctness regressions.
  • Maintain internal CUDA libraries and contribute to coding standards and documentation.

Requirements

  • 4+ years writing production CUDA code, with a track record of shipping performance-critical kernels.
  • Deep understanding of GPU microarchitecture, warps, occupancy, register pressure, and memory hierarchy.
  • Strong CUDA C++ skills, including streams and asynchronous execution.
  • Hands-on experience profiling to diagnose compute-bound vs. memory-bound bottlenecks.
  • Experience with kernel fusion, memory coalescing, and avoiding warp divergence.
  • Experience writing quantised and mixed-precision kernels.
  • Solid grasp of parallel algorithm design and numerical precision tradeoffs.
  • Experience with transformer/attention-style kernels or autoregressive decoding (nice to have).
  • Experience building high-performance GPU libraries from scratch (nice to have).
  • Background in HPC or other latency-critical performance engineering (nice to have).
  • Exposure to multi-GPU or multi-node kernel-level optimisation (nice to have).
  • Comfortable reading PTX/SASS to validate kernel efficiency (nice to have).

Benefits

  • Competitive salary and an equity sign-on bonus.
  • Biannual bonus scheme.
  • Fully expensed tech to match your needs.
  • Breakfast and dinner allowance for office-based employees.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Fieldwire

AI/ML Engineer

Fieldwire 251-1K Construction & Engineering

Fieldwire, a Hilti construction technology company, is hiring a fully remote AI/ML Engineer in the United States to build and deploy machine learning systems that convert 360° jobsite captures into actionable insights for construction teams.

United States Full-time Mid Level Machine Learning Engineer
$152k-$220k
Agile Computer Vision Deep Learning Generative AI Machine Learning
16 hours, 44 minutes ago
MKS2 Technologies

Artificial Intelligence Engineer

MKS2 Technologies 51-250 Internet Software & Services

MKS2 Technologies is seeking a remote Artificial Intelligence Engineer to technically lead the design, deployment, and optimization of AI and machine learning systems supporting a federal government program.

United States Full-time Lead AI Engineer
$180k-$210k
Cybersecurity Feature Engineering Generative AI Machine Learning NLP
16 hours, 44 minutes ago
C

Senior Full-Stack AI Product Engineer

CGS Immersive 5001-10000 Enterprise learning

CGS is seeking a Senior Full-Stack AI Product Engineer to turn product requirements and UX concepts into polished, LLM-powered web products and evolve successful prototypes into maintainable production systems.

Canada Full-time Senior AI Engineer Full-stack Engineer
LLM Next.js React UX Design
17 hours, 59 minutes ago
Kyivstar

AI Product Engineer

Kyivstar 1K-5K Wireless Telecommunication Services

Kyivstar.Tech is seeking an AI Product Engineer to turn business needs into AI-powered products by combining product ownership, full-stack development, and production delivery.

Anywhere Full-time Senior Full-stack Engineer Machine Learning Engineer
AWS Azure CI/CD Cybersecurity Docker GraphQL MLOps Node.js Python React REST API
1 day, 17 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers