ML Infrastructure and Performance Engineer, AI Expert (Remote)

46 minutes ago
Full-time
Mid Level
DevOps and Infrastructure
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Design technical tasks covering accelerator kernel development, performance profiling, distributed-workload debugging, and high-throughput inference serving.
  • Develop complex, adversarial engineering problems to assess advanced AI models' accelerator programming and optimization capabilities.
  • Create technically sound reference solutions that reflect ML systems engineering best practices.
  • Evaluate AI-generated solutions for correctness, efficiency, scalability, and practical applicability.
  • Develop technical guidelines and assessment rubrics for kernel optimization, profiler analysis, distributed systems, and inference performance.
  • Analyze bottlenecks across ML infrastructure, compilers, accelerators, and model-serving systems.
  • Provide structured technical feedback to improve AI model capabilities in ML infrastructure and performance engineering.
  • Collaborate with researchers and subject-matter experts to maintain high-quality AI training and evaluation data.

Requirements

  • At least 2 years of hands-on professional experience in ML systems, ML infrastructure, model serving, accelerator performance engineering, or a related field.
  • Practical experience in accelerator kernel programming, performance profiling, distributed-workload debugging, or LLM inference serving.
  • Production experience with JAX and/or PyTorch.
  • Experience with technologies such as Pallas, Triton, CUDA, CUTLASS, JAX/XLA Profiler, Kineto, torch.profiler, NVIDIA Nsight, vLLM, SGLang, TensorRT-LLM, or JetStream.
  • Understanding of accelerator architectures, including TPUs v4–v6e, NVIDIA H100/B200, AWS Trainium, or AMD MI300.
  • Ability to analyze and optimize throughput, latency, memory utilization, and computational efficiency.
  • Demonstrable professional growth in engineering or infrastructure-focused roles.
  • Excellent written communication skills for explaining complex technical concepts and engineering decisions.
  • Availability for an exclusive, full-time 40-hour-per-week weekday commitment with no conflicting professional engagements.
  • Experience with JAX, XLA, TPU environments, custom operators, sharding, distributed training frameworks, compiler technologies, performance benchmarks, or AI model evaluation is preferred.

Benefits

  • Compensation of $90–$120 per hour.
  • Fully remote work arrangement.
  • Worldwide eligibility.
  • Employment or engagement through an appropriate local partner based on country of residence.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Cloud Infrastructure Engineer / Architect (R-00199)

True Zero Technologies 11-50 Internet Software & Services

True Zero Technologies is seeking a Cloud Migration Engineer / Architect to plan, execute, and govern secure enterprise application and data migrations to AWS GovCloud.

AWS DNS Encryption Terraform
3 hours, 31 minutes ago

Sr Platform/ Infrastructure Engineer

Resilient Co 11-50 Professional Services

As a Senior Platform/Infrastructure Engineer, you will strengthen the platform team by building and operating cloud-native Kubernetes infrastructure that improves reliability, scalability, and performance.

AWS Azure Bash Java Kubernetes OpenSearch PostgreSQL Prometheus Python
2 days, 3 hours ago

Cloud Systems Engineer

Jump Trading 501-1000 Capital Markets

Jump Trading Group is seeking an Infrastructure Engineer to build, operate, and secure independent cloud infrastructure supporting production and HPC-style workloads outside its primary environment.

Ansible AWS Azure Bash DNS GCP Grafana HTTP Kubernetes Linux Load Balancing Prometheus Python SaltStack Secrets Management TCP/IP Terraform TLS
2 days, 3 hours ago

Technical Services and Implementation Contractor

RapidAI 51-200 Health Care Providers & Services

RapidAI is seeking a bilingual Technical Implementation and Platform Services professional to deploy and support its clinical AI platform for healthcare customers across the APAC region, ensuring successful implementations, adoption, and ongoing performance.

Active Directory Ansible AWS Azure Docker Kubernetes Linux Python Terraform Wireshark
3 days, 3 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers