RemoteLeaf Logo
Log in Sign up

LLMOps Engineer

1 month ago
Africa
Full-time
Junior
Machine Learning Engineer
Data Science and Analytics
Python Statistics
Apply Now
ALX Africa

ALX Africa

ALX Africa empowers young individuals by offering no-cost, world-class programs designed to develop their tech and professional skills, ultimately enhancing their career prospects and facilitating their entry into the workforce.

Diversified Consumer Services
1K-5K
Founded 2018
View All Jobs 4

Description

  • Build and run evaluation suites for each product, broken down by failure mode and executed on schedule and with every release.
  • Keep evaluation workflows cost-effective as the product line grows.
  • Own the reporting loop by presenting evaluation findings and platform data to the team and stakeholders.
  • Surface unintended or problematic model behavior before learners encounter it.
  • Steward core datasets, including classified customer-support data.
  • Partner with the AI Product Manager on instrumentation and build evaluations based on captured product data.
  • Collaborate with Anthropic engineers, AI engineers, product managers, and data scientists to improve learning experiences.
  • Measure AI systems honestly and contribute to regression testing so broken behavior does not ship.

Requirements

  • Solid Python skills and a strong data orientation for working with messy LLM-generated data.
  • Ability to decompose an AI product into success metrics and failure metrics.
  • Familiarity with Langfuse, RAGAS, DSPy, or similar evaluation tools.
  • Depth in at least one evaluation tool and awareness of others.
  • Experience keeping evaluations cost-effective at scale is desirable.
  • Dashboarding and reporting experience is desirable.
  • Classical statistics knowledge is desirable.
  • Strong communication and collaboration skills for working across small in-person teams and larger virtual teams.
  • Self-drive to communicate consistently using web collaboration and video conferencing.
  • Preferred time zone: GMT+2.
  • This is a full-time position.

Benefits

  • Opportunity to work on ALX Africa’s AI learning platform with real learner impact.
  • Collaboration with Anthropic engineers and cross-functional AI/product/data teams.
  • Clear junior-to-mid growth path toward broader ownership of the function.
  • Encouragement to continually develop capabilities and attain certifications.
  • Work in a mission-driven non-profit focused on Africa’s digital future.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Air

Senior Machine Learning Engineer

Air 11-50 Media

Air is seeking a Senior Machine Learning Engineer to build and operate the infrastructure supporting the full lifecycle of language models and AI systems for government and industrial customers, from experimentation through production deployment and continuous improvement.

United States Full-time Senior Machine Learning Engineer
AWS Azure Deep Learning GCP Kubernetes LLM Machine Learning Python Reinforcement Learning
4 hours, 47 minutes ago
Mozn

AI Infrastructure Engineer III

Mozn 51-250 Internet Software & Services

Mozn is hiring an AI Infrastructure Engineer III for its Cloud Engineering team to build, operate, and optimize scalable AI platforms and GPU infrastructure that enable efficient model development, training, deployment, and operation across cloud-native and hybrid environments.

Egypt Full-time Mid Level Machine Learning Engineer
Ansible AWS Azure Bash CI/CD Feature Engineering GCP Generative AI GitOps Go Grafana Helm Hugging Face Kubeflow Kubernetes MLflow MLOps OpenSearch OpenTelemetry Prometheus Python PyTorch TensorFlow Terraform
5 hours, 17 minutes ago
T

RL Environment Software Engineer

Talentpluto, Inc. 1-10 Recruiting

As an RL Environment Software Engineer at a remote applied AI research lab, you will build scalable reinforcement-learning environments and agents that simulate real-world workflows for leading AI research organizations.

United States Full-time Senior Machine Learning Engineer
$180k-$220k
Docker Kubernetes Machine Learning Node.js Python React Reinforcement Learning TypeScript
1 day, 5 hours ago
Modern Family Law

AI Workflow Engineer/Automation Architect

Modern Family Law 51-250 Specialized Consumer Services

Modern Family Law is hiring an AI Workflow Engineer / Automation Architect to build scalable AI-native legal workflows, integrations, and operational automation systems that improve compliant, efficient, client-centered service delivery.

United States Full-time Lead AI Engineer Machine Learning Engineer
CI/CD Generative AI Git Python
1 day, 5 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers