RemoteLeaf Logo
Log in Sign up

LLMOps Engineer

1 month ago
Africa
Full-time
Junior
Machine Learning Engineer
Data Science and Analytics
Python Statistics
Apply Now
ALX Africa

ALX Africa

ALX Africa empowers young individuals by offering no-cost, world-class programs designed to develop their tech and professional skills, ultimately enhancing their career prospects and facilitating their entry into the workforce.

Diversified Consumer Services
1K-5K
Founded 2018
View All Jobs 4

Description

  • Build and run evaluation suites for each product, broken down by failure mode and executed on schedule and with every release.
  • Keep evaluation workflows cost-effective as the product line grows.
  • Own the reporting loop by presenting evaluation findings and platform data to the team and stakeholders.
  • Surface unintended or problematic model behavior before learners encounter it.
  • Steward core datasets, including classified customer-support data.
  • Partner with the AI Product Manager on instrumentation and build evaluations based on captured product data.
  • Collaborate with Anthropic engineers, AI engineers, product managers, and data scientists to improve learning experiences.
  • Measure AI systems honestly and contribute to regression testing so broken behavior does not ship.

Requirements

  • Solid Python skills and a strong data orientation for working with messy LLM-generated data.
  • Ability to decompose an AI product into success metrics and failure metrics.
  • Familiarity with Langfuse, RAGAS, DSPy, or similar evaluation tools.
  • Depth in at least one evaluation tool and awareness of others.
  • Experience keeping evaluations cost-effective at scale is desirable.
  • Dashboarding and reporting experience is desirable.
  • Classical statistics knowledge is desirable.
  • Strong communication and collaboration skills for working across small in-person teams and larger virtual teams.
  • Self-drive to communicate consistently using web collaboration and video conferencing.
  • Preferred time zone: GMT+2.
  • This is a full-time position.

Benefits

  • Opportunity to work on ALX Africa’s AI learning platform with real learner impact.
  • Collaboration with Anthropic engineers and cross-functional AI/product/data teams.
  • Clear junior-to-mid growth path toward broader ownership of the function.
  • Encouragement to continually develop capabilities and attain certifications.
  • Work in a mission-driven non-profit focused on Africa’s digital future.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

SecurityScorecard

Senior Forward Deployed Engineer

SecurityScorecard 251-1K IT Services

SecurityScorecard is hiring a Staff Forward Deployed Engineer to work directly with strategic customers, embedding AI-powered cybersecurity data, integrations, and risk models into their operational workflows.

United States Full-time Lead Machine Learning Engineer Solutions Engineer
$200k-$240k
AWS Azure Cybersecurity Machine Learning REST API SAML SIEM
17 hours, 13 minutes ago
SecurityScorecard

Senior Forward Deployed Engineer

SecurityScorecard 251-1K IT Services

SecurityScorecard is hiring a Staff Forward Deployed Engineer to embed with strategic customers, build AI-powered integrations and workflows, and translate cybersecurity data into actionable business decisions.

United States Full-time Lead Machine Learning Engineer Solutions Engineer
$225k-$260k
AWS Azure Cybersecurity REST API SAML
17 hours, 43 minutes ago
SecurityScorecard

Senior Forward Deployed Engineer

SecurityScorecard 251-1K IT Services

SecurityScorecard is hiring a Staff Forward Deployed Engineer to work directly with strategic customers, embedding AI-powered cybersecurity solutions into their workflows and translating security data into actionable business decisions.

Canada Full-time Senior Machine Learning Engineer Solutions Engineer
$130k-$178k
AWS Azure Cybersecurity Machine Learning REST API SIEM
17 hours, 43 minutes ago
NewRocket

AI Platform Architect – Anthropic - UK

NewRocket 251-1K Internet Software & Services

NewRocket is seeking an AI Platform Engineer for its AI Foundry to build and operate secure, scalable infrastructure that moves Claude-powered and enterprise AI solutions from prototypes into governed production use.

United States Full-time Senior Machine Learning Engineer Platform Engineer
Argo CD AWS Azure Bash CI/CD CloudFormation Databricks Docker Elasticsearch GCP Generative AI Git GitHub Actions Go GraphQL Helm Java JavaScript Jenkins Kafka Kubeflow Kubernetes Machine Learning Microservices MLflow MLOps MongoDB Network Security OpenSearch PostgreSQL Pulumi Python REST API Secrets Management Serverless Snowflake Terraform TypeScript Vertex AI
18 hours, 28 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers