RemoteLeaf Logo
Log in Sign up

LLMOps Engineer

6 hours, 47 minutes ago
Africa
Full-time
Junior
Machine Learning Engineer
Data Science and Analytics
Python Statistics
Apply Now
ALX Africa

ALX Africa

ALX Africa empowers young individuals by offering no-cost, world-class programs designed to develop their tech and professional skills, ultimately enhancing their career prospects and facilitating their entry into the workforce.

Diversified Consumer Services
1K-5K
Founded 2018
View All Jobs 4

Description

  • Build and run evaluation suites for each product, broken down by failure mode and executed on schedule and with every release.
  • Keep evaluation workflows cost-effective as the product line grows.
  • Own the reporting loop by presenting evaluation findings and platform data to the team and stakeholders.
  • Surface unintended or problematic model behavior before learners encounter it.
  • Steward core datasets, including classified customer-support data.
  • Partner with the AI Product Manager on instrumentation and build evaluations based on captured product data.
  • Collaborate with Anthropic engineers, AI engineers, product managers, and data scientists to improve learning experiences.
  • Measure AI systems honestly and contribute to regression testing so broken behavior does not ship.

Requirements

  • Solid Python skills and a strong data orientation for working with messy LLM-generated data.
  • Ability to decompose an AI product into success metrics and failure metrics.
  • Familiarity with Langfuse, RAGAS, DSPy, or similar evaluation tools.
  • Depth in at least one evaluation tool and awareness of others.
  • Experience keeping evaluations cost-effective at scale is desirable.
  • Dashboarding and reporting experience is desirable.
  • Classical statistics knowledge is desirable.
  • Strong communication and collaboration skills for working across small in-person teams and larger virtual teams.
  • Self-drive to communicate consistently using web collaboration and video conferencing.
  • Preferred time zone: GMT+2.
  • This is a full-time position.

Benefits

  • Opportunity to work on ALX Africa’s AI learning platform with real learner impact.
  • Collaboration with Anthropic engineers and cross-functional AI/product/data teams.
  • Clear junior-to-mid growth path toward broader ownership of the function.
  • Encouragement to continually develop capabilities and attain certifications.
  • Work in a mission-driven non-profit focused on Africa’s digital future.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

phData

Principal Applied AI Solutions Architect

phData 251-1K IT Services

phData is seeking a Principal Solutions Architect to lead client-facing AI/ML solution architecture, implementation, and lifecycle management for enterprise data and AI projects.

United States Full-time Lead Machine Learning Engineer Solutions Architect
Apache Spark AWS Azure Databricks dbt Docker GCP HDFS Kafka Keras Kubernetes Linux MLflow MySQL Oracle Python SageMaker SAP Scikit-learn Snowflake SQL TensorFlow
8 hours, 2 minutes ago
Motional

Perception Engineer

Motional 1K-5K Automotive

Motional is hiring a Perception Engineer in Boston or remote U.S. to develop and improve AI perception systems for autonomous vehicles.

United States Full-time Junior AI Engineer Machine Learning Engineer
$165k-$198k
C++ Git Machine Learning Python PyTorch
1 day, 6 hours ago
EvolutionIQ

Senior Machine Learning (ML) Engineer (AI Insurtech)

EvolutionIQ 51-250 Internet Software & Services

EvolutionIQ is hiring a Senior Machine Learning Engineer to build and deploy ML solutions that improve insurance claims handling through more accurate, fair, and efficient decision-making.

United States Full-time Senior Machine Learning Engineer
$190k-$225k
Apache Spark Dagster GCP Jupyter Keras Kubernetes Machine Learning NLP Pandas Python PyTorch Scikit-learn Terraform Vertex AI
1 day, 7 hours ago
Capital Rx

Senior Machine Learning Engineer II

Capital Rx 251-1K Health Care Providers & Services

Judi Health is hiring a Senior Machine Learning Engineer II to build and productionize AI-powered pharmacy and health benefits solutions for a fast-growing healthcare technology platform.

United States Full-time Senior Machine Learning Engineer
$150k-$226k
AWS Azure Generative AI HIPAA LLM Machine Learning Microservices NLP Python PyTorch
1 day, 8 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers