AI Prompt Engineer

2 days, 12 hours ago
Full-time
Junior
Software Development
Noodle

Noodle

Noodle is a U.S. based organization that empowers academic excellence worldwide by providing tech-enabled strategies and services for higher education. They collaborate with universities to design solutions that align with each institution's unique vis...

Diversified Consumer Services
251-1K
Founded 2010
$86M raised

Description

  • Write, iterate, and maintain system prompts and instruction sets for educational AI agents.
  • Translate educational, operational, and business requirements into reliable agent behavior, including personas, tone, constraints, fallbacks, and multi-turn logic.
  • Design multi-step, chained, and RAG-augmented agent workflows using program-specific knowledge bases.
  • Configure and deploy agents with engineering teams through Noodle’s AI orchestration platform.
  • Build learner experiences involving students, university staff, and AI assistants in three-way conversations.
  • Develop evaluation frameworks measuring accuracy, tone, hallucination rate, task completion, and learning-objective alignment.
  • Monitor production performance with Langfuse, identify regressions, and prioritize improvements.
  • Design red-team and adversarial testing to identify edge cases and failure modes.
  • Maintain prompt versioning practices and a reusable library of tested prompt components.
  • Document prompt engineering guidelines and stay current with model-provider capabilities and risks.

Requirements

  • 2+ years of experience designing and iterating prompts for production LLM applications.
  • Deep familiarity with few-shot prompting, chain-of-thought, system and user roles, output constraints, tool-use prompting, and RAG integration.
  • Experience defining evaluation metrics, writing test cases, and interpreting results for prompt improvements.
  • Strong written communication and the ability to write clearly and precisely.
  • Experience with LLM observability tools such as Langfuse, Weights & Biases, or similar.
  • Ability to collaborate across engineering, education, product, and university stakeholder groups.
  • Familiarity with LTI and integrating AI tools with LMS platforms such as Moodle or Canvas.
  • Experience with voice agents or multimodal prompting.
  • Basic JavaScript or Python skills for automation and testing pipelines.
  • Knowledge of OpenAI, Anthropic, or other model-provider APIs.
  • Ability to work effectively in ambiguity and rapidly changing team environments.
  • Legally authorized to work and maintain residency in South Africa throughout employment.

Benefits

  • Remote work from a home office.
  • Competitive compensation package.
  • Company-provided laptop and EcoFlow inverter.
  • 12 weeks of paid parental leave.
  • 20 working days of annual leave plus 10 paid national holidays.
  • Medical/retirement annuity benefits, internet allowance, and employee assistance program access.
  • Annual education stipend for lifelong learning.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Prompt Engineer

BPM 1K-5K Diversified Financial Services

Caravel BPM Technology Solutions is seeking an AI Prompt Engineer to build and productionize the prompts, prompt chains, and LLM-driven components that power client solutions and internal AI accelerators.

CRM ERP Git JSON LLM NetSuite Python Salesforce
1 month ago

AI Prompt Developer

BPM 1K-5K Diversified Financial Services

Caravel | BPM Technology Solutions is hiring an AI Prompt Developer to build production prompt workflows and LLM-driven components for client solutions and internal AI accelerators as it launches a new AI practice.

CRM ERP Git JSON LLM NetSuite Python Salesforce
1 month, 1 week ago

Prompt Engineer

Netomi 51-250 IT Services

Netomi is hiring a Prompt Engineer to develop, optimize, and evaluate AI prompts for enterprise customer experience solutions used by major global brands.

Agile Hugging Face LLM Machine Learning NLP Python PyTorch TensorFlow
1 month, 1 week ago

Biology Expert (PhD) - AI Safety

Weekday 11-50 Construction & Engineering

A client is seeking a PhD-level biologist for a remote AI safety project that evaluates and improves AI responses on complex biological sciences.

1 month, 1 week ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers