Prompt Systems Engineer

4 days, 12 hours ago
Full-time
Junior
Software Development
Noodle

Noodle

Noodle is a U.S. based organization that empowers academic excellence worldwide by providing tech-enabled strategies and services for higher education. They collaborate with universities to design solutions that align with each institution's unique vis...

Diversified Consumer Services
251-1K
Founded 2010
$86M raised

Description

  • Write, iterate, and maintain system prompts and instruction sets for AI agents.
  • Translate educational and operational requirements into reliable agent behavior, including personas, tone, constraints, fallbacks, and multi-turn logic.
  • Design multi-step, chained, and RAG-enabled agent workflows using program-specific knowledge bases.
  • Configure and deploy agents with Noodle’s AI orchestration platform in collaboration with engineers.
  • Build learner experiences involving students, university staff, and AI assistants.
  • Develop evaluation frameworks measuring accuracy, tone, hallucination rates, task completion, and learning-objective alignment.
  • Use Langfuse to monitor production performance, identify regressions, and prioritize improvements.
  • Design red-team and adversarial testing protocols for edge cases and failure modes.
  • Maintain prompt versioning practices and a library of reusable, tested prompt components.
  • Document prompt-engineering guidelines and collaborate with product, learning, enrollment, student-success, engineering, and university teams.

Requirements

  • 2+ years of experience designing and iterating prompts for production LLM applications.
  • Deep familiarity with few-shot prompting, chain-of-thought, system and user roles, output constraints, tool-use prompting, and RAG.
  • Experience defining metrics, writing test cases, and running prompt evaluations.
  • Experience with LLM observability tools such as Langfuse, Weights & Biases, or similar.
  • Familiarity with LTI and LMS platforms such as Moodle, Canvas, or Instructure.
  • Experience with voice agents or multimodal prompting.
  • Ability to read and write basic JavaScript or Python for automation and testing pipelines.
  • Knowledge of OpenAI, Anthropic, or other model-provider APIs.
  • Strong written communication and ability to collaborate across engineering, education, and university stakeholder groups.
  • Ability to work effectively in ambiguity and rapidly changing, team-based environments; U.S. work authorization and residence required.

Benefits

  • Remote work from a U.S. home office or Noodle’s NYC office.
  • Company-provided computer and charger.
  • 401(k) with company match and equity opportunities.
  • Medical, dental, vision, mental health, life, and disability insurance.
  • Four weeks of paid vacation, 10 paid holidays, paid sick leave, and paid parental leave.
  • HSA, FSA, commuter benefits, EAP, wellness resources, and Calm subscription.
  • Annual education stipend, monthly mobile connectivity stipend, and growth opportunities.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Prompt Engineer

BPM 1K-5K Diversified Financial Services

Caravel BPM Technology Solutions is seeking an AI Prompt Engineer to build and productionize the prompts, prompt chains, and LLM-driven components that power client solutions and internal AI accelerators.

CRM ERP Git JSON LLM NetSuite Python Salesforce
1 month ago

AI Prompt Developer

BPM 1K-5K Diversified Financial Services

Caravel | BPM Technology Solutions is hiring an AI Prompt Developer to build production prompt workflows and LLM-driven components for client solutions and internal AI accelerators as it launches a new AI practice.

CRM ERP Git JSON LLM NetSuite Python Salesforce
1 month, 1 week ago

Prompt Engineer

Netomi 51-250 IT Services

Netomi is hiring a Prompt Engineer to develop, optimize, and evaluate AI prompts for enterprise customer experience solutions used by major global brands.

Agile Hugging Face LLM Machine Learning NLP Python PyTorch TensorFlow
1 month, 1 week ago

Biology Expert (PhD) - AI Safety

Weekday 11-50 Construction & Engineering

A client is seeking a PhD-level biologist for a remote AI safety project that evaluates and improves AI responses on complex biological sciences.

1 month, 1 week ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers