AI Prompt Engineer

3 days, 14 hours ago
Full-time
Junior
Software Development
BPM

BPM

BPM LLP is a top public accounting and advisory firm offering assurance, advisory, tax, and wealth management services with a focus on client success and innovation in business process management.

Diversified Financial Services
1K-5K
Founded 1986

Description

  • Design, build, test, and iterate on prompts and prompt chains for production LLM workflows.
  • Implement evaluation harnesses, guardrails, and regression tests to measure and stabilize output quality over time.
  • Integrate LLM components with business systems and data sources, including APIs, retrieval/RAG pipelines, and structured outputs.
  • Partner with AI Specialists to turn solution designs into production-ready builds.
  • Document reusable patterns and contribute to Caravel's library of AI accelerators.
  • Tune solutions for accuracy, cost, latency, and safety using real evaluation data.

Requirements

  • 2+ years of experience building software or AI/LLM components, including hands-on prompt crafting for real applications.
  • Working knowledge of LLM fundamentals, including context windows, few-shot prompting, function/tool calling, structured outputs, and RAG basics.
  • Proficiency in Python or a similar language, plus experience with APIs, JSON, and Git.
  • Test-and-measure mindset with the ability to evaluate output quality objectively.
  • Clear written English and strong documentation habits.
  • Ability to collaborate across time zones with an onshore/nearshore team.
  • Experience with evaluation frameworks such as promptfoo, Ragas, or custom eval harnesses (preferred).
  • Familiarity with embeddings, vector databases, and retrieval pipelines (preferred).
  • Exposure to ERP/CRM ecosystems such as NetSuite or Salesforce, or business-process automation (preferred).
  • Experience with agentic frameworks and orchestration (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Maintenance Coordinator

Remote Raven 11-50 Professional Services

Mason is hiring an experienced remote Maintenance Coordinator to oversee AI-assisted work order and resident communication for a property management portfolio.

1 day, 14 hours ago

Associate AI Conversation Designer (German)

Social Media Kenya Limited 1-10 Professional Services

Pearl is hiring an Associate Conversation Designer to help design and optimize German-language chatbot experiences for its AI and human-powered customer support platform.

Asana Figma LLM NLP Power BI Python
1 week, 1 day ago

Prompt Engineer

Netomi 51-250 IT Services

Netomi is hiring a Prompt Engineer to develop, optimize, and evaluate AI prompts for enterprise customer experience solutions used by major global brands.

Agile Hugging Face LLM Machine Learning NLP Python PyTorch TensorFlow
1 week, 4 days ago

Biology Expert (PhD) - AI Safety

Weekday 11-50 Construction & Engineering

A client is seeking a PhD-level biologist for a remote AI safety project that evaluates and improves AI responses on complex biological sciences.

1 week, 5 days ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers