RemoteLeaf Logo
Log in Sign up

Prompt Engineer (LLM Systems, Evals & Safety)

6 months, 1 week ago
Jordan
Mid Level
Prompt Engineer
Software Development
Python TypeScript
Apply Now
Webook

Webook

WEbook.com is a writing community platform empowering writers, shaping future literary stars, and transforming the publishing world.

Media
1-10
Founded 2007
View All Jobs 13

Description

  • Author, refactor, and chain prompts for a range of LLM tasks.
  • Design and maintain system, tool, and policy instructions.
  • Create offline and online evaluation harnesses, including rubrics, golden sets, and metrics.
  • Build and manage prompt libraries with versioning, A/B testing, and telemetry.
  • Reduce hallucinations through verification, constrained decoding, and tool use.
  • Implement safety checks for jailbreaks, prompt injection, content policy, and PII handling.
  • Partner with engineers to integrate prompts into production features.
  • Own evaluation and continuous improvement for LLM feature quality, safety, and cost effectiveness.

Requirements

  • Demonstrated prompt design experience across multiple task types and models.
  • Experience building evaluation datasets and automated scoring for accuracy, faithfulness, utility, cost, and latency.
  • Familiarity with retrieval-augmented generation concepts and tool/function calling.
  • Strong scripting skills in Python or TypeScript for data preparation, evaluation, and analysis.
  • Ability to translate business goals into measurable prompt specifications.
  • Experience with LangChain, LLM orchestration, vector stores, and rerankers is a plus.
  • Knowledge of safety tooling and red-teaming techniques is a plus.
  • Experience with experiment platforms such as feature flags and A/B tests, as well as analytics, is a plus.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Boosta

AI Artist | 2D Illustrator (Freelance) | Honeytech

Boosta 501-1000 information technology & services

Boosta is seeking a remote freelance AI Artist | 2D Illustrator for Honeytech, a webcomics platform producing original content, to create consistent high-quality static visuals for animation production.

Ukraine Freelance Mid Level Graphic Designer Prompt Engineer
1 week, 6 days ago
Wpromote

Content Engineer

Wpromote 251-1K Media

Wpromote x Giant Spoon is seeking a Content Engineer to build and improve AI-powered content production systems that help clients create high-quality content efficiently across industries and channels.

United States Full-time Junior Content Strategist Prompt Engineer
$70k-$80k
Content Marketing Copywriting Generative AI Google Analytics Keyword Research SEMrush SEO
1 month, 1 week ago
Weekday

Biology Expert (PhD) - AI Safety

Weekday 11-50 Construction & Engineering

A client is seeking a PhD-level biologist for a remote AI safety project that evaluates and improves AI responses on complex biological sciences.

United States Contract Senior AI (Artificial Intelligence) Prompt Engineer
$0k-$0k
2 months, 3 weeks ago
BOLD

Senior Prompt Designer II

BOLD 251-1K Internet Software & Services

BOLD is hiring a Senior Prompt Designer II to lead the prompt architecture and governance behind its consumer-facing career tools and AI-generated content at scale.

United States Puerto Rico Full-time Lead Prompt Engineer
$120k-$160k
Git
3 months, 1 week ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers