RemoteLeaf Logo
Log in Sign up

Prompt Engineer (LLM Systems, Evals & Safety)

1 month, 1 week ago
Jordan
Mid Level
Prompt Engineer
Software Development
Python TypeScript
Apply Now
Webook

Webook

WEbook.com is a writing community platform empowering writers, shaping future literary stars, and transforming the publishing world.

Media
1-10
Founded 2007
View All Jobs 12

Description

  • Author, refactor, and chain prompts for a range of LLM tasks.
  • Design and maintain system, tool, and policy instructions.
  • Create offline and online evaluation harnesses, including rubrics, golden sets, and metrics.
  • Build and manage prompt libraries with versioning, A/B testing, and telemetry.
  • Reduce hallucinations through verification, constrained decoding, and tool use.
  • Implement safety checks for jailbreaks, prompt injection, content policy, and PII handling.
  • Partner with engineers to integrate prompts into production features.
  • Own evaluation and continuous improvement for LLM feature quality, safety, and cost effectiveness.

Requirements

  • Demonstrated prompt design experience across multiple task types and models.
  • Experience building evaluation datasets and automated scoring for accuracy, faithfulness, utility, cost, and latency.
  • Familiarity with retrieval-augmented generation concepts and tool/function calling.
  • Strong scripting skills in Python or TypeScript for data preparation, evaluation, and analysis.
  • Ability to translate business goals into measurable prompt specifications.
  • Experience with LangChain, LLM orchestration, vector stores, and rerankers is a plus.
  • Knowledge of safety tooling and red-teaming techniques is a plus.
  • Experience with experiment platforms such as feature flags and A/B tests, as well as analytics, is a plus.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Proximity Works

Creative Technologist

Proximity Works 51-250 Internet Software & Services

Proximity is hiring a Creative Technologist to help shape AI-driven multimodal video production workflows and direct the generation of consistent, high-quality content for sports, media, and entertainment clients.

India Full-time Mid Level AI Engineer Prompt Engineer
Generative AI
20 hours, 44 minutes ago
Byron

Freelance - AI-Enabled Executive Partner - Remote

Byron 11-50 Professional Services

The People Group is hiring an AI-Enabled Chief of Staff to support a fast-moving executive in the AI, Web3, and trading technology space by driving operations, communication, and AI-powered workflow execution.

Philippines Argentina Contract Senior Executive Assistant Prompt Engineer
Blockchain
1 day, 5 hours ago
Proximity Works

Visionscaper

Proximity Works 51-250 Internet Software & Services

Proximity is hiring a Visionscaper to create and refine AI-generated short-form multimedia content for sports, media, and entertainment projects using an AI-driven content platform.

India Full-time Junior Graphic Designer Prompt Engineer
Generative AI
1 day, 15 hours ago
B

AI Artist (Creative & Image Generation)

Brandtech+ 501-1000 Marketing services

Brandtech+ is hiring an AI Creative Lead to help shape, prototype, and deploy generative AI-driven creative work across global brands using its in-house Pencil Pro platform.

India Lead Graphic Designer Prompt Engineer
E-commerce Generative AI Prototyping
1 week, 1 day ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers