RemoteLeaf Logo
Log in Sign up

Project Lion - Senior Prompt Engineer - United States (Remote, Part-Time)

19 hours, 49 minutes ago
United States
Freelance
Senior
Prompt Engineer
Data Science and Analytics
LLM SQL
Apply Now
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised
View All Jobs 376

Description

  • Lead the end-to-end technical migration workflow for transitioning templates to LLM autoraters.
  • Use internal tools and prompt engineering techniques to maximize model performance.
  • Create baseline prompts for complex parent-child template clusters using Automatic Prompt Generation (APG).
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures, anti-patterns, and broken or missing tooling.
  • Design and refine manual prompts to solve edge-case scenarios.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data and measure autorater quality against the human crowd baseline.
  • Calculate model performance metrics such as F1 score, precision, and recall.
  • Draft launch readiness justifications and final Launch Certification Documentation.

Requirements

  • Native fluency in English.
  • Must be based in the United States.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 4 years of experience as a Prompt Engineer.
  • Proven experience tuning large language models (LLMs) for strict structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning.
  • Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Familiarity with enterprise-grade LLM interfaces such as the Goose API (preferred).
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
  • Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows (preferred).
  • Linguistic expertise, including an understanding of semantics and logic (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Outsourced Staff

Prompt Engineer – Conversational AI

Outsourced Staff 11-50 Professional Services

Voice AI Solutions is hiring a remote Prompt Engineer to design and refine conversational AI prompts for voice and chat agents that support business operations across multiple industries.

Philippines Full-time Mid Level Prompt Engineer
LLM NLP
3 hours, 4 minutes ago
Webook

Prompt Engineer (LLM Systems, Evals & Safety)

Webook 1-10 Media

webook.com is hiring a Prompt Engineer to design and improve LLM prompts, instructions, and tooling for production event-ticketing features in Saudi Arabia.

Jordan Mid Level Prompt Engineer
Python TypeScript
9 hours, 4 minutes ago
ItsaCheckmate

Senior Prompt Engineer - Data Science & Quality Analysis (India)

ItsaCheckmate 51-250 Hotels, Restaurants & Leisure

Checkmate is hiring a Prompt Engineer to help develop and optimize production voice AI systems used by major restaurant and retail brands across the U.S.

United States India Senior Prompt Engineer
LLM Machine Learning Python SQL
9 hours, 34 minutes ago
Firework

Prompt Engineer

Firework 251-1K Internet Software & Services

Firework is hiring a remote AI Prompt Engineer in Mexico to optimize prompts and evaluation workflows for large language models and multi-modal generative AI products.

Mexico Mid Level Prompt Engineer
Generative AI LLM Python
12 hours, 49 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers