RemoteLeaf Logo
Log in Sign up

Project Lion - Prompt Engineer - United States (Remote, Part-Time)

4 months, 1 week ago
United States
Freelance
Junior
Prompt Engineer
Data Science and Analytics
LLM SQL
Apply Now
Welo Global

Welo Global

Welo Global specializes in providing enterprise localization, AI training data, and multilingual content solutions, leveraging a portfolio of specialized global brands to meet diverse customer needs in the AI and language services industry.

Professional Services
Founded 1997
View All Jobs 510

Description

  • Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify when optimization reaches deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures, anti-patterns, and edge cases.
  • Design and refine manual prompts to resolve scenarios where tooling is missing or broken.
  • Monitor shadowbot runs to ensure sufficient human-versus-LLM disagreements are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness documentation to support final certification decisions.

Requirements

  • Native fluency in English.
  • Must be based in the United States.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 2 years of experience as a Prompt Engineer.
  • Proven experience tuning large language models (LLMs) for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought prompting and few-shot learning.
  • Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Experience with enterprise-grade LLM interfaces such as the Goose API is preferred.
  • Background in AI model evaluation, data science, computational linguistics, or software engineering is preferred.
  • Hands-on experience with APO systems or prompt tuning workflows is preferred.
  • Linguistic expertise, including semantics and logic, is preferred.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Netomi

Prompt Engineer

Netomi 51-250 IT Services

Netomi is hiring a Prompt Engineer to develop, optimize, and evaluate AI prompts for enterprise customer experience solutions used by major global brands.

Canada Full-time Senior Prompt Engineer
Agile Hugging Face LLM Machine Learning NLP Python PyTorch TensorFlow
1 month ago
Weekday

Biology Expert (PhD) - AI Safety

Weekday 11-50 Construction & Engineering

A client is seeking a PhD-level biologist for a remote AI safety project that evaluates and improves AI responses on complex biological sciences.

United States Contract Senior AI (Artificial Intelligence) Prompt Engineer
$0k-$0k
1 month ago
Modern Family Law

Legal Knowledge Engineer

Modern Family Law 51-250 Specialized Consumer Services

Modern Family Law is hiring a Legal Knowledge Engineer to help design AI-native legal service delivery systems for family law operations.

United States Full-time Mid Level Legal Counsel Prompt Engineer
$120k-$140k
Generative AI
1 month ago
JustMarkets

AI Automation Specialist

JustMarkets 1-10 Capital Markets

JustMarkets is hiring an AI Automation Specialist to transform its marketing department by replacing manual workflows with scalable AI and automation systems that accelerate campaigns, content production, and global operations.

Europe Full-time Mid Level AI (Artificial Intelligence) Prompt Engineer
CRM JSON OAuth REST API Selenium SQL
1 month, 1 week ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers