RemoteLeaf Logo
Log in Sign up

Project Lion - Senior Prompt Engineer - Japan (Remote, Part-Time)

19 hours, 48 minutes ago
Japan
Freelance
Senior
Prompt Engineer
Data Science and Analytics
LLM SQL
Apply Now
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised
View All Jobs 376

Description

  • Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) workflows, review outputs, and identify deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures and edge cases where tooling is insufficient.
  • Design and refine manual prompts to solve difficult edge-case scenarios.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft launch readiness justifications and certification documentation for release approval.
  • Use client internal tools to support the end-to-end technical migration workflow.

Requirements

  • Native fluency in Japanese and fluent English.
  • Must be based in Japan.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, HCI, Cognitive Science, or a related analytical field.
  • At least 4 years of experience as a Prompt Engineer.
  • Experience tuning LLMs for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning approaches.
  • Strong ability to identify error patterns, analyze model performance, and use SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Preferred: familiarity with enterprise-grade LLM interfaces such as the Goose API, AI model evaluation, data science, computational linguistics, or software engineering experience, hands-on experience with APO systems or tuning workflows, and linguistic expertise including semantics and logic.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Outsourced Staff

Prompt Engineer – Conversational AI

Outsourced Staff 11-50 Professional Services

Voice AI Solutions is hiring a remote Prompt Engineer to design and refine conversational AI prompts for voice and chat agents that support business operations across multiple industries.

Philippines Full-time Mid Level Prompt Engineer
LLM NLP
3 hours, 3 minutes ago
Webook

Prompt Engineer (LLM Systems, Evals & Safety)

Webook 1-10 Media

webook.com is hiring a Prompt Engineer to design and improve LLM prompts, instructions, and tooling for production event-ticketing features in Saudi Arabia.

Jordan Mid Level Prompt Engineer
Python TypeScript
9 hours, 3 minutes ago
ItsaCheckmate

Senior Prompt Engineer - Data Science & Quality Analysis (India)

ItsaCheckmate 51-250 Hotels, Restaurants & Leisure

Checkmate is hiring a Prompt Engineer to help develop and optimize production voice AI systems used by major restaurant and retail brands across the U.S.

United States India Senior Prompt Engineer
LLM Machine Learning Python SQL
9 hours, 33 minutes ago
Firework

Prompt Engineer

Firework 251-1K Internet Software & Services

Firework is hiring a remote AI Prompt Engineer in Mexico to optimize prompts and evaluation workflows for large language models and multi-modal generative AI products.

Mexico Mid Level Prompt Engineer
Generative AI LLM Python
12 hours, 48 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers