RemoteLeaf Logo
Log in Sign up

Project Lion - Senior Prompt Engineer - Italy (Remote, Part-Time)

19 hours, 20 minutes ago
Italy
Freelance
Senior
Prompt Engineer
Data Science and Analytics
LLM SQL
Apply Now
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised
View All Jobs 376

Description

  • Lead the end-to-end technical migration workflow for transitioning templates to LLM autoraters.
  • Use internal prompt engineering tools to maximize model performance.
  • Create baseline prompts for complex parent-child template clusters using Automatic Prompt Generation (APG) tools.
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures and edge cases.
  • Troubleshoot anti-patterns and cases where tooling is lacking or broken.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness justifications and Launch Certification Documentation.

Requirements

  • Must be based in Italy.
  • Native fluency in Italian and fluent English.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 4 years of experience as a Prompt Engineer.
  • Proven experience tuning LLMs for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning approaches.
  • Strong ability to identify error patterns and analyze model performance.
  • Experience using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Familiarity with enterprise-grade LLM interfaces such as the Goose API (preferred).
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
  • Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows (preferred).
  • Linguistic expertise, including an understanding of semantics and logic (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Outsourced Staff

Prompt Engineer – Conversational AI

Outsourced Staff 11-50 Professional Services

Voice AI Solutions is hiring a remote Prompt Engineer to design and refine conversational AI prompts for voice and chat agents that support business operations across multiple industries.

Philippines Full-time Mid Level Prompt Engineer
LLM NLP
3 hours, 5 minutes ago
Webook

Prompt Engineer (LLM Systems, Evals & Safety)

Webook 1-10 Media

webook.com is hiring a Prompt Engineer to design and improve LLM prompts, instructions, and tooling for production event-ticketing features in Saudi Arabia.

Jordan Mid Level Prompt Engineer
Python TypeScript
9 hours, 5 minutes ago
ItsaCheckmate

Senior Prompt Engineer - Data Science & Quality Analysis (India)

ItsaCheckmate 51-250 Hotels, Restaurants & Leisure

Checkmate is hiring a Prompt Engineer to help develop and optimize production voice AI systems used by major restaurant and retail brands across the U.S.

United States India Senior Prompt Engineer
LLM Machine Learning Python SQL
9 hours, 35 minutes ago
Firework

Prompt Engineer

Firework 251-1K Internet Software & Services

Firework is hiring a remote AI Prompt Engineer in Mexico to optimize prompts and evaluation workflows for large language models and multi-modal generative AI products.

Mexico Mid Level Prompt Engineer
Generative AI LLM Python
12 hours, 50 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers