RemoteLeaf Logo
Log in Sign up

Project Lion - Senior Prompt Engineer - Italy (Remote, Part-Time)

1 week, 4 days ago
Italy
Freelance
Senior
Prompt Engineer
Data Science and Analytics
LLM SQL
Apply Now
Welo Global

Welo Global

Welo Global specializes in providing enterprise localization, AI training data, and multilingual content solutions, leveraging a portfolio of specialized global brands to meet diverse customer needs in the AI and language services industry.

Professional Services
Founded 1997
View All Jobs 402

Description

  • Lead the end-to-end technical migration workflow for transitioning templates to LLM autoraters.
  • Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify deadlocks or performance plateaus.
  • Manually draft, test, and refine prompts for complex template architectures, anti-patterns, and edge cases.
  • Design and refine manual prompts to solve edge-case scenarios when tooling is missing or broken.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness justifications and Launch Certification Documentation for final release.

Requirements

  • Native fluency in Italian and fluent English.
  • Must be based in Italy.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
  • At least 4 years of experience as a Prompt Engineer.
  • Proven experience tuning LLMs for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning approaches.
  • Strong proficiency in identifying error patterns and analyzing model performance.
  • Experience using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Familiarity with enterprise-grade LLM interfaces like the Goose API (preferred).
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
  • Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows (preferred).
  • Linguistic expertise, including an understanding of semantics and logic (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Talentgrator

AI Concept Artist

Talentgrator 11-50 Hotels, Restaurants & Leisure

A product company in the iGaming industry is hiring a Concept Artist / 2D Artist to create slot game visuals from early ideas through polished production-ready concepts.

Serbia Georgia Poland Czech Republic Full-time Junior Graphic Designer Prompt Engineer
Photoshop
17 hours, 4 minutes ago
Open (YC W24)

AI Agent Designer

Open (YC W24) 11-50 information technology & services

OpenCX is hiring an AI Agent Designer to build and improve customer-facing AI agents by translating real use cases into reliable agent behavior.

Anywhere Full-time Mid Level Customer Success Prompt Engineer
LLM
18 hours, 2 minutes ago
Vecten

Copilot & Agent Engineer

Vecten Internet Software & Services

Copilot & Agent Engineer needed to build and operationalize Microsoft-based AI agents for a private capital and healthcare client, embedding automation into enterprise workflows in a highly regulated environment.

Poland Full-time Senior AI Engineer Prompt Engineer
C# Python REST API
18 hours, 27 minutes ago
Fresh Prints

Product Image Designer

Fresh Prints 251-1K Textiles, Apparel & Luxury Goods

Product Image Designer – Fashion (AI-Focused) at an e-commerce and wholesale-focused company creates AI-enhanced model imagery from garment assets and assembles polished linesheets for product presentation.

Philippines Mid Level Product Designer (UI/UX) Prompt Engineer
E-commerce
1 day, 8 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers