Welo Global

Welo Global specializes in providing enterprise localization, AI training data, and multilingual content solutions, leveraging a portfolio of specialized global brands to meet diverse customer needs in the AI and language services industry.

Professional Services

Industrials

Founded 1997

423 open positions

Links

View All Jobs

Project Lion - Senior Prompt Engineer - Italy (Remote, Part-Time)

5 months ago

Italy

Freelance

Senior

Prompt Engineer

Data Science and Analytics

LLM SQL

Apply Now

Welo Global

Professional Services

Founded 1997

View All Jobs 423

Description

Lead the end-to-end technical migration workflow for transitioning templates to LLM autoraters.
Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
Run and supervise Automated Prompt Optimization (APO) workflows and identify deadlocks or performance plateaus.
Manually draft, test, and refine prompts for complex template architectures, anti-patterns, and edge cases.
Design and refine manual prompts to solve edge-case scenarios when tooling is missing or broken.
Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
Calculate evaluation metrics such as F1 score, precision, and recall.
Draft technical launch readiness justifications and Launch Certification Documentation for final release.

Requirements

Native fluency in Italian and fluent English.
Must be based in Italy.
Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction (HCI), Cognitive Science, or a related analytical field.
At least 4 years of experience as a Prompt Engineer.
Proven experience tuning LLMs for strict, structured outputs and complex classification tasks.
Familiarity with chain-of-thought and few-shot learning approaches.
Strong proficiency in identifying error patterns and analyzing model performance.
Experience using SQL or other data analytics tools.
Ability to quickly learn and master proprietary tools with minimal supervision.
Excellent verbal and written communication skills.
Familiarity with enterprise-grade LLM interfaces like the Goose API (preferred).
Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows (preferred).
Linguistic expertise, including an understanding of semantics and logic (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Content Engineer

Wpromote 251-1K Media

Wpromote x Giant Spoon is seeking a Content Engineer to build and improve AI-powered content production systems that help clients create high-quality content efficiently across industries and channels.

United States Full-time Junior Content Strategist Prompt Engineer

$70k-$80k

Content Marketing Copywriting Generative AI Google Analytics Keyword Research SEMrush SEO

1 week, 1 day ago

Apply

1 week, 1 day ago

Prompt Engineer

Netomi 51-250 IT Services

Netomi is hiring a Prompt Engineer to develop, optimize, and evaluate AI prompts for enterprise customer experience solutions used by major global brands.