Project Lion - Senior Prompt Engineer - Portugal (Remote, Part-Time)

1 hour, 57 minutes ago
Freelance
Senior
Data Science and Analytics
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised

Description

  • Lead the end-to-end technical migration workflow for transitioning templates to LLM autoraters.
  • Use Automatic Prompt Generation (APG) tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise Automated Prompt Optimization (APO) workflows and identify when optimization reaches deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex template architectures and edge cases.
  • Overcome anti-patterns and repair or work around broken or missing tooling with manual prompt design.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated, tracked, and sufficient.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness justifications and Launch Certification Documentation.

Requirements

  • Native fluency in Portuguese and fluent English.
  • Must be based in Portugal.
  • Bachelor's, Master's, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction, Cognitive Science, or a related analytical field.
  • At least 4 years of experience as a Prompt Engineer.
  • Proven experience tuning large language models for strict structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning.
  • Strong proficiency in identifying error patterns, analyzing model performance, and using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Preferred: Familiarity with enterprise-grade LLM interfaces such as the Goose API.
  • Preferred: Experience in AI model evaluation, data science, computational linguistics, or software engineering.
  • Preferred: Hands-on experience with Automated Prompt Optimization (APO) systems or tuning workflows.
  • Preferred: Linguistic expertise, including an understanding of semantics and logic.

Benefits

  • Remote work arrangement.
  • Part-time freelance position.
  • Opportunity to work on AI services and data validation work.
  • Use of internal proprietary tools and advanced LLM workflows.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Legal Knowledge Engineer

Agiloft 51-250 Capital Markets

Agiloft is hiring a remote Legal Knowledge Engineer in Canada to help shape AI-powered contract lifecycle management products by translating commercial legal expertise into real-world AI workflows and product improvements.

Generative AI LLM MLOps
1 hour, 57 minutes ago

Legal Knowledge Engineer

Agiloft 51-250 Capital Markets

Agiloft is hiring a remote Legal Knowledge Engineer to help shape its AI-powered contract lifecycle management platform by applying legal expertise to real-world contract workflows and product development.

Generative AI MLOps
10 hours, 42 minutes ago

Content Designer, Personalization

Spotify Media

Spotify is hiring a Content Designer for its Personalization Design team to shape the language and content systems behind AI-driven music discovery experiences at global scale.

Generative AI LLM
6 days, 2 hours ago

AI Prompt Engineering Lead (Agentic AI & Hiring Automation) - Remote

Cynet Group 251-1K Professional Services

Senior AI Prompt Engineering Lead at Cynet Corp to architect, govern, and optimize Agentic AI systems that autonomously recruit, evaluate, and interact with talent using production-grade LLM architectures.

1 month, 3 weeks ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers