Project Lion - Senior Prompt Engineer - France (Remote, Part-Time)

3 hours, 5 minutes ago
Freelance
Senior
Data Science and Analytics
Welocalize

Welocalize

Welocalize provides translation and localization services to help businesses reach global audiences with precision and efficiency.

Professional Services
1K-5K
Founded 1997
$34M raised

Description

  • Lead the end-to-end technical workflow for migrating templates to LLM autoraters.
  • Use automatic prompt generation tools to create baseline prompts for complex parent-child template clusters.
  • Run and supervise automated prompt optimization workflows and identify deadlocks or plateaus.
  • Manually draft, test, and refine prompts for complex templates, edge cases, and broken tooling.
  • Design manual prompt solutions to overcome anti-patterns and tooling gaps.
  • Monitor shadowbot runs to ensure disagreements between human and LLM ratings are generated and tracked.
  • Run prompt versions against gold data to measure autorater quality against the human crowd baseline.
  • Calculate evaluation metrics such as F1 score, precision, and recall.
  • Draft technical launch readiness justifications and certification documentation for release decisions.

Requirements

  • Native fluency in French and fluent English.
  • Must be based in France.
  • Bachelor’s, Master’s, or Doctorate degree in Computer Science, Data Science, Computational Linguistics, Human-Computer Interaction, Cognitive Science, or a related analytical field.
  • At least 4 years of experience as a Prompt Engineer.
  • Proven experience tuning LLMs for strict, structured outputs and complex classification tasks.
  • Familiarity with chain-of-thought and few-shot learning approaches.
  • Strong ability to identify error patterns and analyze model performance.
  • Experience using SQL or other data analytics tools.
  • Ability to quickly learn and master proprietary tools with minimal supervision.
  • Excellent verbal and written communication skills.
  • Familiarity with enterprise-grade LLM interfaces such as the Goose API (preferred).
  • Experience in AI model evaluation, data science, computational linguistics, or software engineering (preferred).
  • Hands-on experience with Automated Prompt Optimization systems or tuning workflows (preferred).
  • Linguistic expertise, including understanding of semantics and logic (preferred).

Benefits

  • Remote, part-time freelance arrangement.
  • Opportunity to work on an AI services/data validation project.
  • The role involves use of internal proprietary tools and LLM evaluation workflows.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Legal Knowledge Engineer

Agiloft 51-250 Capital Markets

Agiloft is hiring a remote Legal Knowledge Engineer in Canada to help shape AI-powered contract lifecycle management products by translating commercial legal expertise into real-world AI workflows and product improvements.

Generative AI LLM MLOps
3 hours, 50 minutes ago

Legal Knowledge Engineer

Agiloft 51-250 Capital Markets

Agiloft is hiring a remote Legal Knowledge Engineer to help shape its AI-powered contract lifecycle management platform by applying legal expertise to real-world contract workflows and product development.

Generative AI MLOps
12 hours, 35 minutes ago

Content Designer, Personalization

Spotify Media

Spotify is hiring a Content Designer for its Personalization Design team to shape the language and content systems behind AI-driven music discovery experiences at global scale.

Generative AI LLM
6 days, 4 hours ago

AI Prompt Engineering Lead (Agentic AI & Hiring Automation) - Remote

Cynet Group 251-1K Professional Services

Senior AI Prompt Engineering Lead at Cynet Corp to architect, govern, and optimize Agentic AI systems that autonomously recruit, evaluate, and interact with talent using production-grade LLM architectures.

1 month, 3 weeks ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers