Prompt Engineer

2 hours, 51 minutes ago
Mid Level
Software Development
Firework

Firework

Firework offers a cutting-edge video commerce and livestreaming platform that enables businesses to create shoppable videos and engage customers through interactive digital experiences.

Internet Software & Services
251-1K
Founded 2017
$269M raised

Description

  • Design, test, and refine prompts for a range of generative AI applications, including chat, audio synthesis, avatar animation, lip-sync alignment, and product image generation.
  • Develop and curate golden datasets for prompt evaluation and regression testing to support quality control and reproducibility.
  • Document prompt best practices and create reusable prompt templates for internal stakeholders.
  • Refactor existing prompts to align with best-practice prompting approaches.
  • Collaborate with cross-functional teams to integrate AI-driven features into real product experiences.
  • Build and maintain prompt libraries with versioning, metadata tagging, and usage patterns.
  • Improve prompt performance using automated metrics and human-in-the-loop evaluation pipelines.
  • Contribute to the internal evaluation framework by designing new evaluation flows, prompt-specific test cases, and multi-modal metrics.
  • Stay current on prompt engineering techniques, research, and best practices.

Requirements

  • Bachelor’s or Master’s degree in STEM or a related field.
  • Practical experience with large language models and/or multi-modal generative models such as text-to-audio, text-to-image, video, or avatar generation.
  • Familiarity with prompt techniques including zero-shot, few-shot, chain-of-thought, tool usage, and retrieval-based augmentation.
  • Strong analytical and linguistic intuition to translate abstract goals into machine-readable instructions.
  • Ability to create and maintain curated evaluation datasets or golden sets for ongoing testing and benchmarking.
  • Strong writing and communication skills for explaining prompt behavior, rationale, and trade-offs to technical and non-technical audiences.
  • Hands-on experience with Python or another scripting language is preferred.
  • Experience with Jupyter Notebooks or LLM ops tools and libraries such as LangChain, LangFuse, PromptLayer, or vector search systems is preferred.
  • Experience designing or working within evaluation pipelines, including human and automated evaluations, metric design, and result interpretation is preferred.
  • Deep interest in language and communication systems and how humans and machines interact through prompt-based interfaces.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Sr. Conversation Designer

Netomi 51-250 IT Services

Netomi is hiring a Sr. Conversational AI UX Designer in a remote Customer Success role to design and optimize conversational experiences across chat, voice, SMS, email, and emerging messaging channels for enterprise clients.

LLM Prototyping UX Design
2 hours, 51 minutes ago

AI Prompt Engineer

Division50 1-10 Professional Services

D50 AI is hiring an AI Prompt Engineer to design, test, and refine prompts for multiple AI models to improve output quality and task performance.

LLM Machine Learning NLP
4 hours, 21 minutes ago

Agentic AI expert

Sapsol Technologies 51-250 Internet Software & Services

MLC College and TraceSecure are offering an 8-week hands-on Agentic AI training and build program focused on designing AI automation workflows and publishing a live AI tool on the TraceSecure platform.

5 hours, 51 minutes ago

AI-Native Copywriter & Conversion Specialist - Remote (Contractor)

ShaeWellness 1-10 health, wellness & fitness

An AI-first technology and services group is hiring a remote contractor AI-Native Copywriter & Conversion Specialist to create high-velocity, conversion-focused copy across funnels, websites, email, and product messaging.

CRM SEO
6 hours, 6 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers