Prolific

Prolific

Prolific is a platform that enables researchers to quickly find trustworthy research participants. With a pool of over 120,000 active and verified participants, Prolific ensures high-quality responses through continuous monitoring and engagement. The p...

Professional Services
51-250
Founded 1997
$0M raised

Description

  • Evaluate AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
  • Audit ML code and notebooks, including training loops, data preprocessing scripts, and model evaluations, for correctness and efficiency.
  • Provide high-quality human feedback to refine RLHF frameworks and improve model alignment, safety, and helpfulness.
  • Analyze how models handle complex chain-of-thought prompts and identify where reasoning breaks down.
  • Benchmark and compare model outputs using technical taxonomies and performance metrics.
  • Review outputs for hallucinations, bias, and logical failures in AI-generated technical content.

Requirements

  • BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
  • Experience building, deploying, or fine-tuning ML models in a production environment.
  • Professional-level understanding of neural network architectures, including Transformers, CNNs, and RNNs, and optimization techniques.
  • Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
  • Ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms.
  • High attention to detail in spotting hallucinations, biased outputs, or logical failures in technical content.
  • Expert proficiency in PyTorch or TensorFlow/Keras.
  • Advanced Python skills, including NumPy, Pandas, Scikit-learn, and experience with Hugging Face Transformers.
  • Experience with AWS SageMaker, Google Cloud Vertex AI, or tools such as Weights & Biases and LangChain.
  • Familiarity with Pinecone, Milvus, or Weaviate for RAG evaluation.

Benefits

  • Pay rates of up to $80 per hour for relevant research tasks.
  • Flexible hours.
  • Work from home.
  • Quick 10- to 15-minute assessment process before joining.
  • Opportunity to join Prolific as a participant and start paid work in about 15 minutes after approval.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

AI Developer

AI Developer (Contract) at a remote company, responsible for building AI-powered workflows and internal tools that improve business efficiency and create new capabilities.

JavaScript LLM Python
15 hours, 24 minutes ago

AI Agent Implementations Specialist

Extreme Networks 1K-5K IT Services

Extreme Networks is hiring an AI Agent Developer & Marketo Administrator to support marketing automation, AI agent implementation, and MarTech operations across its global marketing organization.

CRM JavaScript Machine Learning Node.js Python REST API
1 day, 15 hours ago

Entrepreneur in Residence - Technical Co-founder (CTO)

FutureSight 11-50 Internet Software & Services

FutureSight is seeking a Co-Founder & CTO to lead the technical direction of a new B2B AI venture from inception to launch and early growth.

LLM System Design
1 day, 15 hours ago

Technical Co-founder (CTO) - AI Collections Agent

FutureSight 11-50 Internet Software & Services

Argentl is seeking a Co-Founder & CTO to lead product and engineering for an AI collections platform that automates debtor follow-up for finance teams at B2B companies.

LLM
1 day, 15 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers