Prolific

Prolific

Prolific is a platform that enables researchers to quickly find trustworthy research participants. With a pool of over 120,000 active and verified participants, Prolific ensures high-quality responses through continuous monitoring and engagement. The p...

Professional Services
51-250
Founded 1997
$0M raised

Description

  • Evaluate AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
  • Audit ML code and notebooks, including training loops, data preprocessing scripts, and model evaluations, for correctness and efficiency.
  • Provide high-quality human feedback to refine RLHF frameworks and improve model alignment, safety, and helpfulness.
  • Analyze how models handle complex chain-of-thought prompts and identify where reasoning breaks down.
  • Benchmark and compare model outputs using technical taxonomies and performance metrics.
  • Review outputs for hallucinations, bias, and logical failures in AI-generated technical content.

Requirements

  • BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
  • Experience building, deploying, or fine-tuning ML models in a production environment.
  • Professional-level understanding of neural network architectures, including Transformers, CNNs, and RNNs, and optimization techniques.
  • Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
  • Ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms.
  • High attention to detail in spotting hallucinations, biased outputs, or logical failures in technical content.
  • Expert proficiency in PyTorch or TensorFlow/Keras.
  • Advanced Python skills, including NumPy, Pandas, Scikit-learn, and experience with Hugging Face Transformers.
  • Experience with AWS SageMaker, Google Cloud Vertex AI, or tools such as Weights & Biases and LangChain.
  • Familiarity with Pinecone, Milvus, or Weaviate for RAG evaluation.

Benefits

  • Pay rates of up to $80 per hour for relevant research tasks.
  • Flexible hours.
  • Work from home.
  • Quick 10- to 15-minute assessment process before joining.
  • Opportunity to join Prolific as a participant and start paid work in about 15 minutes after approval.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior/Principal Local LLM & Generative AI Platform Engineer

Parallel Wireless 251-1K Wireless Telecommunication Services

Parallel Wireless is seeking a senior individual contributor to build and operate a secure, local LLM platform that enables teams to use approved internal data for engineering and business workflows within company-controlled infrastructure.

Active Directory C C++ CI/CD Docker Encryption Generative AI Git Go Java Kubernetes Linux Python Secrets Management
14 hours, 53 minutes ago

Agentic AI Engineer

Weekday 11-50 Construction & Engineering

This full-time mid-senior software development role with one of our clients is remote within India and requires at least five years of experience.

15 hours, 8 minutes ago

Senior/Lead Forward Deployed AI Engineer-Anthropic-US East

NewRocket 251-1K Internet Software & Services

NewRocket is seeking a Senior Forward Deployed AI Engineer for its AI Foundry team to work remotely with approximately 25% travel, delivering secure, production-ready AI workflows and integrations for enterprise customers while advancing NewRocket’s AI platforms and accelerators.

AWS Azure CI/CD Docker GCP Git JavaScript Microservices Python REST API Secrets Management SQL TypeScript
15 hours, 53 minutes ago

Forward Deployed AI Engineer-Anthropic-US West

NewRocket 251-1K Internet Software & Services

NewRocket’s AI Foundry is hiring a Senior Forward Deployed AI Engineer to work remotely with frequent client travel, deploying secure, scalable Claude-powered workflows and integrations across ServiceNow and enterprise environments.

AWS Azure CI/CD Docker GCP Generative AI Git JavaScript Microservices Python REST API Secrets Management SQL TypeScript
15 hours, 53 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers