Prolific

Prolific

Prolific is a platform that enables researchers to quickly find trustworthy research participants. With a pool of over 120,000 active and verified participants, Prolific ensures high-quality responses through continuous monitoring and engagement. The p...

Professional Services
51-250
Founded 1997
$0M raised

Description

  • Evaluate AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
  • Audit ML code and notebooks, including training loops, data preprocessing scripts, and model evaluations, for correctness and efficiency.
  • Provide high-quality human feedback to refine RLHF frameworks and improve model alignment, safety, and helpfulness.
  • Analyze how models handle complex chain-of-thought prompts and identify where reasoning breaks down.
  • Benchmark and compare model outputs using technical taxonomies and performance metrics.
  • Review outputs for hallucinations, bias, and logical failures in AI-generated technical content.

Requirements

  • BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
  • Experience building, deploying, or fine-tuning ML models in a production environment.
  • Professional-level understanding of neural network architectures, including Transformers, CNNs, and RNNs, and optimization techniques.
  • Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
  • Ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms.
  • High attention to detail in spotting hallucinations, biased outputs, or logical failures in technical content.
  • Expert proficiency in PyTorch or TensorFlow/Keras.
  • Advanced Python skills, including NumPy, Pandas, Scikit-learn, and experience with Hugging Face Transformers.
  • Experience with AWS SageMaker, Google Cloud Vertex AI, or tools such as Weights & Biases and LangChain.
  • Familiarity with Pinecone, Milvus, or Weaviate for RAG evaluation.

Benefits

  • Pay rates of up to $80 per hour for relevant research tasks.
  • Flexible hours.
  • Work from home.
  • Quick 10- to 15-minute assessment process before joining.
  • Opportunity to join Prolific as a participant and start paid work in about 15 minutes after approval.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Artificial Intelligence Engineer

MKS2 Technologies 51-250 Internet Software & Services

MKS2 Technologies is seeking a remote Artificial Intelligence Engineer to technically lead the design, deployment, and optimization of AI and machine learning systems supporting a federal government program.

Cybersecurity Feature Engineering Generative AI Machine Learning NLP
16 hours, 38 minutes ago

Senior Full-Stack AI Product Engineer

CGS Immersive 5001-10000 Enterprise learning

CGS is seeking a Senior Full-Stack AI Product Engineer to turn product requirements and UX concepts into polished, LLM-powered web products and evolve successful prototypes into maintainable production systems.

LLM Next.js React UX Design
17 hours, 53 minutes ago

Python/GenAI Solutions Architect

Provectus 251-1K Professional Services

Provectus is seeking a Senior Software Engineer or Solutions Architect to embed with enterprise client teams and deliver production-ready Python, cloud, and generative AI systems from discovery through deployment.

AWS CI/CD Django Docker FastAPI Flask GCP Generative AI GitHub Actions GitLab CI Go Kubernetes Machine Learning Microservices Node.js Pytest Python React REST API Rust SQL Vue.js
1 day, 17 hours ago

[Job - 31015] Master Software Developer ( AI Generative)

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Master Software Developer to design, build, and scale secure, production-grade Generative AI and Agentic AI solutions for enterprise clients in a global delivery environment.

AWS Azure CI/CD Databricks Docker Generative AI Kubernetes MLOps Python Secrets Management Vertex AI
1 day, 17 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers