Prolific

Prolific

Prolific is a platform that enables researchers to quickly find trustworthy research participants. With a pool of over 120,000 active and verified participants, Prolific ensures high-quality responses through continuous monitoring and engagement. The p...

Professional Services
51-250
Founded 1997
$0M raised

Description

  • Evaluate AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
  • Audit ML code and notebooks, including training loops, data preprocessing scripts, and model evaluations, for correctness and efficiency.
  • Provide human feedback to refine RLHF frameworks and improve model alignment, safety, and helpfulness.
  • Analyze model reasoning on complex chain-of-thought prompts and identify where reasoning breaks down.
  • Benchmark and compare model outputs using technical taxonomies and performance metrics.
  • Review technical content for hallucinations, biased outputs, and logical failures.
  • Help train and evaluate next-generation LLMs through paid expert tasks.

Requirements

  • BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
  • Experience building, deploying, or fine-tuning ML models in a production environment.
  • Professional-level understanding of neural network architectures such as Transformers, CNNs, and RNNs, plus optimization techniques.
  • Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
  • Ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms.
  • High attention to detail in spotting hallucinations, biased outputs, and logical failures in AI-generated technical content.
  • Expert proficiency in PyTorch or TensorFlow/Keras.
  • Advanced Python experience, including NumPy, Pandas, Scikit-learn, and Hugging Face Transformers.
  • Experience with AWS SageMaker, Google Cloud Vertex AI, Weights & Biases, or LangChain.
  • Familiarity with Pinecone, Milvus, or Weaviate for RAG evaluation.

Benefits

  • Pay rates up to $80 per hour for researchers seeking your skills.
  • Flexible hours.
  • Ability to work from home.
  • Quick 10- to 15-minute assessment and fast onboarding if successful.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Artificial Intelligence Engineer

MKS2 Technologies 51-250 Internet Software & Services

MKS2 Technologies is seeking a remote Artificial Intelligence Engineer to technically lead the design, deployment, and optimization of AI and machine learning systems supporting a federal government program.

Cybersecurity Feature Engineering Generative AI Machine Learning NLP
16 hours, 39 minutes ago

Senior Full-Stack AI Product Engineer

CGS Immersive 5001-10000 Enterprise learning

CGS is seeking a Senior Full-Stack AI Product Engineer to turn product requirements and UX concepts into polished, LLM-powered web products and evolve successful prototypes into maintainable production systems.

LLM Next.js React UX Design
17 hours, 54 minutes ago

Python/GenAI Solutions Architect

Provectus 251-1K Professional Services

Provectus is seeking a Senior Software Engineer or Solutions Architect to embed with enterprise client teams and deliver production-ready Python, cloud, and generative AI systems from discovery through deployment.

AWS CI/CD Django Docker FastAPI Flask GCP Generative AI GitHub Actions GitLab CI Go Kubernetes Machine Learning Microservices Node.js Pytest Python React REST API Rust SQL Vue.js
1 day, 17 hours ago

[Job - 31015] Master Software Developer ( AI Generative)

CI&T 5K-10K Internet Software & Services

CI&T is seeking a Master Software Developer to design, build, and scale secure, production-grade Generative AI and Agentic AI solutions for enterprise clients in a global delivery environment.

AWS Azure CI/CD Databricks Docker Generative AI Kubernetes MLOps Python Secrets Management Vertex AI
1 day, 17 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers