Prolific

Prolific

Prolific is a platform that enables researchers to quickly find trustworthy research participants. With a pool of over 120,000 active and verified participants, Prolific ensures high-quality responses through continuous monitoring and engagement. The p...

Professional Services
51-250
Founded 1997
$0M raised

Description

  • Evaluate AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
  • Audit ML code and notebooks, including training loops, data preprocessing scripts, and model evaluations, for correctness and efficiency.
  • Provide human feedback to refine RLHF frameworks and improve model alignment, safety, and helpfulness.
  • Analyze model reasoning on complex chain-of-thought prompts and identify where reasoning breaks down.
  • Benchmark and compare model outputs using technical taxonomies and performance metrics.
  • Review technical content for hallucinations, biased outputs, and logical failures.
  • Help train and evaluate next-generation LLMs through paid expert tasks.

Requirements

  • BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
  • Experience building, deploying, or fine-tuning ML models in a production environment.
  • Professional-level understanding of neural network architectures such as Transformers, CNNs, and RNNs, plus optimization techniques.
  • Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
  • Ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms.
  • High attention to detail in spotting hallucinations, biased outputs, and logical failures in AI-generated technical content.
  • Expert proficiency in PyTorch or TensorFlow/Keras.
  • Advanced Python experience, including NumPy, Pandas, Scikit-learn, and Hugging Face Transformers.
  • Experience with AWS SageMaker, Google Cloud Vertex AI, Weights & Biases, or LangChain.
  • Familiarity with Pinecone, Milvus, or Weaviate for RAG evaluation.

Benefits

  • Pay rates up to $80 per hour for researchers seeking your skills.
  • Flexible hours.
  • Ability to work from home.
  • Quick 10- to 15-minute assessment and fast onboarding if successful.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Staff AI Engineer - US

Typeform 251-1K Internet Software & Services

Typeform is hiring a Staff AI Engineer to shape and operate the AI systems powering Research Flow and other customer-facing products, from experimentation through scalable production delivery.

Apache Airflow Apache Spark AWS CI/CD Datadog Docker FastAPI Generative AI Kafka Kubernetes LLM Machine Learning Microservices MLflow OpenSearch Python PyTorch REST API SageMaker Snowflake SQL Terraform
6 minutes ago

Staff AI Engineer - EU

Typeform 251-1K Internet Software & Services

Typeform is hiring a Staff AI Engineer to shape and operate the AI systems powering Research Flow, turning research concepts into secure, scalable, and dependable customer experiences.

Apache Airflow Apache Spark AWS CI/CD Datadog Docker FastAPI Generative AI Kafka Kubernetes LLM Machine Learning MLflow OpenSearch Python PyTorch SageMaker Snowflake SQL Terraform
51 minutes ago

Senior AI Software Engineer

Caseware 251-1K Internet Software & Services

Caseware is hiring a fully remote AI Platform Architect in Colombia to define, build, and operate scalable, secure, and trustworthy AI capabilities for its global accounting and audit software platform.

AWS AWS CDK Confluence DynamoDB GitHub GitHub Actions JIRA Microservices NestJS Python Terraform TypeScript
1 day, 1 hour ago

AI Ops Engineer GTM

Agiloft 51-250 Capital Markets

Agiloft is hiring an AI Ops Engineer, GTM to shape and deliver practical AI solutions across Sales, Marketing, Customer Success, and Revenue Operations, using customer and market insight to improve productivity, revenue outcomes, and customer experience.

CRM HubSpot Python Salesforce Snowflake
1 day, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers