Prolific

Prolific

Prolific is a platform that enables researchers to quickly find trustworthy research participants. With a pool of over 120,000 active and verified participants, Prolific ensures high-quality responses through continuous monitoring and engagement. The p...

Professional Services
51-250
Founded 1997
$0M raised

Description

  • Evaluate AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
  • Audit ML code and notebooks, including training loops, data preprocessing scripts, and model evaluations, for correctness and efficiency.
  • Provide high-quality human feedback to refine RLHF frameworks and improve model alignment, safety, and helpfulness.
  • Analyze how models handle complex chain-of-thought prompts and identify where reasoning breaks down.
  • Benchmark and compare model outputs using technical taxonomies and performance metrics.
  • Review outputs for hallucinations, bias, and logical failures in AI-generated technical content.

Requirements

  • BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning.
  • Experience building, deploying, or fine-tuning ML models in a production environment.
  • Professional-level understanding of neural network architectures, including Transformers, CNNs, and RNNs, and optimization techniques.
  • Hands-on experience with Prompt Engineering, RLHF, or RAG workflows.
  • Ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms.
  • High attention to detail in spotting hallucinations, biased outputs, or logical failures in technical content.
  • Expert proficiency in PyTorch or TensorFlow/Keras.
  • Advanced Python skills, including NumPy, Pandas, Scikit-learn, and experience with Hugging Face Transformers.
  • Experience with AWS SageMaker, Google Cloud Vertex AI, or tools such as Weights & Biases and LangChain.
  • Familiarity with Pinecone, Milvus, or Weaviate for RAG evaluation.

Benefits

  • Pay rates of up to $80 per hour for relevant research tasks.
  • Flexible hours.
  • Work from home.
  • Quick 10- to 15-minute assessment process before joining.
  • Opportunity to join Prolific as a participant and start paid work in about 15 minutes after approval.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Staff AI Engineer - US

Typeform 251-1K Internet Software & Services

Typeform is hiring a Staff AI Engineer to shape and operate the AI systems powering Research Flow and other customer-facing products, from experimentation through scalable production delivery.

Apache Airflow Apache Spark AWS CI/CD Datadog Docker FastAPI Generative AI Kafka Kubernetes LLM Machine Learning Microservices MLflow OpenSearch Python PyTorch REST API SageMaker Snowflake SQL Terraform
5 minutes ago

Staff AI Engineer - EU

Typeform 251-1K Internet Software & Services

Typeform is hiring a Staff AI Engineer to shape and operate the AI systems powering Research Flow, turning research concepts into secure, scalable, and dependable customer experiences.

Apache Airflow Apache Spark AWS CI/CD Datadog Docker FastAPI Generative AI Kafka Kubernetes LLM Machine Learning MLflow OpenSearch Python PyTorch SageMaker Snowflake SQL Terraform
50 minutes ago

Senior AI Software Engineer

Caseware 251-1K Internet Software & Services

Caseware is hiring a fully remote AI Platform Architect in Colombia to define, build, and operate scalable, secure, and trustworthy AI capabilities for its global accounting and audit software platform.

AWS AWS CDK Confluence DynamoDB GitHub GitHub Actions JIRA Microservices NestJS Python Terraform TypeScript
1 day, 1 hour ago

AI Ops Engineer GTM

Agiloft 51-250 Capital Markets

Agiloft is hiring an AI Ops Engineer, GTM to shape and deliver practical AI solutions across Sales, Marketing, Customer Success, and Revenue Operations, using customer and market insight to improve productivity, revenue outcomes, and customer experience.

CRM HubSpot Python Salesforce Snowflake
1 day, 1 hour ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers