AI Safety, Responsible AI & Cybersecurity Specialist (AI Evaluation)

4 hours, 51 minutes ago
Part-time
Mid Level
Artificial Intelligence and Machine Learning
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Collaborate with research and engineering teams to identify knowledge gaps and improve model performance in cybersecurity, responsible AI, red teaming, and abuse prevention.
  • Design domain-specific security and AI safety tasks based on real-world scenarios and develop accurate solutions.
  • Evaluate AI-generated outputs for technical accuracy, safety, policy compliance, and misuse risks.
  • Create adversarial prompts, security challenges, and red-team scenarios to test for vulnerabilities and unsafe behavior.
  • Assess models against threats including prompt injection, data leakage, insecure code generation, and harmful instructions.
  • Develop evaluation frameworks, scoring rubrics, and quality standards for security-sensitive AI responses.
  • Identify weaknesses in model responses and provide structured technical feedback for improvement.
  • Apply cybersecurity and trust-and-safety methodologies across threat scenarios and sensitive use cases.
  • Work with subject-matter experts to maintain the quality and consistency of AI training datasets.

Requirements

  • 4+ years of professional experience in cybersecurity, application security, red teaming, penetration testing, threat intelligence, incident response, or trust and safety.
  • Hands-on expertise in application security, offensive security and penetration testing, threat intelligence and incident response, or trust and safety.
  • Strong understanding of cybersecurity principles, common attack vectors, vulnerability management, and security best practices.
  • Experience identifying and evaluating vulnerabilities across applications, systems, infrastructure, or AI-powered environments.
  • Ability to design adversarial scenarios and assess AI outputs for security weaknesses, unsafe behavior, and misuse.
  • Familiarity with AI safety and Responsible AI concepts, including model security, adversarial robustness, privacy risks, bias, and policy compliance (highly desirable).
  • Relevant certifications such as OSCP, OSWE, GPEN, or CISSP (preferred).
  • Published CVEs, bug bounty findings, security research, technical publications, or cybersecurity project contributions (preferred).
  • Strong analytical, problem-solving, and written communication skills for explaining technical findings and risk assessments.
  • Ability to commit at least 20 hours per week during weekdays.

Benefits

  • Compensation of $90–$140 per hour.
  • W-2 employment opportunity with a leading AI lab’s extended workforce.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Security Engineer (SIEM / EL3 Logging)

Pingwind 51-200 Internet Software & Services

PingWind is seeking a remote Security Engineer to strengthen SIEM, EL3 logging, incident response, and federal compliance for FSA IAM systems protecting sensitive identity data.

SIEM TLS
4 hours, 21 minutes ago

Senior Security Architect

Agile Defense is seeking a Senior Security Architect in Washington, DC to design and oversee resilient, scalable security architectures for federal security operations environments.

AWS Azure GCP Network Security SIEM SOC Splunk
4 hours, 36 minutes ago

Security Operations Engineer

Capital Markets Gateway 51-200 Capital Markets

Capital Markets Gateway (CMG) is seeking a Security Operations Engineer to strengthen threat detection, incident response, security automation, and AI-enabled operations for its capital-markets fintech platform.

CDN CI/CD Git OpenTelemetry PowerShell Python SIEM
4 hours, 51 minutes ago

Senior Data Engineer - Microsoft Data & AI

TTEC Digital 1001-5000 Professional Services

TTEC Digital is seeking a Senior Data Engineer to architect, build, and lead delivery of Azure-based end-to-end data platforms and governed data integrations for client engagements.

Apache Spark Azure CI/CD Generative AI Python SQL
4 hours, 51 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers