kake

kake

Kake offers premier teams of software engineers for leading brands. Curated by people, supported by AI, and powered by positivity, our high-performing engineers seamlessly join your team to scale with your needs.

Internet Software & Services
1-10

Description

  • Create and review coding tasks covering debugging, refactoring, code generation, API usage, testing, performance, security, and edge cases.
  • Write correct, clear, testable reference solutions aligned with task requirements.
  • Evaluate AI-generated code using rubrics for correctness, clarity, security, performance, maintainability, and instruction-following.
  • Compare model responses, select the strongest answer, and provide clear technical justification.
  • Identify bugs, hallucinated APIs, missing edge cases, weak explanations, and poor engineering decisions.
  • Use terminal-based workflows to run tests, debug issues, manage dependencies, and navigate repositories.
  • Follow detailed evaluation guidelines and participate in calibration activities to maintain consistent quality.

Requirements

  • 5+ years of professional software engineering experience in a backend, fullstack, or systems role.
  • Strong proficiency in at least one of Python, JavaScript/TypeScript, Go, Java, C++, or SQL.
  • Hands-on experience with Terminal-Bench and evaluating AI agents on terminal-based software engineering tasks.
  • Experience with Git, command-line tools, and common development workflows.
  • Ability to assess code for functionality, design quality, security, and maintainability.
  • Experience with AI data production, RLHF, data annotation, or LLM evaluation projects.
  • Excellent written and verbal English communication skills.
  • Ability to work independently in a remote, asynchronous, fast-paced environment.
  • Strong attention to detail and ability to follow complex, rubric-based guidelines.
  • Preferred: experience with Python workflows, automated testing, Docker, Linux, Bash, containers, large codebases, open-source projects, backend systems, data engineering, DevOps, infrastructure, or security; PST (GMT-8) timezone overlap required.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Senior Software Engineer

Britive 11-50 Internet Software & Services

Britive is hiring a Senior Software Engineer to build and scale its multi-tenant identity-security SaaS applications on AWS, reporting to the Engineering Manager.

AWS CI/CD Docker ELK Stack Java Spring Spring Boot SQL
27 minutes ago

Forward Deployed Engineer

Figma 1K-5K Internet Software & Services

Figma is hiring a senior/staff Forward Deployed Engineer to embed with enterprise customers, solve complex product adoption challenges, and turn field insights into scalable product improvements.

CI/CD Design Systems Figma JavaScript LLM Python Storybook TypeScript
42 minutes ago

Staff Software Engineer, Data Warehouse Foundation

Pinterest 5K-10K Internet Software & Services

Pinterest is hiring a Staff Software Engineer to provide technical leadership for data warehouse and agentic analytics platforms that support company-wide, data-driven decision-making at massive scale.

Apache Airflow Apache Spark Flink Superset Trino
42 minutes ago

Sr. Staff Software Engineer, Big Data Platform

Pinterest 5K-10K Internet Software & Services

Pinterest is seeking a Senior Staff Software Engineer to lead data infrastructure strategy and development powering large-scale big data and AI applications across the platform.

Apache Spark Flink Go Java Kubernetes Machine Learning Python PyTorch Scala TensorFlow
57 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers