RemoteLeaf Logo
Log in Sign up

Senior Applied Scientist

10 hours, 4 minutes ago
Colombia
Full-time
Senior
Data Scientist
Data Science and Analytics
AWS AWS CDK Generative AI GitHub GitHub Actions Machine Learning MLOps NestJS Python Statistics Terraform TypeScript
Apply Now
Caseware

Caseware

CaseWare International Inc. provides cutting-edge software solutions for accounting firms, corporations, and governments, enabling users worldwide to work smarter and transform insights into impact.

Internet Software & Services
251-1K
Founded 1988
View All Jobs 35

Description

  • Design and run experiments to measure and improve LLM application and agent quality.
  • Own evaluation methodology, including benchmarks, regression suites, scoring methods, thresholds, and release gates.
  • Partner with platform engineering to automate evaluations, monitor drift and regressions, and compare offline and online performance.
  • Build AI capabilities for Caseware’s end-to-end agent builder.
  • Develop synthetic data generation and evaluation-builder tools for creating, evaluating, and deploying agents.
  • Translate audit procedures into task-and-verifier structures based on common LLM failure modes.
  • Develop agentic memory systems, including statistical methods and criteria for promoting and demoting remembered experiences.
  • Ensure memory systems uphold customer and client legal and contractual obligations with Security, Legal, and domain experts.
  • Advance self-learning systems and translate GenAI research into maintainable production capabilities.
  • Influence technical direction through RFCs and design reviews while mentoring scientists and engineers.

Requirements

  • 6+ years of professional experience for senior level or 8+ years for staff level in applied science, machine learning, research, or data-intensive engineering; staff candidates need demonstrated cross-team impact.
  • 2+ years of experience working on production GenAI or LLM-based systems, applications, agents, tooling, or evaluation.
  • Experience designing evaluation frameworks for ML or LLM systems, including metrics, benchmarks, scoring, and rigorous experiments.
  • Strong experimentation mindset and ability to draw defensible conclusions from noisy real-world data.
  • Ability to build and operate production tooling and services, ideally on AWS.
  • Strong understanding of GenAI tradeoffs involving quality, latency, cost, reliability, and safety.
  • Strong foundation in probability and statistics, including experimental design, significance testing, and uncertainty reasoning.
  • Strong English communication and collaboration skills; comfortable working with ambiguity and changing requirements.
  • Preferred: PhD or MS in computer science, statistics, machine learning, or a related quantitative field, or equivalent industry experience.
  • Preferred: experience with classical ML, model training, MLOps, AI governance or safety, distributed SaaS platforms, Infrastructure as Code, regulated domains, or financial audit workflows; familiarity with TypeScript, NestJS, Python, AWS, LangFuse, LangSmith, LangChain, or LangGraph is useful.

Benefits

  • Indefinite-term contract with statutory benefits.
  • Prepaid medical coverage, life insurance, and funeral assistance.
  • Internet allowance and home-office stipend.
  • Competitive compensation above the market average.
  • Fully remote work environment with work-life balance support.
  • Five personal time-off days annually, employer-paid sick-leave top-up, and additional recognition leave.
  • Vacation increases beginning after five years of service.
  • Training budget, mentorship, recognition programs, performance bonuses, and career-growth opportunities.
  • AI-first, collaborative, inclusive environment with international projects.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Timeleft

Data Scientist

Timeleft 1-10 Diversified Consumer Services

Data Scientist joining the first production machine learning team to build and deploy real-time personalization and pricing models that directly power the company’s B2C product and lifecycle experiences.

Europe Mid Level Data Scientist
CI/CD dbt Feature Engineering GCP Git Kafka LightGBM Machine Learning Python PyTorch Reinforcement Learning Scikit-learn SQL TensorFlow Vertex AI XGBoost
10 hours, 4 minutes ago
Life360

Senior Director, Analytics and Data Science, Core Product & Growth

Life360 251-1K Family Services

Life360 is seeking a Senior Director to lead MAU analytics and data science, using measurement, modeling, experimentation, and team development to understand and grow member acquisition, engagement, and retention.

United States Canada Full-time Executive Data Scientist
$247k-$366k
Databricks Machine Learning Python R SQL Tableau
10 hours, 20 minutes ago
Xometry

Senior Data Scientist

Xometry 251-1K Industrial Conglomerates

Xometry is hiring a Senior Data Scientist on a one-year contract with potential extension to develop data-driven solutions, including cost prediction, for its two-sided digital manufacturing marketplace.

Argentina Contract Senior Data Scientist
Agile Git Looker Machine Learning MongoDB NumPy Pandas Python Scikit-learn SciPy Snowflake SQL
1 day, 9 hours ago
CI&T

[Job-31253] Data Scientist Sênior - AI , Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca um(a) Data Scientist para desenvolver soluções de Ciência de Dados e Inteligência Artificial para automatizar e fortalecer a supervisão de controles internos e atividades de Compliance em um projeto estratégico.

Brazil Full-time Senior Data Scientist
Apache Spark Azure Databricks Generative AI Machine Learning MLflow MLOps Python SQL
1 day, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers