RemoteLeaf Logo
Log in Sign up

Senior Applied Scientist

2 weeks, 3 days ago
Colombia
Full-time
Senior
Data Scientist
Data Science and Analytics
AWS Generative AI GitHub GitHub Actions Machine Learning MLOps NestJS Python Statistics TypeScript
Apply Now
Caseware

Caseware

CaseWare International Inc. provides cutting-edge software solutions for accounting firms, corporations, and governments, enabling users worldwide to work smarter and transform insights into impact.

Internet Software & Services
251-1K
Founded 1988
View All Jobs 34

Description

  • Design and run experiments to measure and improve LLM application and agent quality.
  • Own evaluation methodology, including benchmarks, regression suites, scoring, thresholds, drift monitoring, and release gates.
  • Build AI capabilities for Caseware’s end-to-end agent builder.
  • Develop synthetic data generation and evaluation-builder tools for creating, testing, and deploying agents.
  • Convert financial-domain procedures into task-and-verifier structures that identify common LLM failure modes.
  • Advance self-learning systems and design agentic memory promotion and demotion criteria.
  • Validate that agent memory practices meet customer, legal, contractual, security, and compliance obligations.
  • Translate advances in models, retrieval, agent frameworks, and evaluation into maintainable capabilities.
  • Influence technical direction through RFCs and design reviews while mentoring scientists and engineers.

Requirements

  • 6+ years of professional experience for senior roles or 8+ years for staff roles in applied science, machine learning, research, or data-intensive engineering.
  • At least 2 years of experience with production GenAI or LLM-based systems.
  • Experience building evaluation frameworks for ML or LLM systems, including metrics, benchmarks, scoring, and experiment design.
  • Strong probability and statistics foundation, including experimental design, significance testing, and reasoning under uncertainty.
  • Ability to build and operate production tooling and services, preferably on AWS.
  • Understanding of GenAI tradeoffs across quality, latency, cost, reliability, and safety.
  • Strong English communication and collaboration skills.
  • Experience working in ambiguous, fast-moving environments.
  • Preferred: PhD or MS in a quantitative field, or equivalent industry experience.
  • Preferred: experience with ML/MLOps, AI safety or governance, scalable SaaS platforms, Infrastructure as Code, regulated domains, or financial audit workflows; relevant technologies include TypeScript, NestJS, Python, AWS, LangFuse, LangSmith, LangChain, and LangGraph.

Benefits

  • Fully remote work from Colombia with work-life balance.
  • Indefinite-term contract with legal benefits.
  • Prepaid medical coverage, life insurance, and funeral assistance.
  • Internet allowance and home-office stipend.
  • Competitive compensation above the market average.
  • 5 personal time-off days annually, vacation increases after five years, and recognition-based additional paid time off.
  • Employer-paid sick-leave top-up to 100% of salary from days 3–90.
  • Training budget, mentorship, career-growth opportunities, and recognition programs.
  • AI-first, collaborative, inclusive environment with global projects.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

ClinChoice

Principal Pharmacokinetics Scientist -(Permanent Remote role)

ClinChoice 1K-5K Professional Services

ClinChoice is hiring a Principal Pharmacokinetics Scientist to lead clinical pharmacology and PK/PD modeling projects for pharmaceutical, biotechnology, medical device, and consumer health clients.

United States Full-time Lead Data Scientist
R
1 day, 5 hours ago
Coderio

Data Scientist AWS - SR

Coderio 51-250 Internet Software & Services

Coderio busca un/a Senior Data Scientist para desarrollar soluciones de analítica avanzada, pipelines y modelos de Machine Learning escalables en entornos cloud de AWS para proyectos internacionales.

Chile Peru Argentina Colombia Contract Mid Level Data Scientist
AWS CI/CD Docker Git Machine Learning MLOps NumPy Pandas Python Scikit-learn SQL XGBoost
1 day, 6 hours ago
Peerspace

Senior Data Scientist

Peerspace 11-50 Real Estate

Peerspace is hiring a Senior Data Scientist to help Product, Engineering, Design, and business teams understand users, product performance, and its two-sided venue marketplace through analytics and experimentation.

United States Full-time Senior Data Scientist
$165k-$175k
Apache Airflow Git Julia Looker Python R SQL Statistics Tableau
2 days, 6 hours ago
Spotify

Data Scientist - Music Promotion

Spotify Media

Spotify is hiring a Data Scientist for its New York-based Discovery Mode team to use product analytics, experimentation, and customer insights to improve promotional tools that help artists and labels reach listeners.

United States Full-time Mid Level Data Scientist
$95k-$135k
dbt GCP Python SQL Tableau
2 days, 6 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers