RemoteLeaf Logo
Log in Sign up

Senior Applied Scientist

9 hours, 50 minutes ago
Colombia
Full-time
Senior
Data Scientist
Data Science and Analytics
AWS Generative AI GitHub GitHub Actions Machine Learning MLOps NestJS Python Statistics TypeScript
Apply Now
Caseware

Caseware

CaseWare International Inc. provides cutting-edge software solutions for accounting firms, corporations, and governments, enabling users worldwide to work smarter and transform insights into impact.

Internet Software & Services
251-1K
Founded 1988
View All Jobs 35

Description

  • Design and run experiments to measure and improve LLM application and agent quality.
  • Own evaluation methodology, including benchmarks, regression suites, scoring, thresholds, drift monitoring, and release gates.
  • Build AI capabilities for Caseware’s end-to-end agent builder.
  • Develop synthetic data generation and evaluation-builder tools for creating, testing, and deploying agents.
  • Convert financial-domain procedures into task-and-verifier structures that identify common LLM failure modes.
  • Advance self-learning systems and design agentic memory promotion and demotion criteria.
  • Validate that agent memory practices meet customer, legal, contractual, security, and compliance obligations.
  • Translate advances in models, retrieval, agent frameworks, and evaluation into maintainable capabilities.
  • Influence technical direction through RFCs and design reviews while mentoring scientists and engineers.

Requirements

  • 6+ years of professional experience for senior roles or 8+ years for staff roles in applied science, machine learning, research, or data-intensive engineering.
  • At least 2 years of experience with production GenAI or LLM-based systems.
  • Experience building evaluation frameworks for ML or LLM systems, including metrics, benchmarks, scoring, and experiment design.
  • Strong probability and statistics foundation, including experimental design, significance testing, and reasoning under uncertainty.
  • Ability to build and operate production tooling and services, preferably on AWS.
  • Understanding of GenAI tradeoffs across quality, latency, cost, reliability, and safety.
  • Strong English communication and collaboration skills.
  • Experience working in ambiguous, fast-moving environments.
  • Preferred: PhD or MS in a quantitative field, or equivalent industry experience.
  • Preferred: experience with ML/MLOps, AI safety or governance, scalable SaaS platforms, Infrastructure as Code, regulated domains, or financial audit workflows; relevant technologies include TypeScript, NestJS, Python, AWS, LangFuse, LangSmith, LangChain, and LangGraph.

Benefits

  • Fully remote work from Colombia with work-life balance.
  • Indefinite-term contract with legal benefits.
  • Prepaid medical coverage, life insurance, and funeral assistance.
  • Internet allowance and home-office stipend.
  • Competitive compensation above the market average.
  • 5 personal time-off days annually, vacation increases after five years, and recognition-based additional paid time off.
  • Employer-paid sick-leave top-up to 100% of salary from days 3–90.
  • Training budget, mentorship, career-growth opportunities, and recognition programs.
  • AI-first, collaborative, inclusive environment with global projects.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Timeleft

Data Scientist

Timeleft 1-10 Diversified Consumer Services

Data Scientist joining the first production machine learning team to build and deploy real-time personalization and pricing models that directly power the company’s B2C product and lifecycle experiences.

Europe Mid Level Data Scientist
CI/CD dbt Feature Engineering GCP Git Kafka LightGBM Machine Learning Python PyTorch Reinforcement Learning Scikit-learn SQL TensorFlow Vertex AI XGBoost
10 hours, 5 minutes ago
Life360

Senior Director, Analytics and Data Science, Core Product & Growth

Life360 251-1K Family Services

Life360 is seeking a Senior Director to lead MAU analytics and data science, using measurement, modeling, experimentation, and team development to understand and grow member acquisition, engagement, and retention.

United States Canada Full-time Executive Data Scientist
$247k-$366k
Databricks Machine Learning Python R SQL Tableau
10 hours, 20 minutes ago
Xometry

Senior Data Scientist

Xometry 251-1K Industrial Conglomerates

Xometry is hiring a Senior Data Scientist on a one-year contract with potential extension to develop data-driven solutions, including cost prediction, for its two-sided digital manufacturing marketplace.

Argentina Contract Senior Data Scientist
Agile Git Looker Machine Learning MongoDB NumPy Pandas Python Scikit-learn SciPy Snowflake SQL
1 day, 9 hours ago
CI&T

[Job-31253] Data Scientist Sênior - AI , Brazil

CI&T 5K-10K Internet Software & Services

A CI&T busca um(a) Data Scientist para desenvolver soluções de Ciência de Dados e Inteligência Artificial para automatizar e fortalecer a supervisão de controles internos e atividades de Compliance em um projeto estratégico.

Brazil Full-time Senior Data Scientist
Apache Spark Azure Databricks Generative AI Machine Learning MLflow MLOps Python SQL
1 day, 10 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers