RemoteLeaf Logo
Log in Sign up

Senior Applied AI/ML Scientist

3 hours, 14 minutes ago
Remote
Full-time
Senior
Data Scientist
Data Science and Analytics
Datadog MLOps Phoenix Python SQL Transformers
Apply Now
Sprout Social

Sprout Social

Sprout Social offers a comprehensive social media management and engagement platform that enables businesses to effectively manage their social media presence, streamline customer care, and derive actionable insights from analytics to drive growth.

Professional Services
251-1K
Founded 2010
View All Jobs 23

Description

  • Own end-to-end development of agents and agentic features, including requirements, success criteria, evaluations, guardrails, and tools.
  • Lead model selection, development, validation, and adoption decisions based on rigorous evidence.
  • Design and run A/B tests and other experiments to measure the customer impact of AI features.
  • Define and evolve quality standards across agents and partner with engineering on evaluation infrastructure.
  • Improve agent platform capabilities through prompt iteration, reusable judges, context management, tool use, and adoption of advanced models.
  • Communicate AI capabilities, limitations, and quality findings to product, design, engineering, and leadership.
  • Own evaluation and quality for assigned agents and contribute to the broader AI quality roadmap and methodology.
  • Stay current with AI research and identify opportunities to improve agent capability and evaluation practices.

Requirements

  • 5+ years of applied AI/ML experience delivering systems with measurable impact, particularly in evaluation, measurement, and quality.
  • Experience designing evaluation frameworks, calibrating judges or automated evaluators, and establishing their reliability.
  • Strong judgment in model selection and validation.
  • Expertise in experimentation and statistics, including A/B testing, power analysis, and measurement design.
  • Foundational knowledge of Python, common ML frameworks, transformers, embeddings, SQL, and large datasets.
  • Experience collaborating with product, design, and engineering teams and translating technical findings for stakeholders.
  • Experience evaluating production LLM or agentic systems, including prompts, hallucinations, judge design, or tool-calling reliability (preferred).
  • Experience defining quality standards or evaluation methodologies adopted by other teams (preferred).
  • Familiarity with rapid AI/ML prototyping, evaluation and observability tools such as Datadog or Phoenix, MLOps, responsible AI, security, and bias mitigation (preferred).
  • Candidates must be based in Alberta, British Columbia, or Ontario, Canada.

Benefits

  • Hiring range of CA$140,700–CA$177,900 annually; full base pay range of CA$140,700–CA$211,100.
  • 100% employer-paid medical, dental, vision, life insurance, and disability coverage for employees and eligible dependents.
  • 25 vacation days, 5 sick days, public holidays, and company-wide Rest & Recharge days.
  • Free Modern Health access, including coaching, therapy, and digital wellness resources.
  • Annual CA$950 lifestyle spending account.
  • Remote-work support including a one-time CA$550-equivalent home-office stipend and monthly CA$50-equivalent internet stipend.
  • Financial wellness services, subsidized childcare and eldercare, and charitable donation matching.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Pingwind

Data Scientist II

Pingwind 51-250 Internet Software & Services

PingWind is seeking a Data Scientist II to support U.S. Navy electromagnetic warfare and related systems through lifecycle analytics, modeling, and data-driven improvements to readiness, reliability, maintainability, and operational performance.

Anywhere Full-time Mid Level Data Scientist
Machine Learning
3 hours, 44 minutes ago
Pingwind

Data Scientist III

Pingwind 51-250 Internet Software & Services

PingWind is seeking a Data Scientist III to support U.S. Navy electromagnetic warfare and related systems by applying data science, logistics, reliability, and operations research throughout the systems’ lifecycle.

United States Full-time Lead Data Scientist
Machine Learning
3 hours, 44 minutes ago
Pingwind

Data Scientist I

Pingwind 51-250 Internet Software & Services

PingWind is hiring a Data Scientist I to support U.S. Navy electromagnetic warfare systems by applying data science, reliability, logistics, and operations research throughout the systems’ lifecycle to improve readiness and performance.

Anywhere Full-time Junior Data Scientist
Cybersecurity Machine Learning System Design
3 hours, 44 minutes ago
CI&T

[Job-31911] Sênior Data Scientist, Brazil

CI&T 5K-10K Internet Software & Services

Cientista de Dados na CI&T para apoiar a transformação digital do setor de energia, desenvolvendo soluções quantitativas que reduzam custos, melhorem o planejamento logístico e otimizem rotas na cadeia de suprimentos.

Brazil Full-time Senior Data Scientist
Machine Learning Statistics
3 hours, 44 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers