Senior Applied AI/ML Scientist

3 hours, 14 minutes ago
Full-time
Senior
Data Science and Analytics
Sprout Social

Sprout Social

Sprout Social offers a comprehensive social media management and engagement platform that enables businesses to effectively manage their social media presence, streamline customer care, and derive actionable insights from analytics to drive growth.

Professional Services
251-1K
Founded 2010

Description

  • Own end-to-end development of agents and agentic features, including requirements, success criteria, evaluations, guardrails, and tools.
  • Lead model selection, development, validation, and adoption decisions based on rigorous evidence.
  • Design and run A/B tests and other experiments to measure the customer impact of AI features.
  • Set and evolve quality standards across agents and partner with engineering on evaluation infrastructure.
  • Improve agent platform capabilities through prompt iteration, reusable judges, context management, tool use, and new models.
  • Communicate AI capabilities, limitations, and quality findings to product, design, engineering, and leadership.
  • Own evaluation and quality for assigned agents and contribute to long-term AI quality methodologies and roadmaps.
  • Stay current with AI research and apply relevant techniques to improve agentic systems.

Requirements

  • 5+ years of applied AI/ML experience with shipped systems and measurable impact.
  • Experience designing evaluation frameworks, calibrating automated judges, and establishing evaluator reliability for ML, LLM, or agentic systems.
  • Strong judgment in comparing and validating models or approaches.
  • Expertise in experimentation and statistical methods, including A/B testing, power analysis, and measurement design.
  • Working knowledge of Python, common ML frameworks, transformers, embeddings, SQL, and large datasets.
  • Ability to translate technical quality questions for product, design, engineering, and business stakeholders.
  • Experience evaluating production LLM or agentic products, including prompts, hallucinations, judges, or tool-calling reliability (preferred).
  • Experience defining quality standards or methodologies adopted by other teams (preferred).
  • Familiarity with rapid AI/ML prototyping, evaluation and observability tools such as Datadog or Phoenix, MLOps, and responsible AI practices (preferred).

Benefits

  • Annual salary range of $168,000–$210,000, with broader geographic bands of $184,800–$277,200 in Zone 1 and $168,000–$252,000 in Zone 2.
  • Medical, dental, and vision insurance for employees and eligible dependents.
  • 401(k) plan with a 50% company match on the first 6% of contributions.
  • Flexible PTO, company-wide Rest & Recharge days, and up to 16 weeks of paid parental leave.
  • Free Modern Health coaching, therapy, and digital wellness resources.
  • $1,000 annual lifestyle stipend, plus home-office and internet stipends.
  • Remote work flexibility in eligible U.S. locations.
  • Employer-paid life and disability insurance, volunteer time, charitable matching, and additional financial and dependent-care benefits.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Data Scientist II

Pingwind 51-250 Internet Software & Services

PingWind is seeking a Data Scientist II to support U.S. Navy electromagnetic warfare and related systems through lifecycle analytics, modeling, and data-driven improvements to readiness, reliability, maintainability, and operational performance.

Machine Learning
3 hours, 44 minutes ago

Data Scientist III

Pingwind 51-250 Internet Software & Services

PingWind is seeking a Data Scientist III to support U.S. Navy electromagnetic warfare and related systems by applying data science, logistics, reliability, and operations research throughout the systems’ lifecycle.

Machine Learning
3 hours, 44 minutes ago

Data Scientist I

Pingwind 51-250 Internet Software & Services

PingWind is hiring a Data Scientist I to support U.S. Navy electromagnetic warfare systems by applying data science, reliability, logistics, and operations research throughout the systems’ lifecycle to improve readiness and performance.

Cybersecurity Machine Learning System Design
3 hours, 44 minutes ago

[Job-31911] Sênior Data Scientist, Brazil

CI&T 5K-10K Internet Software & Services

Cientista de Dados na CI&T para apoiar a transformação digital do setor de energia, desenvolvendo soluções quantitativas que reduzam custos, melhorem o planejamento logístico e otimizem rotas na cadeia de suprimentos.

Machine Learning Statistics
3 hours, 44 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers