Staff Data Scientist - Experimentation & Causal Inference

3 weeks, 1 day ago
Full-time
Lead
Data Science and Analytics
HighLevel

HighLevel

HighLevel provides an all-in-one sales and marketing platform that agencies can white label and resell, offering tools and resources designed to help businesses consolidate their marketing efforts and achieve their growth objectives.

Internet Software & Services
251-1K
Founded 2018
$60M raised

Description

  • Define the end-to-end experimentation methodology from hypothesis through decision and make it the default across teams.
  • Own the statistical approach for small-sample experimentation, including significance testing, multiple comparisons, sequential testing, and variance reduction.
  • Develop methods for analyzing clustered and hierarchical data across user, sub-account/location, and agency levels.
  • Apply causal inference techniques when controlled experiments are not feasible, especially for churn, onboarding, and go-to-market questions.
  • Design guardrails for running multiple concurrent experiments, including layering, orthogonal tests, and holdouts.
  • Partner with AI/ML teams to design and evaluate experiments for AI features and non-deterministic systems.
  • Run the experiment review forum and determine what qualifies as a valid result.
  • Build experimentation curricula, templates, and standards to improve PM and analyst capability.
  • Partner with Analytics Engineering to ensure governed, experiment-ready data and consistent metric definitions.
  • Influence leadership and cross-functional partners by translating statistical findings into clear recommendations.

Requirements

  • 9+ years of experience in data science, product analytics, or applied statistics.
  • Deep hands-on experience designing and analyzing online controlled experiments at scale.
  • Strong applied statistics knowledge, including frequentist and Bayesian methods, power analysis, variance reduction, and A/B testing failure modes.
  • Practical causal inference experience and sound judgment about causal versus non-causal results.
  • Experience in small-sample, fast-paced, multi-product environments.
  • Strong SQL skills and working proficiency in Python or R.
  • Experience influencing cross-functional teams and senior leadership without direct authority.
  • Familiarity with a modern experimentation platform such as Statsig (preferred).
  • Experience building an experimentation practice or culture from the ground up (preferred).
  • Background in B2B SaaS, CRM, or product-led growth, with familiarity in related measurement challenges (preferred).
  • Multi-tenant or marketplace product experience, such as agency to sub-account to end-customer structures (preferred).

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Lead Machine Learning Scientist, Business Banking

Monzo 1K-5K Banks

Monzo is hiring a Lead Machine Learning Scientist for its Business Banking team to build and ship ML and GenAI models that improve products for UK small businesses.

Generative AI Go LLM Machine Learning Microservices MLOps Python Scikit-learn SQL
19 hours, 40 minutes ago

Lead Bioinformatician (cfDNA Algorithms and Pipelines)

Natera 1K-5K Pharmaceuticals

Natera is hiring a Lead Bioinformatician to develop and support the computational methods behind diagnostic sequencing assays for women’s and organ health.

Prototyping Python
19 hours, 55 minutes ago

Associate Director of Bioinformatics (Women's Health and Organ Health)

Natera 1K-5K Pharmaceuticals

Natera is hiring an Associate Director to lead bioinformatics research and assay-development work for women’s health and organ health diagnostics, with responsibility for guiding a team and transitioning new methods into production.

AWS CI/CD Docker GCP Git Java Kubernetes Machine Learning Python R Shell Scripting
20 hours, 10 minutes ago

Senior Data Scientist, Home Lending

Wealthfront 51-250 Capital Markets

Wealthfront is hiring a Data Scientist to support its fast-growing Home Lending team by using client and behavioral data to improve outreach, product experiences, and business decisions.

Python SQL Statistics
20 hours, 25 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers