RemoteLeaf Logo
Log in Sign up

Senior Machine Learning Engineer, Ads Experimentation & Measurements

4 weeks, 1 day ago
United States
Full-time
Senior
Machine Learning Engineer
Software Development
Apache Spark GCP Machine Learning MLOps Python Scala Snowflake Statistics
Apply Now
Unity

Unity

Unity is the top platform for real-time 3D content creation, empowering creators across industries to bring their ideas to life with interactive 2D and 3D content.

Internet Software & Services
5K-10K
Founded 2004
View All Jobs 128

Description

  • Evaluate ad delivery systems, including pacing and ad selection, and use simulation-based measurement to pre-validate model and policy changes before deployment.
  • Define metrics, build measurement frameworks, analyze A/B test results, and translate experiment outcomes into actionable insights for ML, Product, and Business partners.
  • Design and advance the experimentation platform’s statistical methodologies in a budget-constrained environment.
  • Lead implementation of CUPED, sequential testing, and interleaving frameworks to improve sensitivity and speed up evaluation cycles.
  • Build the statistical foundations for automated experimentation pipelines that test and select features and hyperparameters at scale.
  • Research and validate surrogate metrics that predict long-term retention, churn, and value.
  • Provide ML teams with short-term proxy signals that support optimization for long-term growth.
  • Serve as the lead subject matter expert on experimentation across ML, Product, and Engineering teams.
  • Ensure statistical rigor is applied throughout the product lifecycle, from model training to live production auctions.
  • Mentor engineering teams on experimental rigor and communicate complex statistical concepts clearly.

Requirements

  • 5+ years of experience in Data Science or Applied Research within Ad Tech, Marketplaces, or high-scale experimentation platforms.
  • An MS or PhD in Statistics, Economics, Computer Science, Operations Research, or a related quantitative field.
  • Deep expertise in causal inference, experimental design, and frequentist or Bayesian statistics.
  • Experience applying statistical methods to high-volume, real-time data.
  • Strong programming skills in Python or Scala.
  • Experience with large-scale data processing frameworks such as Spark, Snowflake, or BigQuery.
  • Practical experience implementing CUPED, interleaving, or switchback testing in production.
  • Ability to translate complex statistical concepts into product roadmaps and mentor engineering teams.
  • Experience building or maintaining internal experimentation platforms at a major tech company, preferred.
  • Familiarity with long-term value prediction and surrogate metric design in mobile gaming or digital advertising, preferred.
  • Experience using AI as a strategic advantage in engineering while following best practices for code quality and security, preferred.
  • Sufficient knowledge of English for professional verbal and written communication with global colleagues and partners.
  • Relocation support is not available for this position.

Benefits

  • Gross pay salary range of $148,700 to $229,900 USD.
  • Comprehensive health, life, and disability insurance.
  • Commute subsidy.
  • Employee stock ownership.
  • Competitive retirement or pension plans.
  • Generous vacation and personal days.
  • Support for new parents through leave and family-care programs.
  • Mental health and wellbeing programs and support.
  • Training and development programs.
  • Volunteering and donation matching program.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Natera

Senior AI/ML Engineer

Natera 1K-5K Pharmaceuticals

Natera is hiring a Senior AI/ML Engineer to design and build enterprise Generative AI and machine learning platforms that support internal operations and external AI products in a highly regulated healthcare environment.

United States Full-time Senior Machine Learning Engineer
$126k-$157k
Apache Spark AWS CI/CD Datadog Encryption Generative AI HIPAA Kubeflow Kubernetes Machine Learning MLflow Python PyTorch TensorFlow Terraform
11 hours, 25 minutes ago
Affirm

Manager, Machine Learning Engineering (Repayment & Recovery)

Affirm 1K-5K Diversified Financial Services

Affirm is hiring a Machine Learning Engineering Manager in Europe to lead a team building repayment and recovery models that reduce loss and improve collections across the post-origination credit lifecycle.

Poland Spain United Kingdom Europe Full-time Lead Engineering Manager Machine Learning Engineer
$192k-$257k
Deep Learning Machine Learning Transformers
11 hours, 40 minutes ago
Veeam Software

Lead Domain Engineering Specialist

Veeam Software 1K-5K Internet Software & Services

Veeam is hiring a Lead Domain Engineering Specialist to partner with customer success and sales teams on security, data, and AI risk conversations that improve customer outcomes and uncover expansion opportunities across the Veeam Data Platform.

United States Full-time Lead Machine Learning Engineer Security Engineer
$150k-$383k
Cybersecurity
11 hours, 40 minutes ago
6sense

Staff Enterprise AI Engineer

6sense 1K-5K IT Services

6sense is hiring a Staff Enterprise AI Engineer, IT Operations to design and scale secure, production-grade AI systems and workflow automation that improve internal efficiency and decision-making across the business.

United States Full-time Lead AI Engineer Machine Learning Engineer
$181k-$235k
AWS
11 hours, 40 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers