RemoteLeaf Logo
Log in Sign up

Senior Machine Learning Engineer, Ads Experimentation & Measurements

1 week, 3 days ago
United States
Full-time
Senior
Machine Learning Engineer
Software Development
Apache Spark GCP Machine Learning MLOps Python Scala Snowflake Statistics
Apply Now
Unity

Unity

Unity is the top platform for real-time 3D content creation, empowering creators across industries to bring their ideas to life with interactive 2D and 3D content.

Internet Software & Services
5K-10K
Founded 2004
View All Jobs 120

Description

  • Evaluate ad delivery systems, including pacing and ad selection, and use simulation-based measurement to pre-validate model and policy changes before deployment.
  • Define metrics, build measurement frameworks, analyze A/B test results, and translate experiment outcomes into actionable insights for ML, Product, and Business partners.
  • Design and advance the experimentation platform’s statistical methodologies in a budget-constrained environment.
  • Lead implementation of CUPED, sequential testing, and interleaving frameworks to improve sensitivity and speed up evaluation cycles.
  • Build the statistical foundations for automated experimentation pipelines that test and select features and hyperparameters at scale.
  • Research and validate surrogate metrics that predict long-term retention, churn, and value.
  • Provide ML teams with short-term proxy signals that support optimization for long-term growth.
  • Serve as the lead subject matter expert on experimentation across ML, Product, and Engineering teams.
  • Ensure statistical rigor is applied throughout the product lifecycle, from model training to live production auctions.
  • Mentor engineering teams on experimental rigor and communicate complex statistical concepts clearly.

Requirements

  • 5+ years of experience in Data Science or Applied Research within Ad Tech, Marketplaces, or high-scale experimentation platforms.
  • An MS or PhD in Statistics, Economics, Computer Science, Operations Research, or a related quantitative field.
  • Deep expertise in causal inference, experimental design, and frequentist or Bayesian statistics.
  • Experience applying statistical methods to high-volume, real-time data.
  • Strong programming skills in Python or Scala.
  • Experience with large-scale data processing frameworks such as Spark, Snowflake, or BigQuery.
  • Practical experience implementing CUPED, interleaving, or switchback testing in production.
  • Ability to translate complex statistical concepts into product roadmaps and mentor engineering teams.
  • Experience building or maintaining internal experimentation platforms at a major tech company, preferred.
  • Familiarity with long-term value prediction and surrogate metric design in mobile gaming or digital advertising, preferred.
  • Experience using AI as a strategic advantage in engineering while following best practices for code quality and security, preferred.
  • Sufficient knowledge of English for professional verbal and written communication with global colleagues and partners.
  • Relocation support is not available for this position.

Benefits

  • Gross pay salary range of $148,700 to $229,900 USD.
  • Comprehensive health, life, and disability insurance.
  • Commute subsidy.
  • Employee stock ownership.
  • Competitive retirement or pension plans.
  • Generous vacation and personal days.
  • Support for new parents through leave and family-care programs.
  • Mental health and wellbeing programs and support.
  • Training and development programs.
  • Volunteering and donation matching program.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Airbnb

Senior Machine Learning Engineer, Supply & Competitive Intelligence

Airbnb 5K-10K Hotels, Restaurants & Leisure

Airbnb is hiring a Machine Learning Engineer to lead crawling infrastructure for its Competitive Intelligence platform, building data and ML systems that help the company understand global travel-market supply, pricing, and competitor activity.

United States Full-time Senior Machine Learning Engineer
$196k-$227k
CI/CD Feature Engineering Java Machine Learning Neural Networks Python PyTorch Scala TensorFlow Transformers
2 hours, 17 minutes ago
Block

Staff Machine Learning Engineer (Modeling), Support

Block 10K-50K Capital Markets

Block is hiring a machine learning leader for its Support ML Modeling team to advance AI-powered customer support across Cash App, Square, and other products.

United States Full-time Lead Machine Learning Engineer Technical Support Engineer
$161k-$284k
Deep Learning Generative AI LLM Machine Learning NLP Python PyTorch TensorFlow
4 hours, 55 minutes ago
Voyager

Machine Learning Engineer - Mid-Level

Voyager Life Sciences Tools & Services

Voyager Technologies is seeking a Machine Learning Engineer to develop deep learning solutions for computer vision, synthetic aperture radar, and geospatial exploitation supporting U.S. government missions.

United States Full-time Mid Level Machine Learning Engineer
$160k-$210k
Computer Vision Deep Learning Machine Learning MATLAB Python
4 hours, 55 minutes ago
Voyager

Machine Learning Engineer - Associate

Voyager Life Sciences Tools & Services

Voyager Technologies is seeking a Machine Learning Engineer to develop deep learning solutions for computer vision, SAR, and geospatial exploitation work supporting U.S. government customers.

United States Full-time Junior Machine Learning Engineer
$120k-$170k
Computer Vision Deep Learning Machine Learning MATLAB Neural Networks Python
5 hours, 10 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers