Senior Machine Learning Engineer, Ads Experimentation & Measurements

4 hours, 13 minutes ago
Full-time
Senior
Software Development
Unity

Unity

Unity is the top platform for real-time 3D content creation, empowering creators across industries to bring their ideas to life with interactive 2D and 3D content.

Internet Software & Services
5K-10K
Founded 2004

Description

  • Lead the experimentation and evaluation roadmap for Unity’s ads ecosystem.
  • Design and improve statistical methodologies for a complex, budget-constrained experimentation platform.
  • Implement variance reduction, sequential testing, and interleaving frameworks to increase measurement sensitivity.
  • Build statistical foundations for automated pipelines that test and select features and hyperparameters at scale.
  • Research, validate, and operationalize proxy metrics for long-term value, retention, churn, and user value.
  • Drive product analytics by defining metrics, building measurement frameworks, and analyzing A/B test results.
  • Translate experiment outcomes into actionable insights for ML, Product, and Business partners.
  • Serve as the subject matter expert on experimentation across ML, Product, and Engineering teams.
  • Ensure statistical rigor is applied throughout the product lifecycle, from model training to live production auctions.
  • Support pre-validation of model and policy changes through simulation-based measurement before live deployment.

Requirements

  • 5+ years of experience in Data Science or Applied Research within Ad Tech, Marketplaces, or high-scale experimentation platforms.
  • MS or PhD in Statistics, Economics, Computer Science, Operations Research, or a related quantitative field.
  • Deep expertise in causal inference, experimental design, and frequentist/Bayesian statistics.
  • Experience applying statistical methods to high-volume, real-time data.
  • Strong programming skills in Python or Scala.
  • Experience with large-scale data processing tools such as Spark, Snowflake, or BigQuery.
  • Practical experience implementing CUPED, interleaving, or switchback testing in production.
  • Ability to translate complex statistical concepts into product roadmaps and mentor engineering teams.
  • Hands-on experience evaluating pacing and ad selection systems in the ads ecosystem.
  • Experience building or maintaining internal experimentation platforms at a major tech company is preferred.
  • Familiarity with long-term value prediction and surrogate metric design in mobile gaming or digital advertising is preferred.
  • Experience using AI as a strategic advantage in engineering, with attention to code quality and security is preferred.
  • Sufficient English proficiency for frequent professional verbal and written communication with global colleagues and partners.

Benefits

  • Gross pay salary range of $148,700 to $258,720 USD.
  • Comprehensive health, life, and disability insurance.
  • Employee stock ownership.
  • Competitive retirement or pension plans.
  • Generous vacation and personal days.
  • Support for new parents through leave and family-care programs.
  • Mental health and wellbeing programs and support.
  • Training and development programs.
  • Commute subsidy.
  • Office food snacks.
  • Employee Resource Groups.
  • Global Employee Assistance Program.
  • Volunteering and donation matching program.
  • Relocation support is not available for this position.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Machine Learning Developer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking part-time ML specialists for project-based AI work focused on designing and evaluating computational STEM problems for leading tech companies.

Generative AI LLM Machine Learning MLOps NumPy Pandas Python PyTorch Scikit-learn SciPy SQL TensorFlow
53 minutes ago

Freelance Machine Learning Engineer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking project-based ML specialists to create and verify challenging computational STEM problems for AI evaluation and improvement work.

Generative AI LLM Machine Learning MLOps NumPy Pandas Python PyTorch Scikit-learn SciPy SQL TensorFlow
1 hour, 44 minutes ago

Machine Learning Developer (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking part-time ML specialists for project-based AI work focused on creating and verifying computational STEM tasks that help test and improve AI systems.

Generative AI LLM Machine Learning MLOps NumPy Pandas Python PyTorch Scikit-learn SciPy SQL TensorFlow
3 hours, 20 minutes ago

ML Engineer, Surrogate Modeling (Vehicle Engineering)

SpaceX 10K-50K Aerospace & Defense

SpaceX is hiring an ML Engineer for its Vehicle Engineering AI team to develop surrogate models that accelerate simulation and analysis for launch vehicles and spacecraft.

CI/CD Git Linux Machine Learning Python PyTorch Statistics TensorFlow
3 hours, 32 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers