RemoteLeaf Logo
Log in Sign up

Senior Machine Learning Engineer, Ads Experimentation & Measurements

1 hour, 14 minutes ago
United States
Full-time
Senior
Machine Learning Engineer
Software Development
Apache Spark GCP Machine Learning MLOps Python Scala Snowflake Statistics
Apply Now
Unity

Unity

Unity is the top platform for real-time 3D content creation, empowering creators across industries to bring their ideas to life with interactive 2D and 3D content.

Internet Software & Services
5K-10K
Founded 2004
View All Jobs 122

Description

  • Evaluate ad delivery systems, including pacing and ad selection, and use simulation-based measurement to pre-validate model and policy changes before deployment.
  • Define metrics, build measurement frameworks, analyze A/B test results, and translate experiment outcomes into actionable insights for ML, Product, and Business partners.
  • Design and advance the experimentation platform’s statistical methodologies in a budget-constrained environment.
  • Lead implementation of CUPED, sequential testing, and interleaving frameworks to improve sensitivity and speed up evaluation cycles.
  • Build the statistical foundations for automated experimentation pipelines that test and select features and hyperparameters at scale.
  • Research and validate surrogate metrics that predict long-term retention, churn, and value.
  • Provide ML teams with short-term proxy signals that support optimization for long-term growth.
  • Serve as the lead subject matter expert on experimentation across ML, Product, and Engineering teams.
  • Ensure statistical rigor is applied throughout the product lifecycle, from model training to live production auctions.
  • Mentor engineering teams on experimental rigor and communicate complex statistical concepts clearly.

Requirements

  • 5+ years of experience in Data Science or Applied Research within Ad Tech, Marketplaces, or high-scale experimentation platforms.
  • An MS or PhD in Statistics, Economics, Computer Science, Operations Research, or a related quantitative field.
  • Deep expertise in causal inference, experimental design, and frequentist or Bayesian statistics.
  • Experience applying statistical methods to high-volume, real-time data.
  • Strong programming skills in Python or Scala.
  • Experience with large-scale data processing frameworks such as Spark, Snowflake, or BigQuery.
  • Practical experience implementing CUPED, interleaving, or switchback testing in production.
  • Ability to translate complex statistical concepts into product roadmaps and mentor engineering teams.
  • Experience building or maintaining internal experimentation platforms at a major tech company, preferred.
  • Familiarity with long-term value prediction and surrogate metric design in mobile gaming or digital advertising, preferred.
  • Experience using AI as a strategic advantage in engineering while following best practices for code quality and security, preferred.
  • Sufficient knowledge of English for professional verbal and written communication with global colleagues and partners.
  • Relocation support is not available for this position.

Benefits

  • Gross pay salary range of $148,700 to $229,900 USD.
  • Comprehensive health, life, and disability insurance.
  • Commute subsidy.
  • Employee stock ownership.
  • Competitive retirement or pension plans.
  • Generous vacation and personal days.
  • Support for new parents through leave and family-care programs.
  • Mental health and wellbeing programs and support.
  • Training and development programs.
  • Volunteering and donation matching program.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Weekday

Lead AIML

Weekday 11-50 Construction & Engineering

Nomiso is hiring a senior AIML Developer in India to apply AI and machine learning to customer-facing products and operational challenges for a remote, full-time role.

India Full-time Lead Data Scientist Machine Learning Engineer
$48k-$54k
Apache Spark AWS Docker Git GitLab Go Jenkins Kubernetes Machine Learning Microservices Neural Networks NLP Python PyTorch R Random Forest Scala TensorFlow
1 hour, 44 minutes ago
Weekday

Lead AIML

Weekday 11-50 Construction & Engineering

Weekday is hiring a Lead AI/ML Engineer for a remote India-based role focused on building AI-driven solutions that address complex business and operational challenges across products and operations.

India Full-time Lead Machine Learning Engineer
$48k-$54k
AWS CI/CD Docker Generative AI Git GitLab Go Jenkins Keras Kubernetes LLM Machine Learning Microservices Neural Networks NLP Python PyTorch R SageMaker Scala TensorFlow
2 hours, 29 minutes ago
MUTT DATA

Machine Learning Engineer Specialist– Recommendation Systems

MUTT DATA 51-250 Internet Software & Services

Muttdata is hiring a remote Machine Learning Engineer Specialist to build and operate large-scale recommendation systems that improve personalization and user experience for consumer products and e-commerce clients.

Argentina Full-time Senior Machine Learning Engineer
Apache Spark AWS Azure Databricks dbt Feature Engineering GCP Machine Learning Python PyTorch SQL TensorFlow
3 hours, 20 minutes ago
Wellhub

Senior AI Platform Engineer

Wellhub 1-10 Gas Utilities

Wellhub is hiring a Senior AI Platform Engineer in Brazil to help build and evolve the cloud-native ML development platform that enables engineers and data scientists to develop and deploy AI at scale.

Brazil Full-time Senior Machine Learning Engineer Platform Engineer
Apache Spark AWS CI/CD Kubeflow Kubernetes MLOps Python Terraform
3 hours, 29 minutes ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers