Cost-sensitive Learning for Utility Optimization in Online - PowerPoint PPT Presentation

Sep 02, 2022 •483 likes •713 views

Cost-sensitive Learning for Utility Optimization in Online Advertising Auctions Flavian Vasile (Criteo) Damien Lefortier (Facebook) Olivier Chapelle (Google) Agenda Context Online & Offline Metrics Utility Optimization

Cost-sensitive Learning for Utility Optimization in Online Advertising Auctions Flavian Vasile (Criteo) Damien Lefortier (Facebook) Olivier Chapelle (Google)
Agenda • Context • Online & Offline Metrics • Utility Optimization • Online & Offline Results
Context (1) • Online Advertising Auctions for Display Advertising; 4 types of players: • The auction house: RTB platform, • Demand: the advertiser, • Supply: the publisher, • Bidder: Criteo.
Context (2) • Most people optimize for deep-funnel events and use a conversion rate (CR) prediction model. We focus on this aspect here.
Agenda • Context • Online & Offline Metrics • Utility Optimization • Online & Offline Results
Online Metrics • Conversions are different (e.g., sock vs. car) so we need to weight them by (some flavor of) CPA = Cost / #Conversions.
Offline Metrics
Agenda • Context • Online & Offline Metrics • Utility Optimization • Online & Offline Results
Utility Loss • Defined as the opposite of the Utility: • Non-convex; very hard.
Utility Loss and Log Loss (NLL) • We analyze the Utility loss when c is close to our bid pv. • We assume conversion probabilities are small (p << 1). => The derivatives are approximately equal, up to a factor v
Toy Example • Two advertisers with different CPAs (5 and 50) and CR (1% and 0.1%).
Method • We propose to optimize for WNLL to improve our bidder’s performance. • We use L-BFGS for learning.
Impact on Regularization • We propose the following heuristic to take weights into account:
Agenda • Context • Online & Offline Metrics • Utility Optimization • Online & Offline Results
Offline Setup • We use a public Criteo dataset for our experiments.
Offline Results – Weights
Offline Results – Lambda
Offline Results – High/low CPA
Online Results • The A/B test was done on more than 1 Billion ad displays, on world- wide traffic. Our change resulted in a +2% lift in ROI. • We observed significant savings in display cost + an increase in sales performance for the advertisers, especially on the campaigns with high CPA and low number of sales.
Conclusion • Weighted Log Loss allows to get closer to both offline and online metrics in the context of online advertising auctions.
Thanks!

Recommend

C Cost-Sensitive Active t S iti A ti Visual Category Learning g y g Sudheendra

C Cost-Sensitive Active t S iti A ti Visual Category Learning g y g Sudheendra Vijayanarasimhan j y Kristen Grauman University of Texas at Austin y Learning visual categories Current category m odels d l Annotators wall koala

464 views • 29 slides

Cost-aware Pre-training for Multiclass Cost-sensitive Deep Learning Yu-An Chung 1 Hsuan-Tien Lin 1

Cost-aware Pre-training for Multiclass Cost-sensitive Deep Learning Yu-An Chung 1 Hsuan-Tien Lin 1 Shao-Wen Yang 2 1 Dept. of Computer Science and Information Engineering National Taiwan University, Taiwan 2 Intel Labs Intel Corporation, USA

526 views • 17 slides

Learning the Privacy-Utility Trade-off with Bayesian Optimization Borja Balle Joint work with B.

Learning the Privacy-Utility Trade-off with Bayesian Optimization Borja Balle Joint work with B. Avent, J. Gonzalez, T. Diethe and A. Paleyes Utility Privacy <latexit

532 views • 35 slides

Cost-Sensitive Batch Mode Active Learning: Designing Astronomical Observation by Optimizing

Cost-Sensitive Batch Mode Active Learning: Designing Astronomical Observation by Optimizing Telescope Time and Telescope Choice Xide Xia Advisor: Pavlos Protopapas Finale Doshi-Velez Planet Nebula Constellation Star cluster Galaxy

183 views • 17 slides

Utility Cost of Capital A Markets (and Judgment) Based Approach to Setting Utility Cost of

Utility Cost of Capital A Markets (and Judgment) Based Approach to Setting Utility Cost of Capital Shawn C. Allen, CFA, CMA, MBA, P. Eng. This material represents the personal views of 1 the author Contents Definition of Capital and

1.32k views • 113 slides

Cost-sensitive Dynamic Feature Selection e III 1 and Jason Eisner 2 He He 1 , Hal Daum 1

Cost-sensitive Dynamic Feature Selection e III 1 and Jason Eisner 2 He He 1 , Hal Daum 1 University of Maryland, College Park 2 Johns Hopkins University June 30, 2012 He He, Hal Daum e III and Jason Eisner Cost-sensitive Dynamic Feature

641 views • 46 slides

Optimization Optimization Goal: Find the minimizer ! that minimizes the objective (cost)

Optimization Optimization Goal: Find the minimizer ! that minimizes the objective (cost) function # ! : & Unconstrained Optimization # ! = min ! # ! Constrained Optimization # ! = min ! # ! s.t. , ! = - Equality

882 views • 38 slides

Selective sampling algorithms for cost-sensitive multiclass prediction Alekh Agarwal Microsoft

Selective sampling algorithms for cost-sensitive multiclass prediction Alekh Agarwal Microsoft Research Alekh Agarwal Selective sampling for multiclass prediction Why active learning? Standard setting - receive randomly sampled examples

769 views • 53 slides

Cost Utility Analysis Subgroup Brian Custer ISBT WP-TTID Cancun, Mexico July 8, 2012 Global

Cost Utility Analysis Subgroup Brian Custer ISBT WP-TTID Cancun, Mexico July 8, 2012 Global risk assessment and cost utility of blood safety interventions development of a web- based application and multi-country analysis framework

700 views • 25 slides

3. Preference Learning Techniques a. Learning Utility Functions b. Learning Preference

AGENDA 1. Preference Learning Tasks 2. Performance Assessment and Loss Functions 3. Preference Learning Techniques a. Learning Utility Functions b. Learning Preference Relations c. Structured Output Prediction d. Model-Based Preference

583 views • 39 slides

Learning Outcomes I understand the difference between level- sensitive and edge-sensitive

13.1 13.2 Learning Outcomes I understand the difference between level- sensitive and edge-sensitive Unit 13 I understand how to create an edge-triggered FF from 2 latches Sequential Logic Constructs 13.3 13.4 Sequential Logic

457 views • 12 slides

Optimization (Introduction) : IR IR f ( x ) ID Optimization " 112 FCI ) : IR NE

Optimization (Introduction) : IR IR f ( x ) ID Optimization " 112 FCI ) : IR NE Goal: Find the minimizer ! that minimizes the objective (cost) function " ! : " - fatal * Unconstrained Optimization x :

408 views • 23 slides

A Cost-Sensitive Adaptation Engine for Server Consolidation of Multitier Applications Gueyoung

A Cost-Sensitive Adaptation Engine for Server Consolidation of Multitier Applications Gueyoung Jung, Calton Pu Georgia Institute of Technology Kaustubh Joshi, Matti Hiltunen, Richard Schlichting AT&T Labs Research Context Cloud

475 views • 26 slides

A6: Sensitive Data Exposure A6 Sensitive Data Exposure Sensitive data stored or transmitted

A6: Sensitive Data Exposure A6 Sensitive Data Exposure Sensitive data stored or transmitted insecurely Failure to protect all sensitive data Usernames, passwords, password hashes, credit-card information, identity info Session

415 views • 17 slides

Evaluation Of Post-Hoc Optimization Constraints Under Altered Cost Functions Presentation of

Introduction Operator-Counting Cost-Altered Post-Hoc Optimization Constraints Experiments Conclusion References Evaluation Of Post-Hoc Optimization Constraints Under Altered Cost Functions Presentation of Masters Thesis Andreas Th

628 views • 30 slides

COOL: Common Optimization and Operation framework based on network utiLity theory for 5G

1 IEEE 5G Greece Summit COOL: Common Optimization and Operation framework based on network utiLity theory for 5G technologies & IoT Symeon Papavassiliou National Technical University of Athens (NTUA) School of Electrical and Computer

143 views • 12 slides

Optimization of a Dual-Fuel Low-NOx Combustion System for a Tangentially-Fired Utility Boiler

Optimization of a Dual-Fuel Low-NOx Combustion System for a Tangentially-Fired Utility Boiler Operating at a High Elevation. by F. McKenty, N. Brais, M. Mifuji, L. Gravel, and Y. Sirois STAR Global Energy Forum Houston, Tx 23-24 June,

1.72k views • 63 slides

Utility Preference Robust Optimization: Piecewise Linear Approximation and Statistical Robustness

Utility Preference Robust Optimization: Piecewise Linear Approximation and Statistical Robustness Huifu Xu School of Mathematical Sciences, University of Southampton, UK. (Joint work with Shaoyan Guo) Presented at CMS & MMEI Chemnitz 29

981 views • 96 slides

Machine learning and black-box expensive optimization S ebastien Verel Laboratoire

Introduction Learning for optimization Optimization for learning Machine learning and black-box expensive optimization S ebastien Verel Laboratoire dInformatique, Signal et Image de la C ote dopale (LISIC) Universit e du

305 views • 19 slides

Machine Learning Paradigms for Utility Based Data Mining Naoki Abe Data Analytics Research

Machine Learning Paradigms for Utility Based Data Mining Naoki Abe Data Analytics Research Mathematical Sciences Department IBM T. J. Watson Research Center Contents Learning Models and Utility Learning Models Utility-based

338 views • 30 slides

Outline Optimization Unconstrained Optimization Problems Machine Learning and Pattern

Outline Optimization Unconstrained Optimization Problems Machine Learning and Pattern Recognition Gradient descent Second order methods Chris Williams Constrained Optimization Problems Linear programming School of

540 views • 8 slides

Cost-based Query Optimization Christoph Koch Computing the cost of a query plan We know how

Cost-based Query Optimization Christoph Koch Computing the cost of a query plan We know how to estimate the cost of each individual operator. But for doing this we need to know the size of the input. Compute the size of each relation

760 views • 49 slides

Outline IAML: Optimization Why we use optimization in machine learning The general

Outline IAML: Optimization Why we use optimization in machine learning The general optimization problem Gradient descent Nigel Goddard Problems with gradient descent School of Informatics Batch versus online Second-order

333 views • 6 slides

Unconstrained Optimization -4 0 -4 -2 -2 BEEM103 Mathematics for Economists 0 0 2 2 4 4

Constrained Optimization Constrained Optimization An Example An Example Utility maximization Utility maximization Summary Summary Unconstrained Optimization -4 0 -4 -2 -2 BEEM103 Mathematics for Economists 0 0 2 2 4 4 y x

413 views • 12 slides