A Large Scale Benchmark for Uplift Modeling - Archive ouverte HAL Access content directly
Conference Papers Year : 2018

A Large Scale Benchmark for Uplift Modeling

Eustache Diemert
Artem Betlei
  • Function : Author
  • PersonId : 1066806
Christophe Renaudin
  • Function : Author
  • PersonId : 851749


Uplift modeling is an important yet novel area of research in machine learning which aims to explain and to estimate the causal impact of a treatment at the individual level. In the digital advertising industry, the treatment is exposure to different ads and uplift modeling is used to direct marketing efforts towards users for whom it is the most efficient [1]. To foster research in this topic we release a publicly available collection of 25 million samples from a randomized control trial, scaling up previously available datasets by a healthy 590x factor. We provide details on the data collection and sanity checks performed that allow the use of this data for counter-factual prediction. We formalize the task of uplift prediction that could be performed with this data, along with the relevant evaluation metrics. Finally we show that the dataset size makes it now possible to reach statistical significance when evaluating baseline methods on the most challenging target.
Fichier principal
Vignette du fichier
large-scale-benchmark.pdf (701.32 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02515860 , version 1 (23-03-2020)



Eustache Diemert, Artem Betlei, Christophe Renaudin, Massih-Reza Amini. A Large Scale Benchmark for Uplift Modeling. KDD, 2018, London, United Kingdom. ⟨10.1145/nnnnnnn.nnnnnnn⟩. ⟨hal-02515860⟩
1183 View
1068 Download



Gmail Facebook X LinkedIn More