Comparing Two Samples Through Stochastic Dominance: A Graphical Approach - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Journal of Computational and Graphical Statistics Année : 2023

Comparing Two Samples Through Stochastic Dominance: A Graphical Approach

Résumé

Nondeterministic measurements are common in real-world scenarios: the performance of a stochastic optimization algorithm or the total reward of a reinforcement learning agent in a chaotic environment are just two examples in which unpredictable outcomes are common. These measures can be modeled as random variables and compared among each other via their expected values or more sophisticated tools such as null hypothesis statistical tests. In this article, we propose an alternative framework to visually compare two samples according to their estimated cumulative distribution functions. First, we introduce a dominance measure for two random variables that quantifies the proportion in which the cumulative distribution function of one of the random variables stochastically dominates the other one. Then, we present a graphical method that decomposes in quantiles (i) the proposed dominance measure and (ii) the probability that one of the random variables takes lower values than the other. With illustrative purposes, we reevaluate the experimentation of an already published work with the proposed methodology and we show that additional conclusions—missed by the rest of the methods—can be inferred. Additionally, the software package RVCompare was created as a convenient way of applying and experimenting with the proposed framework.
Fichier principal
Vignette du fichier
2203.07889.pdf (2.62 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04253752 , version 1 (23-10-2023)

Identifiants

Citer

Etor Arza, Josu Ceberio, Ekhiñe Irurozki, Aritz Pérez. Comparing Two Samples Through Stochastic Dominance: A Graphical Approach. Journal of Computational and Graphical Statistics, 2023, 32 (2), pp.551-566. ⟨10.1080/10618600.2022.2084405⟩. ⟨hal-04253752⟩
20 Consultations
46 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More