Communication Dans Un Congrès Année : 2025

Stochastic Online Instrumental Variable Regression: Regrets for Endogeneity and Bandit Feedback

Résumé

The independence of noise and covariates is a standard assumption in online linear regression with unbounded noise and linear bandit literature. This assumption and the following analysis are invalid in the case of endogeneity, i.e., when the noise and covariates are correlated. In this paper, we study the online setting of Instrumental Variable (IV) regression, which is widely used in economics to identify the underlying model from an endogenous dataset. Specifically, we upper bound the identification and oracle regrets of the popular Two-Stage Least Squares (2SLS) approach to IV regression but in the online setting. Our analysis shows that Online 2SLS (O2SLS) achieves $\mathcal O(d^2\log^2 T)$ identification and $\mathcal O(\gamma \sqrt{d T \log T})$ oracle regret after $T$ interactions, where $d$ is the dimension of covariates and $\gamma$ is the bias due to endogeneity. Then, we leverage O2SLS as an oracle to design OFUL-IV, a linear bandit algorithm. OFUL-IV can tackle endogeneity and achieves $\mathcal O(d\sqrt{T}\log T)$ regret. For different datasets with endogeneity, we experimentally show efficiencies of O2SLS and OFUL-IV.

Fichier principal
Vignette du fichier
main_o2sls.pdf (10.05 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-03831210 , version 1 (26-10-2022)
hal-03831210 , version 2 (20-02-2023)
hal-03831210 , version 3 (09-04-2025)

Licence

Identifiants

Citer

Riccardo Della Vecchia, Debabrota Basu. Stochastic Online Instrumental Variable Regression: Regrets for Endogeneity and Bandit Feedback. AAAI Conference on Artificial Intelligence, Feb 2025, Philadelphia, United States. ⟨hal-03831210v3⟩
1109 Consultations
1161 Téléchargements

Altmetric

Partager

  • More