Can I read The Benefit of Being Bayesian in Online Conformal Prediction on EtoBox?

The Benefit of Being Bayesian in Online Conformal Prediction by Zhang, Zhiyu; Lu, Zhou; Yang, Heng is a scholarly article available to read on EtoBox.

What is The Benefit of Being Bayesian in Online Conformal Prediction about?

Based on the framework of Conformal Prediction (CP), we study the online construction of valid confidence sets given a black-box machine learning model. By converting the target confidence levels into quantile levels, the problem can be reduced to predicting the quantiles (in hindsight) of a sequentially revealed data sequence. Two very different approaches have been studied previously. (i) Direct approach: Assuming the data sequence is iid or exchangeable, one could maintain the empirical distribution of the observed data as an algorithmic belief, and directly predict its quantiles. (ii) Indirect approach: As statistical assumptions often do not hold in practice, a recent trend is to consider the adversarial setting and apply first-order online optimization to moving quantile losses (Gibbs & Cand\`es, 2021). It requires knowing the target quantile level beforehand, and suffers from certain validity issues on the obtained confidence sets, due to the associated loss linearization. This paper presents a novel Bayesian CP framework that combines their strengths. Without any statistical assumption, it is able to both: (i) answer multiple arbitrary confidence level queries online, with

Author

Zhang, Zhiyu; Lu, Zhou; Yang, Heng

Published

2024

Language

EN