Osbert Bastani (@obastani.bsky.social)

Conformal prediction sets are a useful way to capture uncertainty for LLMs & deep learning models. But they're data-hungry! We propose a semi-bandit algo to learn these sets online. Check out our @icmlconf.bsky.social paper: arxiv.org/abs/2405.13268 Work led by Haosen Ge, w/ @obastani.bsky.social

loading . . .

Stochastic Online Conformal Prediction with Semi-Bandit Feedback Conformal prediction has emerged as an effective strategy for uncertainty quantification by modifying a model to output sets of labels instead of a single label. These prediction sets come with the gu... https://arxiv.org/abs/2405.13268