Hello! We will be presenting Estimating the Hallucination Rate of Generative AI at NeurIPS. Come if you'd like to chat about epistemic uncertainty for In-Context Learning, or uncertainty more generally. :) Location: East Exhibit Hall A-C #2703 Time: Friday @ 4:30 Paper: arxiv.org/abs/2406.07457

fun @bleilab.bsky.social x oatml collab come chat with Nicolas , @swetakar.bsky.social , Quentin , Jannik , and i today

Check out our new paper from the Blei Lab on probabilistic predictions with conditional diffusions and gradient boosted trees! #Neurips2024

Check out our new paper about hypothesis testing the circuit hypothesis in LLMs! This work previously won a top paper award at the ICML mechanistic interpretability workshop, and we’re excited to share it at #Neurips2024

For anyone interested in fine-tuning or aligning LLMs, I’m running this free and open course called smol course. It’s not a big deal, it’s just smol. 🧵>>

Very happy to share some recent work by my colleagues @velezbeltran.bsky.social, @aagrande.bsky.social and @anazaret.bsky.social! Check out their work on tree-based diffusion models (especially the website—it’s quite superb 😊)!

Just learned about @andrewyng.bsky.social's new tool, aisuite (github.com/andrewyng/ai...) and wanted to share! It's a standardized wrapper around chat completions that lets you easily switch between querying different LLM providers, including OpenAI, Anthropic, Mistral, HuggingFace, Ollama, etc.

Test of Time Paper Awards are out! 2014 was a wonderful year with lots of amazing papers. That's why, we decided to highlight two papers: GANs (@ian-goodfellow.bsky.social et al.) and Seq2Seq (Sutskever et al.). Both papers will be presented in person 😍 Link: blog.neurips.cc/2024/11/27/a...

The Gini coefficient is the standard way to measure inequality, but what does it mean, concretely? I made a little visualization to build intuition: www.bewitched.com/demo/gini

Interested in machine learning in science? Timo and I recently published a book, and even if you are not a scientist, you'll find useful overviews of topics like causality and robustness. The best part is that you can read it for free: ml-science-book.com

new paper from Anthropic on LLM evaluation recommendations www.anthropic.com/research/sta...

Just realized BlueSky allows sharing valuable stuff cause it doesn't punish links. 🤩 Let's start with "What are embeddings" by @vickiboykis.com The book is a great summary of embeddings, from history to modern approaches. The best part: it's free. Link: vickiboykis.com/what_are_emb...

(Shameless) plug for David Blei's lab at Columbia University! People in the lab currently work on a variety of topics, including probabilistic machine learning, Bayesian stats, mechanistic interpretability, causal inference and NLP. Please give us a follow! @bleilab.bsky.social

We created an account for the Blei Lab! Please drop a follow 😊 @bleilab.bsky.social

Almost 3x faster than FlashAttentiion2 github.com/thu-ml/SageA...

📢 Post-Bayesian online seminar series coming!📢 To stay posted, sign up at tinyurl.com/postBayes We'll discuss cutting-edge methods for posteriors that no longer rely on Bayes Theorem. (e.g., PAC-Bayes, generalised Bayes, Martingale posteriors, ...) Pls circulate widely!

Starter packs I found: AI (*about* AI, not *for* an AI) go.bsky.app/SipA7it Spoken Language Processing bsky.app/starter-pack... Diversify Tech's pack bsky.app/starter-pack... Women in Tech bsky.app/starter-pack... Great UK Commentators bsky.app/starter-pack... Linguistics bsky.app/starter-pack...

I'm TAing for a class and wanted to put together a (short) list of papers that are a good, accessible intro for students to get started in mech interp. An ask for the community: what papers would you add / which papers am I missing? (1/n)

If you’re interested in mechanistic interpretability, I just found this starter pack and wanted to boost it (thanks for creating it @butanium.bsky.social !). Excited to have a mech interp community on bluesky 🎉 go.bsky.app/LisK3CP

For anyone looking for climate-related data for ML projects, I recently learned about www.saildrone.com/technology/d.... Saildrone builds ocean drones that collect a ton of oceanic and climate data. And they have some publicly-available datasets on their website for researchers :) 🌊 #mlsky

Nice article by @nedpotter.bsky.social includes a link to a BlueSky Directory of Starter Packs... #AcademicSky #PhDSky

I made a starter pack for researchers in probabilistic machine learning. DM/reply if you want to be added! go.bsky.app/DuCtJqC