We launched CoverDrop 🎉 providing sources with a secure and anonymous way to talk to journalists. Having started five years ago as a PhD research project, this now ships within the Guardian app to millions of users—all of which provide cover traffic. Paper, code, and more info: www.coverdrop.org

This is going to be big news in my field. While we wait for the dataset, the stuff about post-processing makes interesting reading (if you're me)

What's your favorite Veo video?

I'm late to review the "Illusion of Thinking" paper, so let me collect some of the best threads by and critical takes by @scaling01 in one place and sprinkle some of my own thoughts in as well. The paper is rather critical of reasoning LLMs (LRMs): x.com/MFarajtabar...

If the last time you tried to use an LLM for math was ~4 or 5 months ago it’s worth firing up Gemini 2.5 (which you can try for free) or ChatGPT o3 and getting a sense of how rapidly things have progressed.

I want to share my latest (very short) blog post: "Active Learning vs. Data Filtering: Selection vs. Rejection." What is the fundamental difference between active learning and data filtering? Well, obviously, the difference is that: 1/11

Hive (and all of its expansions) has been added to OpenSpiel! 🎉🤩🐝🐜🕷️🐞🦟🪲 From Gen42: "Hive is an award-winning board game with a difference. There is no board. The pieces are added to the playing area thus creating the board. As more and more pieces are added the game becomes a fight to ... 🧵1/5

📢📢 Junior researchers attending #ICLR2025, be sure to check out the mentoring chat sessions! More info here: blog.iclr.cc/2025/04/23/i... You can find all the sessions on the ICLR.cc schedule!

I want to share a blog post on our paper "All Models are Wrong, Some are Useful: Model Selection with Limited Labels" which we will present at AISTATS 2025 next week With @pokanovic.bsky.social‬, Jannes Kasper, @thoefler.bsky.social, @arkrause.bsky.social, and @nmervegurel.bsky.social

I want to reshare @brandfonbrener.bsky.social's @NeurIPSConf 2024 paper on CoLoR-Filter: A simple yet powerful method for selecting high-quality data for language model pre-training! With @hlzhang109.bsky.social @schwarzjn.bsky.social @shamkakade.bsky.social

I want to reshare @brandfonbrener.bsky.social's @NeurIPSConf 2024 paper on CoLoR-Filter: A simple yet powerful method for selecting high-quality data for language model pre-training! With @hlzhang109.bsky.social @schwarzjn.bsky.social @shamkakade.bsky.social

The Ukrainian government has a list of places where you can donate to the war effort here. I personally just donated $100: war.ukraine.ua/donate/ Slava Ukraini.

I am quite excited that our brand-new module "P79: Cryptography and Protocol Engineering" has its first lecture today! @martin.kleppmann.com and I designed the course to bridge the gap between mathematical ideas and the challenge of implementing secure cryptography in the real world. @cst.cam.ac.uk

Check out MODEL SELECTOR, a framework for label-efficient selection of pretrained classifiers. We reduce the labeling cost by up to 94.15% to identify the best model.

Ever wondered why presenting more facts can sometimes *worsen* disagreements, even among rational people? 🤔 It turns out, Bayesian reasoning has some surprising answers - no cognitive biases needed! Let's explore this fascinating paradox quickly ☺️

TMLR is now on Bluesky: be sure to follow @tmlrorg.bsky.social!

Ever wondered why presenting more facts can sometimes *worsen* disagreements, even among rational people? 🤔 It turns out, Bayesian reasoning has some surprising answers - no cognitive biases needed! Let's explore this fascinating paradox quickly ☺️

I didn't talk about it but I also made heavy use of Claude 3.5 and also o1 and Gemini when creating my lecture series on info theory and active learning in 3.5 weeks: bsky.app/profile/bla...

The slides for my lectures on (Bayesian) Active Learning, Information Theory, and Uncertainty are online now 🥳 They cover quite a bit from basic information theory to some recent papers: blackhc.github.io/balitu/ and I'll try to add proper course notes over time 🤗

Just 10 days after o1's public debut, we’re thrilled to unveil the open-source version of the technique behind its success: scaling test-time compute By giving models more "time to think," Llama 1B outperforms Llama 8B in math—beating a model 8x its size. The full recipe is open-source!

Thanks for following me here! 🫶 I went through my notifications to follow people if they are in ML research, doing PhDs, etc, to have a nice feed focused on ML. Apologies to anyone I have missed! You can unfollow and refollow me to give me a new notification (I suppose)! Plz update your profiles 🙏

Excited to be presenting my work, "Big batch Bayesian active learning by considering predictive probabilities" at the Bayesian Decision Making & Uncertainty (BDU) Workshop @neuripsconf.bsky.social, as both a lightning talk and a poster!https://openreview.net/pdf?id=VikX9euujU (1/3)

The NeurIPS Workshop on Bayesian Decision-making and Uncertainty has started - our first talk is by @mvdw.bsky.social! Join us at East Meeting Room 8, 15, or online!

Hello! We will be presenting Estimating the Hallucination Rate of Generative AI at NeurIPS. Come if you'd like to chat about epistemic uncertainty for In-Context Learning, or uncertainty more generally. :) Location: East Exhibit Hall A-C #2703 Time: Friday @ 4:30 Paper: arxiv.org/abs/2406.07457

Thanks for the support! I hope I am doing the right thing here. But having written pseudo-code for both approaches now, it does seem like the only addition is a `.flatten()` 🙃 openreview.net/forum?id=0NM...

📢 We’re recruiting Machine Intelligence PhD interns at MSR Cambridge (UK) 🌍💻 Check it out here — or connect with us at #neurips2024 this week! jobs.careers.microsoft.com/global/en/jo...

Visualization of epistmic uncertainty via MI as the gap between average conditional entropy and predictive entropy: blackhc.github.io/balitu/lectu...

I'm not a Python developer, and often battle with environments and dependencies when I have to use it. This comprehensive introduction to the uv package manager makes me less hesitant to use Python! www.saaspegasus.com/guides/uv-de...

So excited to share our Google DeepMind team's new Nature paper on GenCast, an ML-based probabilistic weather forecasting model: www.nature.com/articles/s41... It represents a substantial step forward in how we predict weather and assess the risk of extreme events. 🌪️🧵

Are you frustrated by how GitHub renders Jupyter notebooks? I have public service that renders GitHub notebooks with Quarto nbsanity.com It now works with gists!

Super grateful to be teaching at AIMS in South Africa for a few weeks on Bayesian Active Learning 😇🥳 aims.ac.za

This is one I've wanted to do for a while: ask why RL has been continually underestimated in the last 2 years. Interviewing Finbarr Timbers on the "We are So Back" Era of Reinforcement Learning Interconnects interview #11. An overview on the past, present, and future of RL. https://buff.ly/3Vqrbqj

Mandatory ELBO derivation in any lecture series: (I think I finally understand the unnecessarily confusing derivation in the VAE paper 😅)

How do LLMs learn to reason from data? Are they ~retrieving the answers from parametric knowledge🦜? In our new preprint, we look at the pretraining data and find evidence against this: Procedural knowledge in pretraining drives LLM reasoning ⚙️🔢 🧵⬇️

5m bluesky dataset up now. gotta applaud someone doing the right thing 👏👏👏

Could you have trained GPT-4 on 2012 GPUs? Today, we’re releasing an interactive distributed training simulator that allows you to answer this question, among many others!

I just want to point out that all my favorite art in the last year has been generated by Midjourney. Midjourney is doing more for art literacy than most modern art museums because you have to learn about artists, styles, and aesthetics to know what to prompt for 😊

Welcome to the Crazy Rich Bayesian Starter Pack, folk who are/were vaguely into Bayesian reasoning but - with a few exceptions - don't shun the non-Bayesian. go.bsky.app/JYH5Z6M

Has anyone shared huggingface.co/datasets/alp... as a torrent yet? Happy to support that effort

👏👏👏

📣 We have a tenure-track faculty opening in Responsible AI at @ethzurich.bsky.social : ethz.ch/en/the-eth-z.... Deadline Nov 30 for full consideration. ETH Zurich is a vibrant environment for AI research with the ETH AI Center etc. Please help spread the word!

New blog post 'Bayesian Appropriation: Variational Inference = PAC-Bayes Optimization?' Recent papers (ECCV '22 oral & CVPR '23 highlight) optimize PAC-Bayes bounds. This post shows this is the same as variational inference and shows ties to the ELBO & model selection. With thanks to Nan Ding!