🧵1/ Fast-moving domains like cybersecurity evolve too quickly for static rules. Adaptive regulation has scheduled review and updates, but hackers evolve faster. An approach I call “hindsight accountability” can help: medium.com/@jeanimal/hi...

LLM-lasso keeps the theory of Lasso, while using an LLM to analyze domain-specific metadata to improve the weights of the regularizer. Result: better performance on biomedical case studies. Plus, since lasso reduces the number of features, it's more interpretable! arxiv.org/abs/2502.10648

The slides for my lectures on (Bayesian) Active Learning, Information Theory, and Uncertainty are online now 🥳 They cover quite a bit from basic information theory to some recent papers: blackhc.github.io/balitu/ and I'll try to add proper course notes over time 🤗

Just 10 days after o1's public debut, we’re thrilled to unveil the open-source version of the technique behind its success: scaling test-time compute By giving models more "time to think," Llama 1B outperforms Llama 8B in math—beating a model 8x its size. The full recipe is open-source!

Double descent enables a chat bot with a billion parameters to perform well and not overfit. But how does double descent work? I use simulations fitting linear regressions, plots, and tables for solving systems of equations to build intuition. medium.com/@jeanimal/ho...