We need to raise the bar on research code right now. 1) documentation and tests are dead simple now. 2) creating benchmarks integrating across multiple implementations 3) have agents double check your work / fix broken tests 4) fix outstanding bugs in major scientific packages

@hempuli.bsky.social ! We want to expand on utilForever's Baba is You RL simulator! github.com/utilForever/... Is that ok with you? We want to expand the set of levels included to involve more complex problems and reasoning over the various abstractions in your (awesome and very hard) game!

We’ve released torchgfn v2! github.com/GFNOrg/torch... We believe we’ve built the go-to library for fundamental GFlowNet methods development and prototyping, and we’re really excited to help you start using it.

Today marks a big milestone for me. I'm launching @law-zero.bsky.social, a nonprofit focusing on a new safe-by-design approach to AI that could both accelerate scientific discovery and provide a safeguard against the dangers of agentic AI.

America cannot long remain free, nor first among nations, if it becomes the kind of place where universities are dismantled because they don't align politically with the current head of the government.

Preprint Alert 🚀 Can we simultaneously learn transformation-invariant and transformation-equivariant representations with self-supervised learning? TL;DR Yes! This is possible via simple predictive learning & architectural inductive biases – without extra loss terms and predictors! 🧵 (1/10)

Great job gang! And thanks to @boussifo.bsky.social for being such a stellar lead. (Also depicted: @jainmoksh.bsky.social)

Ecstatic to show off some work my brilliant colleagues and I did at @iclr-conf.bsky.social this year! 🚀 We address the credit assignment challenge under long trajectories in RL or GFlowNets by constructing high order actions, or “chunks”, effectively compressing trajectory lengths!

From having to wrap a bunch of methods I can say I'm not a big fan of having configs in the form of argparsers.

any economists here that can help me understand why the world's richest man might want to kill the consumer financial protection bureau

Neural surrogates can accelerate PDE solving but need expensive ground-truth training data. Can we reduce the training data size with active learning (AL)? In our NeurIPS D3S3 poster, we introduce AL4PDE, an extensible AL benchmark for autoregressive neural PDE solvers. 🧵

"The complaint alleges the algorithm, dubbed nH Predict, has a 90% error rate, basing that calculation on the percentage of payment denials reversed through internal appeals processes or administrative law judge rulings." www.statnews.com/2023/11/14/u...

Scalable emulation of protein equilibrium ensembles with generative deep learning www.biorxiv.org/content/10.1... No code is available yet, but sounds huge. Effectively does MD-sim, but fast!

This book radically influenced my way of looking at human civilization and the kinds of tech that must be built to move us into a post sacristy, sustainable future. His story (overcoming failure/depression to produce major intellectual contributions outside the academic system was also formative.

Who are the top people working on computationally guided biosynthesis in the Boston / NY area?

Mila is such a large community. One starter pack just isn’t enough! After @josephdviviano.bsky.social’s Mila list filled up, I decided to make another one. Will continue to add members until this one is full too. go.bsky.app/9nXTDHo

Rupali is making the second Mila starter pack. Please reply to this if you're at Mila and she will add you.

🚀 Did you know you can use the in-context learning abilities of an LLM to estimate the transition probabilities of a Markov chains? The results are pretty exciting ! 😄

A great new essay on AI for Science from our colleagues here: deepmind.google/public-polic...

BioM3: a model that generates proteins conditioned on text prompts, with wet-lab validation! www.biorxiv.org/content/10.1...

My suspicion is that we might be able to squeeze more juice out of the data with the correct training paradigm but what we're seeing in PLMs is similar to the saturation we're seeing in LLMs - every dataset/model pair will have a different S curve, with PLMs it is smaller.

The complete guide for transfer learning with the protein language model ESM-2. (In brief: Use ESM-2 650M and calculate mean embeddings across sites.) www.biorxiv.org/content/10.1...

Kind of a broken record here but proceedings.neurips.cc/paper_files/... is totally fascinating in that it postulates two underlying, measurable structures that you can use to assess if RL will be easy or hard in an environment

I'm making a list of AI for Science researchers on bluesky — let me know if I missed you / if you'd like to join! go.bsky.app/AcP9Lix

Hey @mubashariqbal.com please add: go.bsky.app/BHKxoss

And if you'd like to contribute or use these models, join our working group. We're still starting up, so expect some rough edges but we've got a few really exciting projects lined up!

I'm making an unofficial starter pack with some of my colleagues at Mila. WIP for now but here's the link! go.bsky.app/BHKxoss