This ICLR deadline is marked by its soundtrack: Iggy Confidential... wow! www.bbc.co.uk/programmes/b...

Keynote spotlight #5: the third of COLM (and last day of the main conference) will open with a keynote by Nicholas Carlini (Anthropic)

Joey Ramone wrote a song dedicated to his stock investor My contribution to your ICLR deadline soundtrack (or if you are looking for investment advice ¯\_(ツ)_/¯ ) : www.youtube.com/watch?v=vbJx...

Keynote spotlight #4: the second day of COLM will close with @ghadfield.bsky.social from JHU talking about human society alignment, and lessons for AI alignment

Congratulations to Alane Suhr '22, a #CornellTech Ph.D. #alumni advised by associate professor Yoav Artzi, for receiving the prestigious 2022 @aaai.org / @acmsigai.bsky.social Doctoral Dissertation Award! Read more about the award here: aaai.org/about-aaai/a... @yoavartzi.com

As we are spotlighting these last few days, let's also spotlight the spotlights. COLM 2025 has 24 spotlight papers that will be presented as plenary orals 👏

Keynote spotlight #3: COLM's second day will open with some *real* intelligence 🧠🧠🧠 with Tom Griffiths from Princeton

Keynote spotlight #2: COLM's first-day afternoon session will go polymathic 🔭 with Shirley Ho 🌌 from the Flatiron Institute

Keynote spotlight #1: COLM will open on Oct 7 with a keynote by @lukezettlemoyer.bsky.social about mixed-modals models 🌈

How will AI agents impact democratic values? Democracies are—for independent reasons—already under acute pressure. Since WWII Moore's Law and democratisation went up and to the right in lockstep. Not any more.

Authors, your camera ready is due today!

COLM ❤️ families (and volunteers!)

The talk for our work on Retrospective Learning from Interactions, which will be in ACL (once I figure out how to squeeze it shorter) Gist: autonomous post-training from conversational signals for LLM bootstrapping ... look ma, no annotations! no hand-holding! 🙌📈🚀 www.youtube.com/watch?v=qW8S...

The list of accepted papers for COLM 2025 is now available here: colmweb.org/AcceptedPape... The papers will be made available around mid August, following the camera ready deadline

COLM 2025 is now accepting applications for: Financial Assistance Application -- docs.google.com/forms/d/e/1F... Volunteer Application -- docs.google.com/forms/d/e/1F... Childcare Financial Assistance Application -- docs.google.com/forms/d/e/1F... All due by July 31

@colmweb.org decisions are out, and so are we The strength of submissions this year amazed us! Many many hard decisions 😩 + Aditi, @eunsol.bsky.social , @ranjaykrishna.bsky.social 😴😴😴

How global is IRB or IRB-style monitoring of research? I have a pretty good idea that is broadly adopted in the US. What about Europe (my guess is yes)? India? China? Other countries that are exceptions?

Tokenization is still an open problem

What work/software is out there about training models on heterogeneous clusters? Let's say I have access to various machines, some with more contemporary GPUs, some with much older.

Recently hearing a lot of opposition to RAG, largely sounding like "it (will) never works". Trying to reconcile this with almost every query I put into ChatGPT doing a web search and retrieving content. So, definitely seems to work. What am I missing? Is it a definition discreprency?

Is there a comparative study comparing the words/day generation of news publications today vs. 1990s? Or for individual reporters? Trying to put numbers behind my impression of contemporary compulsion to generate endless chatter

What should Machine Translation research look like in the age of multilingual LLMs? Here’s one answer from researchers across NLP/MT, Translation Studies, and HCI. "An Interdisciplinary Approach to Human-Centered Machine Translation" arxiv.org/abs/2506.13468

Is there a 2-3 minute video explaining the technical gist behind the recent Meta V-JEPA2? Just something concrete and to the point

@colmweb.org discussion period ended, and now we entered the meta reviewing period. It's not simple getting reviewer engagement nowadays, but slow and steady we made descent progress, even if shy of the ideal of early and wholly. Progress bars -> 🧵

COLM 2025 will include 6 plenary sessions. The details about the format (panel vs. keynote) and topic will come up soon. We are excited to have our plenary sessions led by experts displaying the broad impact and intellectual spectrum of language modeling. Registration is now open

📈

We are making progress on discussions, but also running out of time. Discussion ends tomorrow. Reviewers and ACs, please get jiggy with it! 💃🕺 Updated stats in the next message ⬇️

Can you train a performant language model using only openly licensed text? We are thrilled to announce the Common Pile v0.1, an 8TB dataset of openly licensed and public domain text. We train 7B models for 1T and 2T tokens and match the performance similar models like LLaMA 1 & 2

@eleutherai.bsky.social 👏 arxiv.org/abs/2506.05209

We are doing our best to encourage engagement during the discussion period. It's moving, even if we wish folks would engage more. 🫵🫵🫵Reviewers, please login, read author responses, consider them, write back! 🫵ACs🫵, we need your help too :)

Always interesting to see how deadlines impact engagement trends

The 2nd stage of the discussion period has now started. The intermediate response deadline was very effective, so now we have plenty of time for ACs, reviewers, and authors to discuss! Let's get that red curve up! 📈📈📈

I briefly noted this very interesting paper on memorization by LLMs when it came out, but it just showed up in my SSRN abstracts and that reminded me to write about it in a bit more detail. 🧵 arxiv.org/abs/2505.12546

Starting to track daily participation for @colmweb.org

Happy to announce the first workshop on Pragmatic Reasoning in Language Models — PragLM @ COLM 2025! 🎉 How do LLMs engage in pragmatic reasoning, and what core pragmatic capacities remain beyond their reach? 🌐 sites.google.com/berkeley.edu/praglm/ 📅 Submit by June 23rd

Here are some graphs

Our discussion period just started. Authors, please read our instructions carefully. We require responses by June 2. But, what you really want to hear about is stats .... right? -> 🧵

The full list of COLM 2025 workshops is now online: colmweb.org/Workshops.html Most deadlines are June 23, but check the specific CFP of each workshop for the details

We're still accepting apps for our research scientist position with LEVANTE (levante-network.org). This position is ideal for folks wanting to be the interface between a cool scientific project and an awesome team of software developers. Think of it as a technical product manager, but for science!

COLM 2025 workshops are announced now, check it out: colmweb.org/Workshops.html

Apparently, NeurIPS D&B allows to choose between double- and single-blind. Choice is hard ... what are arguments for each? Single-blind will be like ACL demo, I guess

There's a beautiful piece from Vivian Gornick in a recent NYRB about City College -- the free-for-all debate atmosphere, its egalitarian mission, and its tremendous impact. Beautiful for both content and form www.nybooks.com/articles/202...

Are there any papers or blog posts on how the deep research tools are designed? Gemini, ChatGPT, etc. I can imagine what is going on there, but I wonder if there's some official word, or a descent speculative blog post

What open-weight models (beyond QWen) show length-increase in reasoning RL? Like the one DeepSeek reports, and folks have been seeing with QWen. Thanks

[Currently, hi-energy physics only] Audio summaries are coming to arXiv! 👂📑 We've partnered with @Science_Cast to pilot 60 second #AI generated audio summaries, starting with astro-ph.HE. More info on this partnership on the blog: blog.arxiv.org/2025/04/08/a...

Workshop proposals due in 5 days -- April 14! Details here: colmweb.org/cfw.html

Recovering from submitting to COLM? Now is the time to prepare your workshop proposal! Due April 14. Workshops will take place Oct 10 colmweb.org/cfw.html

I received a review like this five years ago. It’s probably the right time now to share it with everyone who wrote or got random discouraging reviews from ICML/ACL.