Really enjoyed the discussions in the UT Austin NLP group!

Couldn't have wished for a better place to do my PhD, come apply!

I'll be at COLM! Excited to chat about about anything vision+language, interpretability, cogsci/psych, embedding spaces, visual reasoning, video/world models

Devoured this book in 18 hours, usually not a big fan of audio books! It covered lots from crowdworker rights, the ideologies (doomers, EA, ...) and the silicon valley startup world to the many big egos and company-internal battles Great work by @karenhao.bsky.social

Lmao

Congratulations @bennokrojer.bsky.social on passing your PhD proposal exam! A great presentation and exciting work!

very happy to see the trend of a Behind the Scenes section catching on! transparent & honest science 👌 love the detailed montreal spots mentioned consider including such a section in your next appendix! (paper by @a-krishnan.bsky.social arxiv.org/pdf/2504.050...)

Super cool work on quantifying with NLP how language evolves through generations In linguistics, the "apparent time hypothesis" famously discusses this but never empirically tests it

I miss Edinburgh and its wonderful people already!! Thanks to @tallinzen.bsky.social and @edoardo-ponti.bsky.social for inspiring discussions during the viva! I'm now exchanging Arthur's Seat for Mont Royal to join @sivareddyg.bsky.social's wonderful lab @mila-quebec.bsky.social 🤩

Started a new podcast with @tomvergara.bsky.social ! Behind the Research of AI: We look behind the scenes, beyond the polished papers 🧐🧪 If this sounds fun, check out our first "official" episode with the awesome Gauthier Gidel from @mila-quebec.bsky.social : open.spotify.com/episode/7oTc...

Turns out condensing your research into 3min is very hard but also teaches you a lot Finally the video from Mila's speed science competition is on YouTube! From a soup of raw pixels to abstract meaning t.co/RDpu1kR7jM

Excited to share the results of my recent internship! We ask 🤔 What subtle shortcuts are VideoLLMs taking on spatio-temporal questions? And how can we instead curate shortcut-robust examples at a large-scale? We release: MVPBench Details 👇🔬

Top 99% in Boston 💪 Love these interactive maps

When you forget your leftover rice in the fridge for 3 weeks

Maybe it's just that I'm now paying more attention to the good parts again but since this post bluesky seems more fun again. Still not many paper discussions going on but saw some fun general posts

It was tough just logging back into my retired twitter account and to see a timeline that is so much fuller with interesting research discourse... And yes I've tried to customizing my feeds and whatnot but no feed can fix a lack of posts

I finish my work day with the conclusion that code assistants are maybe net negative for my short-term progress and most likely negative for my long-term progress and learning Also sycophancy is annoying af

Attend my AI 2025 bootcamp

This pattern is going to repeat in one domain after another, and gradually force us to admit that 60% of every job is networking, knowing who to trust, and doing poorly justified risk/benefit assessment.

with great responsibility comes a great amount of reimbursements to file

are there any analysis/interp papers on image editing? papers that are more insights than performance

Day 13: (the original mega-thread has become too long and nested so reposting now as a new strategy) Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models A few notes below 👇 I took less digital notes this time as i was sitting outside in the sun reading 🌞

This is one of the most-shared posts on Bluesky in the past day and it's just completely false. You might think ChatGPT is a *bad* search engine, or prefer another search engine. But it has had integrated web search since last year.

A must-read for anyone in NLP right now

Great work from labmates on LLMs vs humans regarding linguistic preferences: You know when a sentence kind of feels off e.g. "I met at the park the man". So in what ways do LLMs follow these human intuitions?

I would only use if it there were direct verbatim quotes from sources mentioned as the primary answer. Otherwise same, scroll past it

Super useful! I didn't actually know this trick

I will miss Thomas Müller One of the greats of football

This week, Mila researchers will present more than 90 papers at @iclr-conf.bsky.social in Singapore. Every day, we will share a schedule featuring Mila-affiliated presentations. Day 1 👇 #ICLR2025 mila.quebec/en/news/foll...

Fulfilling the male cliche and learning about the fall of the Roman empire which is definitely not related to any current events

Now the paper is also on arxiv and can be easily cited: arxiv.org/abs/2504.07128

My friend @sshkhr.bsky.social created this cool tool to track all kinds of ML summer schools - check it out!

Has anyone had a situation where an arxiv submission is on hold for more than a week? What are usually causes for this?

My labmates made a cool thing The video is also fun to watch!

Really enjoyed diving deep into this paper today: arxiv.org/abs/2406.16860 It's so systematic and a treasure trove full of insights

Here is a great summary of the paper: www.youtube.com/watch?v=aO_c... @sivareddyg.bsky.social gave a talk today at the Simon's institute workshop on The Future of Language Models and Transformers

Never been part of a project like this before - it was a very rewarding+unique experience! Everyone in the lab contributed different chapters and it was much more exploratory than your average phd project. My chapter studied R1's reasoning on "image generation/editing" (via ASCII) 🧵👇 1/N

Which evals do you pay attention the most when judging how good a new VLM is?

It's easy to just get lost in reading clickbaity snippets on all the bad news - very nice change to read something longer and actionable

Is there any bluesky feed that is adaptive to what I like and click on? If i like 3 posts about cats, I see more cats etc

I own way too many ultimate frisbee jerseys, maybe around 30, but they have too much sentimental value to let go

Reviewing papers that focus explicitly on interp (whether it's a track or workshop) is more fun than the my avg reviewing in the past. People asking actual scientific questions and going into the why of things

Truer words were never spoken.

Our work on Asynchronous RLHF was accepted to #ICLR2025 ! (I was so excited to announce it, I forgot to say I was excited) Used by @ai2.bsky.social for OLMo-2 32B 🔥 New results show ~70% speedups for LLM + RL math and reasoning 🧠 🧵below or hear my DLCT talk online on March 28!

a fun use case for LLMs is personalized adaptive quizzes

As someone who has tried to make even basic image editing work in my research (e.g. "move cup to left of table"): Gemini's new editing capabilities are seriously impressive! Playing around with it is quite fun... Edit 1: "edit the image to contain 3 more people"

I'm shocked how most people go about their days in the US like nothing is happening (this is not normal!) During my short visits (rn in Boston for a week), I'm more motivated to join protest (they're few/small afaik) than most living here full-time... What will it take to change this?

Attended my first opera in many years and it was probably the most modern one: an interpretation of Vivaldi's Four Seasons where seasons are messed up due to climate change Also I swear the opera singer looked at me when he sang "it's time to wake up [about climate]" cause I fell asleep briefly

📢Excited to announce our upcoming workshop - Vision Language Models For All: Building Geo-Diverse and Culturally Aware Vision-Language Models (VLMs-4-All) @CVPR 2025! 🌐 sites.google.com/view/vlms4all