Super interested to what degree this interaction can be fine-tuned into models in a non-reversible fashion! Voice cloning is unfortunately a capability which inherently shows up in pretrained audio models. It would be great to be able to largely limit the capability at the level of model weights!

Now that school is starting for lots of folks, it's time for a new release of Speech and Language Processing! Jim and I added all sorts of material for the August 2025 release! With slides to match! Check it out here: web.stanford.edu/~jurafsky/sl...

"GPT-5 shows scaling laws are coming to an end"

We’ve discovered a literal miracle with almost unlimited potential and it’s being scrapped for *no reason whatsoever*. This isn’t even nihilism, it’s outright worship of death and human suffering.

Really great pointer from Hao Zhang on the other site in relation to GPT OSS use of attention sinks. If I were to guess, the attention sink is what allows them to omit QK-Norm which has become otherwise standard. www.evanmiller.org/attention-is...

The SALT Lab is at #ACL2025 with our genius leader @diyiyang.bsky.social. Come see work from @yanzhe.bsky.social, @dorazhao.bsky.social @oshaikh.bsky.social, @michaelryan207.bsky.social, and myself at any of the talks and posters below!

I'm in Vienna for #ACL2025! My work is all presented tomorrow, but today you'll find me today at the poster session from 11-12:30 evangelizing my labmate Yanzhe Zhang's work on his behalf. If you're interested in the risks traditional pop-up attacks present for AI agents, come chat!

A while ago I mentioned that for marin.community project, this gradient increase led to problematic loss ascent which we patched with Z-loss. I was curious, does AdamC just work? So over the weekend, I ran 4 experiments—130M to 1.4B params—all at ~compute-optimal token counts...🧵

kyutai.org/next/unmute has built in turn-detection on the ASR and full I/O streaming for the TTS. Solves the latency issues that I think are 90% of why people use end-to-end speech models in the first place! From the details, you can @kyutai-labs.bsky.social is focused on real-world utility.

Flattered and shocked for our paper to receive the #facct2025 best paper award.

I've only seen Veo 3 (or any other video generation model) used to produce viral videos. The fake videos seem to successfully trick the majority of commenters and have no visible watermark or disclosure of AI use.

What would you say if you saw it in another country? A senator from a coequal branch of government dragged away by security from asking a question of a Cabinet official

🚨 70 million US workers are about to face their biggest workplace transmission due to AI agents. But nobody’s asking them what they want. While AI R&D races to automate everything, we took a different approach: auditing what workers want vs. what AI can deliver across the US workforce.🧵

Really cool to see theory connect to practice! We observed this phenomenon when trying to do deeper WSD cooldowns of our 8B model in the marin.community project! We Z-Lossed our way through the pain, but cool to see some stronger theory: marin.readthedocs.io/en/latest/re...

What foreign power could do as much damage to the United States as Trump is doing to it right now? www.whitehouse.gov/presidential...

Based on current administration policies, China is about to have an influx of returning talent and a accelerated advantage in research investments. You need to be both sinophobic and irrational to expect the US to continue as the global scientific powerhouse with these policy own-goals.

"“From time-to-time instances will arise in which the society, or segments of it, threaten the very mission of the university & its values... In such a crisis, it becomes the obligation of the university as an institution to oppose such measures & actively to defend its interests and its values.”

Super excited Marin is finally out! Come see what we've been building! Code/platform for training fully reproducible models end-to-end, from data to evals. Plus a new high quality 8B base model. Percy did a good job explaining it on the other place. marin.community x.com/percyliang/s...

How much faster would the science of large-scale AI advance if we could open-source the *process* of building a frontier model? Not just the final models/code/data, but also negative results, toy experiments, and even spontaneous discussions. That's what we're trying @ marin.community

It feels worth conference organizers running a study to see if this significantly impacts reviewer scores. I hope things like this are placebos, but if not we need to seriously consider whether existing peer-review processes for big ML conferences are providing value.

Introducing CAVA: The Comprehensive Assessment for Voice Assistants A new benchmark for evaluating the capabilities required for speech-in-speech-out voice assistants! - Latency - Instruction following - Function calling - Tone awareness - Turn taking - Audio Safety TalkArena.org/cava

How does the public conceptualize AI? Rather than self-reported measures, we use metaphors to understand the nuance and complexity of people’s mental models. In our #FAccT2025 paper, we analyzed 12,000 metaphors collected over 12 months to track shifts in public perceptions.

I wrote something up for AI people who want to get into bluesky and either couldn't assemble an exciting feed or gave up doomscrolling when their Following feed switched to talking politics 24/7.

Worth noting that a number of universities have now sued over withheld and canceled grants, but no university has yet sued over the arrest, detention, and threatened deportation of its foreign students. www.nytimes.com/2025/04/19/o...

Mahmoud Khalil writes movingly about what his detention by ICE means for America: www.washingtonpost.com/opinions/202...

aside: a stunning comment from David Baker, UW professor who won the Nobel Prize in 2024. Now 15 lab members are looking for positions overseas. “There’s so many amazing people who want to come in, & we can’t take them. The Nobel Prize was just a little blip. But things have gotten quite bleak.”

Financial Times: "Since 1990, America has lost over 5 million manufacturing jobs. In that time, it has gained 11.8 million roles in professional and business services, and 3.3 million in transportation and logistical activities, linked to multinational supply chains." #EconSky

The Model Context Protocol is cool because it gives external developers a way to add meaningful functionality on top of LLM platforms. To limit test this, I made a "Realtime Voice" MCP using free STT, VAD, and TTS systems. The result is a janky, but makes me me excited about the ecosystem to come!

people being in the streets means something. never let your cynicism convince you otherwise.

The Trump administration’s roundup of students who protested Israel’s bombardment of Gaza marks an astonishing, radical break with what one might justifiably think of as the central American idea. I wrote about it for @theguardian.com. www.theguardian.com/commentisfre...

Working with an interdisciplinary team, we have developed a website to communicate how the White House's proposed cuts to health research would cause losses of $16B and 68,500 jobs. Find out how your community may be impacted. Explore more at SCIMaP: scienceimpacts.org a 🧵

We have had nearly two decades of panic about Free Speech on Campus and not a single case, not even the ones they made up, were as bad as what's happening now

Step 1) Install the #chi2025 module to your Claude/ChatGPT: knollapp.com/add/ZlRKvCmB... Step 2) Ask the LLM, "Given my interests, what are some CHI 2025 papers I should check out?" (If the model doesn't already know your interests, you might need to state them.)

Exclusive: Navajo Code Talkers disappear from military websites after Trump DEI order

Arresting and threatening to deport students because of their participation in political protest is the kind of action one ordinarily associates with the world’s most repressive regimes. It’s genuinely shocking that this appears to be what’s going on right here. 1/

As always, we open source everything. Even our nicely made website: egonormia.org Please check out the leaderboard, the blog (w/Bibtex support), the code, data, as well as a data viewer.

We are getting closer to have agents operating in the real physical world. However, can we trust frontier models to make embodied decisions 🎮 aligned with human norms 👩‍⚖️ ? With EgoNormia, a 1.8k ego-centric video 🥽 QA benchmark, we show that this is surprisingly challenging!

Great to see the International AI Safety Report highlight research on dialect prejudice, including our work on covert racism in LLMs! www.nature.com/articles/s41...

Now most *urgently*: we review the history of these models. A straight line can be traced to modern AI from basic science. Not in engineering but in the cognitive science of language. Much of it funded by NSF, whose funding has now been paused. www.goldengooseaward.org/01awardees/pdp

Balancing data across domains is key to training the best generalist LLMs! In my summer work on the Meta Llama team, we introduce UtiliMax and MEDU, new methods to estimate data utility and optimize data mixes efficiently. HF Blog: huggingface.co/blog/WillHel... ArXiv: arxiv.org/abs/2501.11747

LM agents today primarily aim to automate tasks. Can we turn them into collaborative teammates? 🤖➕👤 Introducing Collaborative Gym (Co-Gym), a framework for enabling & evaluating human-agent collaboration! I now get used to agents proactively seeking confirmations or my deep thinking.(🧵 with video)

Happy New Year everyone! Jim and I just put up our January 2025 release of Speech and Language Processing! Check it out here: web.stanford.edu/~jurafsky/sl...

NYU Abu Dhabi Opening: Computer Science Professor in Artificial Intelligence, Machine Learning, T/TT - Open Rank! Deadline Feb 28, 2025! apply.interfolio.com/161449 #AI #ML #MachineLearning #NLP #NLProc #AIjobs #MLjobs #BigData #DataScience #AIcareers #DataJobs #JobSearch

Doctors Without Borders: What our medical teams have witnessed is "consistent with the descriptions provided by an increasing number of legal experts and organizations concluding that genocide is taking place in Gaza." www.doctorswithoutborders.org/latest/gaza-...

Update: Gemini 2.0 Flash now supported in Talk Arena! Come try the new Gemini and determine how strong it is at Speech & Audio compared to DiVA Llama 3, Qwen 2 Audio, and GPT 4o Advanced Voice at talkarena.org

Introducing Talk Arena🔊: the platform for interactively evaluating Large Audio Models! With the release of speech AI models like GPT4o, Gemini, Qwen-Audio, etc. which is the best? Cast your votes and help us decide🔥

With an increasing number of Large *Audio* Models 🔊, which one do users like the most? Introducing talkarena.org — an open platform where users speak to LAMs and receive text responses. Through open interaction, we focus on rankings based on user preferences rather than static benchmarks. 🧵 (1/5)

New Moving Sofa Problem proof dropped!! arxiv.org/abs/2411.19826

RIP to the first product I got to do real "Big Data" work on 🫡🫡🫡

🚨 NeurIPS 2024 🚨How robust are AI-Generated Image Detectors? 🤔 Can they detect various magnitudes of image augmentations? 💡 Does performance fluctuate across scenes? 🚀 Find out with Semi-Truths: 1.5 million images for the targeted evaluation of AI-generated images. arxiv.org/abs/2411.07472