We updated our LLM epistemic diversity study with a stronger search baseline closer to true search diversity. It beats every model, even though it is underestimated. In other words, one can expect less information from an LLM vs Google searching. See the new results here! arxiv.org/pdf/2510.04226

News about our epistemic diversity paper! 💻 The code is now a python package! Installation instructions here: github.com/dwright37/ll... 🤗 All 1.6M model responses and 70M clustered claims are now available on HuggingFace! huggingface.co/datasets/dwr... 📄 Paper: arxiv.org/pdf/2510.04226

Attending EMNLP 2025 this week? So is CopeNLU -- come find us there! ⤵️ www.copenlu.com/news/8-paper... @apepa.bsky.social @rnv.bsky.social @kirekara.bsky.social @shoejoe.bsky.social @dustinbwright.com @zainmujahid.me @lucasresck.bsky.social @iaugenstein.bsky.social #NLProc #AI #EMNLP2025

Heading to #EMNLP2025? Interested in automatic summarization? Then come to our poster for "Unstructured Evidence Attribution for Long Context Query Focused Summarization" ! ⏰ When: Fri. Nov 7 14:00-15:30 🗺️ Where: Hall C I'm unable to attend but @iaugenstein.bsky.social will present our work!

Which, whose, and how much knowledge do LLMs represent? I'm excited to share our preprint answering these questions: "Epistemic Diversity and Knowledge Collapse in Large Language Models" 📄Paper: arxiv.org/pdf/2510.04226 💻Code: github.com/dwright37/ll... 1/10

🎉 Our work on attribution in summarization is now accepted to #EMNLP2025 main! 🎉 "Unstructured Evidence Attribution for Long Context Query Focused Summarization" w/ @zainmujahid.me , Lu Wang, @iaugenstein.bsky.social , and @davidjurgens.bsky.social

There’s something really special about seeing a physical print copy of our work 🤩 You can read “Efficiency is Not Enough: A Critical Perspective on Environmentally Sustainable AI” now in CACM!!! dl.acm.org/doi/10.1145/...

No fewer than three people were needed to cover all the aspects of our dialogue simulation paper. Thanks for the interest — check out the preprint. Link in Dustin’s post. @dustinbwright.com @ic2s2.bsky.social #ic2s2

We had a great time talking about dialogue simulation with LLMs at @ic2s2.bsky.social !!! Amazing work by all of our colleagues at UMich. See the preprint of this work here: arxiv.org/abs/2409.08330

The work “Extracting Participation in Collective Action from Social Media”, in collaboration with @lajello.bsky.social, at @ic2s2.bsky.social today! Check out the paper ojs.aaai.org/index.php/IC... and models huggingface.co/ariannap22 Feat. poster and research buddy @alessianetwork.bsky.social ♥️

Open PhD positions in Denmark! daracademy.dk/fellowship/f... If you want to apply to work with me and Johannes Bjerva at @aau.dk Copenhagen, I'll be at @ic2s2.bsky.social this week and @aclmeeting.bsky.social next week! DM me if you'd like to meet :)

Our critical perspective of AI efficiency is now online in Communications of the ACM! cacm.acm.org/sustainabili...

Join us for the Pre-ACL 2025 Workshop in Copenhagen, 26 July, 2025! 🇩🇰 With international NLP experts from Columbia, UCLA, University of Michigan, and more to Copenhagen to meet with the Danish NLP community. 🇩🇰 📅 Poster submission deadline: June 16, 2025 🔗 Register: www.aicentre.dk/events/pre-a...

Thanks to @dustinbwright.com (@copenlu.bsky.social) and @mxij.me (@itu.dk) for sharing insights on your research within the collaboratory of Speech & Language, at the Last Fridays Talks!

This work on fact checking with summarized evidence was accepted to #SIGIR 2025!

Latest newsletter featuring a perspective paper by @dustinbwright.com et al. on "Efficiency is Not Enough: A Critical Perspective of Environmentally Sustainable AI" @aicentre.dk

I am still in need of emergency reviewers for ARR this cycle for the computational social science track, please DM me if you have capacity 🙏

Our long context summarization dataset is now on 🤗 Huggingface! huggingface.co/datasets/dwr... Use it as a training or a test set for long context query focused summarization! It includes evidence attribution of free-form text spans from the context, making summaries more transparent and reliable!

New preprint: "Unstructured Evidence Attribution for Long Context Query Focused Summarization" We propose *unstructured* evidence attribution for long context summarization and a synthetic dataset called SUnsET which can help models perform this task. Paper link: arxiv.org/abs/2502.14409 Thread ⬇️

📄 New preprint: "Collecting Cost-Effective, High-Quality Truthfulness Assessments with LLM Summarized Evidence" We show: fact checking w/ crowd workers is more efficient when using LLM summaries, quality doesn't suffer. arxiv.org/abs/2501.18265

Happening now @neuripsconf.bsky.social #NeurIPS2024 !!! Come to poster 4003 in East Hall to learn about Bayesian model reduction for structured pruning!

I’m at #NeurIPS2024! I’m also on the faculty job market! Come talk to me about neural network efficiency, reliable NLP, open positions, and come to my spotlight poster on Friday from 11a — 2p in East Exhibit Hall A — C, poster number 4003

Looking forward to heading to #NeurIPS2024 in a week after some vacation time in Portugal this week 🇵🇹 I’m on the job market so message me if you’d like to meet up during the conference to chat about jobs, research, or to just hang out 😊

If you have ever had cause to doubt the wisdom of taking all of the computers in the world and connecting them to each other, an evening spent perusing social media is unlikely to assuage your concerns.

NeurIPS Conference is now Live on Bluesky! -NeurIPS2024 Communication Chairs

Hello, world! We're a Natural Language Understanding group at the University of Copenhagen (faculty: @iaugenstein.bsky.social, @apepa.bsky.social). Follow us for updates about our research, open positions, and more! More about us: www.copenlu.com #NLP #NLProc #ML #XAI

Yay! I have created a Danish Machine Learning peoples starter pack! Feel free to comment below if you want to add yourself or others ☺️. I aim to include people working in ML in Denmark.

Our research group is on BlueSky as well now! Follow us for updates ⤵️ @copenlu.bsky.social @apepa.bsky.social @nadavb.bsky.social @rnv.bsky.social @dustinbwright.com

#EMNLP2024 was a blast! Next stop is #NeurIPS2024 where I'll present our ✨spotlight✨ paper on thresholdless Bayesian structured pruning! Paper: arxiv.org/pdf/2406.01345

THE BELL JAR HARD ❌ It was a queer, sultry summer, the summer they electrocuted the Rosenbergs, and I didn't know what I was doing in New York EASY ✅ That summer was sizzling, and so were the Rosenbergs

CopeNLU @ #EMNLP2024 — hope you all enjoyed the conference as much as we did 😊🌴 See you again at #ACL2025NLP and #EMNLP2025! #NLProc @rnv.bsky.social, @dwright37.bsky.social, @zeerak.bsky.social

#EMNLP #EMNLP2024 Find me at the widening NLP poster sessions! 1) Morning: fine-grained detection of antisemitic events in news reports (ongoing work) 2) Afternoon: social movement framing on social media, recently published at the journal of quantitative description journalqd.org/article/view...

Here are pictures of my cat Bitsy helping with preparing both posters

"A person who merely refuses to learn what can be known is not a skeptic, but rather an ignoramus; a person who raises questions but does not seek their answers is not a skeptic, but a bullshitter." defector.com/what-the-fuc...

BlueSky starting to feel like my old science focused twitter used to, actually seeing stuff I care about not just drama and politics

Podcasts are a popular medium, but data for computational research is limited! We introduce the Structured Podcast Research Corpus (SPoRC - huggingface.co/datasets/bli...), a large, multimodal dataset of English podcasts 🧵 arxiv.org/abs/2411.07892

Lots of folks listen to podcasts—an estimated half of Americans do monthly!—but there's been limited data to study what happens on them. What do they talk about? Who are the guests? Who is influencing whom?? This new dataset is our attempt to bring light to an important medium

Happening now at #EMNLP2024 ! Come to poster 34 in Jasmine to talk to me, @rnv.bsky.social and Srishti Yadav about LLM political values!

🌴Good morning, #EMNLP2024! Want to learn more about our research? This is what we're presenting 📜 Also, I'm chairing the business meeting & have the honour of revealing the #EMNLP2025 location in the closing session. Don't miss it! 🤩 #NLProc Paper links: isabelleaugenstein.github.io/publications...

If you are interested in AI, follow the folks in this starter pack! I have just updated it to include a few new arrivals here, but please let me know who else is missing go.bsky.app/SipA7it

Looking forward to catching up with old and new friends at #EMNLP2024! I’m on the academic job market so please reach out if you would like to chat 🙏 And come talk to me, @rnv.bsky.social and @iaugenstein.bsky.social on Thu (Nov 14) at poster session G from 2-3:30PM about LLM tropes!

I’ll be at #EMNLP2024 presenting work on investigating political biases in LLMs! Would love to chat with folks about analysis of models, LLM safety, Computational Social Science x NLP, embedding Culture in models, PhD life and more. Also, I’m on the lookout for internship positions!

Also, I'll be giving a talk on "Computational Methods of Social Causes and Effects of Stories" at the workshop on Narrative understanding on Nov 15th #emnlp2024 Excited to share some recent work with my students Joel & Jocelyn and collaborators @mariaa.bsky.social @andrewpiper.bsky.social!

🎓 Fully funded PhD Fellowship in Interpretable NLP at the University of Copenhagen & Pioneer Centre for AI available! 📆 Application deadline: 15 Jan 2025 👥 Supervisors: Pepa Atanasova & me 🤝 Reasons to apply: www.copenlu.com/post/why-ucph/ 📝 Apply here: employment.ku.dk/phd/?show=16... #NLProc #XAI

👋Psst! Want more faithful, verifiable and robust #LLM reasoning than with CoT, but using external solvers is meh? Our FLARE💫uses Logic Prog with Exhaustive Simulated Search to achieve this.🧵 @pminervini.bsky.social, Patrick Lewis, Pat Verga and @iaugenstein.bsky.social arxiv.org/abs/2410.11900

I'm continuing to add people to this list; if you looked at it a couple days ago, you might want to check again for all the new people who have joined!

At #EMNLP2024 we will present our paper on LLM values and opinions! We introduce tropes: repeated and consistent phrases which LLMs generate to argue for political stances. Read the paper to learn more! arxiv.org/abs/2406.19238 Work done Uni Copenhagen + Pioneer Center for AI