🎧 Hear Dr. Hupkes discuss her work on GenBench and how consistency, generalization, and reasoning shape our understanding of LLMs. 🎬 YouTube: www.youtube.com/watch?v=CuTW... 🎙️ Apple Podcasts: podcasts.apple.com/ca/podcast/w... 🎧 Spotify: open.spotify.com/show/51RJNlZ... #WiAIR #NLP #WomenInAI

🎙️ New Episode Out Now! We’re thrilled to announce that the latest episode of the @wiair.bsky.social is live! This week, we sit down with Dr. Angelica Lim, Ph.D., to talk about "Robots with Empathy". #AI #EthicalAI #SocialRobotics #HumanCenteredAI #WiAIR

Read this if you're new to academic conferences or if you'd just like a bit of helpful advice on how to make friends at conferences (as opposed to a formal "networking ")

It is critical for scientific integrity that we trust our measure of progress. The @lmarena.bsky.social has become the go-to evaluation for AI progress. Our release today demonstrates the difficulty in maintaining fair evaluations on the Arena, despite best intentions.

SUPER thrilled that our #NAACL2025 paper got the runnerup BEST paper award 😍😍🏆🏆🏆🚀🚀 We show that people rely 30% more on LLMs when they use emphatic expressions (eg "Sure, happy to help") even though the answer is wrong and 10% more when the task involves math questions 😵 📜 arxiv.org/pdf/2407.07950

🚀 Our new episode is LIVE! 🎙️ In Episode 3, we talk with @aparnabee.bsky.social about: 🏥⚠️ Unique challenges of applying AI in medical contexts 📊🧑🏽‍🤝‍🧑🏻 Data quality and bias 👩‍⚕️🩺 Importance of collaboration with clinicians Watch and subscribe! youtu.be/DEdJltlFg4I #MLforHealth #WiAIR #WomenInAI

The latest happenings in open models - Eagerly awaiting Qwen 3 - Llama 4 uptake is slow - Reasoning models seem to be saturating - Multimodal models are being slept on - China is still dominating - Oh yeah, and a reminder that my RLHF book online version0 is done! Artifacts Log #9. buff.ly/F6lapGF

Glad to share that our publication was recognized as the Top Viewed Article. Read it here alz-journals.onlinelibrary.wiley.com/doi/full/10....

💡If AI rewrites your voice, is it still your voice? We had the pleasure of hosting @CurriedAmanda in our latest episode, where she walked us through her impactful research on “Impoverished Language Technology: Social Class in NLP.” #WiAIR #SocialBias #AIFairness

Proud to be a part of this multi-cultural multi-institutional collaborative project

OpenAI: "Users have told us that understanding how the model reasons ... helps build trust in its answers." Anthropic: "Do reasoning models accurately verbalize their reasoning? Our new paper shows they don't." www.anthropic.com/research/rea...

Don't miss this episode! It's going to be an interesting discussion about social and ethical implications of biased AI, and how researchers are working to create fair and inclusive systems

Following up on my last post - it's time for the big reveal! 🎉 Thrilled to announce that @malikeh97.bsky.social and I are launching a podcast called Women in AI Research! We're excited to bring you inspiring stories from women in AI. Follow @wiair.bsky.social for all the updates #womeninai

Big announcement coming up! My friend @malikeh97.bsky.social and I have been working on something very special. Can't wait to reveal what we have been up to. Stay tuned for more info! 🚀 #WomenInAI

I am not into sports and not a hockey fan. But this time, I am very glad about the outcome of this game. Go Canada! 🇨🇦🇨🇦🇨🇦🏒🎉

Our paper is accepted to ICLR! INCLUDE: Evaluating Multilingual LLMs with Regional Knowledge (arxiv.org/abs/2411.19799) A benchmark of ~200k QA pairs across 44 languages, capturing real-world cultural nuances. A collaborative effort led by @cohereforai.bsky.social, with contributors worldwide. /1

Very interesting paper about unlearning for AI Safety, a subject that deserves more attention. ⬇️

Happy New Year! To kick off the year, I've finally been able to format and upload the draft of my AI Research Highlights of 2024 article. It covers a variety of topics, from mixture-of-experts models to new LLM scaling laws for precision:

Last month I attended the #NeurIPS2024 conference in Vancouver. Now that I'm home, I'd like to reflect on all the interesting works I encountered at the conference. Part 1 is about multimodal #LLM, next parts coming soon. typhoon-mirror-155.notion.site/Multimodal-L...

Excited to co-organize the HEAL workshop at @acm_chi 2025! HEAL addresses the "evaluation crisis" in LLM research and brings HCI and AI experts together to develop human-centered approaches to evaluating and auditing LLMs. 🔗 heal-workshop.github.io #NLProc #LLMeval #LLMsafety