Picard technology tip: Sometimes your chief engineer can build new systems that are better than your existing enterprise software.

❣️ Shout out to my amazing co-authors: Rachel Ostrand, @wernergeyer.bsky.social , @keerthi166.bsky.social, Dennis Wei, and Justin Weisz! If you'll be at AIES, I would love to connect and chat more about our work! 🙌

Picard management tip: Even without game-changing results, experimentation is time well spent.

🚀 Excited to share some updates from EvalAssist, the open-source LLM-as-a-Judge framework we released a few months ago! 🧵

We've just extended the IUI Workshop deadline by one week to August 29. Looking forward to your contributions!

Getting ready! Come visit us at the IBM booth @acl to learn about our latest Research. We have a number of super interesting demos lined up. research.ibm.com/events/acl-2...

We’re growing and going global! 🌍 CHIWORK 2025 is shaping up to be our biggest and most diverse edition yet. Thanks to everyone who submitted, reviewed, and supported us 💙 Can’t wait to see you in Amsterdam! 🔗 chiwork.org #CHIWORK2025 #HCI #FutureOfWork

📢 Call for Workshop & Tutorial Proposals 📢 Bring your ideas and discuss them with fellow researchers in Paphos, Cyprus, from March 22-26, 2026. iui.hosting.acm.org/2026/call-fo... #CallForProposals #IUI2026 #HCI #AI

📣 Today we open-sourced EvalAssist, a web-based tool that makes it super easy to develop criteria for llm judges. You can run this now locally and then scale up with notebooks using Unitxt. Check out the AI Alliance article to get the scoop: thealliance.ai/blog/llm-as-...

📣 Call for Workshop & Tutorial Proposals 📣 #IUI2026 is looking forward to your contribution! Bring your ideas and discuss them with fellow researchers in Paphos, Cyprus, from March 22-26, 2026. 🚨 Proposal Deadlines: Aug 22 (Workshops) and Oct 17 (Tutorials)🚨 iui.hosting.acm.org/2026/call-fo...

📣 IUI 2026 Call for Workshops and Tutorials is live 📣 iui.acm.org/2026/call-fo... Note that this year, submissions will be due August 22 earlier than previous years. Pls. spread the word! We had a fantastic workshop program in 2025 and I'm looking forward to an even better one in 2026 in Cyprus.

We just published a summary the 6th workshop on Human-AI Co-Creation with Generative Models at IUI 2025 in March. This year's special topic, of course, AI agents and agency. Two of our sessions covered this topic and we had an exciting panel discussion. Check it out! medium.com/human-center...

Great work from our team @ IBM Research

A summary of decolonial AI alignment in the Human-Centered AI publication on Medium. Thanks to @jweisz3.bsky.social for asking me to write it, and for editing the piece. medium.com/human-center...

I'm on the IBM Mixture of Experts podcast wearing a safety vest. We talk about all the new things in AI this week. I also connect to older work by IBM Fellows Irene Greif, Bob Dennard, Rolf Landauer, and Charlie Bennett and to Mauro Martino's new AI-generated film. www.youtube.com/watch?v=CgqH...

Granite Guardian tops a new benchmark! research.ibm.com/blog/granite...

And the final product 😋

Asparagus time in Germany. This is an automated peeling machine. No AI 😀

All set up for demo time at IUI. We are showing a tool for GenAU-assisted hypotheses exploration. dl.acm.org/doi/10.1145/...

IBM Research on their way to IUI

Ah, and now there is a cool name for it :) www.zdnet.com/article/what... Is there already a CHI paper about it? :)

We have two amazing keynotes this year at HAI-GEN 2025 to challenge our thinking on co-creative systems from an interaction perspective. Hope to cu at IUI this year! hai-gen.github.io/2025/program/

📣 The #CSCW2026 deadline (@acm-cscw.bsky.social) has been posted. Big change this year. There is **only one deadline** for 2026 and it is May 13, 2025. 📣 Please spread the word! #CSCW #CHI #HCI #socialcomputing cscw.acm.org/2025/index.p...

Looking forward seeing your papers!!!

"IBM has equipped the Granite Guardian 3.1 models with the ability to detect hallucinations in AI agent workflows. This feature provides oversight of an AI agent completing a task, monitoring for fabricated information or incorrect function calls." technologymagazine.com/articles/the...

We released Granite Guardian 3.1 today! Even better at harm detection than Granite Guardian 3.0. The main new feature is 'function calling hallucination' detection relevant for tool-using AI agents. github.com/ibm-granite/...

📣 Join our 6th "HAI-GEN" workshop on Human-AI Co-Creation with Generative Models at #IUI2025! 👉 Submit a paper, demo or poster by Jan 22: hai-gen.github.io/2025/ with: @ossimokryn.bsky.social, @wernergeyer.bsky.social, Orit Shaer, Justin Weisz, Lydia Chilton, Mary Lou Maher #IUI #HCI #CHI #AI

I showed this cool demo last week @neuripsconf.bsky.social Now we have a public version on Hugging Face that you can play with to see the "judge" model in action. huggingface.co/spaces/ibm-g... Enjoy! Open source repo & benchmarks: github.com/ibm-granite/...

Nice video about Granite Guardian! www.youtube.com/watch?v=n7tt...

Neurips is a great place to meet friends and former colleagues

Granite Guardians in Action

It is @neuripsconf.bsky.social booth setup day! Among Ambrish Rawat, @bhoov.bsky.social, and @wernergeyer.bsky.social, who do you think is *not* an author of the Granite Guardian technical report we released today? (Hint: Granite Guardian helps make any LLM safer.) Link: github.com/ibm-granite/...

Starting to look nice 😊

Now posted at the under construction booth 😀 our demo lineup for Tuesday. Looking forward connecting with you at the IBM booth @neuripsconf.bsky.social

Getting ready for the big show this week. @neuripsconf.bsky.social

Do you feel that your profession or organization urgently needs to adopt #AI? Here's some advice that we often share (as academics working in human-AI interaction and #ML) with professional colleagues who consider the role of modern technology in their professions. (w/ Weiwei Pan and Hongjin Lin)

I'm happy to announce a significant revision of our paper describing opportunities and challenges of quantitative AI risk assessments, also known as automated red-teaming: arxiv.org/abs/2209.06317

The UX surrounding this capability was grounded and informed by research our Human-Centered Trustworthy AI team did on communicating factuality scores and source attribution led by @dohyojin.bsky.social, part of a larger research effort on how to communicate uncertainty. arxiv.org/abs/2405.20434

If you are headed to NeurIPS, please join for our Pluralistic Alignment workshop! We have a great set of speakers from a range of backgrounds. & all the papers that will be presented at the workshop are posted: pluralistic-alignment.github.io lmk if you'd like to catch up at the conference too! :)

🎺 Here comes the official 2024 NeurIPS paper browser: - browse all NeurIPS papers in a visual way - select clusters of interest and get cluster summary - ZOOOOM in - filter by human assigned keywords - filter by substring (authors, titles) neurips2024.vizhub.ai #neurips by IBM Research Cambridge

In collab w/ Semantic Scholar, we conducted a large scale (800+) survey of researcher usage and perceptions of LLMs for science. Major findings: +Most are using LLMs already, mostly for writing +LLMs seem to be a win for research equity +But some groups, like women, have more ethical concerns too

I will be at @neuripsconf.bsky.social next week presenting EvalAssist, our research on LLM-as-a-Judge, at the Expo. Stop by if you are around neurips.cc/Expo/Confere...

📣 Join our 6th "HAI-GEN" workshop on Human-AI Co-Creation with Generative Models at #IUI2025! 👉 Submit a paper, demo or poster by Jan 22: hai-gen.github.io/2025/ with: Orit Shaer, Justin Weisz, @wernergeyer.bsky.social, Lydia Chilton, @ossimokryn.bsky.social, Mary Lou Maher

Happy to finally read something useful again in my feed :) ... I found the Sky Follower Bridge really helpful to reconnect with folks on BlueSky.

📣 We're back! Join our 6th "HAI-GEN" workshop on Human-AI Co-Creation with Generative Models at #IUI2025! 👉 Submit a paper, demo or poster by Jan 22: hai-gen.github.io/2025/ with: Orit Shaer, Justin Weisz, Werner Geyer, Lydia Chilton, Osnat Mokryn, Mary Lou Maher