Our Responsible AI group is hiring at GSK! Join a great team investigating how to responsibly develop AI for drug discovery in an environment mixing research and real-world impact. Full-time in London. jobs.gsk.com/en-gb/jobs/4...

We want your work on fairness, alignment, and/or agentic systems!! Proud to be co-organizing AFAA @iclr-conf.bsky.social with: @prakharg.bsky.social @adoubleva.bsky.social @Miriam @Jamelle @Golnoosh @jessicaschrouff.bsky.social @sanmikoyejo.bsky.social www.afciworkshop.org #AFAA2026 #ICLR2026

This is work with Daniel E. Ho and @sanmikoyejo.bsky.social. We also have a related preprint with Erin Beeghly on the social impacts of this personalization, and how it interacts with group-based preferences and stereotypes: angelina-wang.github.io/files/person...

This has huge implications for evaluation: • Benchmark scores ≠ what end users actually experience • Some high-risk behaviors, e.g., manipulative patterns, might only surface in personalized interfaces We argue for more realistic evals that take personalization into account.

In fact, even the same MMLU science question can yield different ChatGPT answers for different users, despite using the exact same underlying model. User-level personalization and interaction patterns shape outputs in ways existing evals do not capture.

The personalization gap challenges an implicit assumption in AI evaluation: that we can measure capability and safety independently of deployment context. Good opportunity to rethink how we evaluate AI systems.

New in @science.org : 20+ AI scholars—inc. @alondra.bsky.social @randomwalker.bsky.social @sanmikoyejo.bsky.social et al, lay out a playbook for evidence-based AI governance. Without solid data, we risk both hype and harm. Thread 👇

Grateful to win Best Paper at ACL for our work on Fairness through Difference Awareness with my amazing collaborators!! Check out the paper for why we think fairness has both gone too far, and at the same time, not far enough aclanthology.org/2025.acl-lon...

Instead, we should permit differentiating based on the context. Ex: synagogues in America are legally allowed to discriminate by religion when hiring rabbis. Work with Michelle Phan, Daniel E. Ho, @sanmikoyejo.bsky.social arxiv.org/abs/2502.01926

Most major LLMs are trained using English data, making it ineffective for the approximately 5 billion people who don't speak English. Here, HAI Faculty Affiliate @sanmikoyejo.bsky.social discusses the risks of this digital divide and how to close it. hai.stanford.edu/news/closing...

Our latest white paper maps the landscape of large language model development for low-resource languages, highlighting challenges, trade-offs, and strategies. Read more here: hai.stanford.edu/policy/mind-...

Collaboration with a bunch of lovely people I am thankful to be able to work with: @hannawallach.bsky.social , @angelinawang.bsky.social , Olawale Salaudeen, Rishi Bommasani, and @sanmikoyejo.bsky.social. 🤗

🧑‍🔬 Happy our article on Creating a Generative AI Evaluation Science, led by @weidingerlaura.bsky.social & @rajiinio.bsky.social, is now published by the National Academy of Engineering. =) www.nae.edu/338231/Towar... Describes how to mature eval so systems can be worthy of trust and safely deployed.

📣We’re thrilled to announce the first workshop on Technical AI Governance (TAIG) at #ICML2025 this July in Vancouver! Join us (& this stellar list of speakers) in bringing together technical & policy experts to shape the future of AI governance! www.taig-icml.com

AI systems present an opportunity to reflect society's biases. “However, realizing this potential requires careful attention to both technical and social considerations,” says HAI Faculty Affiliate @sanmikoyejo.bsky.social in his latest op-ed via @theguardian.com: www.theguardian.com/commentisfre...

Very excited we were able to get this collaboration working -- congrats and big thanks to the co-authors! @rajiinio.bsky.social @hannawallach.bsky.social @mmitchell.bsky.social @angelinawang.bsky.social Olawale Salaudeen, Rishi Bommasani @sanmikoyejo.bsky.social @williamis.bsky.social

3) Institutions and norms are necessary for a long-lasting, rigorous and trusted evaluation regime. In the long run, nobody trusts actors correcting their own homework. Establishing an ecosystem that accounts for expertise and balances incentives is a key marker of robust evaluation in other fields.

which challenged concepts of what temperature is and in turn motivated the development of new thermometers. A similar virtuous cycle is needed to refine AI evaluation concepts and measurement methods.

2) Metrics and evaluation methods need to be refined over time. This iteration is key to any science. Take the example of measuring temperature: it went through many iterations of building new measurement approaches,

Just like the “crashworthiness” of a car indicates aspects of safety in case of an accident, AI evaluation metrics need to link to real-world outcomes.

We identify three key lessons in particular. 1) Meaningful metrics: evaluation metrics must connect to AI system behaviour or impact that is of relevance in the real-world. They can be abstract or simplified -- but they need to correspond to real-world performance or outcomes in a meaningful way.

We pull out key lessons from other fields, such as aerospace, food security, and pharmaceuticals, that have matured from being research disciplines to becoming industries with widely used and trusted products. AI research is going through a similar maturation -- but AI evaluation needs to catch up.

Excited about this work framing out responsible governance for generative AI!

@koloskova.bsky.social is awesome, and you should apply to work with her if you can! Also, Congrats!

📚 Incredible student projects from the 2024 Fall quarter's Machine Learning from Human Preferences course web.stanford.edu/class/cs329h/. Our students tackled some fascinating challenges at the intersection of AI alignment and human values. Selected project details follow... 1/n

As one of the vice chairs of the EU GPAI Code of Practice process, I co-wrote the second draft which just went online – feedback is open until mid-January, please let me know your thoughts, especially on the internal governance section! digital-strategy.ec.europa.eu/en/library/s...

What happens when "If at first you don't succeed, try again?" meets modern ML/AI insights about scaling up? You jailbreak every model on the market😱😱😱 Fire work led by @jplhughes.bsky.social Sara Price @aengusl.bsky.social Mrinank Sharma Ethan Perez arxiv.org/abs/2412.03556

New paper on why machine "unlearning" is much harder than it seems is now up on arXiv: arxiv.org/abs/2412.06966 This was a huuuuuge cross-disciplinary effort led by @msftresearch.bsky.social FATE postdoc @grumpy-frog.bsky.social!!!

📆 AFME workshop: Sat, Dec 14 in room 111-112 Join our expert panellists* for a timely discussion on “Rethinking fairness in the era of large language models”!! * @jessicaschrouff.bsky.social, @sethlazar.org, Sanmi Koyejo, Hoda Heidari

Check out our new paper on privacy preserving style and content transfer 👇 arxiv.org/abs/2411.14639 Led by @poonpura.bsky.social , who is applying for PhD programs this year 🚀 w/ @poonpura.bsky.social , Wei-Ning Chen, Sanmi Koyejo, Albert No

For details, check out our paper (feedback appreciated!): 📄: arxiv.org/abs/2411.14639 🙌: big thank you to my collaborators and mentors Wei-Ning Chen, @berivanisik.bsky.social, Sanmi Koyejo, Albert No 🧵 16/16

Speaking at Stanford CS329h today, grateful to Professor Sanmi Koyejo of the CS school for having me. It's an honor to be among other guest speakers from MIT and Meta. web.stanford.edu/class/cs329h/

A collaboration led by Aidan Peppin with Anka Reuel, Stephen Casper, Elliot Jones, Andrew Strait, Usman Anwar, Anurag Agrawal, Sayash Kapoor, Sanmi Koyejo, Marie Pellat, Rishi Bommasani and Nick Frosst. 🔥 Learn more about the work here: arxiv.org/abs/2412.01946

Professor Sanmi Koyejo and Dr Angelina Wang will present a new fairness metric for measuring discrimination in LLMs

So cool to host you, and thanks for the insightful lecture!