We are studying the sentiments of visual artists towards generative AI in the workplace and their impacts on creative careers. If you're an artist, please consider filling out this recruitment form for access to our survey! cmu.ca1.qualtrics.com/jfe/form/SV_...

Most LLM evals use API calls or offline inference, testing models in a memory-less silo. Our new Patterns paper shows this misses how LLMs actually behave in real user interfaces, where personalization and interaction history shape responses: arxiv.org/abs/2509.19364

US CAISI is hiring -- the internal govt name for the role is "IT Specialist" but it is effectively a research scientist role! Salary is $120,579 to - $195,200 per year, and you get to work on AI evaluation within government agencies! Job posting (**closes EOD 12/28/2025**): lnkd.in/exJgkqr5

Also, our team is hiring an AI Research Scientist! www.usajobs.gov/job/851528400

Our team at NIST's Center for AI Standards and Innovation (CAISI) just released a blog post with open questions for AI measurement science: www.nist.gov/blogs/caisi-...

Did you know that one base model is responsible for 94% of model-tagged NSFW AI videos on CivitAI? This new paper studies how a small number of models power the non-consensual AI video deepfake ecosystem and why their developers could have predicted and mitigated this.

I appreciate this sympathetic position people's feelings of emotional dependency on these "human-like" bots is real. ridiculing them doesn't help anyone

Can public involvement in AI evaluation improve the science? Or does it compromise quality, speed, cost? In @pnas.org, Megan Price & I summarize challenges of AI evaluation, review strengths/weaknesses, & suggest how participatory methods can improve the science of AI www.pnas.org/doi/10.1073/...

Can LLMs accurately aggregate information over long, information-dense texts? Not yet… We introduce Oolong, a dataset of simple-to-verify information aggregation questions over long inputs. No model achieves >50% accuracy at 128K on Oolong!

📣 Our method for conducting community-based algorithmic impact assessments is now available! We’ve just launched a new section on our website where you can find an extensive toolkit, documentation of our pilots, and a series of reflections on lessons learned. datasociety.net/research/alg...

𝐒𝐨𝐜𝐢𝐞𝐭𝐚𝐥 𝐈𝐦𝐩𝐚𝐜𝐭 𝐀𝐬𝐬𝐞𝐬𝐬𝐦𝐞𝐧𝐭 𝐟𝐨𝐫 𝐈𝐧𝐝𝐮𝐬𝐭𝐫𝐲 𝐂𝐨𝐦𝐩𝐮𝐭𝐢𝐧𝐠 𝐑𝐞𝐬𝐞𝐚𝐫𝐜𝐡𝐞𝐫𝐬 🏅 Best Paper Honorable Mention (Top 3% Submissions) 🔗 dl.acm.org/doi/10.1145/... 📆 Wed, 22 Oct | 9:00 AM, CET: Toward More Ethical and Transparent Systems and Environments

💡Can we trust synthetic data for statistical inference? We show that synthetic data (e.g., LLM simulations) can significantly improve the performance of inference tasks. The key intuition lies in the interactions between the moment residuals of synthetic data and those of real data

Our Responsible AI team at Apple is looking for spring/summer 2026 PhD research interns! Please apply at jobs.apple.com/en-us/detail... and email [email protected]. Do not send extra info (e.g., CV), just drop us a line so we can find your application in the central pool!

✨I’m on the academic job market ✨ I’m a PhD candidate at @hcii.cmu.edu studying tech, labor, and resistance 👩🏻‍💻💪🏽💥 I research how workers and communities contest harmful sociotechnical systems and shape alternative futures through everyday resistance and collective action More info: cella.io

🌟 If you’re applying to CMU SCS PhD programs, and come from a background that would bring additional dimensions to the CMU community, our PhD students are here to help! Apply to the Graduate Applicant Support Program by Oct 13 to receive feedback on your application materials:

📌📌📌 I'm excited to be on the faculty job market this fall. I just updated my website with my CV. stephencasper.com

📢2026 Fellowship applications are OPEN!📢 If you are someone looking to inform technology policy through rigorous original reporting or policy analyses, we want to hear from you! Apply here: airtable.com/appIrc1F9M5d...

What can #CSCW learn from tech workers who have been involved in collective action and unionization about how to make transformative change within our field? My new #CSCW2025 paper with Mona Wang, Anna Konvicka, and Sarah Fox seeks to answer this question. Pre-print: arxiv.org/pdf/2508.12579

The exchanges between Adam and ChatGPT are devastating. This, in my mind, is the worst one. One of his last messages was a photo of the noose hung in his bedroom closet, asking if it was "good." ChatGPT offered a technical analysis of the set up and told him it 'could potentially suspend a human."

Adam Raine, 16, died from suicide in April after months on ChatGPT discussing plans to end his life. His parents have filed the first known case against OpenAI for wrongful death. Overwhelming at times to work on this story, but here it is. My latest on AI chatbots: www.nytimes.com/2025/08/26/t...

A cognitively impaired New Jersey man grew infatuated with a Meta chatbot originally created in partnership with celebrity influencer Kendall Jenner. His fatal attraction shines a light on Meta's guidelines for its AI chatbots reut.rs/45DQIRj @jeffhorwitz.bsky.social

🧵 New paper from UK AISI x @eleutherai.bsky.social rai.bsky.social‬ that I led with @kyletokens.bsky.social y.social���: Open-weight LLM safety is both important & neglected. But filtering dual-use knowledge from pre-training data improves tamper resistance *>10x* over post-training baselines.

* STS folks! * CMU is hiring up to 2 tenure track faculty focused on: the intersection of tech & social change, the environmental and social impacts of science, tech, and medicine. They will be housed in History, a department of both historians and anthropologists. apply.interfolio.com/170040

One of the largest text-image datasets is full of PII, including credit card numbers and birth certificates. Excellent writeup by @eileenguo.bsky.social www.technologyreview.com/2025/07/18/1... Read our full audit and legal analysis arxiv.org/pdf/2506.17185

If you're at @icmlconf.bsky.social this week, come check out our poster on "Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge" presented by the amazing @afedercooper.bsky.social from 11:30am--1:30pm PDT on Weds!!! icml.cc/virtual/2025...

🏦 Legacy Procurement Practices Shape How U.S. Cities Govern AI: Understanding Government Employees’ Practices, Challenges, and Needs by @narijohnson.bsky.social et al. explores procurement in the context of recent calls for governments to use their "purchasing power" to incentivize responsible AI.

I did an interview w/ Pittsburgh's NPR station to share some of my views on the topic of the McCormick/Trump AI & Energy summit at CMU tomorrow. Despite being hosted at the university, there will not be opportunities for our university experts to contribute viewpoints at the event.

New article out today, covering our past two years of research asking US cities how they govern AI ✨ The future of AI governance in public services is being shaped right now, through public procurement

In the absence of federal regulation of AI vendors, procurement remains one of the few levers governments have to push for public values, such as safety, non-discrimination, privacy, and accountability, Nari Johnson, Elise Silva, and Hoda Heidari write.

FAccT Day 4 word of the day was impasse. As a field, AI ethics is at a critical moment in which our "big tent" and pluralistic research directions can either complement or cancel each other out. Molly Crockett gave an amazing final keynote calling out genAI-human performance research.

I am so excited to be in 🇬🇷Athens🇬🇷 to present "A Framework for Auditing Chatbots for Dialect-Based Quality-of-Service Harms" by me, @kizilcec.bsky.social, and @allisonkoe.bsky.social, at #FAccT2025!! 🔗: arxiv.org/pdf/2506.04419

🏆 Announcing the #FAccT2025 best paper awards! 🏆 Congratulations to all the authors of the three best papers and three honorable mention papers. Be sure to check out their presentations at the conference next week! facct-blog.github.io/2025-06-20/b...

How can ethical principles translate to the massive data used to train foundation models, like generative AI? Our #CSCW2025 workshop aims to explore how best to define the future of ethical responsibility in large-scale datasets for foundation model training. Apply here: tinyurl.com/CSCW-data

📣 "Understanding and Meeting Practitioner Needs When Measuring Representational Harms Caused by LLM-Based Systems" is forthcoming at #ACL2025NLP - and you can read it now on arXiv! 🔗: arxiv.org/pdf/2506.04482 🧵: ⬇️

🖋️ Curious how writing differs across (research) cultures? 🚩 Tired of “cultural” evals that don't consult people? We engaged with interdisciplinary researchers to identify & measure ✨cultural norms✨in scientific writing, and show that❗LLMs flatten them❗ 📜 arxiv.org/abs/2506.00784 [1/11]

A lot of people say generative AI shouldn't infringe on copyright. These researchers actually tried to do it. The result: an 8 terabyte dataset of text that's openly licensed or in the public domain & 7 B parameter model that performs as well as Meta's Llama 7B www.washingtonpost.com/politics/202...

In @techpolicypress.bsky.social, I explain why using AI to reform government is much harder than policymakers and technologists assume. It's most directly about DOGE, but also raises warnings about the bipartisan push to adopt AI at all levels of government. www.techpolicy.press/using-ai-to-...

There's a lot of chatter around the proposal being inserted into a budget bill that would put a moratorium on any AI legislation being passed by the states for the next 10 years. I thought I'd say a bit about why this is an absolutely disastrous move. www.404media.co/republicans-... 1/n

🏳️‍🌈🎨💻📢 Happy to share our workshop study on queer artists’ experiences critically engaging with GenAI Looking forward to presenting this work at #FAccT2025 and you can read a pre-print here: arxiv.org/abs/2503.09805

Q: What do school buses, desktop computers, and AI have in common? A: The same decades-old laws and processes apply when governments go to purchase them. Our new #FAccT2025 paper examines how these legacy public procurement norms apply to AI. 🧵

The AI jobs crisis is not coming—it's here right now. It just might not look the way many thought it would. www.bloodinthemachine.com/p/the-ai-job...

Excited to present "Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling" at #CHI2025 tomorrow(today)! 🗓 Tue, 29 Apr | 9:48–10:00 AM JST (Mon, 28 Apr | 8:48–9:00 PM ET) 📍 G401 (Pacifico North 4F) 📄 dl.acm.org/doi/10.1145/...

Today I would like to share a journey that started 18 months ago, and while it is still ongoing, I'd like to celebrate the team's achievement of successfully having our work accepted to #FAccT2025! 🎉 🔗 arxiv.org/pdf/2406.09496

A syllabus for a course on machine learning evaluation.

Last month, a group of 200+ researchers signed a letter “Affirming the Scientific Consensus on Bias and Discrimination in AI.” It comes at a time when the Trump admin is rolling back AI policies and threatening research. Justin Hendrix spoke to three of the letter's signatories.

🎉 Participants Needed for Paid Research! Do you use chatbots (e.g. ChatGPT) for mental health? @datasociety.bsky.social is studying how people use them for support. Details: ✔️ 4-week diary study ✔️ Optional 1-hr focus group ✔️ 45-min interview 💰 Earn up tp to $400 Learn more/sign up: bit.ly/4iCLkTd

I'm looking for examples of NLP/ML papers that include interview studies with small sample sizes. Any ideas? I know of these two papers: ↳

NEW Blog Post! Check out how CITP researchers are making real-world impact on the side of workers. Read "Revolutionizing Rideshare: Researchers Develop FairFare App to Empower Workers" 🔻 🙌 @andresmh.com @samanthadalal.bsky.social @dana.witchy.business blog.citp.princeton.edu/2025/03/25/r...

OpenAI's move to allow generating "Ghibly stlye" images isn't just a cute PR stunt. It is an expression of dominance and the will to reject and refuse democratic values. It is a vulgar display of power. https://tante.cc/2025/03/28/vulgar-display-of-power/

I helped build a government AI system. DOGE fired me, rolled the AI out to the whole agency, and implied the AI can do my job and the jobs of the others they've fired. It can't. But, what DOGE accidentally revealed about themselves in the process is fascinating. 🧵