Ryan Steed
@rbsteed.com
📤 533
📥 150
📝 6
AI Policy Fellow @ Princeton | PhD Carnegie Mellon | privacy, accountability, & algorithmic systems
pinned post!
Our team at NIST's Center for AI Standards and Innovation (CAISI) just released a blog post with open questions for AI measurement science:
www.nist.gov/blogs/caisi-...
loading . . .
Accelerating AI Innovation Through Measurement Science
Building gold-standard AI systems requires gold-standard AI measurement science – the scientific study of methods used to assess AI systems’ properties and impacts. NIST works to improve measurements ...
https://www.nist.gov/blogs/caisi-research-blog/accelerating-ai-innovation-through-measurement-science
3 days ago
1
1
1
Our team at NIST's Center for AI Standards and Innovation (CAISI) just released a blog post with open questions for AI measurement science:
www.nist.gov/blogs/caisi-...
loading . . .
Accelerating AI Innovation Through Measurement Science
Building gold-standard AI systems requires gold-standard AI measurement science – the scientific study of methods used to assess AI systems’ properties and impacts. NIST works to improve measurements ...
https://www.nist.gov/blogs/caisi-research-blog/accelerating-ai-innovation-through-measurement-science
3 days ago
1
1
1
reposted by
Ryan Steed
Deb Raji
3 days ago
US CAISI (the equivalent of the US "AI Safety Institute") just put out their approach to AI measurement & there's such a significant portion on construct validity (
nist.gov/blogs/caisi-...
). Great to see this after ongoing advocating about this issue (
arxiv.org/abs/2511.04703
)!
1
18
5
reposted by
Ryan Steed
Emma Harvey
5 months ago
After having such a great time at
#CHI2025
and
#FAccT2025
, I wanted to share some of my favorite recent papers here! I'll aim to post new ones throughout the summer and will tag all the authors I can find on Bsky. Please feel welcome to chime in with thoughts / paper recs / etc.!! 🧵⬇️:
2
55
12
reposted by
Ryan Steed
Nari Johnson
7 months ago
Q: What do school buses, desktop computers, and AI have in common? A: The same decades-old laws and processes apply when governments go to purchase them. Our new
#FAccT2025
paper examines how these legacy public procurement norms apply to AI. 🧵
2
8
2
reposted by
Ryan Steed
Victor Ojewale
7 months ago
Excited to present "Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling" at
#CHI2025
tomorrow(today)! 🗓 Tue, 29 Apr | 9:48–10:00 AM JST (Mon, 28 Apr | 8:48–9:00 PM ET) 📍 G401 (Pacifico North 4F) 📄
dl.acm.org/doi/10.1145/...
2
22
10
reposted by
Ryan Steed
Deb Raji
8 months ago
Our lecture topic in our ML eval class today. ✨ Evals have always played an important socio technical role in policy decision-making and surprisingly little changes when you add "AI" to the mix
add a skeleton here at some point
0
11
2
reposted by
Ryan Steed
Garrett Johnson
9 months ago
Great webinar featuring Alessandro Acquisti on "The Economics of Privacy at a Crossroads." Alessandro has such a wide view of the privacy literature: both its history and inside & outside of economics.
www.youtube.com/watch?v=ecc9...
loading . . .
The Economics of Privacy at a Crossroads | Luohan Webinar
YouTube video by Luohan Academy
https://www.youtube.com/watch?v=ecc97Md4yj4
0
8
2
TIL Minecraft has responsible AI lessons for kids
education.minecraft.net//content/dam...
loading . . .
https://education.minecraft.net//content/dam/education-edition/learning-experiences/cybersafe-ai-dig-deeper/CyberSafe%20AI%20Dig%20Deeper%20EDU%20Guide_Final.pdf
9 months ago
0
0
0
reposted by
Ryan Steed
Dr Abeba Birhane
10 months ago
I was in Paris last week for the
#AIActionSummit
& was honoured to participate in the “AI in public interest” panel. 👇🏾 my thoughts & reflections on what AI in public interest is/isn’t & some concrete steps/initiatives for `bending the arc of AI towards the public interest'
aial.ie/pages/aiparis/
loading . . .
Bending the arc of AI towards the public interest
By Abeba Birhane, 18/02/2025 Following the first in Bletchley Park in 2023 and the second in Seoul in 2024, the third AI Action Summit took place in February 2025 in Paris. In the context of previous ...
https://aial.ie/pages/aiparis/
9
218
98
reposted by
Ryan Steed
Todd Feathers
10 months ago
When Toledo police rolled out their Fusus system, allowing officers to tap into the live feeds of privately owned cameras, they promised to only use the power in emergency situations. We obtained data that tells a very different story about when, and who, TPD watches.
gizmodo.com/clearly-disc...
loading . . .
‘Clearly Discrimination’: How a City Uses Fusus to Spy on Its Poorest Residents
Fusus’s technology allows police to tap into live feeds from public and privately owned surveillance cameras. In Toledo, Ohio, cops use the power to watch one particular type of location.
https://gizmodo.com/clearly-discrimination-how-a-city-uses-fusus-to-spy-on-its-poorest-residents-2000561795#comments
3
42
32
reposted by
Ryan Steed
Karen Hao
10 months ago
As someone who has reported on AI for 7 years and covered China tech as well, I think the biggest lesson to be drawn from DeepSeek is the huge cracks it illustrates with the current dominant paradigm of AI development. A long thread. 1/
211
6181
3097
reposted by
Ryan Steed
Ryan Calo
11 months ago
How often does the FTC base its enforcement proceedings on third party research? Often!
ftcreverse.engineering
loading . . .
FTC RE
https://ftcreverse.engineering/
1
11
2
reposted by
Ryan Steed
Dr Abeba Birhane
12 months ago
oh, this is out and they make me sound like an angel but a really good read “We are not evaluating systems for some hypothetical, potential risks in the future,” Birhane says
www.fastcompany.com/91238006/how...
loading . . .
How Abeba Birhane is cleaning up AI’s dirty data
“We are not evaluating systems for some hypothetical, potential risks in the future. These audits are uncovering actual real issues, real problems, whether it's racism, sexism, or encoding of stereoty...
https://www.fastcompany.com/91238006/how-abeba-birhane-is-cleaning-up-ais-dirty-data
7
177
61
reposted by
Ryan Steed
Ken Holstein
12 months ago
Come work with
@jessicahullman.bsky.social
and I as a postdoc! We'll apply approaches from HCI, AI/ML, statistics, and decision theory to design new tools & methods for evaluating human-AI decision-making (e.g., tools to elicit, represent, & validate specifications of real-world decision problems).
add a skeleton here at some point
1
18
3
reposted by
Ryan Steed
Ben Winters
about 1 year ago
tough morning for data brokers, great morning for people in addition to the CFPB FCRA rule (
bsky.app/profile/benw...
), the FTC announced a case against one who sold location data of visits to healthcare and places of worship, securing a ban on sale of this type of data
www.ftc.gov/news-events/...
add a skeleton here at some point
0
4
3
reposted by
Ryan Steed
Hypervisible
about 1 year ago
The proposed consent order with IntelliVision Technologies would prevent the company “from making misleading claims about its software. That would include any misleading statements about its performance identifying people of different genders, ethnicities, and skin tones.”
loading . . .
The FTC is cracking down on a firm that claims its AI-powered face recognition tech has 'zero' bias
A software provider won’t be allowed to lie about the accuracy of its artificial intelligence-powered facial recognition technology under a new proposed order from the Biden administration.
https://www.yahoo.com/tech/ftc-cracking-down-firm-claims-173206637.html
2
33
11
Something (someone) to be thankful for today — very excited to see this!!
add a skeleton here at some point
about 1 year ago
1
14
1
reposted by
Ryan Steed
Dr Abeba Birhane
about 1 year ago
Friends, this week marks a monumental step forward in my path towards pushing for a greater ecology of accountability in the age of AI. Thrilled to officially announce the AI Accountability Lab (AIAL)
@theaial.bsky.social
at Trinity College Dublin is launching today, Thursday Nov 28, 2024
aial.ie
loading . . .
AI Accountability Lab
Stewarding a greater ecology of accountability in the age of AI
https://aial.ie/
92
1259
346
reposted by
Ryan Steed
Leon Yin
about 1 year ago
Professors and researchers: are you booking speakers for the Spring semester? I have talks and workshops on data-driven investigations using crowdsourcing with WhatsApp, auditing black box AI systems and advanced web scraping.
inspectelement.org/apis.html
gist.github.com/yinleon/4e39...
loading . . .
Finding Undocumented APIs
Introduction, case studies, and exercises for finding and using undocumented APIs hidden in plain sight.
https://inspectelement.org/apis.html
1
22
11
reposted by
Ryan Steed
Jessica Hullman
about 1 year ago
Differential privacy is a SOTA approach for protecting individual privacy in data releases. But how it interacts w/common expectations & workflows can be hard to judge. New article for policy-makers w/P. Nanayakkara summarizes some gaps between theory & practice
journals.sagepub.com/doi/abs/10.1...
loading . . .
Sage Journals: Discover world-class research
Subscription and open access journals from Sage, the world's leading independent academic publisher.
https://journals.sagepub.com/doi/abs/10.1177/23727322241278687
2
22
7
you reached the end!!
feeds!
log in