hey, @mrblackfrancis.bsky.social can you help me out?

🎉 Excited to share a new agent evaluation perspective with our newly accepted #SIGIR2026 paper: "Evaluation of Agents under Simulated AI Marketplace Dynamics." arxiv.org/abs/2604.14256 @acmsigir.bsky.social

Announcing the release of the NTCIR Tip-of-the-Tongue (ToT) Shared Task participation guidelines: ntcir-tot.github.io/guidelines. Please reshare and spread the word. #NTCIR2026 #NTCIRToT #NTCIR2026ToT /1

Heres the link on Apple Podcasts and yes there is a transcript for access! podcasts.apple.com/us/podcast/i...

"Diagram of the art-making process showing the four main phases, feedback loops, and moderating variables." Mary-Anne Mace & Tony Ward (2002) Modeling the Creative Process: A Grounded Theory Analysis of Creativity in the Domain of Art Making, Creativity Research Journal, 14:2, 179-192.

“Every aspect of filmmaking requires choice. The selection of the subject, the shooting, editing and length are all aspects of choice.” RIP Fred Wiseman

“back to school” but rodney dangerfield uses wealth to pay for claude max

🎭 How do LLMs (mis)represent culture? 🧮 How often? 🧠 Misrepresentations = missing knowledge? spoiler: NO! At #CHI2026 we are bringing ✨TALES✨ a participatory evaluation of cultural (mis)reps & knowledge in multilingual LLM-stories for India 📜 arxiv.org/abs/2511.21322 1/10

Allen Newell and Herbert A. Simon. Human problem solving. Prentice-Hall, Inc., 1972.

Microsoft Research NYC is hiring a researcher in the space of AI and society!

Applications for graduate students in computing, sociology, humanities willing to participate in the FAccT 2026 Doctoral Colloquium are open! https://facctconference.org/2026/callfordc.html

what’s surprising here is less that these papers were written or accepted with fabricated citations, but that it’s a symptom that actually reading, understanding, and analyzing literature has deteriorated for both authors and reviews.

as AI increasingly supports shopping and ads, it’s worth remembering that retrieval often shapes who gets exposure in final generated output. in a recent paper, @teknology.bsky.social uses methods from fair ranking to assess and address exposure bias in downstream generation. 841.io/doc/fairrag....

PhD and Postdoc positions drop! The Research Council of Norway funded MishMash Centre for AI & Creativity has announced 18 doctoral and 6 postdoc positions in arts and/or science. I’m a member of the Scientific Advisory Board and so pleased to see this happening. mishmash.no/news/positio...

I am hiring a PhD student at the Max Planck Institute for Security and Privacy. Topics of interest: (i) AI governance/regulation through computational and socio-technical lens, (ii) computational and socio-technical approaches to digital well-being. More information & how to apply:

We are looking for advanced PhD student interns! Spend 12 weeks scratching a research itch in our Cambridge Massachusetts lab. Closes January 17. apply.careers.microsoft.com/careers/job/...

The influence of domain knowledge is huge when it comes to applied AI. Domain expertise can prevent overengineering and/or unnecessary costs. Working in the legal industry as an AI scientist it became obvious early on how crucial it is to build the bridge towards domain experts. Every day.

📣 It's again that time of the year 🤩 - our internship call for the FATE team @ MSR Montreal and our collaborators is now up! 🎉🎉 We are broadly looking for candidates interested in perceptions, evaluation, uses, and impacts of AI! #FAccT #FAccT2025 #CHI2025 #NeurIPS2025 #ACL2025

Want to be an intern at Microsoft Research in the Computational Social Science group in NYC (Jake Hofman, David Rothschild, Dan Goldstein) Follow this link and do your thing! Deadline approaching soonish! apply.careers.microsoft.com/careers/job/...

if you work on "AI" and are concerned with social issues, you should apply to be the new director of the Tufts AI Institute: apply.interfolio.com/178311 (Need to be tenureable in one of our engineering departments, but it's explicitly open to people who work on human-oriented stuff.)

On my way to @neuripsconf.bsky.social -- this is my first time at #NeurIPS and looking forward to seeing folks and presenting our paper on Rigor in AI. Do find me if you want to chat about rigor in AI, anthropomorphic AI, or evaluations #NeurIPS2025

a light thread on what we mean by "user engagement". 🧵 1/26

🎉students interested in evaluation!🎉

Did everyone else already know about "fluid bear painting"? Is this trend a hoax?

Philip K. Dick, "The Penultimate Truth", Belmont Books, 1964.

Rikiya Takehi, Fernando Diaz, Tetsuya Sakai Diversification as Risk Minimization https://arxiv.org/abs/2510.22681

📢 Announcing the First Workshop on Multilingual and Multicultural Evaluation (MME) at #EACL2026 🇲🇦 MME focuses on resources, metrics & methodologies for evaluating multilingual systems! multilingual-multicultural-evaluation.github.io 📅 Workshop Mar 24–29, 2026 🗓️ Submit by Dec 19, 2025

We’re excited to release the Call for Papers for #FAccT2026 which will be held in Montreal, Canada in June 2026! Abstracts are due on January 8th, papers due on January 13th. Call for Papers: facctconference.org/2026/cfp Important info in thread →

AI is evolving too quickly for an annual report to suffice. To help policymakers keep pace, we're introducing the first Key Update to the International AI Safety Report. 🧵⬇️ (1/10)

I am on the job market this year! My research advances methods for reliable machine learning from real-world data, with a focus on healthcare. Happy to chat if this is of interest to you or your department/team.

Renee Shelby, Fernando Diaz, Vinodkumar Prabhakaran: Taxonomy of User Needs and Actions https://arxiv.org/abs/2510.06124 https://arxiv.org/pdf/2510.06124 https://arxiv.org/html/2510.06124

MSR NYC is hiring spring and summer interns in AI/ML/RL! Apply here: jobs.careers.microsoft.com/global/en/jo...

In January, Asia Biega (MPI), Georgina Born (UCL), Mary Gray (MSR), Rida Qadri (G), and I ran a Dagstuhl Seminar bringing together folks from CS and the broader social sciences to discuss questions around AI and culture. Dagstuhl has just posted our report, 1/3 drops.dagstuhl.de/storage/04da...

This was accepted to #NeurIPS 🎉🎊 TL;DR Impoverished notions of rigor can have a formative impact on AI work. We argue for a broader conception of what rigorous work should entail & go beyond methodological issues to include epistemic, normative, conceptual, reporting & interpretative considerations

I'm noticing that some conversational AI interfaces are pausing text generation (or at least rendering) until the user scrolls. A thread on attention modeling. 👀 🧵 1/10

🚨Microsoft Research NYC is hiring🚨 We're hiring postdocs and senior researchers in AI/ML broadly, and in specific areas like test-time scaling and science of DL. Postdoc applications due Oct 22, 2025. Senior researcher applications considered on a rolling basis. Links to apply: aka.ms/msrnyc-jobs

Giuliano, V.E. and P. E. Jones, "Linear Associative Information Retrieval", Rept. no. CACL-2, Arthur D. Little, Inc., Cambridge, Mass., Nov 1962, 240 p. Also in P. W. Howerton and D. C . Weeks [eds ]. "Vistas in Information Handling", 1963, p. 30-54.

junior faculty in STSy positions, check out the CIFAR global scholars call: cifar.ca/next-generat... I'm on the "Future Flourishing Program," and it's a nice community (and a good bit of money as well).

My university has announced a fund to essentially poach doctoral students from US institutions. DM me if you do work on the history/social impacts of AI and are interested in being poached 😂

To Eun Kim just presented the work on "Tip of the Tongue Query Elicitation for Simulated Evaluation" at #SIGIR2025. The approach will be used in the #TREC2025 Tip-of-the-Tongue track, and we had some sweets at the poster :) The paper is available online: dl.acm.org/doi/10.1145/...

Lukas Gienapp presents "The Viability of Crowdsourcing for RAG Evaluation" at #SIGIR2025 The paper is available at: webis.de/publications...

Hello TREC-ToTers! We have released the test queries for the TREC 2025 Tip-of-the-Tongue (TREC-ToT) Track. Please see the guidelines for more information: trec-tot.github.io/guidelines. Run submission deadline will tentatively be in August. #TREC2025 #TRECToT #TREC2025ToT Please spread the word!

I've always felt that Montréal is a safe space for research -- it’s a city that values science, collaboration, and diversity, and I’m proud to call it home 🏠 Like I said in the video: Montréal is home—and all are welcome.💖🦋 youtu.be/dWiL4b7-KEA

We're happy to officially announce the location of #FAccT2026! Next year's conference will be held in Montreal, Canada 🇨🇦 Su Lin Blodgett and Zeerak Talat will be General Chairs, and Michael Madaio will be PC Chair 🎉 (thanks to MindView for the photo!)

p epic conclusion in the og description of the sign test. John Arbuthnot. An argument for divine providence, taken from the constant regularity observ'd in the births of both sexes. Philosophical Transactions of the Royal Society of London, 27(328):186-190, 1710.

There is a lot of talk and effort to figure out how genAI is different (I am also guilty of this!) -- the reality is that genAI is not that different and genAI is not that new either; it was hard to evaluate in the past, and it is still as hard to evaluate now #facct2025

We have to talk about rigor in AI work and what it should entail. The reality is that impoverished notions of rigor do not only lead to some one-off undesirable outcomes but can have a deeply formative impact on the scientific integrity and quality of both AI research and practice 1/

When it comes to text prediction, where does one LM outperform another? If you've ever worked on LM evals, you know this question is a lot more complex than it seems. In our new #acl2025 paper, we developed a method to find fine-grained differences between LMs: 🧵1/9

🖋️ Curious how writing differs across (research) cultures? 🚩 Tired of “cultural” evals that don't consult people? We engaged with interdisciplinary researchers to identify & measure ✨cultural norms✨in scientific writing, and show that❗LLMs flatten them❗ 📜 arxiv.org/abs/2506.00784 [1/11]