We have a call for posters out! Please submit your extended abstracts, it should be quick and easy. And just like last year, provocative work is especially encouraged as it makes for such interesting conversation 😈

This. Copyright is a tool for protection but it’s not everything. In fact, there’s research showing that it is possible to create competitive language models using public domain data only. The proliferation of copyright respecting models would not solve the labor impact policy problem.

Going to San Diego for Neurips? We at @eval-eval.bsky.social , along with the UK AISI, are hosting a closed door state of evals workshop at @ucsandiego.bsky.social on Dec 8th. Request to join below! :) evaleval.github.io/events/works...

Datasets are the backbone of AI for Science, and we want to support scientific data natively on Hugging Face. The amazing @lhoestq.hf.co started a discussion on GH for this! Please engage (better still, submit a PR) so we can start supporting your 🫵 dataset: github.com/huggingface/...

Random off the cuff observation about American AI: LLM folks seem to be concentrated in SF, but AI4Science folks seem to be concentrated in Boston. Meaning as the former gets oversaturated and the latter is only getting started, I expect Boston to be the next big AI epicenter! 💪

🌟 Weekly AI Evaluation Spotlight 🌟 🤖 Did you know malicious actors can exploit trust in AI leaderboards to promote poisoned models in the community? This week's paper 📜"Exploiting Leaderboards for Large-Scale Distribution of Malicious Models" by @iamgroot42.bsky.social explores this!

+1000. I miss life pre-AI hype when the discourse around AI was more scientific and people used to attribute papers and opinions to scientists instead of to their companies. Not all orgs block research papers and sanity check their papers via legal teams, and HF, especially so, is very distributed.

Hey, so can someone tell me why ChatGPT generating erotica is bad, any more so than it generating anything else? Obviously anything non-consensual or age-inappropriate is bad, but I don't see why some researchers in my timeline are up in arms about it, while Grok already does this.

We're starting a weekly paper spotlight series! Come engage with the posts and let's improve evals together! :) First up: Do Large Language Model Benchmarks Test Reliability?

I had never seen people fighting with co-authors via colored latex comments on overleaf in a developing paper draft until today. One of them even pasted a google calendar link saying "can we hop on a call and hash this out". Paper writing is actually exciting sometimes!

Trying to start a new hobby and the internet is useless. Maybe AI will finally kill unstructured information retrieval for good and then we will be forced to call or visit friends for help again

More of such research please! Chatbots are not the future of science, science is

Some of these new gpt/claude wrapper startups make me wonder how much the founders are paying themselves in salary because there is no way they expect their horrible idea to actually be sustainably profitable

AI for scientific discovery is a social problem: In our new position paper, @cgeorgiaw.bsky.social and I show that culture, incentives, and coordination are the main obstacles to progress, and we are launching the Hugging Science Initiative to address this!

At a panel a couple of weeks ago I exclaimed in despair: “who decided that the only mode of interacting with AI is via chatbots?” And this trend is relentless still. www.theverge.com/news/787076/...

Wife brought her 100 year old film camera to that pirates game from a few weeks ago and she got this shot that's just perfect

So fascinating (not really) to me that company execs and tier 1 AI conferences have gone in completely opposite directions as it relates to AI usage. Surely the best minds actually developing AI models know something about overreliance, productivity, and quality? Surely?

This phenomenon needs a nice catchy name because every research paper (including my own) that refers to it uses as many words but it’s an insidious problem

I’m back at my alma mater today to talk about personal anecdotes of how I have experienced AI, how those experiences fueled my research, and the kind of questions that still remain. Looking forward to it! 🤗 www.eventbrite.com/e/personal-a...

I’m just going to play that South Park episode on a loop at people now. It was so spot on

This continues to be a recurring theme -_- Why is consumer agency so scary to the market? Noticed the same trend when I worked at Twitter: the personalization team cared for engagement metrics way more than actually showing users what they wanted to follow: “people don’t know what they like”

🤖 As AI-generated content is shared in movies/TV/across the web, there's one simple low-hanging fruit 🍇 to help know what's real: Visible watermarks. With others @hf.co, I've made sure it's trivially easy to add this disclosure to images, video, chatbot text. See how: huggingface.co/blog/waterma...

I wish there was a way for arxiv to take me to the abstract page by default instead of the html page 😬 it is strictly worse

I adore the public library. I just put 15 picture books on hold for my kiddo, on trains (current obsession) and beaches (first visit soon). We'll pick them up after they're all gathered at our branch. This is free! You all know this, I just feel the need to say it out loud occasionally.

It's interesting to think that the visual depiction of the word "AI" is still strongly coupled to humanoid robots even as the most popular applications of what we currently think of AI are not that. Terminology overloading over time is fascinating to live through.

The Kant Car

Research posts on Bluesky are more original — and get better engagement www.nature.com/articles/d41...

It’s fascinating to see the time gap between Taylor swift’s engagement insta post and full length news articles pop up. Journalist folks please tell me do you have these pre-written just in case or are you just that proficient?

Thinking a lot about documentation standards today. I would be very interested in people's thoughts on what factors lead to a documentation schema to become a standard? Thinking about datasheets vs model cards for eg, and how one became a (somewhat) durable standard..

My favorite thing about the Gemini chain of thoughts is how it says “I am now laser focused on” <insert part of code that I asked to fix>. It’s cute

I genuinely want to know the thought process here. Is each model iteration a new being? Is Claude 4.1 its own legal entity deserving of model welfare different from 4.0? Or is it like one human updating their world knowledge and becoming smarter? Was the very first trained Claude the robot embryo?

Remember the discussions around AI Eval plots last week? We at @eval-eval.bsky.social have a quick blog post on the AI Eval Charts Crisis!

The product decision to discontinue older versions of ChatGPT and the comments on Reddit around that decision reminded me once again of discussions around “robot death”, which is real insofar as people’s feelings and emotions are real.

New paper idea: Graph Crimes in Evaluations as a form of Epistemic Injustice

I’ve made my husband laugh with the same joke 3 times I feel so powerful

This! Also begets the question, why are people starting to get averse to social forms of knowledge production, involving multi-level stakeholders? Why is this mad rush to clip out the humans from the process, instead of working in tandem?

🚨 AI Evals Crisis: Officially kicking off the Eval Science Workstream 🚨 We’re building a shared scientific foundation for evaluating AI systems, one that’s rigorous, open, and grounded in real-world & cross-disciplinary best practices👇 (1/2) Read our new blog post: tinyurl.com/evalevalai

[New] Husbandposting! And yes we had a croquembouche for dessert because I saw it on masterchef once and I’ve always wanted that ❤️

New blog post alert! 🚨"What is the Hugging Face Community Building?", with @yjernite.bsky.social and Irene Soliaman The AI narrative focuses on big players, but the real story is happening in the open source AI ecosystem across 1.8M models, 450K datasets, and 560K apps, on @hf.co.

Gotta plug @timnitgebru.bsky.social @alexhanna.bsky.social and Asmelash Teka Hadgu's piece: www.dair-institute.org/blog/elders/ And @anikacolliernavaroli.com's excellent interview with Timnit on the subject: www.techpolicy.press/through-to-t...

Random hot take: Too many people are building AI for genz and not enough are building for their grandparents. Where are the apps/bots that say a retired, perhaps non English speaking grandma can use to improve their lives?

Not enough people know about nairrpilot.org and it shows. NAIRR needs better marketing and more resources to become a strong public computing infrastructure for American researchers and builders! 🇺🇸 @hf.co is one of many resources you can access through NAIRR ;)

I still think the set design of the Evita revival at the American Rep theater at Harvard was the most stunning interpretation of all time - I hope this concept makes it to Broadway at some point 🤩

Help this project out by participating if it’s up your alley! Moral KG is an ambitious attempt to map AI reasoning traces onto a developing massive philosophical ontology, and very much being built as a bootstrap effort with a rag tag team 🤗

Go say hi to @jennmickel.bsky.social and others and get to know what we are doing!

We're doing better AI Evals together! A herculean effort, but evals are in crisis and together we can go back to research roots and good science 🤗

Generative AI often renders the user invisible in their limited worldview. Please sign up for a short interactive workshop on AI, Misrepresentation and Mental Health, at both @facct.bsky.social in Athens, and Alt-FAccT in NYC! Limited space, so hurry! Sign up here! tinyurl.com/ai-mirrors

Alright, people, let's be honest: GenAI systems are everywhere, and figuring out whether they're any good is a total mess. Should we use them? Where? How? Do they need a total overhaul? (1/6)

I'm very pleased that both FAccT and AIES have way more qualitative evals of systems than I have seen in previous years. More of these please!

Living downtown and literally 2 blocks from the Opera House is certainly a clutch because I’m always late to things. Catch Roméo et Juliette playing in Boston it was great 😍