Are you using survey-style questionnaires designed for humans to measure characteristics of LLMs? In our #EACL2026 paper, we evaluate both the reliability and validity of such tests and found that their scores do not reflect real-world model behavior. In fact, they can be deceptive! 🧵1/3

🚨New paper alert🚨 🤔 Ever wondered how the way you write a persona prompt affects how well an LLM simulates people? In our #EMNLP2025 paper, we find that using interview-style persona prompts makes LLM social simulations less biased and more aligned with human opinions. 🧵1/7

🚨 Upcoming #CS3Meeting 🚨 @wanlo.bsky.social talks about analytic flexibility in silicon samples on October 29, 3:15 to 4:00 PM CET). Great opportunity to gain novel insights into how survey responses can be generated with #LLMs. Sign up now: ww3.unipark.de/uc/cs3_meeti...

Come join next Wednesday if you want to rant about society's love-hate relationship with LLMs!

Thrilled to talk about how seemingly small decisions in silicon sampling can have a large impact on simulated survey responses 👀 Join us on Oct 29th! 👈

👋 #ACL2025NLP 🇦🇹 @marlutz.bsky.social and I are presenting our poster on demographic representativeness of LLMs today! 🕦 10:30-12:00 📍 Hall X5 (board 1 or 14 according to different sources 🧐) Here’s the paper on ACL anthology: aclanthology.org/2025.finding... Drop by!

🚀 New postdoc position for Platform Data & Computational Social Science Join us to drive @gesis.org' efforts around the Digital Services Act (DSA) and conduct research with online platform data 💼 TV-L EG 14 | Location: Cologne 📌 Apply now: www.gesis.org/en/institute... #DSA #CSS #DataScience

🚨 New publication 🚨 Excited to see this published in Findings of #ACL2025, led by @zakashussain.bsky.social. We critically evaluate claims that #LLMs are "just next token predictors" or "just machines" and call for a more measured discussion on LLM cognition. aclanthology.org/2025.finding...

Please vote for the best poster #ic2s2

Chair for Data Science in the Economic and Social Sciences at University of Mannheim having lots of fun at #ic2s2 @janajung.bsky.social @wanlo.bsky.social @indiiigo.bsky.social @jrupprec.bsky.social @maximiliankreutner.bsky.social and Stefano Balietti

opening slides #ic2s2

at the opening of #ic2s2

Really excited to also present this work at #IC2S2 next week in Norrköping! 🎉 I'd love to discuss how to produce LLM survey responses at my poster on Wed at 13:30 (Poster Session 2, Poster ID 68) 📊

Very excited to head to #IC2S2 next week! 🎉 In our project, we tested whether a psychological assessment can measure sexism in LLMs, and found that applying such tools to LLMs is not as straightforward as it seems. Find me and my poster at Poster Session 1 (Tue 12:30-14:30) — hope to see you there

LLMs can understand political discourse, but can they actually predict votes of real politicians? Excited to share my work at #IC2S2 this week! I will present my poster on Tuesday between 1:30 and 3:30 p.m.

Do LLMs represent the people they're supposed simulate or provide personalized assistance to? We review the current literature in our #ACL2025 Findings paper and investigating what researchers conclude about the demographic representativeness of LLMs: osf.io/preprints/so... 1/

Joint work w/ @marlutz.bsky.social, Elisa Rogers, @dgarcia.eu and @mstrohm.bsky.social You can find our code and annotated dataset of papers here: github.com/Indiiigo/LLM... We annotated way more things, e.g., LLM used, response format, so please check it out! 5/5

Excited to present our paper with @maxpe.bsky.social, @dgarcia.eu, and @mstrohm.bsky.social next week at #ICWSM! ✨ We extend social simulation with LLMs to a longitudinal setting by fine-tuning Temporal Adapters—here's how: 🧵