🚨 New paper alert 🚨 Using LLMs as data annotators, you can produce any scientific result you want. We call this **LLM Hacking**. Paper: arxiv.org/pdf/2509.08825

Crowdsourcing datasets is very common, but how much of those results come from LLMs these days? How can we prevent it? Much of it is unclear. This is why we’re conducing a survey (~10 min) to gather community experiences, challenges, and solutions. Share your thoughts 👉https://tinyurl.com/39ab55wf

🌈 Help with my LGBTQIA+ research! 🌈 I'm building a dataset to fight harmful LGBTQIA+ stereotypes in AI. Take my quick survey: 👉 IT: lnkd.in/dfPuyT6j 👉 NL: lnkd.in/d-3Di7WY 👉 FA: lnkd.in/dfvWzWCu Everybody is welcome! 📤 Share if you can!

One highlight of LILG 2025: the official launch of the new open-access journal Gender Linguistics! Published by our association, the journal will be a space for research at all linguistic intersections of language and gender. Learn more: gender-linguistics.org #linguistics #journal #launch

The transformation of the irreplaceable treasure “performative” into a mere synonym for “phony” is a lexical tragedy to be mourned by future generations

The complete lack of regard for the Y-axis hurts me physically #GPT5

Identity-Aware AI workhop at #ECAI2025, in beautiful Bologna! Submit by Aug 22: identity-aware-ai.github.io Organized by: @pranav-nlp.bsky.social Soda Marem Lo, Neele Falk, @gingerinai.bsky.social @davidjurgens.bsky.social @a-lauscher.bsky.social and myself!

word is GPT-5 will have a 13.5% increase in version number over GPT-4.5

We have been carefully testing lots of received prompting wisdom & for recent AI models: 🚫Threats, saying please, being insulting, & promising tips do not change average performance on challenging tasks ⛓️Chain-of-thought no longer helps even non-reasoner performance much Don't make it complicated.

👏 Upcoming workshop: Perspectivist Approaches to NLP @EMNLP 2025 Focusing on non-aggregated datasets and multi-perspective modeling, with sessions on labeling, modeling, evaluation, and applications. nlperspectives.di.unito.it

Why all the interest in AI for automating idea generation in science? Isn't this the fun part? We should be automating the tedious parts.

Who's presenting on subjectivity in annotation (human label variation, learning from disagreement, perspectivism) at #ACL2025? papers by e.g. @liweijiang.bsky.social @tiancheng.bsky.social @gabriellalapesa.bsky.social @romanklinger.de keynote @verenarieser.bsky.social link to full list below ⤵️

The #ACL2025 #ACL2025NLP feed is up and running! It matches both hashtags and any posts from or mentions of @aclmeeting.bsky.social Pin it to your home 📌 and enjoy! bsky.app/profile/did:...

#MethodsHub #Study #helpwanted Invitation to participate: Study on method reproducibility The Methods Hub team at GESIS is conducting a study as part of the Tier2 project on how easily researchers can reproduce results from computational methods.

#GESISGuide #AI #LLM 🧠 New to #prompting LLMs or want to level up your skills? This guide dives into prompting techniques—from basics to advanced strategies like reasoning models & persona prompting. Includes examples, combos, and key limitations to watch out for. https://t1p.de/yv10f#GESISGuide#AI#LLM#promptingF)

Check out the camera-ready version of our ICML position paper ("Position: Evaluating Generative AI Systems Is a Social Science Measurement Challenge") to learn more!!! arxiv.org/abs/2502.00561 (6/6)

You are using LLMs in your research and are wondering about different ways of constructing prompts and things to consider? 🤖 I wrote a @gesis.org DBD guide providing a systematic overview of different prompting methods, their differences, and combinations 🧵⬇️ www.gesis.org/fileadmin/ad...

Deadline approaching! Workshop on Computational Linguistics for the Political and Social Sciences #KONVENS2025, archival long-short papers (acl anthology) & non-archival abstracts and phd project descriptions (get feedback from a great community!) ! Deadline: June 13th.

If you're finishing your camera-ready for ACL or ICML and want to cite co-first authors more fairly, I just made a simple fix to do this! Just add $^*$ to the authors' names in your bibtex, and the citations should change :) github.com/tpimentelms/...

Pls Repost!📢 Unsure about NLP Ethics? Hoping to attend #ACL2025? How about applying for a virtual registration subsidy? All 3? We hear you!✨Tutorial: Navigating Ethical Challenges in NLP✨🗓️Sun, Jul 27, 14:00–17:30 CEST📍@ Hall M, Vienna + 🌍Online (hybrid!) ethics.aclweb.org/tutorials/AC...

this entire paragraph is Stephen Pinker openly saying, "I think race science is real and correct."

Do not miss Vingesh's rare artisanal memes!

So…about AI’s energy use… “…to create a five-second video, a newer AI model uses ‘about 3.4 million joules, more than 700 times the energy required to generate a high-quality image’. That's the equivalent of running a microwave for over an hour.”

Paper arguing that accuracy of the "reasoning" traces in reasoning models is surprisingly unrelated to accuracy of the final results.

📣 Super excited to organize the first workshop on ✨NLP for Democracy✨ at COLM @colmweb.org!! Check out our website: sites.google.com/andrew.cmu.e... Call for submissions (extended abstracts) due June 19, 11:59pm AoE #COLM2025 #LLMs #NLP #NLProc #ComputationalSocialScience

We still have places available for this #GESISworkshop! 🌱 Join Julia Romberg, @vigneshwaran-s.bsky.social, and @mmmaurer.bsky.social to explore adapters — an efficient alternative to fine-tuning your large-language models. ➡️ More information & registration at t1p.de/adapters-lig...

We’re honestly fortunate that this Grok tweak was so ham-handed. The subtle steering of public opinion by a few frontier LLMs is a real risk that I wish were getting more political attention. www.nytimes.com/2025/05/17/o...

Wish I had a single @overleaf.com keyboard shortcut that would 1) append whatever I have in my clipboard to my bib file, 2) parse it, 3) extract the bibkey, and 4) paste it at my current cursor location in the editor.

🚨🚨 Studying the INTERPLAY of LMs' internals and behavior? Join our @colmweb.org workshop on comprehensivly evaluating LMs. Deadline: June 23rd CfP: shorturl.at/sBomu Page: shorturl.at/FT3fX We're excited to see your insights and methods!! See you in Montréal 🇨🇦 #nlproc #interpretability

Do you have Opinions™ on what it means to "represent" things and people with data? Then submit 1-2 pages by May 28th and join us in Århus 🇩🇰 this summer to discuss representation and representativeness with synthetic data!

🚨 NEW PAPER ALERT 🚨 Dialz: A Python Toolkit for Steering Vectors ArXiv: arxiv.org/abs/2505.06262 Docs: cardiffnlp.github.io/dialz/ Repo: github.com/cardiffnlp/d... A Python package to help you create, apply and visualise steering vectors for anything you want - from sycophancy to bias.

Unlock the power of large language models for your research! Join this #GESISworkshop with Julia Romberg, @vigneshwaran-s.bsky.social, and @mmmaurer.bsky.social to explore adapters — an efficient alternative to fine-tuning your models. 🔗 Book now ➡️ t1p.de/adapters-lig... @gesis.org

People at #NAACL2025! Julia Romberg will be presenting our paper "Towards a perspectivist turn in Argument Quality assessment", today, 16.45, Ballroom C! Work with @mmmaurer.bsky.social and Henning Wachsmuth. @gesis.org @hhu.de @unihannover.bsky.social

This is one of the worst violations of research ethics I've ever seen. Manipulating people in online communities using deception, without consent, is not "low risk" and, as evidenced by the discourse in this Reddit post, resulted in harm. Great thread from Sarah, and I have additional thoughts. 🧵

Unlock the power of large language models for your research! This #GESISworkshop with Julia Romberg, @vigneshwaran-s.bsky.social & @mmmaurer.bsky.social introduces you to adapters — an efficient alternative to fine-tuning your models. More infos & registration ➡️ t1p.de/adapters-lig... @gesis.org

"scaling law" is the latest "__ is all you need"

1. LLM-generated code tries to run code from online software packages. Which is normal but 2. The packages don’t exist. Which would normally cause an error but 3. Nefarious people have made malware under the package names that LLMs make up most often. So 4. Now the LLM code points to malware.

#MemoryMonday #NLProc 'Understanding Political Discourse on Twitter through Election Manifestos' Maurer et al. (2024) present a method for predicting party positions from tweets

#Germany has a poverty problem. Despite the country’s vast wealth, the German social security system is simply failing many people. 12 million people live in poverty - single-parent families & older women make up a disproportionate number. Read our new @hrw.org report: www.hrw.org/news/2025/03...

Are you an early-career researcher who's interested in collaborating with someone @gesis.org? Then look into applying for a funded research stay ⬇️ The next deadline is coming up on March 31, 2025!

*Adapters: Lightweight Machine Learning for Social Science Research* by Julia Romberg, @vigneshwaran-s.bsky.social & @mmmaurer.bsky.social. 🗓️ 02 – 04 June 2025 🏢 Hybrid (Cologne | Online) 🌐 t1p.de/adapters-lig...

*Adapters: Lightweight Machine Learning for Social Science Research* by Julia Romberg, @vigneshwaran-s.bsky.social & @mmmaurer.bsky.social. 🗓️ 02 – 04 June 2025 🏢 Hybrid (Online / Cologne) 🌐 t1p.de/adapters-lig...

"Each task consumed approximately 1,785 kWh of energy—about the same amount of electricity an average U.S. household uses in two months" This is one per-task estimate from Salesforce's head of sustainability -->> www.linkedin.com/posts/bgamaz...

And the same for Python is here: python-graph-gallery.com/color-palett...

💙 𝗗𝗮𝘁𝗮 𝗔𝗻𝗻𝗼𝘁𝗮𝘁𝗶𝗼𝗻 𝗕𝗼𝘁𝘁𝗹𝗲𝗻𝗲𝗰𝗸 𝗮𝗻𝗱 𝗔𝗰𝘁𝗶𝘃𝗲 𝗟𝗲𝗮𝗿𝗻𝗶𝗻𝗴 𝗳𝗼𝗿 𝗡𝗟𝗣 𝗶𝗻 𝘁𝗵𝗲 𝗘𝗿𝗮 𝗼𝗳 𝗟𝗟𝗠𝘀 💡 Have you ever had to overcome a lack of labeled data to deal with an NLP task? We are conducting a survey to explore the strategies used to overcome this bottleneck. #NLP #ML

Before you all delete your accounts on X, you should consider deleting content but "donating" them to science. Many institutions, such as @gesis-dataservices.bsky.social might use them to scrape more effectively than via burner accounts.