This seems like an interesting attempt to see how far LLMs can help with social science research. But I am not sure how much progress will come from producing more papers. What we need -I think- is figuring out how to use LLMs to produce better papers.​​​​​​​​​​​​​​​​

Good news everyone 🥳 Our (w @vincentab.bsky.social) primer on models as prediction machines (with the marginaleffects package) is finally officially published!> journals.sagepub.com/doi/10.1177/...

“Don’t tell me you’ve been using particle board in here,” said the 55-year-old woodworker

These are essential questions to be asking right now. Ignoring the power of these models (which are only getting smarter by the month) is a recipe for professional obsolescence for one's self and their students.

Excited to share that @russpoldrack.org will be speaking at @princeton.edu this Tuesday, March 24! Talk: "The Promise and Perils of AI-Assisted Coding in Science" 12:00 PM ET Workshop: "Testing and Validating Code Developed Using AI" 11:00 AM ET The Zoom is open to all (see flyer for details)!

New post on Data Colada. I spent a very long time trying to figure out a figure in a methods paper that is not in my area of expertise. It shows extremely *negative* R-squared values from replications of a true effect. The question on my mind was: WHAT?? I learned some stuff. datacolada.org/134

Every day is a good day for sharing one of the most useful papers about research data ever written. PLEASE get your people to understand and follow this advice. www.tandfonline.com/doi/full/10....

A new Department of Cognitive Science is being created at Bocconi University in Milan, Italy. Here is the call for a cluster hire (for around 10 faculty) in all areas of cognitive science, at both junior and senior levels: www.unibocconi.it/en/faculty-a... Deadline: May 4th, 2026

Answering the most popular question in a PhD methods course datacolada.org/133

The South Bronx bandleader took the Latin genre to new heights while recording for Fania Records. n.pr/4kLTCKV

Would p-curve work if you dropped a piano on it? datacolada.org/129

Colada[128] The Best Audit Study and its interesting shortcoming datacolada.org/128

The second edition of The Effect has been delayed a bit... because there were so many orders they had to switch to a bigger print run! Thank you everyone for your support, and check out the second edition here: www.routledge.com/The-Effect-A...

Don't assume, plot datacolada.org/126

Does anybody know of a paper or blog discussing arguments of the form "we found our results despite this confound that works against our effect"? Essentially, how to think about confounds that go against the hypothesized or observed effect.

Really proud of this new work out @psychscience.bsky.social. Led by the amazing but bluesky-less Amanda Geiser and with @deborahsmall.bsky.social. We show that when comparing moral wrongs, people are (much) more willing to “scale up” than to “scale down” condemnation and punishment…

Measurement error, Nobel Prize winning research, friendly disagreements, and more.... datacolada.org/124

🏆 Research integrity consultant and image forensics expert @elisabethbik.bsky.social has uncovered fraudulent data in over 7,600 scientific papers and exposed the practices of ‘paper mills’ that produce counterfeit scientific articles. She is honoured with the €200K Individual Award. Congrats!

The vibraphonist, composer and jazz-funk pioneer helped inspire the neo-soul movement, and his best-known song was sampled over 100 times.

Delving into a disagreement with prominent political scientists on a fundamental data-analysis question: what do you want to learn from a regression interaction? datacolada.org/123

Today in @worksinprogress.bsky.social, I reflect on Donald Shoup's legacy. Perhaps the most interesting question: how did the most unlikely professor kick off an international parking reform movement? substack.com/home/post/p-...

A new working paper with Daniel Banki, @urisohn.bsky.social and Robert Walatka, just submitted to SSRN. The paper is comment on Ryan Oprea's recent AER paper. The paper is processing, but you, my friends, get early entry. papers.ssrn.com/sol3/papers....

January 19

My ✨New Paper✨ (w/ Robyn LeBoeuf) is out in JEP: General! We find a robust discrepancy between people’s prediction and their own likelihood judgment. 1/n🧵 psycnet.apa.org/record/2025-...

Did a police training improve officers' behavior during arrests? A forthcoming QJE paper with a flexible pre-registration and key p-values of p=.048 & p=.051 says yes. datacolada.org/122

Madrid tripled the length of its metro system in just 12 years, faster and cheaper than almost any other city in the world. Left: in 1994 Right: after 2007 Cost per mile: £64–91 million (around 7x cheaper than London's Jubilee & Northern line expansions & 14x cheaper than Toronto's Ontario line)

I’m looking for responses to replications that attributed failure to stimuli becoming invalid with time (e.g., Shafir and Cheek 2024 JDM on choose/reject effects), or to stimulus selection more generally. Discussions also welcome (e.g., @olegurminsky.bsky.social and Dietvorst 2024 JCR). Pointers?

I'm compiling types of manipulations in psychology: 1) Vignette study 2) Autobiographical ("Remember a time you ...") 3) Confederate acts some way 4) Watch video inducing emotion 5) Behavioral instruction ("talk to a stranger") 6) Prime a construct 7) Framing outcomes To contribute, reply

A popular tool in political science for dealing with nonlinearities in invalidated by... ...nonlinearities. datacolada.org/121

We (i.e., the marketing department at ESADE) are looking for PhD students. Please spread the word:

Man I cannot endorse this abstract more

Previous research shows that people sometimes view moral questions as objectively true, while other times treating them as true only relative to different perspectives. In our new paper, we present evidence that social rewards may explain this apparent inconsistency...

My First R Package: Dec.5-6 I'm super excited to announce that I'll soon be teaching a short course on how to develop #RStats packages! A 📦can make your code more efficient, reproducible, and helpful to others. Please let me know if you have any questions. codehorizons.com/Seminars/my-...

Academics using {renv}: please check out: groundhogr.com/renv #rstats

Request: Are there examples of replications or studies examining whether results change when tested with a larger or different sample of stimuli?

There is a famous article titled: "How to show 9 is bigger than 221"... It critiques between-subject comparisons. Not enough people know the result is artifactual. You only get it when using a 1-10 scale (!) So people say "well, 9 is 9 big". Change scale, no effect.

Is this definition as bad it seems to me?

Judgment and Decision Making (JDM) starter pack Happy to add you go.bsky.app/8nDKmwG

Part 1 of a two-part series on Freakonomics: Why is there so much fraud in academia? Interviews with @briannosek.bsky.social Leif Nelson, @joesimmons.bsky.social, @urisohn.bsky.social, Max Bazerman, and me. Part 2 (about what journals are doing) coming next week freakonomics.com/podcast/why-...

I'm thrilled to announce the new Psych Science editor team! We'll start on Jan 1, 2024. Check us out: here: https://www.psychologicalscience.org/publications/psychological_science/2024-editorial-board We're spread across 15 countries in 5 continents! 🌍🌎🌏 Here’s a thread to introduce the team!

The ACLU filed an incredible amicus brief in defense of @datacolada.bsky.social last week. storage.courtlistener.com/recap/gov.us...

Most papers comparing clustered data methods use biostat/econ language, so I tried to write one using psyc/ed language that covers the origin of the independence assumption, how each method handles ind. violations, and types of questions best-suited for each method psycnet.apa.org/record/2024-...

In the real world, many effects are non-linear. This new paper by @urisohn.bsky.social offers an intuitive explanation of the challenges with standard methods of testing interactions, along with a revised toolbox. In addition to changing a few lines in my R code, this changes how I think about data.

The Many Co-Authors platform went live yesterday. One main goal is to help junior co-authors credibly signal who was involved in data collection in their studies. Added today: figures summarizing the data. manycoauthors.org

A classic chart by Max Roser: The rise and fall in smoking and lung cancer mortality over the 20th century.

I can never think of a good answer to the “what’s a piece of advice…” question, but I thought of one (& will promptly forget it): when someone gives a valid critique of your work, ask them to join your team, invite them for a talk, buy them a cake, do whatever you can to foster that relationship.

Zoé Ziani (who isn't on BlueSky AFAICT) has posted a long post-mortem on the Gino-Ariely case. She explains how she came to suspect Gino’s work, the resistance she met during her Ph.D., her experience working with Data Colada, and the lessons business academia should learn from these scandals...

Simine Vazire (@simine.com) will be the next editor-in-chief of Psychological Science 🥳 t.co/V3nmK0Ud1S

It’s great to see the increasing recognition of how important fraud and error detection are to science. #psyscisky #socialpsych www.wsj.com/science/data...