Effect sizes in social science survey experiments are typically small, requiring large samples and budgets for sufficient statistical power. It gets even trickier because increasing n/$ yields only diminishing returns to statistical power. This study points to an important barrier to credibility👇 1/

To simulate-then-validate, to validate-then-simulate, or to calibrate: that is the question. We discuss ways to simulate human responses to behavioral science experiments using LLMs and strategies to address their limitations. Check out our preprint!

I'm super happy & proud to be able to work with this rock star group of a team (and academic guests)! 🧠🧠🧠💫🙏 @goetheuni.bsky.social @infer-frankfurt.bsky.social - and it's really nice to check out parts of Frankfurt that I hadn't been to as part of our team event

Check out this article on leveraging AI for conducting social science research!

Excited to continue learning about the latest #CSS at @ic2s2.bsky.social! I’ll be at the Social Prediction Session, presenting the mixed subjects design on combining human and LLM data in experiments. Paper with Michael Howes and @austin-van-loon.bsky.social. Come join us! doi.org/10.1177/0049...

New in Sociological Methods & Research: Soc PhD candidate @davidbroska.bsky.social, @austin-van-loon.bsky.social, & Michael Howes show how combining human subjects and large language models can yield precise estimates at low cost, with implications for scientific productivity doi.org/10.1177/0049...

How can we leverage generative AI to advance social science methods and research? Daniel Karell and Thomas Davidson led a special issue in Sociological Methods & Research to find out. Special kudos to them! journals.sagepub.com/doi/10.1177/...

Mixed feelings about silicon subjects (LLM predictions of human behavior) as replacements for human subjects? Consider the mixed subjects design. 🚨Now published at Sociological Methods and Research🚨 doi.org/10.1177/0049...

Happy to share my new paper with Cat Dang Ton and @eollion.bsky.social on how to use generative LLMs for extracting information from textual data (conditionally accepted at Sociological Methods & Research) Here's a rundown.. osf.io/preprints/so...

🚨 ACCEPTED AT SMR 🚨
Confused by colleagues who seem to want to study LLMs instead of humans? Frustrated by skeptics (e.g., myself 8 months ago) who dismiss LLMs as a potential source of data on human behavior? Check out our paper for a new way forward: osf.io/j3bnt_v3/