Starting today, if an AI agent is detected in your Prolific study, we’ll give you twice the cost of that non-human participant back. You pay for human data. You expect human data. We’re backing that with our 100% Human Guarantee. Learn more: www.prolific.com/100-human-gu... #AcademicSky #Research

New preprint out today (osf.io/preprints/ps...). We tested whether AI agents are actually infiltrating online surveys. Spoiler alert: they aren't Thread 🧵 [1/9]

A massive seven-year project exploring 3,900 social-science papers has ended with a disturbing finding go.nature.com/4bZ9k0W

I actually hope I'm wrong here. We use the correlation (r) a lot. Test-retest reliability Prediction/memory accuracy Trait stability We should not; in a new simulation study, r is upwardly biased & doesn't tell you what you want. We show what does (Table 2). osf.io/preprints/ps... #psych #stats

Experiments show causality. Causality requires time. Therefore, mediation in experiments is not cross-sectional. That is all.

== Effect Size and Confidence Intervals (ESCI) check == Lots improved. Has a revamped website and R package on CRAN. Works like statcheck, also checks effect sizes and calculates confidence intervals. Tricky countless edge cases, but after testing it on 1000s of articles, seems pretty decent.

Come work with us! Postdoctoral researcher position in metascience on the UKRI-Funded PRIME project (Bath U), evaluating & implementing results‑blind peer review & translating evidence into policy & practice. FT/PT flexibility possible Advert: www.bath.ac.uk/jobs/Vacancy.... #metasci

Why do we think people who share 1similarity with us are more similar to us in other ways? We think we have an essence, & they share that same essence. But if flips if they come from a different political party (e.g. it is a one-off). From Charles Chu psycnet.apa.org/record/2027-... #psych

out now in Science: @loganjames.bsky.social collected pairs of sounds in 16 species where we *know* which sound is more attractive (to that species) he played them to ppl on themusiclab.org, asking, in each pair, which was nicer. humans agreed w other animals doi.org/10.1126/science.aea1202

Just ignore it and hope it will go away

A threat to many fields of research wanting to conduct longitudinal evaluations is participants may remember their previous answers. Retest reliability, memory accuracy, long-term effects of interventions. We instead show people don't remember what they last said. doi.org/10.31234/osf... #psych

Ambulance callsigns in a real dataset imported with read.csv (left column, correct) vs read_csv (right column). This one got me.

Someone went to the trouble of creating 5 fake OSF accounts today, linking to 5 fake ORCID accounts, and generating 5 fake papers to submit to SocArXiv, with fake author and emails. Dude, if you are reading this, I hope you get the help you need (or a better job).

People think investment is riskier when failing is 1-in-X rather than an equal %. They also over-weigh last digits, so .05 is not seen as < .1. If you want up play up risk, say 9-in-X; play it down, round to the small digit %( .1%). From @marklacour.bsky.social link.springer.com/content/pdf/...

Me trying to type anything into the search bar on osf.io so it doesn't pause me and start auto-searching before I can type more than 2 letters

hurrah! a new preprint*! weee have DAGs! we have Total Survey Error**! WE have MrP (rebranded as RPP)! We have cool plots showing how even high quality random samples can benefit from a good weighting model! What else do you want?! With @ianhussey.bsky.social, @malte.the100.ci, & @ruben.the100.ci

In the Andromeda galaxy, just one galaxy over, there USED to be a star. And now it is gone. Swallowed up by a Black hole. From Kishalay De www.science.org/doi/10.1126/... #phdsky

The sky is not falling; high-quality platforms (Prolific, Verasight, CR Connect) have low rates of apparent bots. osf.io/preprints/ps... But also not zero; vigilance is very much needed!

Four more days left to apply for a Postdoctoral Research Fellowship in the Social Science Collaborartory. For the right candidate, I'm upping the offer: I will double the supply of toy dinosaurs that come with this position 🦕

editing some writing atm...

We have written a simple, plain-language, no equations & minimal jargon tutorial for experimentalists on why you can't drop people who don't take your treatments or follow your instructions. with re-analyses & recommendations! with @samanthajamesbrown.bsky.social osf.io/preprints/ps... #psych

Our crowdsourced megastudy comparing a diverse set of 12 single-session interventions for depression is out today in @nathumbehav.nature.com! Read the full paper here: rdcu.be/e6pzz (no paywall) We also published a brief non-academic piece about the study today: theconversation.com/free-10-minu...

‼️ Postdoc recruitment Want to help build and understand the future of scientific collaboration? We are seeking a postdoc in computational meta‑science. 📍 UF (Gainesville, FL) 💰 $55–60k (1-3 years) 🧠 High intellectual agency 📅 Deadline March 10 Send us your idea. Details attached!

I always hated doi links in references; a pain to find them. But NOW it is a great way to check for LLM-hallucinated references. And this, in evolutionary biology, is called a spandrel. Something that evolved for one purpose but now serves a different purpose (or none at all). #phdsky

Oh, Bluesky. Never change.

Just a plea from a struggling stats instructor, could we possibly debate why Type I sums of squares is the default in the base R anova functions

The last SPSP (2015, Long Beach) I went to was so toxic, I haven't been back. I've been told that was unusual and because of the Reproducibility project: Psychology. Now I am going back to my first SPSP since then. I sure hope the SCORE project isn't released this week... #psych #meta

🧠 Job alert! Tenured Associate Professor in Neuroscience at Université de Toulouse, France (CLLE/CNRS) Cognition × Language × Neuroimaging 📅 Open Mar 3 → Deadline Apr 3 | Interviews May 🔗 odyssee.enseignementsup-recherche.gouv.fr #Neuroscience #AcademicJobs #CognitiveScience 🧵 More details:

I love this kind of stuff. The oldest sewn clothing has been found. Shoes and hides sewn together, along with animal traps, found in Oregon. Made about 10,000 years ago. From Richard L. Rosencrance www.science.org/doi/pdf/10.1... #phdsky

Best line about fadeout!

Registered Reports are the way forward

Great team here!

Our lab has the capacity to test ~500 uni students each semester If you’re a researcher in cognitive psychology or metascience and need data collection support, we’d love to collaborate. We can help collect high-quality data from a large student sample. Get in touch to discuss potential projects!

I'd love to see an American Culinary Class Wars where the judges are Thomas Keller and Guy Fieri and they are always 100% blind to who cooked what.

I have a suspicion researchers have a quantity, let's call it Nmin. Where any study whose sample size is below Nmin, REGARDLESS OF STATISTICAL POWER, is summarily ignored. It makes doing within subjects experiments irksome. Social psychologists' Nmin average seems around 200-250. #meta #psych

1903

Anytime you see a product criticized for "hacking your dopamine reward system" and it is not a chemical substance, they just mean it's enjoyable. That's it. The product is enjoyable.

Maybe it's my own scientism bias but it seems to me: If something exists independent of what people say it is, it can be studied & understood. If something only exists as what people say it is, studying people tells us what it is. Is something missing here or are one of the premises wrong?

Where are the economists at who somehow have a dataset of all people wait listed at only one college who either did or did not get into college?

every once in a while I read a paper that changes me. If you do research involving between-Ss experiments or interpreting between-people correlations in any way (e.g. SEM) read this paper, weep, & don't ignore the implications. from Michael D Hunter pmc.ncbi.nlm.nih.gov/articles/PMC... #psych

Really crazy that so many Americans based their entire life around carrying guns to protect US from authoritarians & pedophiles, then when confronted with authoritarians & pedophiles they joined in as paramilitary terrorizing innocent civilians & protecting the pedophiles from accountability.

If you're interested in data sleuthing but aren't sure where to start, or if you're conducting a systematic review/meta-analysis and want to ensure you're not including junk studies, check out this Cochrane training session on Trustworthiness Assessment by @jdwilko.bsky.social

What is a great journal that really likes tutorial papers and re-analyses (metasciencey) that helps translate econometrics to Psychology but DOESN'T charge an APC? #psych #meta #stats

“Our findings suggest that although respondents believe that questionable research practices should not be used, they conceded there are systemic reasons some use them.” Open Acc: doi.org/10.1098/rsos... BSky authors: @sarahcaroleo.bsky.social, @jesse-fleming.bsky.social, @bryancook.bsky.social

What drives retention in online longitudinal research? We conducted an experiment (N=1,798) on @joinprolific.bsky.social, orthogonally manipulating payment rate (£6–£9/hr + bonus) and session interval (1, 2, or 4 weeks) across five sessions. The findings challenge some common assumptions 👇

My Mom: What are you working on now? Me: A Monte Carlo simulation on the lowly correlation coefficient. My Mom: I thought you were studying how memory biases influence prejudice against Kids These Days, why are you doing this? Me: What does it look like Im doing?

behold, we found great variation in how people think! Many activities that we thought would be “gaming” weren't & vice versa, eg half of the participants interpreted ‘gambling’ to be ‘gaming’. Ergo: surveying ‘gaming’ without defining it creates data mess

Some thoughts: 1. The deadline for nominating a person or group for the Nobel Peace Prize is Feb. 1. 2. History professors are qualified nominators. 3. The people of Minnesota have been awe-inspiringly peaceful in the face of state violence. 4. He would be so mad.

Me thinking I like reading #philosophy until I get hit with a sentence like this. Seriously, who writes this, slaps it, and says that's good that's not going anywhere? P. S. this is a footnote calling to another footnote.

Great team in a beautiful city!