Friends, I have written you a book on forensic metascience. It is free. You can have it. Happy St. Valentine's Day. If you wish to give me a gift back, you can use it to cause trouble - the greatest gift of all. open.substack.com/pub/jamescla...

Call for Proposals: Metascience 2025 Be part of the biggest Metascience meeting yet! We're inviting proposals for: ✅ Virtual symposia ✅ In-person panels ✅ Talks & posters ⏰ Submit by 7 Feb 2025 🔗 Full details: metascience.info/call-for-pro...

Wouldn't it be nice if u could read a published pharma-sponsored clinical trial about some new drug & be confident that the results are what they appear to be? @chrisdc77 & I think it's very achievable using the @RegReports peer review model. Our proposal ⬇️ www.openpharma.blog/blog/transpa...

Happy Friday! Following on from my guide on preregistration, here is the second exciting instalment: “Registered Reports: A How-To Guide” 📖🔓 osf.io/preprints/ps... #OpenScience #OpenResearch #AStudentsGuide #Metaresearch #ResearchTraining #RegisteredReports #Preregistration #AcademicSky (1/6)

A first starting pack for metaresearch and open science now counts 150 accounts. I will star a second for those who are not in (sorry but it is difficult to be exhaustive). Please jus answer 👋 to this post. go.bsky.app/R8RNJgc

We're excited to announce a major update to the Transparency and Openness Promotion (TOP) Guidelines—TOP 2025! These guidelines streamline research practices and provide greater clarity around openness in research. The preprint is now available. Your feedback is welcome! www.cos.io/blog/new-pre...

Taylorism is a management philosophy based on using scientific optimization to maximize labor productivity and economic efficiency. Here's the result of making the false Taylorist assumption that the output of scientific research is scientific papers—the more, faster, and cheaper, the better.

Exciting news: I will be teaching a 4-day summer school on open science this August! The course is for ECRs in the social & behavioural sciences who want to get up to speed with open & reproducible practices and/or learn how to handle specific problems. utrechtsummerschool.nl/courses/data...

The Benefits of Preregistration and Registered Reports: http://osf.io/dqap7/

Very pleased to share our new paper "A registered report survey of open research practices in psychology departments in the UK and Ireland" 🎉 doi.org/10.1111/bjop... We examined open research practices and self-reported capability, opportunity, and motivation to engage in open research practices.

“While both replication and theory crises have caused concern for scientists and philosophers alike, the reforms that so far have resulted allow for cautious optimism.” New chapter by Tomos ap Sion & @briandavidearp.bsky.social www.researchgate.net/profile/Bria... #MetaSci #PhilSci #Methodology

New blog post! "Preregistration: More Promises than Pitfalls," some thoughts inspired by the recent meeting at the Royal Society. I don't find many pitfalls with preregistration itself, but there are plenty of problems with how we talk about it. getsyeducated.substack.com/p/preregistr...

New Managing Editor position! COS is conducting a research and development project on a new model of scholarly communication called Lifecycle Journals to evaluate its strengths and weaknesses and suitability for transition into a scalable and sustainable solution. jobs.lever.co/cos/1db59b80...

Very interesting and encouraging pilot at the University of Sussex — hope this can spread to other departments and universities! h/t @deevybee.bsky.social www.ukrn.org/2024/01/30/p...

Are you a researcher? Please participate in our global survey (5-10mins) and share it with other researchers in your network - thanks! 🙏 ➡ cardiffunipsych.eu.qualtrics.com/jfe/form/SV_... #AcademicSky #metasci #PhDSky #PsychSkySci #STS 🧪

A preliminary agenda is available for our meeting on "The promises and pitfalls of preregistration". We've also extended the submission deadline for lightning talks and posters to 29th January. Registration and submission details on the meeting website: royalsociety.org/science-even...

Our new review article in Current Opinion in Psychology -- Interventions to Counter Misinformation: Lessons from the Global North and Applications to the Global South authors.elsevier.com/a/1iDnO_,5MJ... Part of special issue on "The Psychology of Misinfo." www.sciencedirect.com/journal/curr...

New preprint: When and How to Deviate from a Preregistration osf.io/preprints/ps... I hope this helps researchers to reflect on the consequence of deviations from preregistrations by evaluating the test's severity and the validity of the inference.

We’ve spent the last decade talking a lot about replications, but to what extent has this talk translated to a tangible change in how often replications are published in psychology journals? osf.io/preprints/ps... /w Katherine Lee, Sarah Schiavone, @mijke.bsky.social @simine.com (1/9)

I’m a fan of trying to quantify how often reviewers & editors check authors’ preregistrations (eg, by @syeducation.bsky.social), but also we should not forget that reviewers fail to check for deviations from a priori plans in 100% of unpreregistered studies. Because they can’t.

Remember best practice in a power analysis is to plan not for the effect you expect, but for the smallest effect size of interest. The type 2 error is a conditional inference: If there is an effect I care about, I would have X probability to detect it. lakens.github.io/statistical_...

Finally! New policies for Psych Science in 2024 (part 1): Editorial 1: https://www.psychologicalscience.org/publications/psychological_science/vazire-editorial Editorial 2 w/ @tomhardwicke.bsky.social : https://www.psychologicalscience.org/publications/psychological_science/hardwicke-editorial

New preprint! How often do editors/reviewers actually compare preregistrations to the reporting in the article? Almost never. This figure sums up all of the results. Not good.

175: Defending against the scientific dark arts We chat about a recent post from @deevybee.bsky.social, in which she proposes a Master course that will provide training in fraud detection—what should such a course teach & where would these graduates work? everythinghertz.com/175

📢 Have you authored or reviewed a Registered Report? ✏️ Please give feedback about your experience (takes 5-10mins): registeredreports.cardiff.ac.uk/feedback 📊 So far authors & reviewers have given 345 pieces of feedback across 73 journals - see our dashboards! #AcademicSky #metasci 🧪

Calling all researchers - please participate in our survey (5-10mins) and share with your networks - thanks! 🙏 ➡ cardiffunipsych.eu.qualtrics.com/jfe/form/SV_... #AcademicSky #metasci #PhDSky #PsychSkySci #STS 🧪

Registered Reports in Sport, Exercise, and Performance Psychology (Editorial): http://osf.io/rs4t2/

The ACLU filed an incredible amicus brief in defense of @datacolada.bsky.social last week. storage.courtlistener.com/recap/gov.us...

MetaROR (MetaResearch Open Review) will be a platform for open peer review of meta-research. researchonresearch.org/project/meta... Interested? Give us feedback and get added to our nascent mailing list: tinyurl.com/metaror We are working to partner with editors of existing journals.

Thanks to @aimosinc.bsky.social for the opportunity to present! #aimos2023

For anyone interested, the website can be found here: registeredreports.cardiff.ac.uk/feedback/das... Authors/reviewers of Registered Reports manuscripts can add their feedback too!

"NHS England has awarded the £480m contract for its federated data platform (FDP) to the US spy technology firm Palantir, in the face of opposition from the BMA, the Doctors’ Association UK, patients’ groups, and privacy campaigners" www.bmj.com/content/383/...

"government is creating a new metascience unit. The unit will be jointly run across DSIT and UKRI, with an initial funding commitment of £10 million" assets.publishing.service.gov.uk/media/655e2a...

Special issue: "Is psychology self-correcting? Reflections on the Credibility Revolution in Social and Personality Psychology." Edited by @simine.com and I. Check out the nine articles with diverse perspectives and approaches to examining the reform movement: spb.psychopen.eu/index.php/sp...

A cool paper on an important topic: Questionable research practices in student projects. Students may engage in QRPs not knowing that they’re questionable, or not thinking that the data would be used for a real article. See full thread 👇 https://spb.psychopen.eu/index.php/spb/article/view/9411

Ahm, Cortex - I have questions: www.sciencedirect.com/science/arti... #neuroskyence #PsychSciSky

I'm looking to recruit a new Ph.D. student for Fall 2024, particularly someone interested in meta-science, and preferably intersections with diversity/structural perspectives. Full consideration given to applicants from inside or outside the U.S. Deadline is Dec 1. cla.umn.edu/psychology/g...

Our paper "High replicability of newly discovered social-behavioral findings is achievable" appears today in Nature Human Behaviour. Just as the large replications provided an inflection point in identifying replicability challenges, this paper does so for solutions. www.nature.com/articles/s41...

Royal Society meeting “The promises and pitfalls of preregistration” to be held in London (and online) March 4th-5th, 2024. Free to attend. Call for posters and lightning talks now open. Details: royalsociety.org/science-even... w/ @cruwelli.bsky.social EJ Wagenmakers, Marcus Munafò & Dorothy Bishop

Calling all researchers - please participate in our survey (5-10mins) and share with your networks - thanks! 🙏 ➡ cardiffunipsych.eu.qualtrics.com/jfe/form/SV_... #AcademicSky #metasci #PhDSky #PsychSkySci #STS 🧪

A big congratulations to Dr NancyOlivieri and @cbpolis.bsky.social for winning the 2023 #MaddoxPrize and #EarlyCareerMaddoxPrize from Sense About Science and Nature. Two fantastic women who stood up for good science despite lots of pushback. senseaboutscience.org/activities/m...

Erick Turner is now here at BlueSky: @eturnermd1.bsky.social He wrote a superb paper on publication bias that we discussed in our book and that now is going to be the centerpiece of a training unit on research rigor that we are developing for NIH/NINDS. Welcome, Erick.

Open data sharing is a good thing; Protecting participant privacy is a good thing. Sometimes these two good things are in conflict. Our new preprint introduces a decision-making framework and open source tools to help share as openly as possible and as closed as necessary. osf.io/preprints/me...

Researchers! As part of my PhD, I'm collecting data to help build a better picture of how the results of a research study influence publication in the literature. The survey take 5-10mins - please participate & share with your networks: cardiffunipsych.eu.qualtrics.com/jfe/form/SV_... Thanks :)

#HiSciSky! I'm a PhD student in Metascience, focusing on the Registered Reports publishing format. Looking forward to connecting with old and new faces on here! #AcademicSky #metasci #PhDSky #PsychSkySci #STS 🧪