Passionate about advancing scholarly publishing? SSP is seeking judges for the 2026 EPIC Awards. Help recognize innovation and excellence in our community! Applications are open through November 28.

There’s still time to register for the Friends of #NLM webinar #AI / #LLMs and the Medical Journal: Threats and Opportunities Wed Nov 12, 2025 | 1– 3P Eastern www.fnlm.org/product/arti... ! with PRC10 Co-Directors #AnnetteFlanagin #JohnIoannidis and @chaug.bsky.social @gdtl.bsky.social and more!

What's needed to maintain an effective editorial office in the age of misinformation? @maverick-os.bsky.social's Lynsey Haire covers takeaways from an @easeeditors.bsky.social panel, which spanned workflow structures, submission screening tools/processes, and reviewer engagement.

Video recordings of our webinars “Peer Review and its Diversification” are now available on YouTube: www.youtube.com/playlist?lis... We would like to thank our speakers: Annie Whamond @anniewham.bsky.social Rachel Heyard Marcus Munafò Richard J. Acton Mario Malički @mariomalicki.bsky.social

Join us on November 18 - 9 am PT | 12 pm ET | 6 pm CET, for 8th Reproducibility Rounds: 𝐇𝐨𝐰 𝐑𝐞𝐩𝐫𝐨𝐝𝐮𝐜𝐢𝐛𝐥𝐞 𝐢𝐬 𝐇𝐞𝐚𝐥𝐭𝐡 𝐒𝐜𝐢𝐞𝐧𝐜𝐞 𝐑𝐞𝐬𝐞𝐚𝐫𝐜𝐡?. Registration at: stanford.zoom.us/meeting/regi...

@miryamnaddaf.bsky.social reports at length for @nature.com about identity verification in scientific publishing and why it is no trivial task (featuring some lovely illustrations): www.nature.com/articles/d41...

Published today: One of the biggest #science #communication studies to date. We asked 71,922 people in 68 countries how they #engage with information about #science and combined the data with several country-level factors: journals.sagepub.com/doi/10.1177/... #OpenAccess

How to find the papers you need to read — and avoid the ones you don’t - Subscribe to what matters - Let Pubmed do the work - Follow people, not papers - Use social media wisely www.nature.com/articles/d41...

Here the full story: jamanetwork.com/journals/jam... Well presented Johannes👏

In addition to being truly a giant in the field, Drummond also is the source for one of my favorite 2 slide transitions I've ever put in a talk. It shows the rapid change in sentiment on clinical trial registration in the early 2000s (in the wake of the Paroxetine scandal).

Presented at PRC10: Mss characteristics associated w being sent for review, final acceptance @science.org #ScienceAdvances 2015-19 include institutional prestige, country, team size www.science.org/cont...#ScienceAdvances@jeffreybrainard.bsky.social @aaronclauset.bsky.social @sfiscience.bsky.social @aaas.org

Presented at PRC10: Using an #AI detection tool, @theaacr.bsky.social detected 36% of abstracts contained at least some #LLM text though authors disclosed use for only 9% of papers studied www.science.org/cont...#AI#LLMy @jeffreybrainard.bsky.social @royperlis.bsky.social @evanko.bsky.social @science.org

Editorial: "Remembering Drummond Rennie—Champion of Integrity in Science and Scientific Publication." ja.ma/422578O

Earlier this month, Cecilie, @helenavbk.bsky.social, Mette, and @alundh.bsky.social presented their research at the 10th International Congress on Peer Review and Scientific Publication in Chicago! #PRC10 Read more about our team and the research we do on our website: www.sdu.dk/en/forskning...

Peer Review in Transition: Helen King and Christopher Leonard on AI and the Future of Peer Review scholarlykitchen.sspnet.org/2025/09/18/p...

For #PeerReviewWeek, I just published my BlueSky posts and notes from the 10th International Peer Review Congress, held 2 weeks ago in Chicago. #PRC10 @peerreviewcongress.bsky.social Part 1 is here: scienceintegritydigest.com/2025/09/16/p...

An AACR study presented at the 10th International Congress on Peer Review & Scientific Publication found authors & reviewers for the AACR journals are increasingly using generative AI, but only a small proportion are disclosing this usage as required by the journals. @peerreviewcongress.bsky.social

The Peer Review Congress celebrates the life of Drummond Rennie. His intellect and vision created the Congress and the field of meta-research, and sustained both for over 40 year. He was a champion of inclusion, a consummate teacher, and a wonderful friend who enriched us all. Godspeed Drummond.

@theaacr.bsky.social found that 23% of abstracts in manuscripts and 5% of peer-review reports submitted to its journals in 2024 contained text that was probably generated by large language models (#LLMs) www.nature.com/articles/d41... #AI #metaresearch

Today, our article "The entities enabling scientific fraud at scale are large, resilient, and growing rapidly" is finally published in PNAS. I hope that it proves to be a wake-up-call for the whole scientific community. reeserichardson.blog/2025/08/04/a...

👏 keynote Ana Marušić (#PeerReviewWorkbench advisory board member) “Forward to the Past – Making Contributors Accountable” concluding that authorship hasn't been replaced by contributorship; we'll need systemic approach to balance scientific credit, career advancement & ethical responsibility #PRC10

So much to absorb from a week in Chicago at @peerreviewcongress.bsky.social. Grateful to all who organized and spoke at this incredible meeting! #PRC10

Check out out research on the factors associated with trial registration and related practices in collaboration with @bmj.com

That’s a wrap on the 10th Peer Review Congress! Thanks to all for attending & following - we will repost in the following days & weeks to keep it all alive. Thanks to contributors and superfans @lexbouter.bsky.social @elisabethbik.bsky.social @abalkina.bsky.social and others for the amplification!

Comparing #LLM vs human #PeerReview of 5 @bmj.com mss, LLM reviews matched or exceeded humans on key elements of identifying strengths/weaknesses, commenting on writing, organization, and Tables and Figures, and constructiveness peerreviewcongress.o...

Methods to detect #LLM-generated #PeerReview: in ms, add command to LLM to: 1. Watermark (insert a random start string, fake citation, or technical term) 2. Hidden prompt (insert white-colored text, different language, font manipulation) @cmu.edu

A pilot study testing the ability of #MachineLearning models trained on well-annotated datasets to automate detection of hype in biomedical research writing (eg ‘groundbreaking', ‘revolutionary’) showed 70-80% accuracy vs human detection peerreviewcongress.o...#MachineLearning

In the #PubMedCentral-OA dataset, 34% (981 of 2898) of citation quotations were erroneous. #LLMs (@GeminiApp @GPT4oGPT) can be trained to detect citation errors with moderate accuracy, according to @uofilsystem.bsky.social researchers #AI

Journals with a purely #OA publishing model and higher impact factor were more likely than others to adopt RCT transparency policies (trial reg, protocol submission, #DataSharing) @utoronto.ca @wchospital.bsky.social @tmu-medicine.bsky.social #OpenScience #Metaresearch

@asapresearch.parkinsonsroadmap.org’s #OpenScience policy and compliance workflow — requiring grantees to post preprints, deposit research outputs, unambiguously i.d. research inputs — led to increases in all outcomes and activities. peerreviewcongress.o...

Among 134 higher-impact journals, 36 required, 98 recommended #datasharing. Most studies intended to share data for purposes and by mechanisms at the discretion of and subject to approval by the PI, without supporting documents or specified timeframes

In 2014-23 China experienced rapid growth in RCTs, surpassing Japan & the US. Neoplastic, CV, metabolic disease accounted for the largest percentages, each representing ~15-25% of all registered trials. In the US, mental health trials increased, reflecting growing interest in the area.

Comparing improperly vs properly registered RCTs submitted to @bmj.com, 2019-23, proper registration was associated w larger sample size, more authors, nonprofit funding. Trials with authors from Asia had higher odds of improper registration, per @eloder.bsky.social and #BMJ colleagues

Nonregistration, premature discontinuation due to poor recruitment, and nonpublication of #RCT results remain major challenges, especially for nonindustry trials @schwenkej.bsky.social @clinepi-basel.bsky.social @unibas.ch @mcmasteruniversity.bsky.social #OpenScience #MetaResearch #PeerReview

A @bmj.com RCT is comparing effects of use of an #OpenScience checklist on provision of study protocols, code, data, more. Too early to assess reproducibility FX! @mariskaleeflang.bsky.social @ingestegeman.bsky.social @floriannaudet.bsky.social @mlrethlefsen.bsky.social @amsterdamumc.bsky.social

Risks, barriers to #OpenResearch in UK higher ed id’d in the 2022-23 UK #Reproducibility Network Open & Transparent Research Practices Survey were personal (eg error), systems/institutional (eg resources), ethical/quality @lhughesnoehrer.bsky.social @naubertbonn.bsky.social @manchester.ac.uk

#ChatGPT was accurate in identifying changes in RCT outcomes on ClinicalTrials.gov, and completed the entire process (ie, matching, defining, comparing) in ~2 min per trial vs 27 min for humans @ischoolui.bsky.social @colbyvorland.bsky.socia #clinepi #metaresearch peerreviewcongress.o...

At the 10th International Congress on Peer Review and Scientific Publication in Chicago, Maria Kowalczuk, Research Integrity Auditor Manager at Frontiers, shared her abstract on editor engagement with AI-assisted checks in peer review. #PRC10 Find out more ⬇️ fro.ntiers.in/MariaPoster

SHapley Additive exPlanations (#SHAP) is a method to explain output from black box #MachineLearning models. SHAP identified words in the #McMASTERPLUS #RCT database associated w #LLM assessments of RCT rigor, quality (see image) @mcmasteruniversity.bsky.social @muala.bsky.social

#GPT-4o performed admirably at assessing whether published #RCTs include the information recommended by #SPIRIT 2013 and #CONSORT 2010 reporting guidelines @emilyricotta.bsky.social @deloittedigi.bsky.social

#NLP comparison of #COVID19 early-#pandemic pre- vs post-prints identified 22.6% (n=105) that had changes in final form that could potentially change policy guidance, including conclusions about the effectiveness of clinical or nonpharma interventions @emilyricotta.bsky.social

#ZakKohane on #AI in #PeerReview: the surge in scientific publication is straining the conventional review system beyond capacity. @ai.nejm.org piloting AI-augmented fast track review: manuscripts w high prior of being good gets assigned to #GPT5 + a human, disposition reviewed by editorial team!

Last talk: Simine Vazire @simine.com, with 'Journal Prestige Can and Should Be Earned' SV: I wear many hats. As Editor in Chief of Psychological Science I would love my journal name to mean anything, but on the other hand, should we value one journal over another? #PRC10

In a @bmj.com survey of 183 patient/public #PeerReviewers assaying their experience, perspectives on payment (£50 or an online #BMJ journal subscription) (69% response rate), 84% reported a good/very good experience, 48% might be more likely to review @emmajdoble.bsky.social @amyprice.bsky.social

In a @critcaremed.bsky.social quasi-RCT comparing financial incentives for #PeerReview ($250 vs $0), there was no difference in % invites accepted (48 vs 53%) but paid reviewers were more likely to complete reviews (OR 1.36; 95% CI. 1.01-1.84) journals.lww.com/ccm...#PeerReview@sccmcriticalcare.bsky.social

Ethical review boards in Sweden handled 20,440 applications 2021-23, mostly amendments, primarily from health care systems (51%), universities (42%), & corporations (3%). COVID-19 studies had expedited processing times (median t to decision, 51 vs 63d; P < .001). @stockholm-uni.bsky.social @ki.se

In a non-randomized comparison of a 21- v 14-d #PeerReview return deadline involving 593 review invitations for 95 JCO #Oncology Practice manuscripts, late reviews decreased (from 27% to 22%) & median time to review submission increased (from median 19 to 13 d) @ascocancer.bsky.social #metaresearch

Comparing 1291 preprint vs published versions-of-record (VORs) Oct ’22 - Dec ’24 under @eLife's Publish-Review-Curate model (where manuscripts are published as publicly reviewed preprints), 82.6% were declared ‘VOR’ after 1 revision w changes to strength, significance of evidence most common.

Paper characteristics associated w being sent for review, final acceptance @science.org #ScienceAdvances 2015-19 include institutional prestige, team size, ms topic, country, gender. Expert advice also correlates w final editorial decision @aaronclauset.bsky.social @sfiscience.bsky.social @aaas.org

Comparing submitted vs published RCT abstracts eval'd at @nejm.org in 4 domains (design, outcome, AEs, conclusions). published abstracts improved in a mean 0.9 domains. More improvements observed in leading gen med vs 433 other journals (72 % vs 48%) www.acpjournals.org/... @cpkotanidis.bsky.social