🔖 Now up on MetaROR: a full evaluation of the Handbook for Reproduction and Replication Studies, which enables researchers to conduct high-quality reproductions & replications across social science disciplines. Reviewers praised it as timely & useful while providing recommendations. Read it now 👇

Today we publish the evaluation of a bibliometric analysis of (bilateral & multilateral) scientific collaboration intensity between Russia and other countries. Reviewers recognize the approach's value & also provide (literature) suggestions. 👇 Read the assessment, reviews and full text on MetaROR

This article, which went through two rounds of MetaROR evaluation, just got published in Quantitative Science Studies! 👏 Congratulations to the authors! Read it here: direct.mit.edu/qss/article/...

Our two Iranian co-authors, Saeed Shafiei Sabet of the University of Guilan and Marziyeh Amini Fard may not know about these positive reviews for our manuscript, because my emails to them continue to bounce. I wanted to recognize them here because I'm very concerned about their future.

🗨️ This article's authors announce expansion of CRediT into 36 languages & describe how translations from English were made. Reviewers commended the method & praised the project for being inclusive. They raise issues on automatic translation and limitations of CRediT. 👇 Read the full evaluation

🔗 This new evaluation attempts to trace causal linkages from research funding towards societal outcomes. Researchers praise it for showing how targeted funding can foster mutually beneficial academia–industry collaborations. They also identify problems in framing, clarity & depth. 👇 Read now

We are delighted to see the growth of the ‘Publish, Review, Curate’ (PRC) initiatives in recent years!🚀 One of them is @metaror.bsky.social (MetaResearch Open Review). This platform focuses on open peer review and curation of metaresearch articles. Learn more about MetaROR👉️ metaror.org

Who owns the knowledge? Our latest evaluation is a call for researchers to act in response to AI models using their research. Reviewers consider it a good primer on the topic yet suggest more focus on the political/commercial context & greater precision in the legal analysis. 👇 Read now on MetaROR

🔍 Academic search engine optimisation (A-SEO) vital for enhancing research visibility. Our latest evaluation is a study comparing four leading A-SEO tools. Reviewers emphasize the topic's relevance but do point out the limitation of including only 2 publishers in the study. 👇 Read now on MetaROR

2️⃣ The authors of this article on preprint adoption across discipline and region returned for a 2nd evaluation. Our editor found changes corresponding to most suggestions made in the reviews and reasonable and convincing arguments for why specific suggestions were declined. 👇 Read it all on MetaROR

#Excited for the fteval Journal for Research and Technology Policy Evaluation X @metaror.bsky.social collaboration. We, @fteval, @rorinstitute.bsky.social @aimosinc.bsky.social, are joined by the mission for open & transparent peer review and strengthening international the field of meta-research.

2️⃣ After the initial review, the authors returned to MetaROR for a second round. Reviewers believe that their concerns have been addressed, though one of them still prefers the author to drop three references. 👇 Read the 2nd evaluation round, incl. reviews, assessment and full article now on MetaROR

Today, author @tomhardwicke.bsky.social argues "that without safeguards, Synchronous Robustness Reports could inadvertently create more confusion than clarity about robustness. The reviewer, among other things, suggests distinguishing between different types of reports. 👇 Read it now on MetaROR

🔓 Our latest article presents an analysis of bronze open access publications in the Web of Science database. Reviewers did not identify major weaknesses, calling it solid, timely & sound, and suggested expanding the discussion on the concept of bronze OA. 👇 Read the full evaluation now on MetaROR

🤝 We are happy to announce another new partner journal: @jcre.bsky.social The Journal of Comments and Replications in Economics "aims for articles that comment on or replicate previously published articles in economics & closely related disciplines" 👇 See our full list of partners on our website

🇬🇧 Our latest paper "uses broad bibliometrics to compare the STEM and SHAPE sectors over time in the UK, with comparisons to other countries" Reviewers find it timely & useful, yet suggest a different analytical approach as well as a tighter definition of SHAPE 👇 Find the full evaluation on MetaROR

🤝 MetaROR is happy to announce Replication Research as its new partner journal! @r2journal.bsky.social is an interdisciplinary journal for replication research focusing on reproductions, close replications and conceptual replications. 👇 See our full list of partners on our website

We published a 2nd round of reviews for a paper on preprint review services' "potential to turn peer review into a more transparent and rewarding experience and to improve publishing and peer review workflows" Reviewers see improvements while still highlighting a potential issue. 👇 Read on MetaROR

🤝 MetaROR is happy to announce Psychology, Public Policy, & Law as its partner. @pppl-journal.bsky.social "provides a forum to critically evaluate contributions of psychology & related disciplines to public policy & legal issues & vice versa." 👇 See our list of partners metaror.org/partner-jour...

For the University of Helsinki's comprehensive research assessment, researchers designed a dedicated module to capture interdisciplinarity. Reviewers called their approach "inspiring" and did not identify major weaknesses, but do provide recommendations. 👇 Read the assessment, reviews & full text

We are now a partner journal of @metaror.bsky.social, @jcre.bsky.social, and The Tromsø Repository of Language and Linguistics (TROLLing). Read the full announcement here: www.uni-muenster.de/Ejournals/in...

Innovation in scientific publishing and its implications for Crossref DOI registration practices - MetaROR’s approach doi.org/10.64000/vfe... Together with @andre-brasil.bsky.social I just published this blog post about @crossref.bsky.social DOI registration practices for @metaror.bsky.social.

@metaror.bsky.social has made some major decisions about its deployment of DOIs:We will mint separate DOIs for peer-reviewed preprints using the 'article' reference type. @ludowaltman.bsky.social and André Brasil lay out our reasoning here: www.crossref.org/blog/innovat...

Innovation in scientific publishing and its implications for Crossref DOI registration practices - MetaROR’s approach https://metaror.org/innovation-in-scientific-publishing-and-its-implications-for-crossref-doi-registration-practices-metarors-approach/

Publication bias poses a serious challenge to clarity and precision in scientific research & meta-analyses. This article by Paweł Lenartowicz poses a way to deal with this: the Likelihood Ratio Test for Publication Bias. 👇 Read the editorial assessment, peer reviews, and full article on MetaROR now

Our latest article argues that citation noise "represents an [...] underexplored challenge in citation analysis". Reviewers appreciate the fresh/innovative approach but question its conceptual underpinning: can citation accuracy be determined objectively? 👇 Read the assessment, reviews & full text

Really great to see this paper get published with our partner #JDIS after being reviewed at MetaROR!

@metaror.bsky.social is now 1 year old 🎉 In our first year: 28 articles evaluated, 59 expert reviewers, most reviews published ahead of target, 9 partner journals, and growing visibility across conferences & media. A strong start for community-owned, open peer review: metaror.org/metaror-turn...

That's great news, Serhii! Congratulations on the JDIS acceptance 👏

🎈 Time flies! Exactly one year ago today @rorinstitute.bsky.social and @aimosinc.bsky.social launched MetaROR, a platform to publish metaresearch through the publish-review-curate approach. Over the course of the year, we published 28 articles reviewed by 59 different reviewers. [1/3]

Discussion about next steps for MetaROR @metaror.bsky.social A partnership between @aimosinc.bsky.social and @rorinstitute.bsky.social Led by @alexh.bsky.social and @aidybarnett.bsky.social #AIMOS2025

More people need to know about MetaROR @metaror.bsky.social! If you are doing meta-research, then you get that the for-profit publishing system is a headache – you can help sideline journals by having your preprints handled by the MetaROR team for the peer review process. #AIMOS2025

Our newest study "reviews and categorises 15 publications that debate the epistemic function of replications." Reviewers found the question important, yet had some concerns about the small number of pubs selected and how they were chosen. 👇 Read the editorial assessment, reviews and full text now

Our latest article uses simulations to "explore ways in which decision reliability, bias, extent of decision randomisation and other factors interact". Reviewers consider it timely and "methodologically sound" while challenging some of the assumptions and offering suggestions. 👇 Read it here

Revised preprint: "Establishing trust in automated reasoning" osf.io/preprints/me... Based on two very helpful reviews from @metaror.bsky.social: metaror.org/kotahi/artic... More references, better discussion of unfamiliar concepts (e.g. conviviality), and more. 🧪 #metasci #compsci

How are national systems for assessing publicly funded research evolving? That's the question our latest article poses. Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social 👇 Read the assessment, reviews & full article here

Between open reviews and cases of abusing anonymity, the authors of our latest article argue for "pseudo-anonymous" (i.e., traceable) reviews. The reviewers support the general idea while also offering amendments and alternative solutions. 👇 Read the assessment, reviews & full article now

Just finished my @metaror.bsky.social journey – two rounds of #OpenPeerReview, valuable feedback, a stronger paper, and finally a journal submission. Open review takes time, but it’s worth every week for the transparency and trust it brings. doi.org/10.70744/Met... #OpenScience #Publishing

I just published my first paper on MetaROR (MetaResearch Open Review). The #PublishReviewCurate model brings reviewing and editorial decision making into the open. To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!

🆕 Our latest study asks how authors incorporate the PRISMA guideline into workflows when conducting reviews. Both reviewers highlighted the study's importance yet also requested more information and details from the author. 👇 Read the full editorial assessment, reviews and paper on MetaROR

Very glad to see the ANU Journal of Law and Technology has agreed to be @metaror.bsky.social's first partner journal from the field of law: cms.metaror.org/partner-jour... MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.

A qualified statistician's review can improve study designs. But who has access to one? Our new article surveys this among Australian human research ethics committees. Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes. 👇Read it now on MetaROR

📠 Why should we trust automated reasoning systems? That's the question posed in our latest article by @khinsen.scholar.social.ap.brid.gy. The two reviewers generally praise the ideas but ask for more detail and share some concerns. 👇 Read the editorial assessment, reviews and full paper at MetaROR

Thank you Hans for sharing your positive experience with @metaror.bsky.social, using your reviews and assessment to publish at our partner journal, Quantitative Science Studies: www.openscience.nl/en/cases/the...

🔓 It's great to see authors sharing their experiences with publishing on MetaROR (MetaResearch Open Review) — our open review platform for metascience using the publish–review–curate model: www.openscience.nl/en/cases/the...

⌛ How is preprinting adopted over time across disciplines and regions? Our latest article attempts to answer this. The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues. 👇 Read it now on MetaROR

MetaROR will be present at the @stienid2025.bsky.social conference this week! We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋 www.stienid2025.org

This great new initiative highlights lots of interesting research and initiatives, including (on p.40) a primer on what MetaROR is doing, by @andre-brasil.bsky.social 👏 Congratulations to everyone involved for producing such a great magazine!

Great question! Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI). However, there are also various differences between MetaROR and PCI. Let me highlight two of them.

👇 MetaROR is very proud and excited to announce this new partnership with @plosbiology.org 🙏 As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".