Our latest article argues that citation noise "represents an [...] underexplored challenge in citation analysis". Reviewers appreciate the fresh/innovative approach but question its conceptual underpinning: can citation accuracy be determined objectively? 👇 Read the assessment, reviews & full text

Really great to see this paper get published with our partner #JDIS after being reviewed at MetaROR!

@metaror.bsky.social is now 1 year old 🎉 In our first year: 28 articles evaluated, 59 expert reviewers, most reviews published ahead of target, 9 partner journals, and growing visibility across conferences & media. A strong start for community-owned, open peer review: metaror.org/metaror-turn...

That's great news, Serhii! Congratulations on the JDIS acceptance 👏

🎈 Time flies! Exactly one year ago today @rorinstitute.bsky.social and @aimosinc.bsky.social launched MetaROR, a platform to publish metaresearch through the publish-review-curate approach. Over the course of the year, we published 28 articles reviewed by 59 different reviewers. [1/3]

Discussion about next steps for MetaROR @metaror.bsky.social A partnership between @aimosinc.bsky.social and @rorinstitute.bsky.social Led by @alexh.bsky.social and @aidybarnett.bsky.social #AIMOS2025

More people need to know about MetaROR @metaror.bsky.social! If you are doing meta-research, then you get that the for-profit publishing system is a headache – you can help sideline journals by having your preprints handled by the MetaROR team for the peer review process. #AIMOS2025

Our newest study "reviews and categorises 15 publications that debate the epistemic function of replications." Reviewers found the question important, yet had some concerns about the small number of pubs selected and how they were chosen. 👇 Read the editorial assessment, reviews and full text now

Our latest article uses simulations to "explore ways in which decision reliability, bias, extent of decision randomisation and other factors interact". Reviewers consider it timely and "methodologically sound" while challenging some of the assumptions and offering suggestions. 👇 Read it here

Revised preprint: "Establishing trust in automated reasoning" osf.io/preprints/me... Based on two very helpful reviews from @metaror.bsky.social: metaror.org/kotahi/artic... More references, better discussion of unfamiliar concepts (e.g. conviviality), and more. 🧪 #metasci #compsci

How are national systems for assessing publicly funded research evolving? That's the question our latest article poses. Reviewers consider the work "valuable and timely", noting its relevance to reform initiatives like @coarassessment.bsky.social 👇 Read the assessment, reviews & full article here

Between open reviews and cases of abusing anonymity, the authors of our latest article argue for "pseudo-anonymous" (i.e., traceable) reviews. The reviewers support the general idea while also offering amendments and alternative solutions. 👇 Read the assessment, reviews & full article now

Just finished my @metaror.bsky.social journey – two rounds of #OpenPeerReview, valuable feedback, a stronger paper, and finally a journal submission. Open review takes time, but it’s worth every week for the transparency and trust it brings. doi.org/10.70744/Met... #OpenScience #Publishing

I just published my first paper on MetaROR (MetaResearch Open Review). The #PublishReviewCurate model brings reviewing and editorial decision making into the open. To me, it can become a real game changer in #ScholarlyCommunication. I got great reviews and look forward to revise my manuscript!

🆕 Our latest study asks how authors incorporate the PRISMA guideline into workflows when conducting reviews. Both reviewers highlighted the study's importance yet also requested more information and details from the author. 👇 Read the full editorial assessment, reviews and paper on MetaROR

Very glad to see the ANU Journal of Law and Technology has agreed to be @metaror.bsky.social's first partner journal from the field of law: cms.metaror.org/partner-jour... MetaROR partners accept MetaROR reviews as part of their editorial process, making the publishing ecosystem more efficient.

A qualified statistician's review can improve study designs. But who has access to one? Our new article surveys this among Australian human research ethics committees. Reviewers liked the article yet were disappointed by the response rate. They suggested minor changes. 👇Read it now on MetaROR

📠 Why should we trust automated reasoning systems? That's the question posed in our latest article by @khinsen.scholar.social.ap.brid.gy. The two reviewers generally praise the ideas but ask for more detail and share some concerns. 👇 Read the editorial assessment, reviews and full paper at MetaROR

Thank you Hans for sharing your positive experience with @metaror.bsky.social, using your reviews and assessment to publish at our partner journal, Quantitative Science Studies: www.openscience.nl/en/cases/the...

🔓 It's great to see authors sharing their experiences with publishing on MetaROR (MetaResearch Open Review) — our open review platform for metascience using the publish–review–curate model: www.openscience.nl/en/cases/the...

⌛ How is preprinting adopted over time across disciplines and regions? Our latest article attempts to answer this. The reviewers praised the comprehensive analysis & clear presentation, while requesting more background information & addressing data availability issues. 👇 Read it now on MetaROR

MetaROR will be present at the @stienid2025.bsky.social conference this week! We are excited for all the presentations, discussions and inspiration to come and we would be more than happy to greet you at our stand 👋 www.stienid2025.org

This great new initiative highlights lots of interesting research and initiatives, including (on p.40) a primer on what MetaROR is doing, by @andre-brasil.bsky.social 👏 Congratulations to everyone involved for producing such a great magazine!

Great question! Indeed @metaror.bsky.social and @peercommunityin.bsky.social have a lot in common, and in fact the MetaROR model was partly inspired by the great work done by Peer Community In (PCI). However, there are also various differences between MetaROR and PCI. Let me highlight two of them.

👇 MetaROR is very proud and excited to announce this new partnership with @plosbiology.org 🙏 As part of this, "PLOS Biology will formally consider meta-research articles that are peer-reviewed on the MetaROR platform", in order to "improve transparency" and "[prevent] futile cycles of peer review".

🔒Our latest study regards "the effect of APC waivers on the participation of Ukrainian researchers in fully Gold OA journals". The reviewers call it "well-developed", "timely" & "important" while questioning the focus on only 5 publishers. 👇Read the assessment, reviews & author response on MetaROR

Exciting news! @metaror.bsky.social has joined Lifecycle Journal's growing list of evaluation service partners, & will review & assess metaresearch submissions. Under LJ's innovative model of scholarly communication, research is published first, then openly reviewed. 🔎: lifecyclejournal.org/about/

📢 MetaROR is excited to announce our partnership with Lifecycle Journal. We have joined LCJ's growing group of evaluation services and will review and assess metaresearch submissions. 👇 LCJ joins our ever-increasing list of partner journals. Please find the full list in the link below [1/2]

Great news from Rogue Scholar! As briefly referenced in the piece, MetaROR is open to receive scholarly blog posts for peer review (as long as they fit our guidelines: cms.metaror.org/guidelines-a...) See also this peer-reviewed blog post (& thoughtful author response): metaror.org/kotahi/artic...

📝 Our latest article is on "a large-scale empirical analysis of spelling errors in scientific titles and abstracts". The reviews "emphasize the paper's novelty & scope" while suggesting "more refinement of its theoretical framing & methodological rigor" 👇 Read the full evaluation now on MetaROR

🆕 From now on, MetaROR can also include author responses on its submission pages. You will find them underneath the assessment & reviews. Have you already been reviewed on MetaROR & want to provide a response? Please contact your editor. 👇 Two of our submissions now include such a response [1/3]

When MetaROR launched at the end of last year, we published four articles. One of these has now returned to our platform for another round of peer review. 👇 Read the editorial assessment, reviews & full manuscript text at MetaROR (incl. links to the first version and first round of reviews) [1/3]

Discussion at #Metascience2025 about transforming research communication, including a talk by @andre-brasil.bsky.social about the @metaror.bsky.social platform. @rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl

Today's MetaROR paper discusses "the use of document data networks to control the topic clustering of a science map" with "rigorous methodology" & "careful presentation". Reviewers consider it "a valuable contribution to the literature", and provide the authors detailed feedback. 👇 Read on MetaROR

Very grateful to all colleagues in the metascience community who dropped by at the @metaror.bsky.social stand at the recent #Metascience2025 conference. Glad to see the overwhelming interest in the MetaROR platform! metaror.org @rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl

Innovations in #ScholarlyCommunication and #ResponsibleResearchAssessment need to go hand in hand. New guest post by @jasonchin.bsky.social, @ludowaltman.bsky.social, and Kathryn Zeiler, editors at @metaror.bsky.social, share insights on these connections. Read more👇 sfdora.org/2025/07/08/m...

In this blog post we make the case for the @metaror.bsky.social publish-review-curate model, arguing it supports better research assessment, as promoted by DORA and others. @rorinstitute.bsky.social @aimosinc.bsky.social @cwts.nl

Thank you, #Metascience2025 & everyone who took the time to connect! We're delighted with sharing resources & meaningful connections at the DORA booth! @coarassessment.bsky.social @metaror.bsky.social @ginnybarbour.bsky.social @rnls.bsky.social @scurry.bsky.social @lizziegadd.bsky.social

🖇Today, we look at a paper whose "authors examine reproducibility and replicability in qualitative research". According to the assessment, "both reviewers found the article to be technically sound, interesting, and of likely value to the field." 👇 Read the assessment, reviews & full text on MetaROR

Was very proud to represent MetaROR.org, the new preprint reviewing service for metaresearch (check out the website, we already have several articles with open reviews posted!), with @denolmo.bsky.social (pictured), @ludowaltman.bsky.social, Kathy Zeiler, and André Brasil, all at #metascience2025

Be part of the future and submit your metascience work to MetaROR! #metascience2025

🆔 What is the role of persistent identifiers and metadata standards in open science governance? Today we publish the assessment, reviews and full text of a paper asking that question. 👇 As always, everything is publicly available on MetaROR metaror.org/kotahi/artic...

🎓 Today we publish another evaluation for an article whose authors present a novel method—developed through a series of workshops—for assessing academics. 🙏 Thanks to the authors, reviewers & editors! 👇 Read the full text, reviews & editorial assessment on MetaROR metaror.org/kotahi/artic...

🤝 MetaROR is (once again) happy to announce a new partner: Advances in Methods and Practices in Psychological Science. #AMPPS "publishes innovative developments in research methods, practices and conduct [...] within psychological science". 👇 See our full list of partners on our website

🤝 We are happy to announce the Journal of Data and Information Science as its partner. JDIS, an OA peer-reviewed journal, offers a platform for scientists across diverse fields to enhance the quantitative understanding of research activities through data-driven insights. 👇 See our list of partners

📢"Peer Review at the Crossroads" (v2) is out! 🔄Improved via @metaror.bsky.social peer review. 🔗 Read the full paper here osf.io/preprints/so... #PeerReview #PublishReviewCurate #ScholarlyPublishing #ScholarlyCommunication #OpenReports #OpenIdentities #RegisteredReports #ModularPublishing

Looking forward to talking about open peer review and @metaror.bsky.social at next week's @easeeditors.bsky.social conference ease.org.uk/ease-events/.... I'll share some experiences in setting up the MetaROR platform for open peer review of metaresearch metaror.org. @rorinstitute.bsky.social

🤝 Transformative agreements have become an important strategy in the transition to open access yet they suffer from important transparency limitations. Today, MetaROR publishes the editorial assessment and reviews for a paper analyzing them using open metadata. 👇 Read it now on MetaROR

Great to read these experiences by @csmarcum.sciences.social.ap.brid.gy reflecting on the MetaROR open peer review process! Thanks Christopher!

In this post, I argue against university rankings (@aidybarnett.bsky.social) and assessment regimes that reward quantity over quality. Let's slow down, correct existing errors (@jabyrnesci.bsky.social), and engage in better peer review (eg, @metaror.bsky.social): theconversation.com/reliable-sci...