Benabou et al ~measure “are people are utilitarian or deontological” via lab experiments (incl. "real stakes trolley problem"). → 20-44% non-consequentialist choices, but unstable preferences 2 evaluators: interested but skeptical of design & interpretation.

https://bit.ly/3Vvz4KN Love Brian Nosek's response to my Q on "fear of negative public evaluations" @ Unjournal & Lifecyclejournal "I certainly understand the fear. I shared it myself until I had the experience of realizing that's how people advance their careers." -->

Why cite Unjournal.org evals in your research? 1. Strengthen/temper cited claims 2. Justify methods/revisions 3. Credit insights 4. Support meta-analysis How? Easy citation interfaces, individual DOIs for each eval & response Short (uslick) explainer:

Did you know The Unjournal has a researcher and evaluator pool with: 309 prioritized members, 170 highly prioritized (rated 65%+) 110 with PhD degrees 147 Economists Dashboard: https://bit.ly/4gxFZws How to get involved & use our work: https://bit.ly/3ImqTxu

Evaluation Summary and Metrics: "Maternal cash transfers for gender equity and child development: Experimental evidence from India"

Evaluation Summary and Metrics: "A systematic review and meta analysis of social safety nets, women’s economic achievements and agency"

Rethink Priorities 2022 research: “Forecasts estimate limited cultured meat production through 2050“. Unjournal 2025 evaluators: The forecasts and the report were too pessimistic. Manheim: cultured meat is likely to be commercially viable soon. https://bit.ly/4nhyIDX #CellAg #AnimalWelfare -->

Evaluation Summary and Metrics: "Forecasts estimate limited cultured meat production through 2050", Applied Stream

Evaluation Summary and Metrics: "Ends versus Means: Kantians, Utilitarians, and Moral Decisions"

Do you teach a research-focused course in economics, perhaps at the PhD level? Looking to show examples of detailed public peer-review & methodological discussion, with a focus on research with global impact? Check out unjournal.pubpub.org, or our table view here: https://bit.ly/4gaYG9n -->

At Unjournal we published evaluations of one of these working papers on universal basic income (cash payment) RCTs. Why not read some views from actual experts instead of David Brooks? link: unjournal.pubpub.org/pub/evalsumr... @unjournal.bsky.social www.nytimes.com/2025/09/05/o...

Phantom paper/citation cascade? Peasgood , Mukuria, Karimi, & Brazier (2018): "Eliciting Preference Weights for Life Satisfaction: A Feasibility Study.” Cited in influential places (incl. UK HM Treasury), but we can't find it, & authors haven't replied Have you read it/can you share a copy? -->

The Unjournal is delighted to announce the winners of our small incentives draw. We randomly selected 2 of 7 papers to award small prizes (multiplied by 7/2). Each of these had one eligible (and anonymous) evaluator:

At The Unjournal, we pay all of our evaluators who provide reviews of the impactful research we prioritize. We committed to pay $450 per evaluation on average - and that includes base pay, incentives, and prizes. Today, we’re announcing a draw for small incentives.

Evaluation Summary and Metrics: "Asymmetry in Civic Information: An Experiment on Tax Participation among Informal Firms in Togo"

At @unjournal.bsky.social we completed open peer reviews of an @nber.org WP with an experiment to counter pro-authoritarian propaganda. In sum: results are 😍, but we need to better understand what it was about the experimental intervention that made it 👌. Link: unjournal.pubpub.org/pub/evalsumd...

At The Unjournal, we compensate experts for evaluating and rating research with impact potential. We committed to pay $450 per evaluation on average - including base pay, incentives, and prizes.

Evaluation Summary and Metrics: "Misperceptions and Demand for Democracy under Authoritarianism"

Evaluation Summary and Metrics: "Population ethical intuitions"

Evaluation Summary and Metrics: "Meaningfully reducing consumption of meat and animal products is an unsolved problem: A meta-analysis"

Will we soon eat meat produced in a large bioreactor rather than on factory farms? Should animal welfare advocates fund this development? Unjournal's first "Pivotal Question" considers this: https://bit.ly/4m5ontN https://bit.ly/4nGD8EH

Drug prices too LOW? Frech et al, 2023's model & evidence suggest even US prices (highest in OECD) don't adequately incentivize R&D & USA should advocate higher global prices. 2 Unjournal evaluators: strong doubts & constructive criticism: https://bit.ly/4l8BCK7

Evaluation Summary and Metrics: “Pharmaceutical Pricing and R&D as a Global Public Good”

Unjournal makes all evaluations public & allows evaluators to choose anonymity or not. I expected those who opt into anonymity to be more negative. Plotted overall ratings --> mixed bag. https://bit.ly/4kaFQzq

Zimbabwe grandmas giving 45 minutes of therapy– among the most effective ways to boost wellbeing, says HLI meta-analysis/review/CEA. bit.ly/44cvnh0 Both evaluators had ~confidence in main results. Also critiques & suggestions; authors responded in detail. ->

Evaluation Summary and Metrics: "The wellbeing cost effectiveness of StrongMinds and Friendship Bench: review and meta-analysis with charity-related data"

Evaluation Summary and Metrics: "The Effect of Public Science on Corporate R&D"

"Can we trust social science yet?" @ryancbriggs.net‬ asks in @asterisk_mag. https://bit.ly/4kYyHTx His verdict: "at present... usually 'no.'" But he sees some points of light, including unjournal.org & i4replication.org (he's on both teams) -->

Williams et al (2024, Nature) model the biophysical potential for forest regeneration. Both Unjournal.org evaluators agree: methodological concerns fundamentally challenge the validity/utility of the modeling & the 215 Mha estimate.

Evaluation Summary and Metrics: "Global potential for natural regeneration in deforested tropical regions"

Do experts agree on what labs should do to make AI safer? Schuett et al's (2023) survey finds a broad consensus. Here’s what Unjournal’s evaluators thought about this. https://bit.ly/3StZtXU (Thread continues on Bluesky)

Evaluation Summary and Metrics: "Towards best practices in AGI safety and governance: A survey of expert opinion" (~applied stream)

Evaluation Summary and Metrics: "Choose Your Moments: NIH Peer Review and Scientific Risk Taking"

Evaluation Summary and Metrics: "A Welfare Analysis of Policies Impacting Climate Change"

Evaluation Summary and Metrics: "Adaptability and the Pivot Penalty in Science and Technology"

Excited to share the first published papers in Lifecycle Journal! In this new, transparent model, research is published before undergoing evaluation—putting publishing & evaluation in the control of the scholarly community. 📄 Read: lifecyclejournal.org/publications/ 🖋️ Submit: osf.io/registries/l...

Evaluation Summary and Metrics: "Stagnation and Scientific Incentives"

Lifecycle Journal enables researchers to share work early & receive expert evaluations that shape the credibility of their findings. @unjournal.bsky.social, one of LJ’s evaluation partners, brings rigorous independent assessment to economics & social science research. ℹ️: lifecyclejournal.org...

Top-5 journals in economics (#econsky) desk-reject half of submissions. Your globally-impactful paper is a diamond in the rough – how to get it taken seriously? Submit it to unjournal.org (bit.ly/UJsubmit) for public evaluation & rating. -->

Should China have planted billions of trees? bit.ly/42fqDrj Xing et al finds health benefits dwarf health costs (pollen). We commissioned 2 expert evaluations of this: bit.ly/42mbAdT We're grateful for the authors' commitment to open inquiry!

Evaluation Summary and Metrics: "Urban Forests: Environmental Health Values and Risks"

https://bit.ly/3R9ArfZ The Unjournal pays evaluators (~reviewers), with bonuses and prizes for promptness for strong work. We target $450 in average compensation, following the #450movement.

Thanks for posting these and for a great conference! Unjournal.org (Reinstein's) talk is at youtu.be/PegsSgZnapo?... Slides at bit.ly/bitssunjournal My talk leveraged Brian Nosek's presentation. For a more standalone version (focusing on sldes): www.youtube.com/watch?v=--2m...

#Unjournal.org considering expanding into legal research with potential for global impact. #Legal scholars/ #AppellateSky: would you be interested in doing public peer-review/rating of work in your area w/ modest compensation (~$450)? [Reposting because of previous broken link]

It could be helpful to be able to extract an @cos.io preregistration page as a flat file, perhaps through their API. To pipe into LLMs etc. to check the paper against the plan. @i4replication.bsky.social and others in #openscience -- any tips or experience with this?

FWIW Unjournal.org targets $450 per evaluator (peer reviewer) in average compensation #450movement @jamesheathers.bsky.social www.reuters.com/legal/litiga... @lucinauddin.bsky.social

Do IFLScience even if it risks “dangerous forms of bioterrorism”? Matt Clancy's models: on balance, yes, it's ~60x better to give $1 to science than to a guy earning $50k/yr . #Unjournal commissioned 3 expert evaluations, and Clancy responded in detail: https://bit.ly/4hYwc20 -->

Anyone know the answer to this question? Thanks!

Evaluation Summary and Metrics: "The animal welfare cost of meat: evidence from a survey of hypothetical scenarios among Belgian consumers"

#Unjournal.org considering expanding into legal research with potential for global impact. #Legal scholars/ #AppellateSky: would you be interested in doing public peer-review/rating of work in your area w/ modest compensation (~$450)?