Ben Van Calster
@benvancalster.bsky.social
š¤ 762
š„ 211
š 39
Medical Statistician at KU Leuven. My brain is like a snail but it gets there in the end (or not).
reposted by
Ben Van Calster
The BMJ
6 days ago
Doug Altman was an internationally renowned statistician who served as The BMJās chief statistical adviser. Read about life and work that made this statistician a "citation millionaire"
#BMJChristmas
www.bmj.com/content/391/...
0
57
33
Our guidance regarding performance measures for medical AI models is finally out! - Stop bashing AUROC, although it does not settle things - Calibration and clinical utility are key - Show risk distributions - Classification statistics (e.g. F1) are improper
www.thelancet.com/journals/lan...
loading . . .
Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: overview and guidance
Numerous measures have been proposed to illustrate the performance of predictive artificial intelligence (AI) models. Selecting appropriate performance measures is essential for predictive AI models i...
https://www.thelancet.com/journals/landig/article/PIIS2589-7500(25)00098-6/fulltext
10 days ago
2
48
25
reposted by
Ben Van Calster
Andrew Mercer
4 months ago
Expertise is having fucked up in enough different ways that you become able to anticipate it.
0
29
11
In our latest work, we show that risk estimates for patients are HUGELY uncertain due to model, data, and population uncertainty. Even for well performing models (c statistic, calibration, utility) based on large N. @laure_wynants @ESteyerberg
@lasaibarrenada.bsky.social
arxiv.org/abs/2506.17141
loading . . .
The fundamental problem of risk prediction for individuals: health AI, uncertainty, and personalized medicine
Background: Clinical prediction models for a health condition are commonly evaluated regarding performance for a population, although decisions are made for individuals. The classic view relates uncer...
https://arxiv.org/abs/2506.17141
4 months ago
1
8
3
Universities love open science Small print: unless money is involved
4 months ago
0
3
0
reposted by
Ben Van Calster
Dorothy Bishop
4 months ago
Huge variability documented in how publishers respond when informed about a problematic body of work by a research group.
www.jclinepi.com/article/S089...
#publishers
#retractions
2
107
62
reposted by
Ben Van Calster
Triad sou.
5 months ago
Multiple Imputation of Missing Covariates When Using the FineāGray Model. Edouard F. Bonneville, Jan Beyersmann, Ruth H. Keogh, Jonathan W. Bartlett, Tim P. Morris, Nicola Polverelli, Liesbeth C. de Wreede, Hein Putter. Statistics in Medicine.
onlinelibrary.wiley.com/doi/10.1002/...
loading . . .
Multiple Imputation of Missing Covariates When Using the FineāGray Model
The FineāGray model for the subdistribution hazard is commonly used for estimating associations between covariates and competing risks outcomes. When there are missing values in the covariates includ...
https://onlinelibrary.wiley.com/doi/10.1002/sim.70166?af=R
0
5
2
reposted by
Ben Van Calster
Darren Dahly
5 months ago
Seconded. Any time someone uses this term, make sure they explain exactly what they mean. If they can't, they are obviously trying to bullshit you.
add a skeleton here at some point
2
23
4
reposted by
Ben Van Calster
Samuel Moore
5 months ago
āVolume is a bad driver,ā [Sir Mark Walport] said. āThe incentive should be quality, not quantity. Itās about re-engineering the system in a way that encourages good research from beginning to end.ā
www.theguardian.com/science/2025...
loading . . .
Quality of scientific papers questioned as academics āoverwhelmedā by the millions published
Widespread mockery of AI-generated rat with giant penis in one paper brings problem to public attention
https://www.theguardian.com/science/2025/jul/13/quality-of-scientific-papers-questioned-as-academics-overwhelmed-by-the-millions-published
1
30
16
reposted by
Ben Van Calster
RickiāšŖ
6 months ago
What is common knowledge in your field, but shocks outsiders? Data isn't objective and researchers have innumerable ways to put their thumbs on the scale. Many don't understand statistics well enough to realize they're doing it.
add a skeleton here at some point
3
53
16
reposted by
Ben Van Calster
Richard Riley (R²)
7 months ago
**New Lancet DH paper** "Importance of sample size on the quality & utility of AI-based prediction models for healthcare" - for broad audience - explains why inadequate SS harms
#AI
model training, evaluation & performance - pushback to claims SS irrelevant to AI research š
tinyurl.com/yrje52fn
loading . . .
Importance of sample size on the quality and utility of AI-based prediction models for healthcare
Rigorous study design and analytical standards are required to generate reliable findings in healthcare from artificial intelligence (AI) research. Onā¦
https://www.sciencedirect.com/science/article/pii/S2589750025000214
2
34
17
I recently had a paper in a journal where the fee for open access was lower than the fee for closed access. Is that common?
@grahamkendall.bsky.social
8 months ago
1
1
0
reposted by
Ben Van Calster
Oliver Alexander
9 months ago
Why arenāt you wearing a suit? Have you said āThank youā to Greenland and Denmark for allowing you to have a base on Greenland?
1151
34918
8579
reposted by
Ben Van Calster
Julia M. Rohrer
10 months ago
Oh, there's an English version as well! DW reports about misconduct at Max Planck Institutes:
www.youtube.com/watch?v=n5nE...
add a skeleton here at some point
6
35
28
PROBAST+AI is out!
www.bmj.com/content/388/...
loading . . .
PROBAST+AI: an updated quality, risk of bias, and applicability assessment tool for prediction models using regression or artificial intelligence methods
The Prediction model Risk Of Bias ASsessment Tool (PROBAST) is used to assess the quality, risk of bias, and applicability of prediction models or algorithms and of prediction model/algorithm studies....
https://www.bmj.com/content/388/bmj-2024-082505
9 months ago
0
3
0
reposted by
Ben Van Calster
Lasai BarreƱada, "Lasso"
9 months ago
I will be presenting our recent work on individual risk estimation uncertainty at ENAR in New Orleans. Come say hi! Work with
@benvancalster.bsky.social
@laurewynants.bsky.social
#DoranneThomassen
#EwoutSteyerberg
0
5
1
Quousque tandem?
@kuleuvenuniversity.bsky.social
@fwovlaanderen.bsky.social
A lot of publications in MDPI journals also in Flanders, despite it being listed on
predatoryjournals.org
.
add a skeleton here at some point
9 months ago
0
0
1
reposted by
Ben Van Calster
Eric Schares
about 1 year ago
šØ Preprint! We combine our recent open dataset of
#APC
prices with the article counts per journal-year from
#OpenAlex
to estimate how much the academic community has paid in APCs over the last 5 years. A. $8.349 billion ($8.968 B in 2023 USD) $2.5B in 2023 alone.
arxiv.org/abs/2407.16551
#metasci
loading . . .
Estimating global article processing charges paid to six publishers for open access between 2019 and 2023
This study presents estimates of the global expenditure on article processing charges (APCs) paid to six publishers for open access between 2019 and 2023. APCs are fees charged for publishing in some ...
https://arxiv.org/abs/2407.16551
6
187
181
reposted by
Ben Van Calster
Dr Abeba Birhane
9 months ago
my life would radically improve if i werenāt subjected to microsoft products..,. like my days would feel a 1000 x better
27
312
29
reposted by
Ben Van Calster
Lasai BarreƱada, "Lasso"
10 months ago
NEW PREPRINT š: We propose 3 methods to obtain flexible calibration plots while accounting for clustering: 1. Clustered Group Calibration (CG-C) 2. Two-Stage Meta-Analysis Calibration (2MA-C) 3. Mixed Model Calibration (MIX-C) Ready-to-use R code included!
add a skeleton here at some point
0
9
3
We tried to look at ways to obtain flexible calibration plots in clustered (e.g. multicenter) validation studies. Work with
@lasaibarrenada.bsky.social
@laurewynants.bsky.social
@bavodccampo.bsky.social
arxiv.org/abs/2503.08389
loading . . .
Clustered Flexible Calibration Plots For Binary Outcomes Using Random Effects Modeling
Evaluation of clinical prediction models across multiple clusters, whether centers or datasets, is becoming increasingly common. A comprehensive evaluation includes an assessment of the agreement betw...
https://arxiv.org/abs/2503.08389
10 months ago
0
12
4
It is a good day today, I got the reviewer comment "please consult a statistician" again.
10 months ago
1
29
3
reposted by
Ben Van Calster
Andreas De Block
10 months ago
'Onze universiteit roept op tot evidence-based beleid, maar zelf volgt de rector zijn buikgevoel'
www.veto.be/onderzoek/on...
loading . . .
'Onze universiteit roept op tot evidence-based beleid, maar zelf volgt de rector zijn buikgevoel'
Professor wetenschapsfilosofie Andreas De Block zat acht jaar lang de rectorale denktank rond basisfinanciering voor. Hij blikt teleurgesteld terug op het afgelegde traject: 'De uitkomst moest altijd ...
https://www.veto.be/onderzoek/onze-universiteit-roept-op-tot-evidence-based-beleid-maar-zelf-volgt-de-rector-zijn-buikgevoel/352081
2
14
8
reposted by
Ben Van Calster
Nikolay Tumanov
11 months ago
Bad. But how bad? I once asked myself, while finding fakes in the Scientific Report
@natureportfolio.bsky.social
. So I decide to "do my our research" - I took 100 articles in a row from Physical sciences that contains diffraction. Result - 15 fakes out 100. Details in the š§µ
#ResearchIntegrity
1/x
5
170
90
reposted by
Ben Van Calster
Maarten van Smeden
about 1 year ago
NEW PREPRINT A detailed overview of 32 popular predictive performance metrics for prediction models
arxiv.org/abs/2412.10288
11
192
71
New work in preprint! "Performance evaluation of predictive AI models to support medical decisions: Overview and guidance". Under the wings of the STRATOS initiative. But
@maartenvsmeden.bsky.social
said it better already š
arxiv.org/abs/2412.10288
loading . . .
Performance evaluation of predictive AI models to support medical decisions: Overview and guidance
A myriad of measures to illustrate performance of predictive artificial intelligence (AI) models have been proposed in the literature. Selecting appropriate performance measures is essential for predi...
http://arxiv.org/abs/2412.10288
about 1 year ago
0
42
16
Is this something everybody knows already but me? The joy of EHR!
www.youtube.com/watch?v=xB_t...
loading . . .
EHR State of Mind | An Electronic Medical Records Parody
YouTube video by ZDoggMD
https://www.youtube.com/watch?v=xB_tSFJsjsw
about 1 year ago
0
3
0
reposted by
Ben Van Calster
Alejandro Montenegro
about 1 year ago
FFS
www.sciencedirect.com/science/arti...
9
211
74
reposted by
Ben Van Calster
Darren Dahly
about 1 year ago
Covariate adjustment = AI digital twins š Such dishonesty Good luck regulators and HTAs. I hope you are able to hold the line and insist on evidence for all the claims in this advert.
www.insideprecisionmedicine.com/topics/infor...
4
26
10
I'm always getting stuck when I try to sharply define (the differences between) biases like information bias, observer bias, detection bias, and ascertainment bias. I read quite some contradicting things. How should I see this?
about 1 year ago
0
1
0
reposted by
Ben Van Calster
Stephen Curry
about 1 year ago
I will not be completing this survey and would encourage everyone else to do likewise. These opinions are converted into so called measurements of university performance in the THE World University Rankings - a ridiculous and damaging exercise for the sector.
5
102
54
you reached the end!!
feeds!
log in