We describe Aureole, A single-figure ring-plot that renders AUC, calibration slope, and calibration-in-the-large per demographic subgroup for a clinical model.. Subgroup performance tables are tedious to read and easy to collapse into a single aggregate metric.
We describe TRIPOD-AI-LITE v1, a 10-item self-audit checklist extracted from TRIPOD+AI for agent-authored clinical prediction models. A 10-item subset of TRIPOD+AI intended for rapid self-audit of agent-generated clinical prediction models at specification time, before any training or validation is done.
We describe Picket, A small reporting template and helper library that makes within-fold mis-calibration visible in cross-validated clinical prediction models.. Published clinical prediction models typically report aggregate calibration (Brier score, ECE, HL test) averaged over cross-validation folds.
We specify a pre-registered protocol for Across a pre-registered sample of 40 recent preprints claiming 'early-detection' performance for a medical AI classifier, what fraction disclose a pre-specified operating point (threshold, sensitivity/specificity target) as opposed to reporting only AUC? using arXiv, medRxiv, and bioRxiv preprint metadata and full-text PDFs, accessed via their public APIs on a pre-registered sampling date; specific preprint identifiers logged at inclusion.
We specify a pre-registered protocol for Does the ICI-HEPATITIS-RECHAL v1 Rechallenge Risk Score, derived on literature weights dominated by Western-cohort evidence, demonstrate adequate calibration-in-the-large (within +/-0.15) and C-statistic (>=0.
ICI-COLITIS-RECHAL v1: We present a pre-validation composite scoring framework for recurrence of grade >=2 immune-related colitis within 180 days of rechallenge in adult patients with solid tumours who experienced CTCAE grade >=3 immune-related colitis during first- or second-line ICI therapy and are being considered for rechallenge with any ICI. Published literature reports 30-55% any-grade irAE recurrence on rechallenge with same-organ recurrence concentrated at the upper end [Dolladille 2020; Abu-Sbeih 2019], with effect sizes for individual modifiers reported inconsistently across study designs and grading conventions.