Analyser change explorer
34 method comparisons at 14 data sets, from 12 open-access studies. Pick one to see its bias and crossings at each decision limit.
Research
Our method run end to end on published data: every comparison, figure and score is open to inspect, each with its source.
34 method comparisons at 14 data sets, from 12 open-access studies. Pick one to see its bias and crossings at each decision limit.
A full analyser-change report on a published platform replacement of 1,885 paired CD4 counts.
The studies behind the explorer, each with its authors, source, licence and what we changed.
A versioned evaluation standard for medical AI, built by NakedSignal, with a sealed and rotating held-out test set, demonstrated on public data.
A shared record of what analyser changes do to patient results, for laboratories that choose to contribute. Open for founding laboratories; none has contributed yet.
Practical guides to bias at decision limits, reclassification, lot-to-lot checks and comparability across sites.
6 of 6 passed
Each check was fixed before our run of 16 October 2026 on the 34 public method comparisons in the explorer. These are our own checks, not an outside validation.
Reproduces reference results (41 of 41): passed
The program reproduces its reference comparison lines and crossing counts exactly.
Re-test budget held on the fitted data: passed
On each comparison's own pairs, the share of results in the re-test band stays within the budget fixed in advance.
Re-test band holds on unseen data: passed
For every comparison large enough for a full band, the re-test share on held-out data stays within the limit fixed in advance.
Small-study safeguard: passed
A comparison too small for a full band gets an indicative grade and keeps its re-test share within the limit on held-out data.
Handles messy exports (15 of 15): passed
Awkward export files with missing columns, decimal commas, text results, duplicate IDs and similar problems each give the expected outcome.
Same result in any row order: passed
The same pairs written in two different row orders give identical results. Added by an amendment after our first public run, when a re-exported file was found to give different out-of-sample re-test shares.
A technical validation kit rebuilds our headline result from public data in an offline container and prints pass or fail. Our evidence library and analysis console are available on written request.