RoundsCorrowmere Clinics · Estmark synthetic data · seed 23

Accuracy against the answer key

Every planted problem in the replayed week (2026-11-10 to 2026-11-16) scored against what the operator found and did. Source: replay-seed23.json (seed23), the week before the busiest window at 300 s steps, then the window itself at 30 s.

143planted problems in the week
92%precision (140 of 152 findings real)
97%recall (138 of 143 found)
62%handled without a person
4actions undone
90 minmean time to resolve
Weakest detector: duplicate patient, 67% precision over 18 findings. Lowest recall: result misfiled, 60% (10 planted). The known gaps page says why.
DetectorFindingsPrecisionPlantedRecallTime to resolve
abnormal result unacknowledged26
100%
26
100%
87 min
authorisation expiring16
100%
16
100%
428 min
clinician sick full list6
100%
6
100%
2 min
consent missing19
95%
18
100%
23 min
double booking12
100%
12
100%
3 min
duplicate patient18
67%
12
100%
88 min
no show cascade10
80%
7
86%
45 min
post discharge followup overdue14
100%
14
100%
27 min
referral not booked22
100%
22
100%
28 min
result misfiled9
67%
10
60%
37 min

Decided by: rules 53 · model cost 0.00 USD · left waiting for sign-off at the end: 8

The answer key in this database

Kind of problemPlanted in the worldLive in the replayed week
abnormal result unacknowledged6626
authorisation expiring1616
clinician sick full list166
consent missing1818
double booking3012
duplicate patient3212
no show cascade177
post discharge followup overdue2914
referral not booked4722
result misfiled2210