ORA Informatics · Expert Radiology
General Radiology AI Observability
Shadow mode · 584 cases · Not clinical
Safe Capacity Recommendation
Current Trust State
84%
Green
Minimal edits
14%
Yellow
Moderate edits
2%
Red
Critical corrections
Recommendation
Risk: Low (stable, low critical error rate)
Estimated safe increase in MRI read throughput: 10–15% under current model behavior.
▲Primary risk concentrated in lumbar spine measurement/grading — requires targeted radiologist oversight.
✓Hallucination and reversal rates are within acceptable thresholds for supervised AI-assist workflow.
Trust Stability — Last 14 Days
MRI case trust band distribution over time
25%50%75%100%Mar 11Mar 13Mar 15Mar 17Mar 19Mar 21Mar 23
Performance Summary
Trust Distribution
84%
14%
Green 492
Yellow 83
Red 9
Meaningful Intervention Rate
16%
92 cases required meaningful radiologist correction
Critical Risk Rate
2%
9 cases — potential diagnostic impact
Case Trust Distribution
cervical spine290 cases
84%
13%
84%Green
Minimal edits
13%Yellow
Moderate edits
3%Red
Critical corrections
lumbar spine294 cases
84%
15%
84%Green
Minimal edits
15%Yellow
Moderate edits
1%Red
Critical corrections
Systematic Error Clusters
Recurring failure patterns by anatomy
M
lumbar spine — Measurement / grading errors
66
M
cervical spine — Measurement / grading errors
62
H
lumbar spine — Fabricated findings
29
O
cervical spine — Missed findings
28
H
cervical spine — Fabricated findings
28
O
lumbar spine — Missed findings
27
N
lumbar spine — Diagnostic reversals
19
N
cervical spine — Diagnostic reversals
18
Trust Score by Anatomy
Average CCI by body region
cervical spine (290)
98 avg · 84% green
lumbar spine (294)
98 avg · 84% green
Critical Case Review
Diagnostic Reversal
Case #399MRIlumbar spineTrust 30/100
AI Preliminary Report
Degenerative change at L4-5 without epidural collection. Moderate canal stenosis is present.
Final Radiologist Report
Small posterior epidural fluid collection is present at L4-5 contributing to moderate canal stenosis.
Clinical Severity
Critical — diagnostic reversal
Error classification
Edit Distance
0.693
0 identical · 1 fully different
Meaning Preserved
30%
Word overlap with final
Trust Score
30/100
Lowest in dataset
Synthetic demo dataset · For UI and metric prototyping only · ORA Informatics MVP v1 · March 2026