Analysis frame
Peer-reviewed research
A measured workflow saving can be valuable without establishing a patient benefit; follow the work beyond the annotation screen before scaling the claim.
- Oncology staff reviewing immunotherapy notes
- Patients and health systems managing treatment-related adverse events
- The single-system study does not establish external generalizability or improved patient outcomes.
- The destination of saved time and downstream review burden remain to be measured.
- Time savings could improve capacity if subsequent work is resourced.
- Human reviewers may anchor on suggestions or inherit additional follow-up work.
Keep the denominators visible
The crossover involved 17 staff, 20 unique notes and 316 timing observations—not 316 participants. The estimated time difference was minus 2.71 minutes, with a 95 percent confidence interval from minus 3.89 to minus 1.53. Complete agreement across six current-grade labels was 19.4 percent manually and 25.9 percent with assistance. Those are a strict endpoint, not a general accuracy score.
What comes next
The prospective silent evaluation and crossover address different questions. Neither demonstrates improved patient outcomes or independent external replication. A practical next study would follow the full pathway from extraction through verification and clinical response, including the burden of false flags and missed events.
Go to the source
Read the evidence behind this analysis. External links open in a new tab.
Nature Cancer — multi-phase clinical validation PubMed — earlier preprint record, same project


