How we read the signal

Analysis frame

Evidence level

Peer-reviewed research

Analytical lens

Evaluate human error interception under incorrect advice, without conflating heterogeneous tasks or historical systems.

Affected groups
  • Patients receiving AI-supported care
  • Clinicians reviewing recommendations
  • Hospitals procuring decision-support systems
What remains unknown
  • Generalizability to particular current models and specialties
  • Reliable effects on patient-level outcomes
  • Which workflow interventions improve interception in each setting
Second-order effects to watch
  • Testing bad recommendations could reveal weak workflows hidden by average accuracy.
  • A blanket requirement for signatures could add workload without improving detection.

Read the denominator before sharing the number

The 26.6% estimate concerns erroneous computerized ECG interpretations in four studies, not all AI-assisted decisions. Heterogeneity was high (I² = 95.8%). The article is an accepted, peer-reviewed early version, published October 23 and still subject to final editing. These qualifications belong with the result, not in a footnote readers never reach.

Useful tools still need a complete pathway

WHO's regulatory considerations emphasize intended use, external validation, human intervention and lifecycle monitoring. Those are useful baselines, not proof that any specific product is safe.

The constructive opportunity is to evaluate the combined service: the machine's output, the clinician's response and the patient's subsequent care. Better average accuracy may coexist with a dangerous pattern of deference on the cases where the machine is wrong. That is the failure mode institutions should actively look for, without treating this review as personal medical advice.

Primary trail

Go to the source

Read the evidence behind this analysis. External links open in a new tab.

npj Digital Medicine — systematic review and meta-analysis WHO — regulatory considerations for AI in health