A striking diagnosis score. Not a licence to replace doctors.

Microsoft's diagnostic result deserves excitement and a careful reading. In its October 22 account of the research, Microsoft reports that MAI-DxO reached 83% diagnostic accuracy on complex New England Journal of Medicine cases, compared with 36% for physicians allowed external reference resources. The company also reports a strong result on a separate set of emergency-department cases. These are promising results for a system that works through diagnostic questions, rather than simply guessing from a finished vignette. But the setting matters. The comparisons used controlled simulations and historical cases, not a prospective trial showing improved outcomes for patients receiving care. Generalist physicians are not the same comparator as a specialist team with a physical examination, a full clinical workflow and responsibility for treatment. Microsoft's benchmark documentation also explains that its gatekeeper can supply plausible information when the underlying case record does not contain a requested detail. That does not make the experiment worthless. Controlled comparisons help identify capabilities worth testing. It does mean that a diagnostic score should not silently become a claim about clinical safety, replacement of clinicians or money already saved in hospitals. The encouraging next step is the one Microsoft itself describes: prospective evaluation with Beth Israel Deaconess. Our question is not whether an AI can look impressive on a benchmark. It is whether assistance improves decisions and outcomes when the patient, the uncertainty and the consequences are real.