
Doctors are asking AI how to treat patients. Are we testing the right thing?
A doctor wondering which treatment to choose is a more consequential scene than an AI acing a diagnostic quiz. A new JAMA study analyzed 271 million questions submitted by 952,008 verified US clinicians to OpenEvidence between January 2024 and June 2026. Among physicians' queries, 33.1% concerned treatment and management, while 13.9% concerned diagnosis. More than half were categorized as clinical decision-making. Monthly active users rose from 355 to 703,265 over the study period, though that is growth on one platform, not a count of all US clinicians using AI. The authors say early-career physicians and nonprocedural specialties used it disproportionately. That should change the evaluation agenda. A tool can score well on diagnostic vignettes and still give weak medication guidance, omit a contraindication or misread an evolving guideline. The study did not examine the answers, clinical decisions or patient outcomes, and it could not tell whether a question was asked at the bedside or in preparation. Its topic labels came from a model, with a small clinician validation sample, and several authors disclosed employment at the platform. Those limits do not make the usage pattern unimportant; they make independent treatment-focused testing more urgent. The next studies should compare AI-assisted and usual-care decisions on real treatment tasks, measure errors as well as speed, and ask whether patients are better off. For now, the accurate headline is not that AI treats patients. It is that clinicians are increasingly asking it treatment questions before we have strong public evidence for those answers.





