Cognition & learningTechnical failuresSocial good & healthGlobalResearch
Tang et al., “Reinforcement learning for treatment decision-making in sepsis: a scoping review”
Reviewing 72 studies of reinforcement-learning systems for sepsis treatment, the authors found that every study was retrospective, 58 studies—80.6%—relied on the same MIMIC critical-care database, and only 10 used private datasets. Although many papers claimed that AI-derived treatment policies outperformed clinicians, variation in how patient states, treatment actions, rewards, and counterfactual outcomes were defined made those comparisons difficult to validate.
Reviewing 72 studies of reinforcement-learning systems for sepsis treatment, the authors found that every study was retrospective, 58 studies—80.6%—relied on the same MIMIC critical-care database, and only 10 used private datasets.
Why it matters
This is strong negative-side evidence that apparent superhuman performance can emerge from fragile offline evaluation rather than demonstrated improvement in patient care; prospective trials, clinically grounded reward functions, interpretability, and external validation remain largely absent.
Primary trail
Go to the source
Read the evidence behind this analysis. External links open in a new tab.