Reviewing 72 studies of reinforcement-learning systems for sepsis treatment, the authors found that every study was retrospective, 58 studies—80.6%—relied on the same MIMIC critical-care database, and only 10 used private datasets. Although many papers claimed that AI-derived treatment policies outperformed clinicians, variation in how patient states, treatment actions, rewards, and counterfactual outcomes were defined made those comparisons difficult to validate.
Reviewing 72 studies of reinforcement-learning systems for sepsis treatment, the authors found that every study was retrospective, 58 studies—80.6%—relied on the same MIMIC critical-care database, and only 10 used private datasets.
This is strong negative-side evidence that apparent superhuman performance can emerge from fragile offline evaluation rather than demonstrated improvement in patient care; prospective trials, clinically grounded reward functions, interpretability, and external validation remain largely absent.
Read the evidence behind this analysis. External links open in a new tab.
Nature
A review of evidence across cognitive science, education, medicine, and human-factors research finds that fully offloading mental work to AI can weaken the acquisition and retention of the specific skills people stop practicing. The authors distinguish that evidence from broader claims about declining intelligence: effects on foundational abilities such as attention and working memory remain uncertain, while AI used as a collaborator, tutor, or source of feedback can preserve or improve learning.
In a randomized field experiment across a chain of middle and high schools in Turkey, giving teachers a generative-AI support tool reduced students’ intrinsic motivation by 0.11 standard deviations. Average academic performance did not change, but students taught by lower-performing teachers experienced significant declines in both performance and confidence, showing that a tool that makes lesson preparation easier for teachers does not automatically improve the student experience.
The NUS/Harbin-led team identifies a domain-specific form of generative-AI hallucination: molecular candidates can receive strong predicted binding scores while violating basic chemistry or producing physically impossible atomic arrangements. Its DrugRPG framework incorporates chemical-foundation-model priors and differentiable physical constraints during molecule generation, reducing severe steric clashes by 65.4% relative to the reported state-of-the-art baseline and increasing by 28.6% the share of generated candidates meeting combined potency, stability, and synthetic-feasibility criteria.