AIImpactLab
9 impact clustersWork & marketsCognition & learningTechnical failuresPrivacySecurityEnvironmentLaw & informationSocial good & healthSystemic risk
Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

5 stories found

A transparent lung scan and clinical evidence panel pass through several hospital environments while a performance signal changes between sites.
Social good & healthEurope+2 clusters01

Explainable AI improved oncologists’ lung-cancer predictions, but external validation exposed the limits

A multi-country study in Nature Medicine evaluated explainable AI support for treatment decisions in advanced non-small-cell lung cancer. The retrospective I3LUNG cohort included 2,396 patients treated with immunotherapy-based regimens across six centers in six countries. Models using routine clinical and blood data achieved test performance up to an area under the curve of 0.77 and outperformed traditional single biomarkers and clinical scores in the independent test set. In a separate usability study, twenty oncologists reviewed one hundred cases first without and then with model predictions and SHAP-based explanations. Sensitivity for predicting disease control increased from 0.72 to 0.87, with gains in accuracy and F1 performance; overall-survival prediction improved more modestly. The paper is valuable because it reports the limits alongside the gains. External-validation performance fell to an AUC range of 0.55 to 0.72, the complete multimodal sample was small, and added imaging, pathology, and genomic data did not produce a reliable benefit across test and external cohorts. Differences between patient populations may explain some decline, which is exactly why local calibration and prospective evaluation matter. The authors describe silent prospective validation in more than two thousand patients, another usability study, and a planned pragmatic randomized trial before deployment. The result is promising decision support, not autonomous clinical authority.

7 min
Thousands of AI agent nodes spiral into a fluid vortex beside a formal proof chain and an independent review stamp waiting to close.
Social good & healthGlobal+4 clusters02

OpenAI says 10,000 AI agents solved the Navier-Stokes problem

OpenAI says an internal system significantly more capable than GPT-6 Astra produced an analytical proof that smooth three-dimensional fluid motion can develop a singularity in finite time under a smooth external force. That would resolve the Navier-Stokes existence and smoothness Millennium Prize problem by establishing the counterexample formulations labeled C and D in the official statement. The company released a 166-page writeup and a Lean formalization, says the decisive effort involved roughly 10,000 concurrent agents, and reports that the Navier-Stokes work used about 2.7 million agent messages and 130 billion output tokens. It does not intend to claim the million-dollar prize. The result is potentially historic, but the correct verb today is claims, not solved. A formal proof artifact makes checking more rigorous and transparent, yet experts must still verify that the definitions, assumptions, and formal statements match the intended problem and that no gap sits outside the encoded proof. Provenance also matters. OpenAI says it began after hearing rumors about related work, did not access the outside researchers' specific user data, and cannot entirely rule out indirect influence from de-identified data used to improve models. The episode therefore demonstrates both the promise and the governance burden of AI-accelerated science. Massive parallel search can attack problems at a scale unavailable to most mathematicians. Scientific legitimacy will depend on independent verification, reproducible artifacts, careful credit, and clear policies protecting unpublished work submitted to commercial AI systems.

6 min
Several luminous designed protein binders attach to a transparent molecular target above a physical laboratory assay tray.
Social good & healthGlobal+4 clusters03

Claude designs protein binders that survive wet-lab testing

Anthropic reports that Claude Opus 4.8 and Mythos Preview designed protein binders against 15 targets and succeeded against 14 after external laboratories produced and tested the designs. Reported hit rates ranged from 22.6 percent to 35.1 percent depending on the setup, above the 10 to 15 percent that Anthropic says is typical in current campaigns. The models orchestrated existing protein-design and folding tools with minimal human scientific guidance, producing 354 confirmed binders from 1,320 designs. This is a meaningful result because physical testing separates a scientific claim from a plausible-looking output. It is not a finished drug. Minibinders are an early design step, one target failed, additional characterization is planned, and the campaigns used substantial compute and specialist infrastructure. The same autonomy is dual-use, so Anthropic says its strongest biological capabilities remain restricted while it develops scientist access. The breakthrough and the control problem arrive together.

7 min
A clinical waveform and reinforcement-learning decision tree ending at an evidence gap.
Cognition & learningGlobal+2 clusters04

Tang et al., “Reinforcement learning for treatment decision-making in sepsis: a scoping review”

Reviewing 72 studies of reinforcement-learning systems for sepsis treatment, the authors found that every study was retrospective, 58 studies—80.6%—relied on the same MIMIC critical-care database, and only 10 used private datasets. Although many papers claimed that AI-derived treatment policies outperformed clinicians, variation in how patient states, treatment actions, rewards, and counterfactual outcomes were defined made those comparisons difficult to validate.

2 min
Cognition & learningGlobal+2 clusters05

Souei et al., “Artificial intelligence in deep brain stimulation for movement disorders: a systematic review and technology readiness assessment”

Researchers reviewed 239 peer-reviewed studies on AI-supported deep-brain stimulation and found a pronounced gap between reported algorithmic performance and clinical readiness. External validation remained rare, evaluations were predominantly retrospective and single-centre, and more than one-quarter of studies used small, high-dimensional datasets with elevated overfitting risk; most systems therefore remained at early-to-intermediate technology-readiness levels.

2 min