AIImpactLab
9 impact clustersWork & marketsCognition & learningTechnical failuresPrivacySecurityEnvironmentLaw & informationSocial good & healthSystemic risk
Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

10 stories found

A transparent lung scan and clinical evidence panel pass through several hospital environments while a performance signal changes between sites.
Social good & healthEurope+2 clusters01

Explainable AI improved oncologists’ lung-cancer predictions, but external validation exposed the limits

A multi-country study in Nature Medicine evaluated explainable AI support for treatment decisions in advanced non-small-cell lung cancer. The retrospective I3LUNG cohort included 2,396 patients treated with immunotherapy-based regimens across six centers in six countries. Models using routine clinical and blood data achieved test performance up to an area under the curve of 0.77 and outperformed traditional single biomarkers and clinical scores in the independent test set. In a separate usability study, twenty oncologists reviewed one hundred cases first without and then with model predictions and SHAP-based explanations. Sensitivity for predicting disease control increased from 0.72 to 0.87, with gains in accuracy and F1 performance; overall-survival prediction improved more modestly. The paper is valuable because it reports the limits alongside the gains. External-validation performance fell to an AUC range of 0.55 to 0.72, the complete multimodal sample was small, and added imaging, pathology, and genomic data did not produce a reliable benefit across test and external cohorts. Differences between patient populations may explain some decline, which is exactly why local calibration and prospective evaluation matter. The authors describe silent prospective validation in more than two thousand patients, another usability study, and a planned pragmatic randomized trial before deployment. The result is promising decision support, not autonomous clinical authority.

7 min
Paper-cut diagnostic panels and a clinician's hand suggest careful evaluation of imaging AI.
Social good & healthGlobal+1 clusters02

Medical AI has promising signals. Patients need proof of benefit.

These are results worth taking seriously—not because they settle the case for medical AI, but because they make the next questions sharper. A fracture-detection umbrella review covered 50 reviews and 387 primary studies. Its pooled sensitivity was 89.7% and specificity 90.4%, but certainty was generally low or very low. Comparisons between clinicians, standalone AI and assisted clinicians remained inconclusive. No included review reported adverse events or other safety outcomes. That is missing evidence, not a clean bill of health. A separate BREST-AI study examined three-year breast-cancer risk from negative screening mammograms. In external UK case–control validation, its AUC was 0.751 versus 0.700 for Mirai. The smaller US comparison did not demonstrate a statistically significant improvement. AUC measures ranking performance across thresholds; 0.751 does not mean that 75.1% of women received a correct diagnosis. The promise is real enough to investigate. Better risk stratification might help target follow-up, while better fracture detection might help clinicians notice an injury. But a useful score becomes a useful service only through decisions: who gets another examination, who waits, who receives reassurance and who is exposed to unnecessary procedures. NICE's conditional approach to certain fracture tools offers a practical model: use as an adjunct while gathering evidence, rather than substituting software for definitive review. These two new papers do not establish reduced mortality or safer care. They tell us where to look next, and which outcomes deserve to decide whether a promising tool earns a lasting place.

3 min
A clinician compares a paper ECG trace and a tablet, with a pencil poised to check a discrepancy.
Social good & healthGlobal+2 clusters03

A doctor in the loop is not a safety guarantee

If a hospital tells you a clinician checks the AI, that sounds reassuring. A new peer-reviewed review asks the question hidden inside that reassurance: what happens when the automated advice is wrong? Its evidence concerns the performance of the human-and-system combination, not simply whether a person was present in the workflow. The review includes 46 reports representing 41 independent cohort clusters, with 40 core cohorts. In four heterogeneous real-world computerized ECG studies, the pooled proportion of erroneous interpretations not corrected or recognized was 26.6%, with a very wide 95% confidence interval of 6.4% to 65.6%. That is not a failure rate for all clinicians, modern chatbots or clinical AI. The newer AI and language-model studies were too different to combine in the same way. Patient-level adverse events appeared in only one retrospective cohort. For a patient, the implication is neither to distrust every tool nor to assume a professional signature settles the safety question. For an institution, it is to test the actual review process using deliberately incorrect recommendations before relying on it. Does the reviewer see the underlying evidence? Can they disagree without friction? Is there enough time to check? Those are proposed design tests, not interventions this review proves will work everywhere. The study supports a harder standard for oversight: demonstrate error interception in the intended setting, then keep watching real outcomes.

4 min
A clinician compares overlapping prostate-cancer risk maps before a radiotherapy decision.
Social good & healthSweden+2 clusters04

A prostate-cancer AI reordered risk, but has not proved better care

A better-looking risk chart is not yet a better treatment for a patient. A new Scientific Reports study tested a previously developed multimodal AI model on 353 people receiving radiotherapy for localized prostate cancer in the STHLM3 cohort. The model combined clinical features and biopsy-slide information and produced a different risk ordering from the European Association of Urology categories. For biochemical recurrence, its concordance index was 0.65 versus 0.60 for the EAU scheme. The reported difference did not meet conventional statistical significance, with p = 0.09. Comparisons for high-risk biochemical recurrence and prostate-cancer-specific mortality were also not statistically significant. The study did find exploratory variation inside the conventional high-risk group: a subset labeled low-risk by AI had no observed biochemical recurrence over ten years, while another subset did substantially worse. That may be worth pursuing, but it is not a license to de-escalate therapy today. The threshold was determined within this radiotherapy cohort, events were limited, and the population was linked to the same broader research setting used during model development. Independent external validation and prospective tests of treatment decisions are still needed. A patient might reasonably ask, 'Would this change what my doctor does, and would that help me?' The current paper cannot answer that outcome question. Its real contribution is a testable hypothesis about who needs more or less treatment, with a clear warning that promising stratification must survive clinical trials before becoming a care rule.

7 min
An ordinary chest CT reveals a small illuminated esophageal lesion while an AI triage path directs the patient toward confirmatory endoscopy.
Social good & healthChina and international validation sites+4 clusters05

AI found hidden esophageal cancers in CT scans patients already had

A multicenter Nature Medicine study reports that an AI system called EAGLE can identify esophageal cancer and precancerous lesions in noncontrast chest CT scans that were not acquired specifically for the esophagus. The model was trained on 6,813 patients and validated across 12 centers in three countries involving 80,612 patients. In external cohorts totaling 11,466 people, it reached 90.0 percent sensitivity for cancer and 98.5 percent specificity, while sensitivity for precancerous lesions was lower at 52.5 percent. A calibration cohort of 35,402 patients reduced false positives by 72.7 percent while preserving sensitivity. In a prospective hospital cohort of 17,446 patients, 38 of 90 positive predictions were true positives, producing a 42.2 percent positive predictive value and 87.8 percent sensitivity for cancer. A real-world low-dose screening cohort of 10,959 people reported 99.94 percent specificity. The opportunity is unusually practical: use scans already being performed to identify people who should receive confirmatory endoscopy. But the strongest efficiency claims remain modeled. Simulations suggested triage could triple detection, reduce diagnostic time by 70.4 percent, and lower costs in seven of eight countries. Those are not randomized outcomes or evidence of reduced mortality. Most data came from China, follow-up was under two years, endoscopy adherence was limited, and broader validation is needed for different disease patterns. EAGLE may make existing imaging more valuable. It has not yet proved that population deployment improves survival or avoids harmful overdiagnosis.

10 min
Precision measurement instruments from multiple jurisdictions align around one frontier-AI calibration frame while a separate approval lever remains outside it.
Law & informationGlobal+4 clusters06

OpenAI proposes common frontier standards without global prerelease approval

OpenAI is proposing a U.S.-led international standards network for frontier AI, automated research, and recursive self-improvement. The company argues that shared measurements should cover capability evaluation, risk assessment, safeguard sufficiency, human oversight of automated research, and common severity levels for alignment incidents. It points to the existing international network created through the U.S. Center for AI Standards and Innovation as an institutional base. NIST says that network already includes government bodies from ten jurisdictions and has published consensus areas for automated evaluations. OpenAI draws a careful boundary around the proposal: the standards would not themselves be licenses, mandatory prerelease reviews, or approvals. National governments would decide whether and how to incorporate them into law. The post also says fully autonomous recursive self-improvement is not happening today and should not be pursued until it can be done safely. This is a consequential shift from general principles toward common technical definitions, but it also preserves national discretion and avoids a global permission system. A frontier developer has an obvious interest in standards that prevent fragmentation without slowing releases through external approval. That interest does not invalidate the proposal; it makes governance of the standard-setting process central. Credibility will depend on transparent methods, equal access for independent experts and open-model developers, declared conflicts, field validation, and evidence that a failed measurement changes what a laboratory is allowed to do.

9 min
Thousands of AI agent nodes spiral into a fluid vortex beside a formal proof chain and an independent review stamp waiting to close.
Social good & healthGlobal+4 clusters07

OpenAI says 10,000 AI agents solved the Navier-Stokes problem

OpenAI says an internal system significantly more capable than GPT-6 Astra produced an analytical proof that smooth three-dimensional fluid motion can develop a singularity in finite time under a smooth external force. That would resolve the Navier-Stokes existence and smoothness Millennium Prize problem by establishing the counterexample formulations labeled C and D in the official statement. The company released a 166-page writeup and a Lean formalization, says the decisive effort involved roughly 10,000 concurrent agents, and reports that the Navier-Stokes work used about 2.7 million agent messages and 130 billion output tokens. It does not intend to claim the million-dollar prize. The result is potentially historic, but the correct verb today is claims, not solved. A formal proof artifact makes checking more rigorous and transparent, yet experts must still verify that the definitions, assumptions, and formal statements match the intended problem and that no gap sits outside the encoded proof. Provenance also matters. OpenAI says it began after hearing rumors about related work, did not access the outside researchers' specific user data, and cannot entirely rule out indirect influence from de-identified data used to improve models. The episode therefore demonstrates both the promise and the governance burden of AI-accelerated science. Massive parallel search can attack problems at a scale unavailable to most mathematicians. Scientific legitimacy will depend on independent verification, reproducible artifacts, careful credit, and clear policies protecting unpublished work submitted to commercial AI systems.

6 min
Several luminous designed protein binders attach to a transparent molecular target above a physical laboratory assay tray.
Social good & healthGlobal+4 clusters08

Claude designs protein binders that survive wet-lab testing

Anthropic reports that Claude Opus 4.8 and Mythos Preview designed protein binders against 15 targets and succeeded against 14 after external laboratories produced and tested the designs. Reported hit rates ranged from 22.6 percent to 35.1 percent depending on the setup, above the 10 to 15 percent that Anthropic says is typical in current campaigns. The models orchestrated existing protein-design and folding tools with minimal human scientific guidance, producing 354 confirmed binders from 1,320 designs. This is a meaningful result because physical testing separates a scientific claim from a plausible-looking output. It is not a finished drug. Minibinders are an early design step, one target failed, additional characterization is planned, and the campaigns used substantial compute and specialist infrastructure. The same autonomy is dual-use, so Anthropic says its strongest biological capabilities remain restricted while it develops scientist access. The breakthrough and the control problem arrive together.

7 min
A clinical waveform and reinforcement-learning decision tree ending at an evidence gap.
Cognition & learningGlobal+2 clusters09

Tang et al., “Reinforcement learning for treatment decision-making in sepsis: a scoping review”

Reviewing 72 studies of reinforcement-learning systems for sepsis treatment, the authors found that every study was retrospective, 58 studies—80.6%—relied on the same MIMIC critical-care database, and only 10 used private datasets. Although many papers claimed that AI-derived treatment policies outperformed clinicians, variation in how patient states, treatment actions, rewards, and counterfactual outcomes were defined made those comparisons difficult to validate.

2 min
Cognition & learningGlobal+2 clusters10

Souei et al., “Artificial intelligence in deep brain stimulation for movement disorders: a systematic review and technology readiness assessment”

Researchers reviewed 239 peer-reviewed studies on AI-supported deep-brain stimulation and found a pronounced gap between reported algorithmic performance and clinical readiness. External validation remained rare, evaluations were predominantly retrospective and single-centre, and more than one-quarter of studies used small, high-dimensional datasets with elevated overfitting risk; most systems therefore remained at early-to-intermediate technology-readiness levels.

2 min