AIImpactLab
9 impact clustersWork & marketsCognition & learningTechnical failuresPrivacySecurityEnvironmentLaw & informationSocial good & healthSystemic risk
Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

4 stories found

Missing papers form holes in a clinical evidence wall while a rising stack of AI debt passes behind it into an interconnected financial network.
Social good & healthGlobal and United Kingdom+3 clusters01

AI can miss the evidence while markets finance the promise

Two new records describe the same structural problem at very different scales: AI is becoming consequential faster than its blind spots are becoming visible. In a peer-reviewed study, researchers evaluated Consensus, Ai2 Paper Finder, ChatGPT, Gemini, and Claude against a prospectively assembled, non-public gold-standard corpus. Across fifteen query formulations, median recall per query ranged from 7.2% to 42.2%. Even after pooling every query, platform recall ranged from 45.8% to 72.3%. Twelve percent of all relevant evidence was never retrieved by any platform, and conference proceedings were far more likely to disappear than journal articles: 38.9% versus 4.6%. The lesson is not that these tools are useless. It is that a fluent synthesis can hide an uneven evidence universe. On the same day, the Bank of England said rapid AI-related debt issuance is broadening capital-market exposure to AI capability, adoption, cyber incidents, and operational failures. Its record cites analyst estimates of roughly $450 billion in global AI-related debt issuance by early September, more than double all of 2025, and $4.1 trillion of debt-financed AI capital expenditure from 2026 through 2030. The Bank also says markets remained orderly after a July selloff and UK banks remain resilient. This is not a crash forecast. It is a visibility warning: healthcare tools can hide missing studies while financial structures hide leverage and circular exposure. Both systems need evidence maps before confidence becomes allocation.

12 min
A friendly local-news page passes through an AI chatbot and emerges as an authoritative election answer while hidden red and blue funding cables remain visible behind it.
Law & informationUnited States and U.S.-China relations+3 clusters02

Partisan sites are shaping election chatbots as national leaders split over AI control

An audit published by POLITICO found that seven leading chatbots repeatedly treated partisan websites disguised as local news as ordinary sources for questions about competitive 2026 races. NewsGuard built 168 queries from coverage by 12 so-called pink-slime sites across six battleground states. Collectively, the chatbots cited one of those sites in 48.2 percent of responses; in 7.7 percent, a partisan site was the only source cited in the answer itself. The rates ranged from 70.8 percent for ChatGPT to 29.2 percent for Grok, and only one answer identified a cited site as partisan. Left-leaning sites appeared three times as often as right-leaning ones, but the audit found that the progressive networks also published more frequently, so the result cannot establish a general model ideology. It does reveal a laundering mechanism: when sponsorship and ownership disappear behind a chatbot’s even tone, partisan framing can arrive as neutral synthesis. A Brennan Center study complicates the picture. Six chatbots consistently challenged familiar election conspiracies, yet half of tested answers contained an inaccuracy or bad citation, and the same systems could generate misleading election media. At the national level, the governance split is just as sharp. The Washington Post reported that President Trump dismissed demands for stronger AI rules before meeting China’s leader, while China’s official account said both countries should ensure AI remains under human control. Neither statement proves how either government will act. Together, the evidence shows why the first chatbot election has no agreed referee: campaigns can shape the source layer while the two largest AI powers disagree about the rules above it.

11 min
A mechanical confidence dial controls an answer gate while a separate correctness marker remains visibly misaligned.
Technical failuresGlobal+1 clusters03

Language models use internal confidence to decide when to abstain

A peer-reviewed study has moved the debate about AI uncertainty beyond asking whether a model can produce a confidence score. Across four language models, researchers used a four-phase experiment to test whether confidence-related internal states actually drive the decision to answer or abstain. Confidence strongly predicted refusal behavior. More importantly, activation steering that boosted or suppressed confidence changed abstention rates, and instructions that altered the decision threshold changed behavior without fundamentally changing the underlying confidence representation. That is causal evidence for a two-stage control process: an internal confidence signal and a policy that decides how much confidence is enough. The safety opportunity is real. Systems could be engineered to defer, verify, or request human review when their own uncertainty crosses a tested boundary. The warning is just as important. Verbal confidence independently influenced abstention even though it was less effective than calibrated token probabilities at distinguishing correct from incorrect answers. A model can therefore act on a confidence signal that is behaviorally powerful but imperfectly connected to truth. This is not evidence of consciousness, and the experiment does not show that open-ended agents can reliably monitor long reasoning chains. It used factual multiple-choice questions without chain-of-thought instructions. The practical lesson is narrower and more useful: confidence is a control surface. High-stakes deployment must validate both the internal signal and the threshold policy under real costs, because a model that knows when it feels unsure can still be confidently wrong about whether to proceed.

5 min
A retro-futurist debate stage shows an AI podium flooding an evidence table with claim cards while elite human debaters race a rapidly advancing fact-check clock.
Cognition & learningGlobal+3 clusters04

AI chatbots outpersuaded elite human debaters by producing more claims faster

A preprint covered by Science placed more than 2,000 people in political debates with other people or leading chatbots. ChatGPT, Gemini, and Claude consistently changed opinions more than laypeople and a paid group of 56 elite debaters, including world champions. The models' advantage was not a mysterious new form of wisdom. Persuasion rose with the number of fact-checkable claims, and forcing AI to write human-length messages at human speed brought its performance down to roughly human levels. That mechanism should alarm anyone building political, commercial, or therapeutic chatbots: claim volume can look like evidence even when the facts are weak or false. The researchers also found professional fundraisers were less effective than a persuasive bot at increasing donations in the study. These are controlled experiments with paid participants, not proof of mass persuasion in the wild, but they expose a scalable asymmetry between the speed of assertion and the time humans need to verify it.

6 min