AIImpactLab
9 impact clustersWork & marketsCognition & learningTechnical failuresPrivacySecurityEnvironmentLaw & informationSocial good & healthSystemic risk
Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

2 stories found

Missing papers form holes in a clinical evidence wall while a rising stack of AI debt passes behind it into an interconnected financial network.
Social good & healthGlobal and United Kingdom+3 clusters01

AI can miss the evidence while markets finance the promise

Two new records describe the same structural problem at very different scales: AI is becoming consequential faster than its blind spots are becoming visible. In a peer-reviewed study, researchers evaluated Consensus, Ai2 Paper Finder, ChatGPT, Gemini, and Claude against a prospectively assembled, non-public gold-standard corpus. Across fifteen query formulations, median recall per query ranged from 7.2% to 42.2%. Even after pooling every query, platform recall ranged from 45.8% to 72.3%. Twelve percent of all relevant evidence was never retrieved by any platform, and conference proceedings were far more likely to disappear than journal articles: 38.9% versus 4.6%. The lesson is not that these tools are useless. It is that a fluent synthesis can hide an uneven evidence universe. On the same day, the Bank of England said rapid AI-related debt issuance is broadening capital-market exposure to AI capability, adoption, cyber incidents, and operational failures. Its record cites analyst estimates of roughly $450 billion in global AI-related debt issuance by early September, more than double all of 2025, and $4.1 trillion of debt-financed AI capital expenditure from 2026 through 2030. The Bank also says markets remained orderly after a July selloff and UK banks remain resilient. This is not a crash forecast. It is a visibility warning: healthcare tools can hide missing studies while financial structures hide leverage and circular exposure. Both systems need evidence maps before confidence becomes allocation.

12 min
A sealed historical archive leaks future facts into an AI drafting many competing theories, with one relativity equation buried among them.
Cognition & learningGlobal+3 clusters02

The Einstein test exposes why proving AI discovery is so hard

Could an AI trained only on knowledge available before a scientific breakthrough rediscover the breakthrough independently? Nature examines that deceptively simple test through historical language models built with cutoff dates before relativity, quantum mechanics, Turing machines, and other landmark ideas. The early results are humbling. A model trained on pre-1900 material showed occasional phrases that resembled later insights after receiving strong hints, but mostly failed and often produced plausible language without a reliable physical model. Other researchers attempting a pre-1930 system discovered that the training corpus leaked later facts: the supposedly historical model could answer questions about Franklin D. Roosevelt's administration. A University of Zurich family of four-billion-parameter models uses cutoffs at 1913, 1929, 1933, 1939, and 1946, but limited historical data and compute constrain what those systems can demonstrate. The test reveals two separate problems. First, dated archives are messy, incomplete, and contaminated by metadata and digitization. Second, a generative model can produce many theories, some suggestive and many wrong, while science still needs a process to rank them and connect them to evidence. Mathematics offers formal verification; empirical science requires experiments, instruments, causal reasoning, and judgment about which hypothesis deserves scarce attention. Historical models remain valuable because they can expose hindsight leakage and benchmark scientific novelty. But a striking rediscovery claim should not count unless the dataset, cutoff, prompts, researcher hints, candidate failures, and evaluation rule are independently reconstructable.

5 min