AIImpactLab
9 impact clustersWork & marketsCognition & learningTechnical failuresPrivacySecurityEnvironmentLaw & informationSocial good & healthSystemic risk
Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

5 stories found

Three empty chairs face unopened model-test reports in a glass-walled AI safety room.
Systemic riskUnited States / China+3 clusters01

Safety researchers were fired as a study found sparse public test results

Two reports expose different weaknesses in how the AI industry makes safety visible. AP says OpenAI fired three safety researchers after what the company calls a breach of trust involving sensitive information. The researchers say their dismissals could chill internal criticism and ask the company to honor outside-monitoring commitments. OpenAI denies the firings were retaliation for raising safety concerns. The public record does not settle whose account of the employment dispute is right, and we should not convert allegation into verdict. Reuters separately reports a SemiAnalysis review of 857 releases by nine leading Chinese developers from 2021 to September 15. It found model-specific safety results published for 31 releases, or 3.6%, and at or before launch for only nine. That measures disclosure, not whether private safety testing occurred or whether any specific model is unsafe. The review did not produce a directly comparable U.S. rate, so the two reports are not a transnational scorecard. What links them is the problem of verifiable evidence: can researchers communicate concerns safely, and can outsiders inspect release-specific tests before risk travels downstream? Better governance would protect legitimate dissent while honoring confidentiality, require documented outside-evaluator access, and make model-level results understandable without exposing sensitive exploit details.

6 min
An interdisciplinary roundtable inside a futuristic observatory surrounds a luminous AGI model while the public entrance remains beyond a transparent laboratory ring.
Systemic riskGlobal+3 clusters02

DeepMind opens an institute to debate how an AGI era should be shaped

The new DeepMind Institute says artificial general intelligence is approaching quickly enough to require sustained work across technical safety, economics, philosophy, the arts, humanities, and government. Its mission is to examine safe development, beneficial use, and social implications, including how institutions may need to adapt or be rebuilt. The institute describes itself as a platform for researchers inside Google DeepMind, Google, and the wider global community, and says contributors will disagree and revise their positions as evidence changes. It also states that technologists should not provide the answers alone. The premise is consequential: the laboratory that helped define modern frontier AI is creating an institution to frame the intellectual agenda around the next stage. That could widen debate and connect specialist knowledge to questions of meaning, distribution, and legitimacy. It could also narrow debate if participation begins from fixed assumptions that AGI is near, desirable, or inevitable. The institute's own disclaimer says its essays are conversation starters rather than Google's official view, which protects pluralism but leaves unclear how arguments will affect corporate decisions. Measure the project not by the prestige or diversity of its contributors, but by agenda-setting power. Can outsiders challenge the premises, publish uncomfortable evidence, influence release policy, and define questions the laboratory did not choose? A forum becomes public-interest infrastructure when participation can change the direction, not only enrich the discussion.

7 min
Two competing AI laboratory tracks accelerate toward a red threshold while researchers stand beside an unused emergency brake.
Systemic riskUnited States+3 clusters03

Frontier AI insiders call for a slowdown as extinction warnings intensify

CNBC reports that researchers at OpenAI and Anthropic are publicly calling for slower AI development after a departing researcher accused the laboratories of gambling with human lives. The report cites an Anthropic alignment leader's personal estimate of a greater than 10% chance of human extinction this decade, other employees warning about recursively self-improving systems, and an OpenAI chief scientist calling for extreme caution as AI begins to accelerate parts of AI research. Roughly 1,400 researchers reportedly signed a July letter urging the U.S. government to build tools for deliberately pacing automated frontier development. These statements are important evidence about concern inside the institutions building the systems. They are not a scientific measurement of extinction probability. The forecasts use uncertain definitions, undisclosed assumptions, and timelines that cannot be validated from public comments. The contradiction is institutional: laboratories describe potentially irreversible danger while competition, fundraising, product schedules, and expected public listings keep the race moving. Concern becomes governance only when it controls a decision. A credible slowdown proposal needs measurable capability triggers, independent evaluations, coordinated coverage across major developers, and a named authority that can impose or verify a pause. Without those elements, public warnings may raise awareness while leaving the operating system of the race untouched. The question is not whether one dramatic percentage is correct. It is why a stated double-digit catastrophic risk does not automatically activate a reviewable safety process.

6 min
A laboratory risk dial rises above ten percent while a deployment gate remains open and the decision rule is visibly blank.
Systemic riskUnited States+2 clusters04

Anthropic's alignment lead puts AI extinction risk above 10% this decade

CNBC reports that Anthropic's alignment science lead publicly said he assigns a greater than 10% chance to AI killing all humans within the next decade. The statement followed a colleague's resignation and warning that frontier laboratories are racing toward self-improving superintelligence. This is related to the previous story, but it is institutionally different. The first account is a departing researcher's explanation for leaving. The second is a serving safety leader endorsing the core concern while saying Anthropic is trying its best, does not yet have a plan to align superintelligence, and is not clearly on track to solve the problem. That creates a governance contradiction with real consequences: a company can describe an outcome as materially possible, lack a clear solution, and still continue capability development. A numerical estimate makes the warning legible, but it can create false precision. CNBC's report does not provide a forecasting model, base rate, calibration record, or definition of the event and time boundary behind the percentage. The statement is better treated as disclosure of institutional belief than a validated risk measurement. Boards, investors, regulators, and employees should ask what operational decision follows from that belief. If a laboratory accepts a double-digit catastrophic probability, it should publish the capability indicators that raise or lower the estimate, the thresholds that would change deployment, the independent reviewers who can test them, and the authority that can stop a release. A probability without a decision rule is a warning label on an accelerating machine.

5 min
A sealed artificial intelligence vault opens into distributed model fragments that pause at an independent safety review gate.
Law & informationUnited States+3 clusters05

Meta says open AI can check concentrated power while adding a safety-board gate

The New York Times reports that Meta is renewing its commitment to release some AI models openly and framing concentrated control as a greater danger than broad access. The company says an independent board will approve release-safety criteria and review whether models meet them. That is more specific than an appeal to openness alone, but the credibility of the structure will depend on who selects the board, what evidence it can demand, whether its decisions are public, and whether it can stop a release when commercial pressure peaks. Today's cyber-evaluation and North Korean hacking reports show why the debate cannot be reduced to open versus closed. Openness can widen research, competition, and access while also allowing capable systems to be adapted beyond the provider's monitoring and update channel.

5 min