AIImpactLab
9 impact clustersWork & marketsCognition & learningTechnical failuresPrivacySecurityEnvironmentLaw & informationSocial good & healthSystemic risk
Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

3 stories found

An imagined multidisciplinary safety meeting faces a protected stop switch in a data-center control room.
Systemic riskUnited States / Global+2 clusters01

AI labs are asking philosophers for guidance as a safety leader calls for a harder brake

A Hindu monk says Anthropic invited him to discuss AI ethics and the training of Claude. The striking image is not a machine acquiring a religion; Anthropic says it has consulted scholars, clergy, philosophers and ethicists from more than 15 religious and cross-cultural groups, and explicitly rejects making Claude follow one tradition. The company says those conversations may inform its constitution, values and evaluations. We do not know what this particular discussion changed. At the same time, a former OpenAI employee who led writing for launch safety reports has resigned, arguing that a sprinting, trial-and-error culture is inadequate for more capable systems. He says he helped draft OpenAI's Preparedness Framework and oversaw reports for 12 frontier launches. OpenAI told Reuters that it pauses training or holds back models when needed. His essay is an informed first-person critique, not an independent finding that a specific launch was unsafe. The pair of stories asks a sharper question than whether AI companies care about ethics. Whose concern can delay a release, require a new test or change an agent's permissions? A diverse conversation can reveal blind spots; a documented decision process can act on them. Without both, advisers may be heard sincerely and still have no leverage. Readers should look for concrete examples of consultations changing evaluations and of safety objections reaching an accountable go/no-go decision, rather than inferring either safety or danger from a meeting invitation or resignation alone.

6 min
An abandoned research badge lies between two accelerating AI laboratories racing toward the same red danger line.
Systemic riskUnited States+2 clusters02

A departing frontier researcher says the AI race is gambling with human lives

A researcher who spent three years on model pretraining at OpenAI and Anthropic has left the AI industry with a severe warning. Euronews reports that Jacob Coxon accused both laboratories of racing toward self-improving superintelligence without acting responsibly. His distinctive claim is not merely that advanced AI could be dangerous. It is that employees understand catastrophic stakes privately yet continue because each company believes it must arrive first to prevent a less responsible rival from controlling the technology. That describes a coordination failure: individually rational competition can create a collectively unacceptable risk even when participants share the same fear. Coxon's resignation is evidence that this conflict is serious enough to change one insider's career. It is not proof that a self-improving system will emerge on his proposed timeline or that catastrophe is likely. His public thread does not provide model evaluations, incident records, capability thresholds, or a causal forecast that independent analysts can reproduce. The response should therefore avoid two easy mistakes. Dismissing the warning as marketing ignores the cost of resignation and the insider's access. Treating it as a measured probability turns testimony into science it is not. The actionable question is institutional: what shared rules would let one laboratory slow down without simply transferring advantage to another? Predeclared capability thresholds, confidential cross-lab evaluation, mandatory incident reporting, and coordinated pauses can convert fear into a testable governance proposal.

5 min
A laboratory risk dial rises above ten percent while a deployment gate remains open and the decision rule is visibly blank.
Systemic riskUnited States+2 clusters03

Anthropic's alignment lead puts AI extinction risk above 10% this decade

CNBC reports that Anthropic's alignment science lead publicly said he assigns a greater than 10% chance to AI killing all humans within the next decade. The statement followed a colleague's resignation and warning that frontier laboratories are racing toward self-improving superintelligence. This is related to the previous story, but it is institutionally different. The first account is a departing researcher's explanation for leaving. The second is a serving safety leader endorsing the core concern while saying Anthropic is trying its best, does not yet have a plan to align superintelligence, and is not clearly on track to solve the problem. That creates a governance contradiction with real consequences: a company can describe an outcome as materially possible, lack a clear solution, and still continue capability development. A numerical estimate makes the warning legible, but it can create false precision. CNBC's report does not provide a forecasting model, base rate, calibration record, or definition of the event and time boundary behind the percentage. The statement is better treated as disclosure of institutional belief than a validated risk measurement. Boards, investors, regulators, and employees should ask what operational decision follows from that belief. If a laboratory accepts a double-digit catastrophic probability, it should publish the capability indicators that raise or lower the estimate, the thresholds that would change deployment, the independent reviewers who can test them, and the authority that can stop a release. A probability without a decision rule is a warning label on an accelerating machine.

5 min