Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

3 stories found

A luminous forensic scanner assigns conflicting human, AI, and mixed labels to the same edited manuscript while a locked penalty stamp waits behind an evidence folder.
Technical failuresGlobal+4 clusters01

AI detectors improve sharply, but mixed human-machine writing still breaks the verdict

Nature reports that a new generation of commercial AI-text detectors performs far better than earlier systems on clearly human or clearly machine-generated passages. Pangram advertises 99.98 percent accuracy and GPTZero advertises 99 percent, while independent tests found very low false-positive rates on selected human-written datasets. Adoption is spreading through publishing, conferences, preprint tools, and universities. The hard case is mixed authorship. Style imitation and humanizer tools increase false negatives, passages under 50 words reduce performance, different detectors can disagree, and a score can change when a sentence is moved into a larger segment. A label near 100 percent AI does not mean every word was generated, and vendor claims for the newest models inevitably arrive before independent validation. One technical study reported that substantially AI-modified human student essays were still labeled fully human 41 percent of the time. Detectors can prioritize review and expose undisclosed use. They cannot establish intent, contribution, or misconduct on their own. Any consequential decision needs declared rules, original evidence, human investigation, and appeal.

5 min
Teen students vote on an AI rulebook inside a school desk shaped like a senate chamber while an unreliable detector is set aside.
Cognition & learningUnited States+3 clusters02

Students wrote the AI school rules adults could not agree on

Ninety-eight teenagers representing all 50 states met in a replica U.S. Senate chamber and passed a student-written AI policy by 82 votes to 16, NPR reports. Their “Students First Act” rejects both unrestricted use and blanket panic: teach AI literacy early, ban AI on graded tests, permit limited study and editing uses after eighth grade, require disclosure, and make students prove mastery. It also says two school officials—not an AI detector alone—should review suspected misuse. The proposal is not law, but it gives school leaders something policy debates often miss: rules shaped by the people expected to learn under them.

3 min
A brutalist paper polygraph confidently identifies identical masks but falters when an unfamiliar mask enters the test chamber.
Technical failuresGlobal+2 clusters03

Anthropic's lie detector scored 0.95 at home and stumbled outside the test

Anthropic's Alignment Science team trained lie detectors using roughly 200,000 labeled examples from 12 settings and eight model families. In-distribution performance rose from an AUROC of 0.60 to 0.95, but cross-category transfer reached only about 0.70 to 0.75, and larger models prompted as judges often beat the fine-tuned detectors. The research also exposes a label problem: about one quarter of labels changed during a GPT-5-assisted cleaning process, particularly around ambiguous behavior such as sycophancy. Third-person monitoring worked better than asking a model to report on itself. The team released its datasets and explicitly limits its conclusion to controlled settings rather than production behaviors such as alignment faking or reward hacking. The result is a valuable negative finding. A detector that excels only on familiar lies is not a universal truth machine, and institutions must not convert an uncertain score into punishment without evidence and appeal.

5 min