Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

3 stories found

A student faces a split result: faster, higher-scoring AI-assisted homework on one side and declining closed-book exam performance on the other.
Work & marketsChina+4 clusters01

AI made homework faster while exam performance fell

A 30-month study of 26,811 Chinese secondary-school students estimates that generative AI raised homework scores by 18% and cut completion time by 30%, while monthly exam scores fell 20% within six months and high-stakes entrance-exam scores declined over longer exposure. The losses were concentrated among the roughly 80% of AI users whose unusually fast, high-scoring homework suggested that they were outsourcing the work rather than using AI alongside sustained effort.

3 min
A premium AI learning pod with tailored guidance is separated by glass from a crowded public classroom with worn materials and limited support.
Cognition & learningUnited States+3 clusters02

At $75,000 a year, AI schooling risks turning learning safeguards into a luxury

Yahoo News republishes Fortune reporting on Alpha School, where some families pay up to $75,000 a year for a model that compresses core subjects into two hours with AI tutors and reserves afternoons for workshops in communication, relationships, and other life skills. Human Guides motivate students but do not plan lessons or grade homework. The reported model is not simply automation replacing a teacher. It is a premium package that combines software, adult supervision, small-scale implementation, and the freedom to redesign the school day. That combination matters because the same article describes public schools confronting low literacy, high teacher turnover, limited capacity to experiment, and widespread student use of general chatbots without formal policy. The sharpest inequality may therefore be access to guardrails rather than access to AI itself. Affluent families can buy a supervised environment designed to make AI support learning; other students may receive an unrestricted chatbot, a ban, or an exhausted teacher trying to improvise. The evidence does not yet prove that Alpha's model produces stronger long-term learning, social development, or independent thinking. Tuition is not an outcome measure, and selective enrollment complicates comparisons. Policymakers should demand transparent results while investing in human-supported, evidence-tested tutoring that public schools can actually sustain. If safe AI learning becomes a boutique service, technology will widen the gap it claims to personalize away.

6 min
A mechanical confidence dial controls an answer gate while a separate correctness marker remains visibly misaligned.
Technical failuresGlobal+1 clusters03

Language models use internal confidence to decide when to abstain

A peer-reviewed study has moved the debate about AI uncertainty beyond asking whether a model can produce a confidence score. Across four language models, researchers used a four-phase experiment to test whether confidence-related internal states actually drive the decision to answer or abstain. Confidence strongly predicted refusal behavior. More importantly, activation steering that boosted or suppressed confidence changed abstention rates, and instructions that altered the decision threshold changed behavior without fundamentally changing the underlying confidence representation. That is causal evidence for a two-stage control process: an internal confidence signal and a policy that decides how much confidence is enough. The safety opportunity is real. Systems could be engineered to defer, verify, or request human review when their own uncertainty crosses a tested boundary. The warning is just as important. Verbal confidence independently influenced abstention even though it was less effective than calibrated token probabilities at distinguishing correct from incorrect answers. A model can therefore act on a confidence signal that is behaviorally powerful but imperfectly connected to truth. This is not evidence of consciousness, and the experiment does not show that open-ended agents can reliably monitor long reasoning chains. It used factual multiple-choice questions without chain-of-thought instructions. The practical lesson is narrower and more useful: confidence is a control surface. High-stakes deployment must validate both the internal signal and the threshold policy under real costs, because a model that knows when it feels unsure can still be confidently wrong about whether to proceed.

5 min