Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

Search all reporting

5 stories found

A programming student faces three artificial intelligence tutor pathways with rising engagement indicators but unchanged learning gauges.

More engagement did not mean more learning when AI tutors were steered by prompts

A preregistered ICER 2026 study tested whether system prompts could make AI tutors produce better learning behavior in an authentic introductory programming course. In a three-arm crossover design involving 1,059 students over six weeks, researchers compared a constrained baseline tutor with two tutors prompted to support planning, monitoring, reflection, and deeper cognitive engagement. Across four preregistered confirmatory measures, the study found no statistically significant differences. Exploratory analyses found that students sometimes spent longer, wrote longer messages, and made more constructive contributions with the self-regulated-learning tutors, while the relationship between cognitive load and quiz performance also shifted. Those exploratory patterns should not be presented as confirmed learning gains. The practical signal is narrower and important: changing a tutor's system prompt can change interaction without reliably changing measured learning. Better educational AI may require student choice, adaptive pedagogy, stronger course integration, and evaluation based on durable capability rather than engagement alone.

Aug 13, 20265 min

An unfinished mathematics notebook sits beside the glow of an AI answer on a screen.

Cognition & learningGlobal+2 clusters02

AI help raised short-term scores, then weakened independent performance

The unnerving part of this study is not that AI gave wrong answers. It often helped people solve the immediate problem. The cost appeared after the tool was removed. In randomized experiments involving 1,222 participants, researchers tested fraction problems and reading comprehension. Across the experiments, assisted performance improved, but later unaided performance fell. Participants also skipped more problems in some conditions. The pattern appeared after roughly ten to fifteen minutes of use. That is an experimental result about short tasks, not evidence that any individual's intelligence has permanently declined. One replication found a smaller accuracy gap, and its overall skip-rate difference was not statistically significant. A subgroup analysis suggested the largest persistence cost among people who sought direct answers, but that comparison was observational within the trial and should not be called causal. The practical implication is a design choice: an assistant that always finishes the problem may optimize the visible score while removing the practice that builds competence. Teachers and employers should test what people can do without the tool, not merely count AI-assisted output. Developers could compare answer-giving against hint-first or delayed-help designs. The paper began as an April preprint and was revised October 3; it is not a new experiment performed today.

Oct 10, 20265 min

A premium AI learning pod with tailored guidance is separated by glass from a crowded public classroom with worn materials and limited support.

Cognition & learningUnited States+3 clusters03

At $75,000 a year, AI schooling risks turning learning safeguards into a luxury

Yahoo News republishes Fortune reporting on Alpha School, where some families pay up to $75,000 a year for a model that compresses core subjects into two hours with AI tutors and reserves afternoons for workshops in communication, relationships, and other life skills. Human Guides motivate students but do not plan lessons or grade homework. The reported model is not simply automation replacing a teacher. It is a premium package that combines software, adult supervision, small-scale implementation, and the freedom to redesign the school day. That combination matters because the same article describes public schools confronting low literacy, high teacher turnover, limited capacity to experiment, and widespread student use of general chatbots without formal policy. The sharpest inequality may therefore be access to guardrails rather than access to AI itself. Affluent families can buy a supervised environment designed to make AI support learning; other students may receive an unrestricted chatbot, a ban, or an exhausted teacher trying to improvise. The evidence does not yet prove that Alpha's model produces stronger long-term learning, social development, or independent thinking. Tuition is not an outcome measure, and selective enrollment complicates comparisons. Policymakers should demand transparent results while investing in human-supported, evidence-tested tutoring that public schools can actually sustain. If safe AI learning becomes a boutique service, technology will widen the gap it claims to personalize away.

Sep 10, 20266 min

A bright AI tutor screen waits in a quiet classroom while empty login indicators and unused student desks dominate the evidence board.

Cognition & learningUnited States+2 clusters04

Nearly half of students never used the AI tutor assigned to them

Futurism highlights a pair of randomized school trials that tested whether human support could increase use of an AI literacy tutor. The primary working paper covers 355 elementary students across two districts. Despite dedicated time, only 60.7 percent and 53.3 percent of students assigned to use the platform independently ever used it; average weekly use was 2.18 and 5.23 minutes. Human tutors focused on motivation, accountability, reflection, and troubleshooting rather than direct reading instruction. Their presence increased use by about one minute a week in one district and 4.4 minutes in the other, while engagement measured by stories completed rose 71 to 80 percent relative to the control averages. The percentage gains sound large because the baseline was extremely low. Usage remained well below the platform provider's recommended 30 minutes a week, and the intervention did not improve reading achievement. The researchers do not conclude that AI tutoring is ineffective because the students never received enough exposure to test that claim. The result is still a warning for procurement: access, scheduled time, and a capable product are not implementation. Schools should require evidence of sustained use, learning outcomes, equitable participation, and the human support costs needed to make the tool matter.

Aug 29, 20266 min

A paper-collage classroom balances an AI tutor and automated grading stamps against a protected teacher-student conversation.

Cognition & learningUnited States+5 clusters05

AI enters classrooms as educators fight to preserve human connection

WCAX reports that schools are testing AI-driven tutoring and automated grading to personalize learning while navigating academic integrity and the possible loss of human connection. The tradeoff cannot be reduced to adoption versus prohibition. A tutor that gives immediate feedback may expand access, and an assistant that handles routine grading may return time to teachers. The same system can make confident mistakes, expose student data, reward answer production over understanding, or shift professional judgment from an educator to a vendor. Schools need evidence about learning outcomes, not only engagement or time saved. They also need clear rules for disclosure, privacy, age-appropriate use, independent assessment, and the teacher's right to override the tool. The safest classroom is not the one with the least technology. It is the one where AI strengthens human teaching without replacing the struggle, trust, and relationship through which students actually learn.

Aug 18, 20265 min