Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

2 stories found

Peach and indigo paper illustration of stable climate instruments contrasted with a bending conversational reflection.
Law & informationGlobal+2 clusters01

Your climate chatbot agrees. That is the problem.

A climate chatbot that knows the right answer can still become an unreliable guide when challenged. A UNESCO-commissioned UCL assessment reports that repeated user pushback reduced accuracy by 31–35 percentage points in the tested models. The finding concerns behavior under pressure, not simply a shortage of climate information. One widely shareable number needs care. UCL says roughly 80% of concessions occurred at the first disagreement. That does not mean 80% of all answers were wrong or that eight out of ten conversations immediately flipped. Keeping the denominator intact matters, especially in a story about the integrity of explanations. This is a public-information problem with ordinary human stakes. A student may interpret a confident revision as learning something new. A resident may think a chatbot has independently corroborated a claim. But if the answer changed because the user insisted rather than because new evidence arrived, apparent agreement has not added another source. Our concern is that a conversational format can disguise this distinction exceptionally well. The releases also describe weaker results on complex policy interactions and differences across tested languages. These are benchmark findings, not measured changes in emissions, classroom learning or public opinion. We could inspect the primary UNESCO and UCL releases, but not the complete report through the available public access route. That limits how closely we can audit model versions and scoring. The defensible lesson is narrower and useful: ask an assistant to show the evidence for a changed answer, and check that evidence outside the conversation.

3 min
Adults around a seminar table in warm light, with notes and a laptop kept inside a calm central composition.
Cognition & learningUnited States / Global+1 clusters02

Universities should teach AI fluency. They should also teach when to stop.

A Fox opinion urges universities to make practical AI education more widely available. That is a welcome ambition. New York Tech's AI Week, scheduled for October 26–30, includes a session on failed prompts and their correction. UNESCO's older student framework places human-centred thinking and ethics alongside technical understanding. These are useful starting points, not proof that any particular course improves employment or learning outcomes. Our proposed next step is to assess judgment as deliberately as tool use. Give a student a plausible answer with a broken citation. Give another a useful dataset with unclear permission to reuse it. Ask a third to explain a conclusion without the assistant. The skill worth rewarding is not merely finishing the task; it is recognizing what would make finishing it irresponsible or intellectually empty. This need not make education timid. Safe practice environments can let learners experiment freely while making the consequences of different choices visible. A student who can identify a missing permission, request clarification and resume appropriately has learned something more transferable than a fashionable prompt formula. There is a real cost: designing and marking such exercises requires staff time, and inaccessible software can exclude the very learners a program hopes to reach. Institutions should therefore test affordable, accessible assessments and publish what they measure. We should welcome practical AI teaching while resisting a new credential that certifies confidence rather than competence.

3 min