AI chatbots beat search engines at challenging foreign propaganda in one experiment
An NPR experiment conducted with NewsGuard tested 30 English-language questions built from false narratives spread by China, Iran, and Russia between December 2025 and July 2026. Popular AI chatbots correctly challenged or debunked the false narratives about three-quarters of the time and failed at a lower rate than the first page of traditional search results. That is a meaningful result because users increasingly begin research inside conversational systems. It is not a universal verdict that chatbots are reliable. The test covered a small, selected set of current-event narratives, systems change over time, and the underlying sources still require inspection. NPR found that state-controlled or state-aligned sites appeared in chatbot citations at rates broadly similar to conventional search links. The sharpest warning concerned AI summaries placed above search results. As a group, those summaries challenged false narratives a majority of the time but performed worse than chatbots and failed to challenge falsehoods more often than ordinary search results. Performance also varied across products. Google disputed aspects of the methodology, and several providers said they update failed responses. The right conclusion is not to crown a winner. Search pages and chatbots are now active information intermediaries that need continuous independent testing, preserved outputs, source-level audits, product-specific failure reporting, and visible caveats when evidence is contested.