AIImpactLab
9 impact clustersWork & marketsCognition & learningTechnical failuresPrivacySecurityEnvironmentLaw & informationSocial good & healthSystemic risk
Search the evidence

Find the signal.

Search titles, impact clusters, countries, organizations and the full text of every analysis.

2 stories found

A doctor and patient in a clinical corridor stand near a medical device shown under ongoing monitoring.
Social good & healthUnited Kingdom+2 clusters01

The UK accepts 44 medical-AI recommendations. Now it must prove the monitoring works

The UK government has accepted all 44 recommendations from an independent commission on regulating AI in healthcare. That is a policy commitment, not 44 rules that have already taken effect or proof that an AI product improves patients' health. The most concrete change today is the opening of Phase 3 of the MHRA's AI Airlock, a regulatory sandbox focused on post-market surveillance and how AI-enabled devices behave after deployment. The commission's central critique is that one-time assessment is not enough for technology that changes, drifts or meets different patients and clinical workflows. The government promises draft guidance by December 2026 on managing changes to AI-enabled medical devices and a full implementation roadmap by spring 2027. It also plans future consultation on how devices are classified. The application terms expose an important implementation question: participation has no fee, but applicants currently fund their own studies and data access, and testing in real settings remains in a shadow pathway rather than directly informing patient decisions. That can be a sensible safety design; it may also be harder for smaller developers to finance, although participation data do not yet show exclusion. Patients should ask whether monitoring will detect unequal performance, how clinicians will report failures, who can pause an update, and whether results will be public. Healthcare AI's promise is real enough to warrant testing. The hard work starts after a policy announcement: measure outcomes over time, name the accountable institution, and show what happens when the system changes under care.

6 min
A polished AI-generated medical note floats over a patient conversation while missing clinical facts glow in the gaps.
Social good & healthUnited Kingdom and international healthcare+4 clusters02

AI scribes save clinicians time while hiding errors inside fluent notes

Ambient AI scribes are spreading faster than the evidence needed to govern them. A new British Dental Journal literature review searched research published from January 2015 through December 2025, screened 3,036 records, and included 57 studies. Only three focused on dentistry. The systems can reduce documentation burden and may improve burnout measures, but fluent notes can conceal omissions, substitutions, and hallucinations that are harder to notice precisely because the prose reads well. In one dental speech-recognition study, an experimental system reached a 3.7 percent word-error rate and the strongest commercial product reached 5.4 percent, yet clinically meaningful mistakes remained, including changing “16 hours” to “10 minutes.” Across wider healthcare research cited by the review, one analysis found hallucinations in 1.47 percent of note sentences and omissions corresponding to 3.45 percent of transcript sentences. Those figures are not universal error rates; studies used different systems, specialties, and definitions. The severity evidence is still sobering: 44 percent of hallucinated sentences and 16.7 percent of omissions in that study were classified as capable of major harm. Human review reduced clinically significant errors from 63.6 percent to 7.8 percent in another cited study, but that shifts clinicians from writers to editors and potential liability sinks. Patient attitudes also depend on disclosure. Favorability toward ambient documentation fell when people received fuller information about how it works. The technology may genuinely return attention to the patient. Its success will depend on whether saved typing time becomes careful verification time rather than disappearing from the workflow.

11 min