A recent audit by Ontario's auditor general has found that AI medical scribes recommended by the provincial government are regularly generating incorrect, incomplete, and hallucinated information.
The audit reviewed transcription tests from 20 approved AI scribe vendors. All 20 showed some issue with accuracy or completeness. Nine hallucinated patient information, 12 recorded information incorrectly, and 17 missed key details about discussed mental health issues.
The report warns this could "potentially result in inadequate or harmful treatment plans" impacting patient health outcomes. Examples include AI scribes hallucinating nonexistent referrals for blood tests or therapy, and incorrectly transcribing prescription medication names.