The McGurk Effect Proves Hearing Is Partly Vision

Harry McGurk was studying infant speech perception in 1976 when his technician accidentally dubbed the wrong audio track onto a video of a talking face. The result was so strange that McGurk and his colleague John MacDonald wrote it up immediately. When a video of a mouth forming the syllable "ga" is paired with the sound "ba", most listeners hear a third syllable: "da" — one that was neither seen nor heard.

The brain does not treat vision and hearing as separate channels. When it detects a mismatch between lip shape and sound, it averages them out, producing a percept that minimizes conflict. This isn't a bug in poorly-wired brains — the effect works on nearly everyone, including auditory researchers who have studied it for decades.

The easiest proof: close your eyes during the stimulus. The illusion disappears. Open them, and "da" returns. You can watch this happen in real time on your own auditory system — and still not override it.

The practical stakes go beyond a party trick. Listeners with hearing loss rely more heavily on lip-reading, which makes the speech-reading cue stronger and the McGurk influence larger. In noisy environments, the visual signal carries so much weight that a speaker wearing a mask — one that hides the lips — is measurably harder to understand even for people with normal hearing, not because the acoustic signal changed, but because the visual one disappeared.