Recess
Sign in
← Back to feed
You're reading as a guest. Sign in to save posts, see what's new, and tune your feed.
Sign in
THE MCGURK EFFECT · BITE · 2 MIN · BEGINNER

The Lab Mistake That Proved Your Eyes Edit Your Ears

A mis-dubbed video meant to study babies showed two psychologists hearing a sound that was neither spoken nor mouthed.

Harry McGurk's lab at the University of Surrey in the mid-1970s was not trying to build an illusion. They were studying how infants perceive speech, and they wanted a video where the audio of one syllable played over the lips of another. They asked a technician to dub it. When McGurk and his colleague John MacDonald sat down to watch the result, both of them heard a third sound — one that matched neither the audio nor the lips.

They kept watching. The illusion held. It held when they ran adults through it formally: when participants heard the syllable /ba/ while watching a face mouth /ga/, 98% reported hearing /da/. Cover your eyes and the audio is unambiguous /ba/; close your ears and the lips clearly say /ga/. Combine the streams and your brain quietly invents a compromise.

McGurk and MacDonald wrote it up as a one-page paper, Hearing Lips and Seeing Voices, and Nature ran it on December 23, 1976. It was a side finding. They never went back to babies. The paper now sits past 4,800 citations and is the foundation of modern audiovisual speech research.

The effect is not universal. Native Japanese and Mandarin listeners show a much weaker version — a finding usually attributed to differences in how often listeners look at a speaker's face during conversation, and to which consonant contrasts the language treats as meaningful. The brain isn't fusing two sensory streams blindly; it's fusing them through whatever priors a lifetime of listening has built up.

What the dub mistake exposed wasn't a bug in perception. It was the seam. Hearing is not a recording of the air in front of you; it's a guess your brain commits to, edited in real time by everything else it can see.

#perception#speech#multisensory#illusions#cognition
Sources
NatureWikipediaFrontiers in Psychology / PMC