Multisensory integration
Also known as: Crossmodal integration
The brain fuses sight, sound, and touch into a single coherent perception.
What it means
Multisensory integration is the process by which the brain combines information arriving through different senses into a unified perceptual estimate of the world. Rather than simply averaging inputs, the brain weights each sense roughly by its reliability, so the more precise modality dominates — vision typically wins for spatial location, while audition dominates timing. Integration follows principles of spatial and temporal coincidence: signals are bound when they occur close together in space and time, and the resulting percept can be more accurate and faster than either sense alone. The phenomenon is revealed dramatically by illusions in which one sense overrides or distorts another, demonstrating that what we consciously perceive is a constructed best guess rather than a direct readout of any single channel. It matters for understanding perception, attention, product and interface design, and conditions in which sensory binding goes awry.
Examples
In the McGurk effect, seeing lips mouth 'ga' while hearing 'ba' makes most people perceive 'da' — the brain fuses the conflicting visual and auditory cues into a compromise.
In a cinema the voices leave speakers at the side of the room, but you hear them coming from the actor's mouth. Vision wins on location, so the sound is pulled to the lips.
Food companies engineer the snap of a crisp, because a louder, crisper crunch makes the identical crisp taste fresher. The sound is folded into the flavour before you notice.