Locating sounds in realistic scenes is challenging because of distracting echoes and coarse spatial acoustic estimates. Fortunately, listeners can improve performance through several compensatory mechanisms. For instance, their brains perceptually suppress short latency (1-10 ms) echoes by constructing a representation of the acoustic environment in a process called the precedence effect [1]. This remarkable ability depends on the spatial and spectral relationship between the first or precedent sound wave and subsequent echoes [2]. In addition to using acoustics alone, the brain also improves sound localization by incorporating spatially precise visual information. Specifically, vision refines auditory spatial receptive fields [3] and can capture auditory perception such that sound is localized toward a coincident visual stimulus [4]. Although visual cues and the precedence effect are each known to improve performance independently, it is not clear whether these mechanisms can cooperate or interfere with each other. Here we demonstrate that echo suppression is enhanced when visual information spatially and temporally coincides with the precedent wave. Conversely, echo suppression is inhibited when vision coincides with the echo. These data show that echo suppression is a fundamentally multisensory process in everyday environments, where vision modulates even this largely automatic auditory mechanism to organize a coherent spatial experience. Highlights: Auditory localization is difficult in reverberant environments The brain improves perception by suppressing echoes and using visual information Visual contributions to echo suppression are unknown Vision can enhance or inhibit echo suppression
展开▼
