by John G. Neuhoff
Description
This chapter covers auditory perception, cognition, and action in the context of auditory display and sonification. Perceptual dimensions such as pitch and loudness can have complex interactions, and cognitive processes such as memory and expectation can influence user interactions with auditory displays. These topics, as well as auditory imagery, embodied cognition, and the effects of musical expertise will be reviewed.
Download Chapter
Download the chapter: TheSonificationHandbook-chapter4 (PDF, 1M)
Media Examples
Example S4.1: McGurk Effect
This video shows the McGurk effect where synchronous lip movement can cause the sound perception to change even when the underlying sound signal is exactly the same.
media file S4.1
download: SHB-S4.1 (mp4, 5M)
source: The video is a quote (snippet) from a clip broadcasted by BBCTwo. The full video is available at http://www.youtube.com/watch?v=G-lN8vWm3m0