by Stefania Serafin, Karmen Franinovic, Thomas Hermann,
Guillaume Lemaitre, Michal Rinott, Davide Rocchesso
This chapter introduces the emerging discipline of sonic interaction design (SID). SID is the study and exploitation of sound as one of the principal channels conveying information, meaning, and aesthetic/emotional qualities in interactive contexts. Sonic interaction design lies at the intersection of interaction design and sound and music computing.
Download the chapter: TheSonificationHandbook-chapter5 (PDF, 10.9M)
Example S5.1: Flops
The Flops are a series of interactive glasses which were designed to study the use of habitual and explorative sonic gestures.
The interface was used in psychological experiments exploring emotion, sound and gesture.
media file S5.1
download: SHB-S5.1 (mp4, 811k)
source: G. Lemaitre, O. Houix, P. Susini, Y. Visell and K. Franinovic., 2011
media file S5.2
download: SHB-S5.2 (mp4, 532k)
source: P. Susini, N. Misdariis, O. Houix, and G. Lemaitre, 2009
Example S5.3: Parameterized Auditory Icons
Desktop interaction that shows how deleting files of different size could be represented by different sounds to convey more information beyond a mere acknowledgment of the deletion.
media file S5.3
download: SHB-S5.3 (mp4, 852k)
source: Programmed and rendered by Stefano Papetti (PhD, Thesis, Univ. of Verona, 2010) using the Sound Design Toolkit.
Example S5.4: Drilling Machine with Auditory Feedback
Video that shows the augmented drilling machine (Großhauser, Hermann 2009) where deviation from an ideal angle (e.g. perpendicular to the surface) is represented by pulsing sounds of different pitch and direction.
media file S5.4
download: SHB-S5.4 (m4v, 5.7M)
source: Tobias Großhauser and Thomas Hermann (2010)
media file S5.5
download: SHB-S5.5 (mp4, 4M)
source: Jessica Hummel, Thomas Hermann, Christopher Fraunberger and Tony Stockman (2010).
Example S5.6: Auditory Augmentation – (Wetterreim)
Video of Auditory Augmentation (Bovermann, Tünnermann, Hermann 2010) that shows how real interaction sounds such as typing on a keyboard can be augmented by data-driven sound modifications, here displaying different weather conditions as timbral quality.
media file S5.6
download: SHB-S5.6 (mp4, 6.8M)
source: Till Bovermann, Rene Tünnermann, Thomas Hermann (2010). Auditory Augmentation. Int. J. on Ambient Computing and Intelligence (IJACI), 2 (2) , p. 27 – 41