Acoustic Rendering and Auditory–Visual Cross-Modal Perception and Interaction
Article first published online: 28 FEB 2012
© 2012 The Authors Computer Graphics Forum © 2012 The Eurographics Association and Blackwell Publishing Ltd.
Computer Graphics Forum
Volume 31, Issue 1, pages 102–131, February 2012
How to Cite
Hulusic, V., Harvey, C., Debattista, K., Tsingos, N., Walker, S., Howard, D. and Chalmers, A. (2012), Acoustic Rendering and Auditory–Visual Cross-Modal Perception and Interaction. Computer Graphics Forum, 31: 102–131. doi: 10.1111/j.1467-8659.2011.02086.x
- Issue published online: 28 FEB 2012
- Article first published online: 28 FEB 2012
- acoustic rendering;
- cross-modal interaction;
- I.3.7 [Computer Graphics]: Three-dimensional Graphics and Realism—Virtual Reality;
- I.3.5 Computational Geometry and Object Modeling—Physically based Modelling;
- I.6.8 Types of Simulation—Animation
In recent years research in the three-dimensional sound generation field has been primarily focussed upon new applications of spatialized sound. In the computer graphics community the use of such techniques is most commonly found being applied to virtual, immersive environments. However, the field is more varied and diverse than this and other research tackles the problem in a more complete, and computationally expensive manner. Furthermore, the simulation of light and sound wave propagation is still unachievable at a physically accurate spatio-temporal quality in real time. Although the Human Visual System (HVS) and the Human Auditory System (HAS) are exceptionally sophisticated, they also contain certain perceptional and attentional limitations. Researchers, in fields such as psychology, have been investigating these limitations for several years and have come up with findings which may be exploited in other fields. This paper provides a comprehensive overview of the major techniques for generating spatialized sound and, in addition, discusses perceptual and cross-modal influences to consider. We also describe current limitations and provide an in-depth look at the emerging topics in the field.