Research Article

Integrating physically based sound models in a multimodal rendering architecture

  1. Federico Avanzini*,
  2. Paolo Crosato

Article first published online: 14 JUN 2006

DOI: 10.1002/cav.144

Issue

Computer Animation and Virtual Worlds

Computer Animation and Virtual Worlds

Special Issue: CASA 2006

Volume 17, Issue 3-4, pages 411–419, July 2006

Additional Information

How to Cite

Avanzini, F. and Crosato, P. (2006), Integrating physically based sound models in a multimodal rendering architecture. Comp. Anim. Virtual Worlds, 17: 411–419. doi: 10.1002/cav.144

Author Information

*Department of Information Engineering, University of Padova, Via Gradenigo 6/A, 35131 Padova, Italy.

Publication History

  1. Issue published online: 14 JUN 2006
  2. Article first published online: 14 JUN 2006
  3. Manuscript Accepted: 10 MAY 2006
  4. Manuscript Revised: 2 MAY 2006
  5. Manuscript Received: 10 APR 2006

Funded by

  • EU Sixth Framework Programme—IST Information Society Technologies

SEARCH

SEARCH BY CITATION

ARTICLE TOOLS

Get PDF (529K)

Keywords:

  • multimodal interaction;
  • sound rendering;
  • stiffness

Abstract

This paper presents a multimodal rendering architecture that integrates physically based sound models with haptic and visual rendering. The proposed sound modeling approach is compared to other existing techniques. An example of implementation of the architecture is presented, that realizes bimodal (auditory and haptic) rendering of contact stiffness. It is shown that the proposed rendering scheme allows tight synchronization of the two modalities, as well as a high degree of interactivity and responsiveness of the sound models to gestures and actions of a user. Finally, an experiment on the relative contributions of haptic and auditory information to bimodal judgments of contact stiffness is presented. Experimental results support the effectiveness of auditory feedback in modulating haptic perception of stiffness. Copyright © 2006 John Wiley & Sons, Ltd.

Get PDF (529K)