SPECIAL ISSUE PAPER
Animating synthetic dyadic conversations with variations based on context and agent attributes
Version of Record online: 9 FEB 2012
Copyright © 2012 John Wiley & Sons, Ltd.
Computer Animation and Virtual Worlds
Volume 23, Issue 1, pages 17–32, January/February 2012
How to Cite
Sun, L., Shoulson, A., Huang, P., Nelson, N., Qin, W., Nenkova, A. and Badler, N. I. (2012), Animating synthetic dyadic conversations with variations based on context and agent attributes. Comp. Anim. Virtual Worlds, 23: 17–32. doi: 10.1002/cav.1421
- Issue online: 21 FEB 2012
- Version of Record online: 9 FEB 2012
- conversation model;
- agent attributes;
- smart event;
- behavior trees;
- crowd simulation
Conversations between two people are ubiquitous in many inhabited contexts. The kinds of conversations that occur depend on several factors, including the time, the location of the participating agents, the spatial relationship between the agents, and the type of conversation in which they are engaged. The statistical distribution of dyadic conversations among a population of agents will therefore depend on these factors. In addition, the conversation types, flow, and duration will depend on agent attributes such as interpersonal relationships, emotional state, personal priorities, and socio-cultural proxemics. We present a framework for distributing conversations among virtual embodied agents in a real-time simulation. To avoid generating actual language dialogues, we express variations in the conversational flow by using behavior trees implementing a set of conversation archetypes. The flow of these behavior trees depends in part on the agents' attributes and progresses based on parametrically estimated transitional probabilities. With the participating agents' state, a ‘smart event’ model steers the interchange to different possible outcomes as it executes. Example behavior trees are developed for two conversation archetypes: buyer–seller negotiations and simple asking–answering; the model can be readily extended to others. Because the conversation archetype is known to participating agents, they can animate their gestures appropriate to their conversational state. The resulting animated conversations demonstrate reasonable variety and variability within the environmental context. Copyright © 2012 John Wiley & Sons, Ltd.