Abstract
During the last decade research groups as well as a number of commercial software developers have started to deploy embodied conversational characters in the user interface especially in those application areas where a close emulation of multimodal human-human communication is needed. Most of these characters have one thing in common: In order to enter the user’s physical world, they need to be physical themselves. The paper focuses on challenges that arise when embedding synthetic conversational agents in the user’s physical world. We will start from work on synthetic agents that populate virtual worlds and anthropomorphic robots that inhabit physical worlds and discuss how the two areas need to be combined in order to populate physical worlds with synthetic characters. Finally, we will report on so-called traversable interfaces that allow agents to cross the border from the physical space to the virtual space and vice versa.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Gratch, J., Rickel, J., André, E., Badler, N., Cassell, J., Petajan, E.: Creating interactive virtual humans: Some assembly required. IEEE Intelligent Systems 17, 54–63 (2002)
Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Transactions on Information Systems E77-D, 1321–1329 (1994)
Sidner, C.L., Kidd, C.D., Lee, C., Lesh, N.: Where to look: a study of human-robot engagement. In: IUI 2004: Proceedings of the 9th international conference on Intelligent user interface, pp. 78–84. ACM Press, New York (2004)
Jeff Rickel, W.L.J.: Animated agents for procedural training in virtual reality: Perception, cognition, and motor control. Applied Artificial Intelligence 29, 343–382 (1999)
Cavazza, M., Charles, F., Mead, S.J., Martin, O., Marichal, X., Nandi, A.: Multimodal acting in mixed reality interactive storytelling. IEEE-Multimedia 11, 30–39 (2004)
Kruppa, M., Spassova, L., Schmitz, M.: The virtual room inhabitant. In: Proc. of the IUI-2005Workshop on Multi-User and Ubiquitous User Interfaces (MU3I), San Diego, USA (2005)
André, E., Dorfmüller-Ulhaas, K., Rist, T.: Embodied conversational characters: Wandering between the digital and the physical world. IT - Information Technology 46, 332–340 (2004)
Peters, C., O’Sullivan, C.: Bottom-up Visual Attention for Virtual Human Animation. In: Proceedings of the Computer Animation and Social Agents (CASA 2003), pp. 111–117. Rutgers University, New York (2003)
Hill, R.: Modeling Perceptual Attention in Virtual Humans. In: Proceedings of the 8th Conference on Computer Generated Forces and Behavioral Representation, Orlando, FL (1999)
Chopra-Khullar, S., Badler, N.I.: Where to look? Automating attending behaviors of virtual human characters. In: Proceedings of the third annual conference on Autonomous Agents, pp. 16–23. ACM Press, New York (1999)
Jung, B., Kopp, S.: Flurmax: An interactive virtual agent for entertaining visitors in a hallway. In: Rist, T., et al (eds.) Intelligent Virtual Agents, pp. 23–26. Springer, Heidelberg (2003)
Kopp, S., Jung, B., Lessmann, N., Wachsmuth, I.: Max — A Multimodal Assistant in Virtual Reality Construction. KI – Künstliche Intelligenz, 11–17 (2003)
Clark, H.: Using Language. Cambridge University Press, Cambridge (1996)
Nakano, Y., Reinstein, G., Stocky, T., Cassell, J.: Towards a model of face-to-face grounding. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL 2003), pp. 553–561 (2003)
Clark, H.H.: Pointing and Placing. In: Kita, S. (ed.) Pointing: Where language, culture, and cognition meet, pp. 1–17. Erlbaum, Hillsdale (2003)
Gorniak, P., Roy, D.: A visually grounded natural language interface for reference to spatial scenes. In: ICMI 2003: Proceedings of the 5th international conference on Multimodal interfaces, pp. 219–226. ACM Press, New York (2003)
Roy, D., Hsiao, K.-Y., Mavridis, N.: Mental imagery for a conversational robot. IEEE Transactions On Systems, Man, And Cybernetics 34, 1374–1383 (2004)
Kendon, A.: Nonverbal Communication, Interaction, and Gesture. Mouton, The Hague (1981)
Argyle, M., Cook, M.: Gaze and Mutual Gaze. Cambridge University Press, Cambridge (1976)
Vertegaal, R., Slagter, R., van der Veer, G., Nijholt, A.: Eye gaze patterns in conversations: there is more to conversational agents than meets the eyes. In: CHI 2001: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 301–308. ACM Press, New York (2001)
Nakano, Y.I., Nishida, T.: Awareness of Perceived World and Conversational Engagement by Conversational Agents. In: Proceedings of the AISB 2005 Symposium on Conversational Informatics for Supporting Social Intelligence & Interaction (2005)
Peters, C.: Foundations of an Agent Theory of Mind Model for Conversation Initiation in Virtual Environments. In: Proceedings of the AISB 2005 Joint Symposium on Virtual Social AGents, pp. 163–170 (2005)
Baron-Cohen, S.: How to build a baby that can read minds: Cognitive Mechanisms in Mind-Reading. Cahiers de Psychologie Cognitive 13, 513–552 (1994)
Lester, J., Voerman, J., Towns, S., Callaway, C.: Deictic Believability: Coordinating Gesture, Locomotion, and Speech in Lifelike Pedagogical Agents. Applied Artificial Intelligence 29, 383–414 (1999)
Guye-Vuillième, A., Thalmann, D.: A high level architecture for believable social agents. Virtual Reality Journal 5, 95–106 (2001)
Bailenson, J.N., Blasovich, J., Beall, A.C., Loomis, J.M.: Interpersonal distance in immersive virtual environments. Personality and Social Psychology Bulletin 29, 819–833 (2003)
Koleva, B., Schnädelbach, H., Benford, S., Greenhalgh, C.: Traversable interfaces between real and virtual worlds. In: CHI 2000: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 233–240. ACM Press, New York (2000)
Witmer, B., Singer, M.: Measuring presence in virtual environments: A presence questionnaire. Presence: Teleoperators and Virtual Environments 7, 225–240 (1998)
Rocchi, C., Stock, O., Zancanaro, M., Kruppa, M., Krüger, A.: The museum visit: generating seamless personalized presentations on multiple devices. In: IUI 2004: Proceedings of the 9th international conference on Intelligent user interface, pp. 316–318. ACM Press, New York (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
André, E., Dorfmüller-Ulhaas, K., Rehm, M. (2005). Engaging in a Conversation with Synthetic Characters Along the Virtuality Continuum. In: Butz, A., Fisher, B., Krüger, A., Olivier, P. (eds) Smart Graphics. SG 2005. Lecture Notes in Computer Science, vol 3638. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11536482_1
Download citation
DOI: https://doi.org/10.1007/11536482_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-28179-5
Online ISBN: 978-3-540-31905-4
eBook Packages: Computer ScienceComputer Science (R0)Springer Nature Proceedings Computer Science
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.