Autonomous Virtual Agents Learning a Cognitive Model and Evolving

  • Toni Conde
  • Daniel Thalmann
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3661)


In this paper, we propose a new integration approach to simulate an Autonomous Virtual Agent’s cognitive learning of a task for interactive Virtual Environment applications. Our research focuses on the behavioural animation of virtual humans capable of acting independently. Our contribution is important because we present a solution for fast learning with evolution. We propose the concept of a Learning Unit Architecture that functions as a control unit of the Autonomous Virtual Agent’s brain. Although our technique has proved to be effective in our case study, there is no guarantee that it will work for every imaginable Autonomous Virtual Agent and Virtual Environment. The results are illustrated in a domain that requires effective coordination of behaviours, such as driving a car inside a virtual city.


Virtual Environment Cognitive Model Road Signal Virtual Human Virtual Sensor 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Flake, G.W.: The Computational Beauty of Nature. The MIT Press, Cambridge (2000)Google Scholar
  2. 2.
    Larkin, P.: Achieving human style navigation for synthetic characters. A survey. In: Proceedings of Neural Networks and Computational Intelligence (2003)Google Scholar
  3. 3.
    Downs, R., Stea, D.: Cognitive maps and spatial behavior. In: Downs, R., Stea, D. (eds.) Image and Environment. Chicago, pp. 8–26. Adline Publishing (1973)Google Scholar
  4. 4.
    Griffin, D.: Topographical Orientation. In: Downs, R., Stea, D. (eds.) Image and Environment, Chicago, pp. 296–299. Adline Publishing (1973)Google Scholar
  5. 5.
    Kamwisher, N., Downing, P.: Separating the wheat from the chaff. Science 282, 57–58 (1998)CrossRefGoogle Scholar
  6. 6.
    Conde, T., Thalmann, D.: An Artificial Life Environment for Autonomous Virtual Agents with multi-sensorial and multi-perceptive features. Computer Animation and Virtual Worlds 15(3-4), 311–318 (2004)CrossRefGoogle Scholar
  7. 7.
    Reynolds, C.: Flocks, herds, and schools: A distributed behavioural model. In: Proceedings of ACM SIGGRAPH, pp. 25–34 (1987)Google Scholar
  8. 8.
    Tu, X., Terzopoulos, D.: Artificial fishes: Physics, locomotion, perception, behaviour. In: Proceedings of ACM SIGGRAPH, pp. 43–50 (1994)Google Scholar
  9. 9.
    Blumberg, B., Galyean, T.: Multi-level direction of autonomous creatures for real-time virtual environments. In: Proceedings of ACM SIGGRAPH, pp. 47–54 (1996)Google Scholar
  10. 10.
    Perlin, K., Golberg, A.: A improv: a system for scripting interactive actors in virtual worlds. In: Proceedings of ACM SIGGRAPH, pp. 205–216 (1996)Google Scholar
  11. 11.
    Burke, R., Isla, D., Downie, M., Ivanov, Y., Blumberg, B.: Creature smarts: The art and architecture of a virtual brain. In: Proceedings of the Computer Game Developers Conference (2001)Google Scholar
  12. 12.
    Tomlinson, B., Blumberg, B.: Alphawolf: Social learning, emotion and development in autonomous virtual agents. In: Proceedings of First GSFC/JPL Workshop on Radical Agent Concepts (2002)Google Scholar
  13. 13.
    Blumberg, B., Downie, M., Ivanov, Y., Berlin, M., Johnson, M., Tomlinson, B.: Integrated learning for interactive synthetic characters. In: Proceedings of ACM SIGGRAPH, pp. 417–426 (2002)Google Scholar
  14. 14.
    Conde, T., Tambellini, W., Thalmann, D.: Behavioral Animation of Autonomous Virtual Agents helped by Reinforcement Learning. LNCS, vol. 272, pp. 175–180. Springer, Berlin (2003)Google Scholar
  15. 15.
    Jordan, M.I., Rumelhart, D.E.: Supervised Learning with a distal Teacher. Cognitive Science 16, 307–354 (1992)CrossRefGoogle Scholar
  16. 16.
    Bransford, J.D., Brown, A.L.: Cocking R.R. Brain, Mind, Experience, and School. National Academy Press, Washington (1999)Google Scholar
  17. 17.
    Mitchell, T.: Machine Learning. McGraw Hill, New York (1997)zbMATHGoogle Scholar
  18. 18.
    Domeniconi, C., Gunopulos, D.: Adaptive Nearest Neighbor Classification using SupportVector Machines. In: Advances in Neural Information Processing Systems, vol. 14, pp. 223–229. MIT Press, Cambridge (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Toni Conde
    • 1
  • Daniel Thalmann
    • 1
  1. 1.Virtual Reality LabEcole Polytechnique Fédérale de Lausanne (EPFL)LausanneSwitzerland

Personalised recommendations