The Significance of Textures for Affective Interfaces

  • Paula M. Ellis
  • Joanna J. Bryson
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3661)


This paper reports experiments demonstrating that the extent to which subjects ascribe emotions to VR faces is highly dependent on textures applied to the face. We demonstrate this for both a photo-realistic vs. non-photo-realistic texture pair and for a male vs. female texture pair. In both cases, experiments were conducted over the Internet on still frames taken from a well-controlled VR emotion modelling system. Given the enormous extent to which textures determine emotion recognition, we consider this a critical area for future research in affective virtual agents.


Facial Expression Virtual Environment Facial Image Emotional Expression Emotion Recognition 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Breazeal, C.: Emotion and sociable humanoid robots. International Journal of Human Computer Interaction 59, 119–155 (2003)Google Scholar
  2. 2.
    Bryson, J.: Personal communication, based on data presented at HCI 2003 by Ward. Bell & Marsden (2004)Google Scholar
  3. 3.
    Cassell, J.: Nudge nudge wink wink: Elements of face-to-face conversation for embodied conversational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 1–27. MIT Press, London (2000)Google Scholar
  4. 4.
    Collier, G.: Emotional Expression. Lawrence Erlbaum Associates, London (1985)Google Scholar
  5. 5.
    Coolican, H.: Research Methods and Statistics in Psychology. Hodder & Stoughton, 2nd edn., London (1994)Google Scholar
  6. 6.
    Davis, D.N.: Agents, emergence, emotion and representation. In: IECON 2000: 26th Annual Conference of the IEEE Industrial Electronics Society, October 2000, vol. 4, pp. 2577–2582. IEEE, Los Alamitos (2000)Google Scholar
  7. 7.
    De Rosis, F., Pelachaud, C., Poggi, I., Carofiglio, V., De Carolis, B.: From greta’s mind to her face: Modelling the dynamics of affective states in a conversational agent. International Journal of Human Computer Studies 59, 81–118 (2003)CrossRefGoogle Scholar
  8. 8.
    Ekman, P., Friesen, W., Ellsworth, P.: Emotion in the Human Face: Guidelines for Research and an Integration of Findings. Pergamon Press, New York (1972)Google Scholar
  9. 9.
    Fabri, M., Moore, D.J., Hobbs, D.J.: Expressive agents: Non-verbal communication in collaborative virtual environments. In: Proceedings of AAMAS 2002 Workshop: Embodied Conversational Agents: Let’s Specify And Evaluate Them!, July 2002, pp. 402–409 (2002)Google Scholar
  10. 10.
    Ferh, B., Russell, J.A.: Concept of emotion viewed from a prototype perspective. Journal of Experimental Psychology: General 113, 464–486 (1984)CrossRefGoogle Scholar
  11. 11.
    Fox, E., Lester, V., Russo, R., Bowles, R.J., Pichler, A., Dutton, K.: Facial expression of emotion: Are angry faces detected more efficiently? Cognition and Emotion 14(1), 61–92 (2000)CrossRefGoogle Scholar
  12. 12.
    Fox, J.: Factors of emotion recognition in faces: Three perspectives. Journal of Young Investigators (3) (March 2004)Google Scholar
  13. 13.
    Fridlund, A.J.: The behaviour, ecology and sociality of human faces. In: Clark, M.S. (ed.) Emotion, pp. 175–212. Sage, London (1992)Google Scholar
  14. 14.
    Gaggioli, A., Mantovani, F., Castelnuovo, G., Wiederhold, B., Riva, G.: Avatars in clinical psychology: A framework for the clinical use of virtual humans. CyberPsychology and Behavior 6(2), 117–125 (2003)CrossRefGoogle Scholar
  15. 15.
    Haddad, H., Klobas, J.: Expressive agents: Non-verbal communication in collaborative virtual environments. In: Proceedings of AAMAS 2002 Workshop: Embodied Conversational Agents: Let’s Specify And Evaluate Them! (July 2002)Google Scholar
  16. 16.
    Hansen, C.H., Hansen, R.D.: Finding the face in the crowd: An anger superiority effect. Journal of Personality and Social Psychology 54, 917–924 (1988)CrossRefGoogle Scholar
  17. 17.
    Hara, F., Kobayashi, H.: A face robot able to recognise and produce facial expression. In: IEEE International Conference on Intelligent Robots and Systems (IROS1996), Osaka (1996)Google Scholar
  18. 18.
    Izard, C.E.: The emotions and emotion constructs in personality and culture research. In: Cattell, R.B. (ed.) Handbook of Modern Personality Theory. Aldine Press, Chicago (1969)Google Scholar
  19. 19.
    Kahana-Kalman, R., Walker-Andrews, A.S.: The role of person familiarity in young infants perception of emotional expressions. Child Development 72, 352–369 (2001)CrossRefGoogle Scholar
  20. 20.
    Massaro, D.W., Cohen, M.M., Beskow, J., Cole R.A.: Developing and evaluating conversational agents. In: Cassell, J., Sullivan, J., Prevost, S., Churchill, E. (eds.) Embodied Conversational Agents, pp. 287–317. MIT Press, London (2000)Google Scholar
  21. 21.
    Parke, F.I.: Computer graphic models for the human face. In: Proceedings of the IEEE Computer Society’s Third International Computer Software and Applications Conference (COMPSAC 1979), Chicago, November 1979, pp. 724–727 (1979)Google Scholar
  22. 22.
    Parke, F.I., Waters, K.: Computer Facial Animation. A. K. Peters Ltd. (1996)Google Scholar
  23. 23.
    Predinger, H., Ishizuka, M. (eds.): Life-Like Characters: Tools, Affective Functions and Applications. Springer, Berlin (1998)Google Scholar
  24. 24.
    Reeves, B., Naas, C.: The Media Equation: How People Treat Computers, Television and New Media Like Real People and Press. Cambridge University Press, Cambridge (1996)Google Scholar
  25. 25.
    Shaver, P.R., Wu, S., Schwartz, J.C.: Cross cultural similarities and differences in emotion and it’s representation: A prototype approach. In: Clark, M.S. (ed.) Emotion, pp. 175–212. Sage, London (1992)Google Scholar
  26. 26.
    Sloman, A.: Beyond shallow models of emotions. Cognitive Processing 2(1), 177–198 (2001)Google Scholar
  27. 27.
    Strippgen, S.: INSIGHT: A virtual laboratory for design, test and evaluation of autonomous agents. In: Zobel, R.N., Möller, D.P.F. (eds.) Twelfth European Simulation Multiconference: Simulation — Past, Present and Future, Manchester, UK (June 1998)Google Scholar
  28. 28.
    Sullivan, L.A., Kirkpatrick, S.W.: Facial interpretation and component consistency. Genetic, Social and General Psychology Monographs 122(4), 389–404 (1996)Google Scholar
  29. 29.
    Takeuchi, A.: Situated facial displays: Towards social interaction. In: Proceedings of CHI 1994, pp. 450–454. ACM Press, New York (1994)Google Scholar
  30. 30.
    Tanguy, E.: An abstract muscle model for facial animations. Dissertation about a year project carried out during the third year of a computer science degree in the Univeristy of Sheffield (May 2001)Google Scholar
  31. 31.
    Tanguy, E.A.R., Willis, P.J., Bryson, J.J.: A layered Dynamic Emotion Representation for the creation of complex facial animation. In: Rist, T., Aylett, R., Ballin, D., Rickel, J. (eds.) Intelligent Virtual Agents, September 2003, pp. 101–105. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  32. 32.
    Vinayagamoorthy, V., Garau, M., Steed, A., Slater, M.: An eye gaze model for dyadic interaction in an immerse virtual environment: Practice and experience. Computer Graphics Forum 23(1), 1–11 (2004)CrossRefGoogle Scholar
  33. 33.
    Ward, R., Bell, D., Marsden, P.: A exploration of facial expression tracking in affective HCI. In: O’Neill, E., Palanque, P., Johnson, P. (eds.) People and Computers XVII — Designing for Society (HCI 2003), Bath, September 2003, pp. 383–399. Springer, Heidelberg (2003)Google Scholar
  34. 34.
    Yik, M.S.M., Russell, J.A.: Interpretation of faces: Cross-cultural study of a prediction from Fridlund’s theory. Cognition and Emotion 13(1), 93–104 (1999)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Paula M. Ellis
    • 1
  • Joanna J. Bryson
    • 1
  1. 1.Department of Computer ScienceUniversity of BathBathUnited Kingdom

Personalised recommendations