Do faces and body postures integrate similarly for distinct emotions, kinds of emotion and judgent dimensions?
Publicado
oct 7, 2016
Almetrics
Dimensions
Google Scholar
##plugins.themes.bootstrap3.article.details##
Resumen
Faces and bodies are typically seen together in most social interactions, rendering probable that facial and bodily expressions are perceived and eventually processed simultaneously. The methodology of Information Integration Theory and Functional Measurement was used here to address the following questions: Under what rules do facial and bodily information integrate in judgments over different dimensions of so-called basic and self-conscious emotions? How does relative importance of face and body vary across emotions and judgment dimensions? Does the relative importance of face and body afford a basis for distinguishing between basic and self-conscious emotions? Three basic (happiness, anger, sadness) and two social self-conscious emotions (shame and pride) were considered in this study. Manipulated factors were 3-D realistic facial expressions (varied across 5 levels of intensity) and synthetic 3-D realistic body postures (3 levels of intensity). Different groups of participants judged expressed intensity, valence, or arousal of the combined presentations of face and body, meaning that judgment dimension was varied between-subjects. With the exception of arousal judgments, averaging was the predominant integration rule. Relative importance of face and body was found to vary as a function of judgment dimension, specific emotions and, for judgments of arousal only, type of emotion (basic versus self-conscious).
Keywords
expresiones faciales, posturas corporales, medición funcional, importancia relativa, teoría de integración de la informaciónfacial expressions, body postures, functional measurement, relative importance, information integration theory
References
Anderson, N. H. (1981). Foundations of information integration theory . New York: Academic Press.
Anderson, N. H. (1982). Methods of information integration theory . New York: Academic Press.
Anderson, N. H. (1989). Information integration approach to emotions and their measurement. In R. Plutchik & H. Kellerman (Eds.), Emotion: Theory, research, and experience. Volume 4: The measurement of emotions (pp. 133-186). San Diego, CA: Academic press.
Anderson, N. H. (2008). Unified social cognition . New York: Psychology Press.
App, B., Reed, C. L., & McIntosh, D. N. (2012). Perceiving emotional state and motion intention in whole body displays: Relative contributions of face and body configurations. Cognition and Emotion, 26 , 690-698.
Atkinson, A. P., Dittrich, W. H., Gemmell, A. J., & Young, A. (2004). Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception, 33 (6), 717-746.
Aviezer, H. Trope, Y., & Todorov, A. (2012). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science , 338(6111), 1225-1229 doi: 10.1126/science.1224313.
Bänziger, T., Mortillaro, M., & Scherer, K.R. (2012). Introducing the Geneva Multimodal Expression corpus for experimental research on emotion perception. Emotion, 12 , 5, 1161-1179.
Carver, C. S., & Johnson, S. L. (2010). Authentic and Hubristic Pride: Differential Relations to Aspects of Goal Regulation, Affect, and Self-Control. Journal of Research in Personality , 44(6), 698–703. doi:10.1016/j.jrp.2010.09.004.
Dael, N., Mortillaro M., & Scherer K. R. (2012a). Emotion expression in body action and posture. Emotion , 12(5), 1085-1101
Dael, N., Mortillaro M., & Scherer K. R. (2012b). The Body Action and Posture coding system (BAP): Development and reliability. Journal of Nonverbal Behavior, 36 , 97-121.
de Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philosophical Transactions of the Royal Society B: Biological Sciences, 364 (1535), 3475-3484. http://dx.doi.org/10.1098/rstb.2009.0190
de Gelder, B., Snyder, J., Greve, D., Gerard, G., & Hadjikhani, N. (2004). Fear fosters flight: A mechanism for fear contagion when perceiving emotion expressed by a whole body. Proceedings of the National Academy of Sciences, 101 (47), 16701-16706.
Ekman, P. (1965). Differential communication of affect by head and body cues. Journal of Personality and Social Psychology, 2 (5), 926–735.
Ekman, P. (1999). Basic emotions. In T. D. Power (Ed). The handbook of cognition and emotion (pp. 45-60). Sussex, UK: Wiley.
Ekman, P., & Friesen, W. V. (1978). Facial Action Coding System . Palo Alto, CA: Consulting Psychologists Press.
Ekman, P., Friesen, W., & Hager, J. (Eds.). (2002). Facial Action Coding System [E-book]. Salt Lake City, UT: Research Nexus.
Fernández-Dols, J. M., & Carroll, J. M. (1997). Is the meaning perceived in facial expression independent of its context? In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expression (pp. 275-294). Cambridge: Cambridge University Press.
Frijda, N. H. (1987) Emotion, cognitive structure, and action tendency. Cognition and Emotion, 1 , 2, 115-143.
Frijda, N. H. (1969). Recognition of emotion. In L. Berkowitz (Ed.), Advances in experimental social psychology, Vol. 4 (pp. 167–224). New York: Academic Press.
Gallois, C., & Callan, V. (1986). Decoding emotional messages: Influence of ethnicity, sex, message type, and channel. Journal of Personality and Social Psychology, 51 , 755-762.
Goodenough, F. L., & Tinker, M. A. (1931). The relative potency of facial expression and verbal description of stimulus in the judgment of emotion. Comparative Psychology, 12 , 365-370.
Harrigan, J. A. (2005). Proxemics, kinesics, and gaze. In J. A. Harrigan, R. Rosenthal, & K. Scherer (Eds.), The new handbook of methods in nonverbal behavior research (pp. 137–198). New York: Oxford University Press.
Hess, U., Blairy, S. & Kleck, R. E. (1997). The intensity of emotional facial expressions and decoding accuracy. Journal of Nonverbal Behavior, 21 (4), 241-257.
Hess, U., Kappas, A., & Scherer, K. R. (1988). Multichannel communication of emotion: Synthetic signal production. In K. R. Scherer (Ed.) Facets of emotion: Recent research (pp. 161-182). Hillsdale, NJ: Lawrence Erlbaum Associates.
Hietanen, J. K., & Leppänen, J. M. (2008). Judgment of other people's facial expressions of emotions is influenced by their concurrent affective hand movements. Scandinavian Journal of Psychology, 49 , 221-230.
Hofmans, J., & Mullet, E. (2013). Towards unveiling individual differences in different stages of information processing: A clustering-based approach. Quality & Quantity, 47 , 555–564.
Huis in ‘t Veld, E. M., Van Boxtel, G. J., & de Gelder, B. (2014). The Body Action Coding System II: muscle activations during the perception and expression of emotion. Frontiers in Behavioral Neuroscience, 8 , 1-13. http://dx.doi.org/10.3389/fnbeh.2014.00330
Keltner, D. (1995). The signs of appeasement: Evidence for the distinct displays of embarrassment, amusement and shame. Journal of Personality and Social Psychology, 68 , 441-454.
Kleinsmith, A., & Bianchi-Berthouze, N. (2007). Recognizing affective dimensions from body posture. In A. R. Paiva, R. Prada, & R. Picard (Eds.), Affective computing and intelligent interaction. Volume 4738 (pp. 48–58). Berlin: Springer. http://dx.doi.org/10.1007/978-3-540- 74889-2_5
Kleinsmith, A., & Bianchi-Berthouze, N. (2012). Affective body expression perception and recognition: A survey. IEEE Transactions on Affective Computing, 4 , 1, 15-33. http://dx.doi.org/10.1109/T-AFFC.2012.16
Meeren, H. K. M., van Heijnsbergen, C., & de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences of the USA, 102 , 16518-16523.
Mehrabian, A., & Ferris, S. R. (1967). Inference of Attitudes from Nonverbal Communication in Two Channels. Journal of Consulting Psychology , 31(3), 248–252.
Larsen, R. & Diener, E. (1992). Promises and problems with the circumplex model of emotion. In M. S. Clark (Ed.). Emotion (pp. 25-59). Newbury Park, CA: Sage.
Meijer, M. (1989). The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behavior, 13 (4), 247-268.
Oliveira, A. M., Teixeira, N., Oliveira, M., Breda, S. J., & Da Fonseca, I. (2007). Algebraic Integration Models of Facial Features of Expression: A Case Made for Pain. Rivista di Storia e Metodologia della Psicologia, 12 , 1-2, 155-166.
O’Sullivan, M., Ekman, P., Friesen, W., & Scherer, K. (1985). What you say and how you say it: The contribution of speech content and voice quality to judgment of others. Journal of Personality and Social Psychology , 48, 54-62.
Poser 7 (2006) [computer software]. E-frontier America, Inc.
Scherer, K. R. (1986). Voice, stress, and emotion. In M. H. Appley & R. Trumbull (Eds.), Dynamics of stress (pp. 159-181). New York: Plenum.
Scherer, K. R. (1994). Toward a Concept of ‘Modal Emotions’. In P. Ekman & R .J. Davidson (Eds.). The Nature of Emotion: Fundamental Questions (pp. 25–31.) New York and Oxford: Oxford University Press.
Scherer, K. R., & Ellgring, H. (2007). Multimodal expression of emotion: Affect programs or componential appraisal patterns? Emotion, 7 , 1, 158-171.
Silva, A. D., Oliveira, A. M., Viegas, R., Oliveira, M., Lourenço, V., & Gonçalves, A. (2010). The cognitive algebra of Prototypical expressions of emotion in the face: one or many integration rules? In A. Bastianelli & G. Vidotto (Eds.) Fechner Day 2010: Proceedings of the 26th Annual Meeting of the International Society for Psychophysics (pp. 339-344). Padova, Italy: ISP.
Tracy, J. L., & Robins, R. W. (2004). Show your pride: Evidence for a discrete emotion expression. Psychological Science, 15 , 194 –197.
Tracy, J. L., & Robins, R. W. (2008). The nonverbal expression of pride: Evidence for cross-cultural recognition. Journal of Personality and Social Psychology, 94 , 3, 516-530.
Tracy, J. L., Robins, R. W., & Schriber, R. A. (2009). Development of a FACS-verified set of basic and self-conscious emotion expressions. Emotion, 9 , 554-559.
Van den Stock, J., Righart, R., & de Gelder, B. (2007). Body expressions influence recognition of emotions in the face and voice. Emotion, 7 , 3, 487-494.
Vidotto, G., Massidda, D., & Noventa, S. (2010). Averaging models: parameters estimation with the R-Average procedure. Psicologica, 31 , 3, 461-475.
Vidotto, G., Noventa, S., Massidda, D., & Vicentini, M. (2011). rAverage: Parameter estimation for the Averaging model of Information Integration Theory [Computer program]. Retrieved from http://www.rproject.org .
Waller, B. M., Cray, J. J., & Burrows, A. M. (2008). Selection for universal facial emotion. Emotion, 8 (3), 435-439.
Wehrle, T., Kaiser, S., Schmidt, S., & Scherer, K. R. (2000). Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology, 78 , 1, 105-119.
Willis, M. L., Burke, D., & Palermo, R. (2011). Judging approachability on the face of it: the influence of face and body expressions on the perception of approachability. Emotion, 11 , 3, 514-523.
Winters, A. M. (2005). Perceptions of Body Posture and Emotion: A question of methodology. The New School Psychology Bulletin, 3 , 2, 35-45.
Zalinski, J., & Anderson, N. H. (1991). Parameter estimation for averaging theory. In N. H. Anderson (Ed.), Contributions to Information Integration Theory (Vol. I: Cognition, pp. 353-394). Hillsdale, NJ: Lawrence Erlbaum Associates.
Anderson, N. H. (1982). Methods of information integration theory . New York: Academic Press.
Anderson, N. H. (1989). Information integration approach to emotions and their measurement. In R. Plutchik & H. Kellerman (Eds.), Emotion: Theory, research, and experience. Volume 4: The measurement of emotions (pp. 133-186). San Diego, CA: Academic press.
Anderson, N. H. (2008). Unified social cognition . New York: Psychology Press.
App, B., Reed, C. L., & McIntosh, D. N. (2012). Perceiving emotional state and motion intention in whole body displays: Relative contributions of face and body configurations. Cognition and Emotion, 26 , 690-698.
Atkinson, A. P., Dittrich, W. H., Gemmell, A. J., & Young, A. (2004). Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception, 33 (6), 717-746.
Aviezer, H. Trope, Y., & Todorov, A. (2012). Body cues, not facial expressions, discriminate between intense positive and negative emotions. Science , 338(6111), 1225-1229 doi: 10.1126/science.1224313.
Bänziger, T., Mortillaro, M., & Scherer, K.R. (2012). Introducing the Geneva Multimodal Expression corpus for experimental research on emotion perception. Emotion, 12 , 5, 1161-1179.
Carver, C. S., & Johnson, S. L. (2010). Authentic and Hubristic Pride: Differential Relations to Aspects of Goal Regulation, Affect, and Self-Control. Journal of Research in Personality , 44(6), 698–703. doi:10.1016/j.jrp.2010.09.004.
Dael, N., Mortillaro M., & Scherer K. R. (2012a). Emotion expression in body action and posture. Emotion , 12(5), 1085-1101
Dael, N., Mortillaro M., & Scherer K. R. (2012b). The Body Action and Posture coding system (BAP): Development and reliability. Journal of Nonverbal Behavior, 36 , 97-121.
de Gelder, B. (2009). Why bodies? Twelve reasons for including bodily expressions in affective neuroscience. Philosophical Transactions of the Royal Society B: Biological Sciences, 364 (1535), 3475-3484. http://dx.doi.org/10.1098/rstb.2009.0190
de Gelder, B., Snyder, J., Greve, D., Gerard, G., & Hadjikhani, N. (2004). Fear fosters flight: A mechanism for fear contagion when perceiving emotion expressed by a whole body. Proceedings of the National Academy of Sciences, 101 (47), 16701-16706.
Ekman, P. (1965). Differential communication of affect by head and body cues. Journal of Personality and Social Psychology, 2 (5), 926–735.
Ekman, P. (1999). Basic emotions. In T. D. Power (Ed). The handbook of cognition and emotion (pp. 45-60). Sussex, UK: Wiley.
Ekman, P., & Friesen, W. V. (1978). Facial Action Coding System . Palo Alto, CA: Consulting Psychologists Press.
Ekman, P., Friesen, W., & Hager, J. (Eds.). (2002). Facial Action Coding System [E-book]. Salt Lake City, UT: Research Nexus.
Fernández-Dols, J. M., & Carroll, J. M. (1997). Is the meaning perceived in facial expression independent of its context? In J. A. Russell & J. M. Fernández-Dols (Eds.), The psychology of facial expression (pp. 275-294). Cambridge: Cambridge University Press.
Frijda, N. H. (1987) Emotion, cognitive structure, and action tendency. Cognition and Emotion, 1 , 2, 115-143.
Frijda, N. H. (1969). Recognition of emotion. In L. Berkowitz (Ed.), Advances in experimental social psychology, Vol. 4 (pp. 167–224). New York: Academic Press.
Gallois, C., & Callan, V. (1986). Decoding emotional messages: Influence of ethnicity, sex, message type, and channel. Journal of Personality and Social Psychology, 51 , 755-762.
Goodenough, F. L., & Tinker, M. A. (1931). The relative potency of facial expression and verbal description of stimulus in the judgment of emotion. Comparative Psychology, 12 , 365-370.
Harrigan, J. A. (2005). Proxemics, kinesics, and gaze. In J. A. Harrigan, R. Rosenthal, & K. Scherer (Eds.), The new handbook of methods in nonverbal behavior research (pp. 137–198). New York: Oxford University Press.
Hess, U., Blairy, S. & Kleck, R. E. (1997). The intensity of emotional facial expressions and decoding accuracy. Journal of Nonverbal Behavior, 21 (4), 241-257.
Hess, U., Kappas, A., & Scherer, K. R. (1988). Multichannel communication of emotion: Synthetic signal production. In K. R. Scherer (Ed.) Facets of emotion: Recent research (pp. 161-182). Hillsdale, NJ: Lawrence Erlbaum Associates.
Hietanen, J. K., & Leppänen, J. M. (2008). Judgment of other people's facial expressions of emotions is influenced by their concurrent affective hand movements. Scandinavian Journal of Psychology, 49 , 221-230.
Hofmans, J., & Mullet, E. (2013). Towards unveiling individual differences in different stages of information processing: A clustering-based approach. Quality & Quantity, 47 , 555–564.
Huis in ‘t Veld, E. M., Van Boxtel, G. J., & de Gelder, B. (2014). The Body Action Coding System II: muscle activations during the perception and expression of emotion. Frontiers in Behavioral Neuroscience, 8 , 1-13. http://dx.doi.org/10.3389/fnbeh.2014.00330
Keltner, D. (1995). The signs of appeasement: Evidence for the distinct displays of embarrassment, amusement and shame. Journal of Personality and Social Psychology, 68 , 441-454.
Kleinsmith, A., & Bianchi-Berthouze, N. (2007). Recognizing affective dimensions from body posture. In A. R. Paiva, R. Prada, & R. Picard (Eds.), Affective computing and intelligent interaction. Volume 4738 (pp. 48–58). Berlin: Springer. http://dx.doi.org/10.1007/978-3-540- 74889-2_5
Kleinsmith, A., & Bianchi-Berthouze, N. (2012). Affective body expression perception and recognition: A survey. IEEE Transactions on Affective Computing, 4 , 1, 15-33. http://dx.doi.org/10.1109/T-AFFC.2012.16
Meeren, H. K. M., van Heijnsbergen, C., & de Gelder, B. (2005). Rapid perceptual integration of facial expression and emotional body language. Proceedings of the National Academy of Sciences of the USA, 102 , 16518-16523.
Mehrabian, A., & Ferris, S. R. (1967). Inference of Attitudes from Nonverbal Communication in Two Channels. Journal of Consulting Psychology , 31(3), 248–252.
Larsen, R. & Diener, E. (1992). Promises and problems with the circumplex model of emotion. In M. S. Clark (Ed.). Emotion (pp. 25-59). Newbury Park, CA: Sage.
Meijer, M. (1989). The contribution of general features of body movement to the attribution of emotions. Journal of Nonverbal Behavior, 13 (4), 247-268.
Oliveira, A. M., Teixeira, N., Oliveira, M., Breda, S. J., & Da Fonseca, I. (2007). Algebraic Integration Models of Facial Features of Expression: A Case Made for Pain. Rivista di Storia e Metodologia della Psicologia, 12 , 1-2, 155-166.
O’Sullivan, M., Ekman, P., Friesen, W., & Scherer, K. (1985). What you say and how you say it: The contribution of speech content and voice quality to judgment of others. Journal of Personality and Social Psychology , 48, 54-62.
Poser 7 (2006) [computer software]. E-frontier America, Inc.
Scherer, K. R. (1986). Voice, stress, and emotion. In M. H. Appley & R. Trumbull (Eds.), Dynamics of stress (pp. 159-181). New York: Plenum.
Scherer, K. R. (1994). Toward a Concept of ‘Modal Emotions’. In P. Ekman & R .J. Davidson (Eds.). The Nature of Emotion: Fundamental Questions (pp. 25–31.) New York and Oxford: Oxford University Press.
Scherer, K. R., & Ellgring, H. (2007). Multimodal expression of emotion: Affect programs or componential appraisal patterns? Emotion, 7 , 1, 158-171.
Silva, A. D., Oliveira, A. M., Viegas, R., Oliveira, M., Lourenço, V., & Gonçalves, A. (2010). The cognitive algebra of Prototypical expressions of emotion in the face: one or many integration rules? In A. Bastianelli & G. Vidotto (Eds.) Fechner Day 2010: Proceedings of the 26th Annual Meeting of the International Society for Psychophysics (pp. 339-344). Padova, Italy: ISP.
Tracy, J. L., & Robins, R. W. (2004). Show your pride: Evidence for a discrete emotion expression. Psychological Science, 15 , 194 –197.
Tracy, J. L., & Robins, R. W. (2008). The nonverbal expression of pride: Evidence for cross-cultural recognition. Journal of Personality and Social Psychology, 94 , 3, 516-530.
Tracy, J. L., Robins, R. W., & Schriber, R. A. (2009). Development of a FACS-verified set of basic and self-conscious emotion expressions. Emotion, 9 , 554-559.
Van den Stock, J., Righart, R., & de Gelder, B. (2007). Body expressions influence recognition of emotions in the face and voice. Emotion, 7 , 3, 487-494.
Vidotto, G., Massidda, D., & Noventa, S. (2010). Averaging models: parameters estimation with the R-Average procedure. Psicologica, 31 , 3, 461-475.
Vidotto, G., Noventa, S., Massidda, D., & Vicentini, M. (2011). rAverage: Parameter estimation for the Averaging model of Information Integration Theory [Computer program]. Retrieved from http://www.rproject.org .
Waller, B. M., Cray, J. J., & Burrows, A. M. (2008). Selection for universal facial emotion. Emotion, 8 (3), 435-439.
Wehrle, T., Kaiser, S., Schmidt, S., & Scherer, K. R. (2000). Studying the dynamics of emotional expression using synthesized facial muscle movements. Journal of Personality and Social Psychology, 78 , 1, 105-119.
Willis, M. L., Burke, D., & Palermo, R. (2011). Judging approachability on the face of it: the influence of face and body expressions on the perception of approachability. Emotion, 11 , 3, 514-523.
Winters, A. M. (2005). Perceptions of Body Posture and Emotion: A question of methodology. The New School Psychology Bulletin, 3 , 2, 35-45.
Zalinski, J., & Anderson, N. H. (1991). Parameter estimation for averaging theory. In N. H. Anderson (Ed.), Contributions to Information Integration Theory (Vol. I: Cognition, pp. 353-394). Hillsdale, NJ: Lawrence Erlbaum Associates.
Cómo citar
Duarte Silva, A., & Oliveira, A. M. (2016). Do faces and body postures integrate similarly for distinct emotions, kinds of emotion and judgent dimensions?. Universitas Psychologica, 15(3), 1–21. https://doi.org/10.11144/Javeriana.upsy15-3.fbis
Número
Sección
Artículos