Facial expression
A facial expression is one or more motions or positions of the muscles beneath the skin of the face. According to one set of controversial theories, these movements convey the emotional state of an individual to observers. Facial expressions are a form of nonverbal communication. They are a primary means of conveying social information between humans, but they also occur in most other mammals and some other animal species. (For a discussion of the controversies on these claims, see Fridlund[1] and Russell & Fernandez Dols.[2])
Humans can adopt a facial expression voluntarily or involuntarily, and the neural mechanisms responsible for controlling the expression differ in each case. Voluntary facial expressions are often socially conditioned and follow a cortical route in the brain. Conversely, involuntary facial expressions are believed to be innate and follow a subcortical route in the brain.
Facial recognition can be an emotional experience for the brain and the amygdala is highly involved in the recognition process. The Amygdala is the integrative center for emotions, emotional behavior, and motivation.
The eyes are often viewed as important features of facial expressions. Aspects such as blinking rate can possibly be used to indicate whether a person is nervous or whether they are lying. Also, eye contact is considered an important aspect of interpersonal communication. However, there are cultural differences regarding the social propriety of maintaining eye contact or not.
Beyond the accessory nature of facial expressions in spoken communication between people, they play a significant role in communication with sign language. Many phrases in sign language include facial expressions in the display.
There is controversy surrounding the question of whether facial expressions are a worldwide and universal display among humans. Supporters of the Universality Hypothesis claim that many facial expressions are innate and have roots in evolutionary ancestors. Opponents of this view question the accuracy of the studies used to test this claim and instead believe that facial expressions are conditioned and that people view and understand facial expressions in large part from the social situations around them. Moreover, facial expressions have a strong connection with personal psychology. Some psychologists have the ability to discern hidden meaning from a person's facial expression.
A 2020 study on "emotion residue" found that even when study participants attempted to make neutral facial expressions, their faces still retained emotion residue from prior expressions, and these prior expressions were able to be detected by observers.[3]
One experiment investigated the influence of gaze direction and facial expression on face memory. Participants were shown a set of unfamiliar faces with either happy or angry facial expressions, which were either gazing straight ahead or had their gaze averted to one side. Memory for faces that were initially shown with angry expressions was found to be poorer when these faces had averted as opposed to direct gaze, whereas memory for individuals shown with happy faces was unaffected by gaze direction. It is suggested that memory for another individual's face partly depends on an evaluation of the behavioural intention of that individual.[4]
Creation
Facial muscles
Facial expressions are vital to social communication between humans. They are caused by the movement of muscles that connect to the skin and fascia in the face. These muscles move the skin, creating lines and folds and causing the movement of facial features, such as the mouth and eyebrows. These muscles develop from the second pharyngeal arch in the embryo. The temporalis, masseter, and internal and external pterygoid muscles, which are mainly used for chewing, have a minor effect on expression as well. These muscles develop from the first pharyngeal arch.[5]
Neuronal pathways
There are two brain pathways associated with facial expression; the first is voluntary expression. Voluntary expression travels from the primary motor cortex through the pyramidal tract, specifically the corticobulbar projections. The cortex is associated with display rules in emotion, which are social precepts that influence and modify expressions. Cortically related expressions are made consciously.[5]
The second type of expression is emotional. These expressions originate from the extrapyramidal motor system, which involves subcortical nuclei. For this reason, genuine emotions are not associated with the cortex and are often displayed unconsciously. This is demonstrated in infants before the age of two; they display distress, disgust, interest, anger, contempt, surprise, and fear. Infants' displays of these emotions indicate that they are not cortically related. Similarly, blind children also display emotions, proving that they are subconscious rather than learned. Other subcortical facial expressions include the "knit brow" during concentration, raised eyebrows when listening attentively, and short "punctuation" expressions to add emphasis during speech. People can be unaware that they are producing these expressions.[5]
Asymmetries
The lower portions of the face are controlled by the opposite cerebral hemisphere, causing asymmetric facial expression. Because the right hemisphere is more specialised for emotional expression, emotions are more strongly expressed on the left side of the face.,[6] particularly for negative emotions.[7] Asymmetries in expression can be seen in chimeric faces (facial portraits made by combining the left and right halves of faces with different expressions)[8] and also in portraits which more often show the left, more emotional side of the face than the right.[9]
Neural mechanisms in face perception
The amygdala plays an important role in facial recognition. Functional imaging studies have found that when shown pictures of faces, there is a large increase in the activity of the amygdala. The amygdala receives visual information from the thalamus via the subcortical pathways.[10] The amygdala may also have a significant role in the recognition of fear and negative emotions. It is believed that the emotion disgust is recognized through activation of the insula and basal ganglia. The recognition of emotion may also utilize the occipitotemporal neocortex, orbitofrontal cortex and right frontoparietal cortices.[11]
Gender and facial cues
More than anything though, what shapes a child's cognitive ability to detect facial expression is being exposed to it from the time of birth. The more an infant is exposed to different faces and expressions, the more able they are to recognize these emotions and then mimic them for themselves. Infants are exposed to an array of emotional expressions from birth, and evidence indicates that they imitate some facial expressions and gestures (e.g., tongue protrusion) as early as the first few days of life.[12] In addition, gender affects the tendency to express, perceive, remember, and forget specific emotions.[13][14] For instance, angry male faces and happy female faces are more recognizable, compared to happy male faces and angry female faces.[14]
Communication
Eye contact
A person's face, especially their eyes, creates the most obvious and immediate cues that lead to the formation of impressions. This article discusses eyes and facial expressions and the effect they have on interpersonal communication.
A person's eyes reveal much about how they are feeling, or what they are thinking. Blink rate can reveal how nervous or at ease a person may be. Research by Boston College professor Joe Tecce suggests that stress levels are revealed by blink rates. He supports his data with statistics on the relation between the blink rates of presidential candidates and their success in their races. Tecce claims that the faster blinker in the presidential debates has lost every election since 1980.[15] Though Tecce's data is interesting, it is important to recognize that non-verbal communication is multi-channeled, and focusing on only one aspect is reckless. Nervousness can also be measured by examining each candidates' perspiration, eye contact and stiffness.[16]
Within their first year, Infants learn rapidly that the looking behaviors of others convey significant information. Infants prefer to look at faces that engage them in mutual gaze and that, from an early age, healthy babies show enhanced neural processing of direct gaze.[17]
Eye contact is another major aspect of facial communication. Some have hypothesized that this is due to infancy, as humans are one of the few mammals who maintain regular eye contact with their mother while nursing.[18] Eye contact serves a variety of purposes. It regulates conversations, shows interest or involvement, and establishes a connection with others.
But different cultures have different rules for eye contact. Certain Asian cultures can perceive direct eye contact as a way to signal competitiveness, which in many situations may prove to be inappropriate. Others lower their eyes to signal respect, and similarly, eye contact is avoided in Nigeria;[19] however, in western cultures this could be misinterpreted as lacking self-confidence.
Even beyond the idea of eye contact, eyes communicate more data than a person even consciously expresses. Pupil dilation is a significant cue to a level of excitement, pleasure, or attraction. Dilated pupils indicate greater affection or attraction, while constricted pupils send a colder signal.
Sign languages
Facial expression is used in sign languages to convey specific meanings. In American Sign Language (ASL), for instance, raised eyebrows combined with a slightly forward head tilt to indicate that what is being signed is a yes–no question. Lowered eyebrows are used for wh-word questions. Facial expression is also used in sign languages to show adverbs and adjectives such as distance or size: an open mouth, squinted eyes and tilted back head indicate something far while the mouth pulled to one side and the cheek held toward the shoulder indicate something close, and puffed cheeks mean very large. It can also show the manner in which something is done, such as carelessly or routinely.[20] Some of these expressions, also called non-manual signs, are used similarly in different sign languages while others are different from one language to another. For example, the expression used for 'carelessly' in ASL means 'boring or unpleasant' in British Sign Language.[21]
Universality hypothesis
The universality hypothesis is the assumption that certain facial expressions and face-related acts or events are signals of specific emotions (happiness with laughter and smiling, sadness with tears, anger with a clenched jaw, fear with a grimace, or gurn, surprise with raised eyebrows and wide eyes along with a slight retraction of the ears, and disgust with a wrinkled nose and squinted eyes—emotions which frequently lack the social component of those like shame, pride, jealousy, envy, deference, etc.) and are recognized by people regardless of culture, language, or time. The belief in the evolutionary basis of these kinds of facial expressions can be traced back to Darwin's The Expression of the Emotions in Man and Animals. Reviews of the universality hypothesis have been both supportive[22][23] and critical.[24][25] Work in 2013 by Nelson and Russell[26] and Jack et al.[27] has been especially critical.
Support
Ekman's work on facial expressions had its starting point in the work of psychologist Silvan Tomkins. Ekman showed that facial expressions of emotion are not culturally determined, but universal across human cultures.
To demonstrate his universality hypothesis, Ekman ran a test on a group of the South Fore people of New Guinea, a pre-industrial culture that was isolated from the West. The experiment participants were told brief stories about emotional events (happiness, sadness, anger, fear, surprise, and disgust). After each story, they were asked to select the matching facial expression from an array of three faces.[28] The Fore selected the correct face on 64–90% of trials but had difficulty distinguishing the fear face from the surprise face. Children selected from an array of only two faces, and their results were similar to the adults'. Subsequent cross-cultural studies found similar results[29]
Criticism
Both sides of this debate agree that the face expresses emotion. The controversy surrounds the uncertainty about what specific emotional information is read from a facial expression. Opponents of the universality hypothesis believe that more general information is pieced together with other contextual information in order to determine how a person feels.[30]
One argument against the evidence presented in support of the universality hypothesis is that the method typically used to demonstrate universality inflates recognition scores.[25] Although each factor may contribute only a small amount to the inflation, combined, they can produce exaggerated scores. The three main factors are the following:
- The universality hypothesis focuses on people's abilities to recognize spontaneous facial expressions as they occur naturally. However, the facial expressions used to test this hypothesis are posed. Studies of spontaneous facial expressions are rare and find that participants' recognition of the expressions is lower than that of the corresponding posed expressions.[31][32]
- In most studies, participants are shown more than one facial expression (Ekman recommends six of each expression). However, people judge facial expressions relative to others that they have seen,[33] and participants who judge more than one facial expression have higher recognition rates than those who judge only one.[25]
- The response format that is most commonly used in emotion recognition studies is forced choice. In forced choice, for each facial expression, participants are asked to select their response from a short list of emotion labels. The forced choice method determines the emotion attributed to the facial expressions via the labels that are presented.[25] That is, participants will select the best match to the facial expression even if it is not the emotion label they would have provided spontaneously and even if they would not have labeled the expression as an emotion at all.[34]
Evolutionary significance of universality
Darwin argued that the expression of emotions has evolved in humans from animal ancestors, who would have used similar methods of expression. Darwin believed that expressions were unlearned and innate in human nature and were therefore evolutionarily significant for survival. He compiled supporting evidence from his research on different cultures, on infants, and in other animal species.[35]: 12 Ekman found that people from different cultures recognized certain facial expressions despite vast cultural differences, and his findings tended to confirm Darwin's initial hypothesis.[36]
Cross-cultural studies had shown that there are similarities in the way emotions are expressed across diverse cultures, but studies have even shown that there are similarities between species in how emotions are expressed. Research has shown that chimpanzees are able to communicate many of the same facial expressions as humans through the complex movements of the facial muscles. In fact, the facial cues were so similar that Ekman's Facial Action Coding System could be applied to the chimps in evaluating their expressions.[37] Of course, differences between the species' physical facial properties, such as white sclera and everted lips in chimps, would mean that some expressions could not be compared.[38]
Similarly, Darwin observed that infants' method of expression for certain emotions was instinctive, as they were able to display emotional expressions they had not themselves yet witnessed.[39] Facial morphology impacts expression recognition in important ways, and therefore, infant facial morphology may also serve some specific communicative function. These similarities in morphology and movement are important for the correct interpretation of an emotion.[40] Darwin was particularly interested in the functions of facial expression as evolutionarily important for survival. He looked at the functions of facial expression in terms of the utility of expression in the life of the animal and in terms of specific expressions within species. Darwin deduced that some animals communicated feelings of different emotional states with specific facial expressions. He further concluded that this communication was important for the survival of animals in group-dwelling species; the skill to effectively communicate or interpret another animal's feelings and behaviors would be a principal trait in naturally fit species.[35]: 12–14 However, this suggests that solitary species such as orang-utans would not exhibit such expressions.
See also
- Affect display
- Bell's palsy
- Body language
- Computer processing of body language
- Display rules
- Emoticon (Facial Expression Markup Language)
- Emotion classification
- Laughter
- Gelotology
- Metacommunicative competence
- Thought Moments
References
- Alan J. Fridlund (1994). Human facial expression (1 ed.). San Diego: Academic Press. ISBN 978-0-12-267630-7.
- J.A. Russell; J.M. Fernandez Dols (1997). The psychology of facial expression (1 ed.). Cambridge University Press. ISBN 978-0-521-58796-9.
- Albohn, Daniel N.; Adams, Reginald B. (2021-05-01). "Emotion Residue in Neutral Faces: Implications for Impression Formation". Social Psychological and Personality Science. 12 (4): 479–486. doi:10.1177/1948550620923229. ISSN 1948-5506. S2CID 225674024.
- Nakashima, Satoshi F.; Langton, Stephen R.H.; Yoshikawa, Sakiko (2012). "The effect of facial expression and gaze direction on memory for unfamiliar faces" (PDF). Cognition and Emotion. 26 (7): 1316–25. doi:10.1080/02699931.2011.619734. hdl:1893/21041. PMID 22077759. S2CID 15646129.
- Rinn, William E. (1984). "The Neuropsychology of Facial Expression: A Review of the Neurological and Psychological Mechanisms for Producing Facial Expressions". Psychological Bulletin. 95 (1): 52–77. doi:10.1037/0033-2909.95.1.52. PMID 6242437.
- Blonder LX, Bowers D, Heilman KM (1991). "The role of right hemisphere in emotional communication". Brain. 114 (3): 1115–1127. doi:10.1093/brain/114.3.1115. PMID 2065243.
{{cite journal}}
: CS1 maint: multiple names: authors list (link) - Ahern GL, Schwartz GE (1979). "Differential lateralization for positive versus negative emotion". Neuropsychologia. 17 (6): 693–698. doi:10.1016/0028-3932(79)90045-9. PMID 522984. S2CID 27771100.
- Levy J, Heller W, Banich MT, Burton LA (1983). "Asymmetry of Perception in Free Viewing of Chimeric Faces". Brain and Cognition. 2 (4): 404–419. doi:10.1016/0278-2626(83)90021-0. PMID 6546034. S2CID 21456608.
{{cite journal}}
: CS1 maint: multiple names: authors list (link) - Nicholls Mike, Clode D, Wood SJ and Wood AG (1999). "Laterality of expression in portraiture: Putting your best cheek forward". Proceedings of the Royal Society B. 266 (1428): 1517–1522. doi:10.1098/rspb.1999.0809. PMC 1690171. PMID 10467743.
{{cite journal}}
: CS1 maint: multiple names: authors list (link) - Carlson, Neil R. (2010). Physiology of behavior (10th ed.). Boston: Allyn & Bacon. pp. 386–89. ISBN 978-0-205-66627-0.
- Adolphs, Ralph (9 May 2002). "Neural systems for recognizing emotion". Current Opinion in Neurobiology. 12 (2): 169–77. doi:10.1016/S0959-4388(02)00301-X. PMID 12015233. S2CID 13169882.
- Field, T. M., Woodson, R., Cohen, D., Greenberg, R., Garcia, R., & Collins, K. (1983). Discrimination and imitation of facial expressions by term and preterm neonates. Infant Behavior and Development, 6(4), 485-489.
- Tay, Peter Kay Chai (2015-06-22). "The adaptive value associated with expressing and perceiving angry-male and happy-female faces". Frontiers in Psychology. 6: 851. doi:10.3389/fpsyg.2015.00851. ISSN 1664-1078. PMC 4476135. PMID 26157405.
- Tay, Peter K.C.; Yang, Hwajin (2017-05-22). "Angry faces are more resistant to forgetting than are happy faces: directed forgetting effects on the identity of emotional faces". Journal of Cognitive Psychology. 29 (7): 855–65. doi:10.1080/20445911.2017.1323907. ISSN 2044-5911. S2CID 148887899.
- "In the blink of an eye." (October 21, 1999). Newsweek.
- Rothwell, J. Dan. In the Company of Others: An Introduction to Communication. United States: McGraw-Hill, 2004.
- Eye Contact Detection in Humans From Birth, PNAS Vol 99 N.14 2002.
- Spitz, Rene A., and Wolf, K.M. "The Smiling Response: A Contribution to the Ontogenesis of Social Relations." Genetic Psychology Monographs. 34 (August 1946). pp. 57–125.
- Caring for Patients from Different Cultures, by Geri-Ann Galanti, p. 34
- Baker, Charlotte, and Dennis Cokely (1980). American Sign Language: A teacher's resource text on grammar and culture. Silver Spring, MD: T.J. Publishers.
- Sutton-Spence, Rachel, and Bencie Woll (1998). The linguistics of British Sign Language. Cambridge: Cambridge University Press.
- Ekman, P.; W.V. Friesen; P. Ellsworth (1972). "Emotion in the human face: Guidelines for research and a review of findings". New York: Permagon.
{{cite journal}}
: Cite journal requires|journal=
(help) - Izard, C.E. (1971), The face of emotion, New York: Appleton-Century-Crofts
- Woodworth, R.S.; Schlosberg, H. (1954). Experimental Psychology. New York: Henry Holt.
- Russell, James A. (1994). "Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies". Psychological Bulletin. 115 (1): 102–41. doi:10.1037/0033-2909.115.1.102. PMID 8202574.
- Nelson, N.L.; Russell, J.A. (2013). "Universality revisited". Emotion Review. 5 (1): 8–15. doi:10.1177/1754073912457227. S2CID 220262886.
- Jack, R.E.; Garrod, O.G.; Yu, H.; Caldara, R.; Schyns, P.G. (2012). "Facial expressions of emotion are not culturally universal". Proceedings of the National Academy of Sciences. 109 (19): 7241–44. doi:10.1073/pnas.1200155109. PMC 3358835. PMID 22509011.
- Ekman, P.; W.V. Friesen (1971). "Constants across cultures in the face and emotion" (PDF). Journal of Personality and Social Psychology. 17 (2): 124–29. doi:10.1037/h0030377. PMID 5542557. S2CID 14013552. Archived from the original (PDF) on 2015-02-28. Retrieved 2015-02-28.
- Ekman, P.; Friesen, W.V.; O'Sullivan, M.; et al. (1987). "Universals and cultural differences in the judgments of facial expressions of emotion". Journal of Personality & Social Psychology. 53 (4): 712–17. doi:10.1037/0022-3514.53.4.712. PMID 3681648.
- Carroll, J.M.; J.A. Russell (1996). "Do facial expressions signal specific emotions? Judging emotion from the face in context". Journal of Personality and Social Psychology. 70 (2): 205–18. doi:10.1037/0022-3514.70.2.205. PMID 8636880. S2CID 4835524.
- Matsumoto, David; LeRoux, Jeff; Wilson-Cohn, Carida; et al. (September 2000). "A New Test to Measure Emotion Recognition Ability: Matsumoto and Ekman's Japanese and Caucasian Brief Affect Recognition Test (JACBART)" (PDF). Journal of Nonverbal Behavior. 24 (3): 179–209. doi:10.1023/A:1006668120583. S2CID 18039888.
- Naab, P.J.; J.A. Russell (2007). "Judgments of emotion from spontaneous facial expressions of New Guineans". Emotion. 7 (4): 736–44. doi:10.1037/1528-3542.7.4.736. PMID 18039042.
- Thayer, Stephen (1980). "The effect of expression sequence and expressor identity on judgments of the intensity of facial expression". Journal of Nonverbal Behavior. 5 (2): 71–79. doi:10.1007/bf00986510. S2CID 144353978.
- Wagner, H. L. (2000). "The accessibility of the term "contempt" and the meaning of the unilateral lip curl". Cognition and Emotion. 14 (5): 689–710. doi:10.1080/02699930050117675. S2CID 144565541.
- Ekman, Paul, ed. (2006). Darwin and facial expression: a century of research in review. Cambridge, MA: Malor Books. ISBN 978-1-883536-88-6.
- Carlson, Neil R. (2012). Physiology of behavior (11th ed.). New Jersey: Pearson Education Inc. p. 377. ISBN 978-0-205-23939-9.
- Vick, Sarah-Jane; Waller, Bridget M., Parr, Lisa A., Smith Pasqualini, Marcia C., Bard, Kim A. (15 December 2006). "A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS)". Journal of Nonverbal Behavior. 31 (1): 1–20. doi:10.1007/s10919-006-0017-z. PMC 3008553. PMID 21188285.
{{cite journal}}
: CS1 maint: multiple names: authors list (link) - Vick, Sarah-Jane; Waller, Bridget M., Parr, Lisa A., Smith Pasqualini, Marcia C., Bard, Kim A. (15 December 2006). "A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS)". Journal of Nonverbal Behavior. 31 (1): 16. doi:10.1007/s10919-006-0017-z. PMC 3008553. PMID 21188285.
{{cite journal}}
: CS1 maint: multiple names: authors list (link) - Russell, James (1994). "Is There Universal Recognition of Emotion From Facial Expression? A Review of the Cross-Cultural Studies". Psychological Bulletin. 115 (1): 102–41. doi:10.1037/0033-2909.115.1.102. PMID 8202574.
- Vick, Sarah-Jane; Waller, Bridget M., Parr, Lisa A., Smith Pasqualini, Marcia C., Bard, Kim A. (15 December 2006). "A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS)". Journal of Nonverbal Behavior. 31 (1): 17. doi:10.1007/s10919-006-0017-z. PMC 3008553. PMID 21188285.
{{cite journal}}
: CS1 maint: multiple names: authors list (link)
- Salvadori, Eliala A.; Colonnesi, Cristina; Vonk, Heleen S.; Oort, Frans J.; Aktar, Evin (2021-01-14). "Infant Emotional Mimicry of Strangers: Associations with Parent Emotional Mimicry, Parent-Infant Mutual Attention, and Parent Dispositional Affective Empathy". International Journal of Environmental Research and Public Health. 18 (2): 654. doi:10.3390/ijerph18020654. PMC 7828673. PMID 33466629.
External links
- Facial Expressions Resources Page contains links to research concerning facial expressions
- Bell's Palsy information site Information for sufferers of facial palsy/facial paralysis
- The Umeå University Database of Facial Expressions, October 12, 2012. Journal of Medical Internet Research
- The JAFFE Database of Facial Expressions
- Facial expression analysis David Matsumoto and Paul Ekman Scholarpedia, 3(5):4237. doi:10.4249/scholarpedia.4237