A facial expression is one or more motions or positions of the muscles beneath the skin of the face. According to one set of controversial theories, these movements convey the emotional state of an individual to observers. Facial expressions are a form of nonverbal communication. They are a primary means of conveying social information between humans, but they also occur in most other mammals and some other animal species. (For a discussion of the controversies on these claims, see Fridlund and Russell & Fernandez Dols.). The pioneer F-M Facial Action Coding System 2.0 (F-M FACS 2.0)  was created in 2017 by Dr. Freitas-Magalhães, and presents about 2,000 segments in 4K, using 3D technology and automatic and real-time recognition.
Humans can adopt a facial expression voluntarily or involuntarily, and the neural mechanisms responsible for controlling the expression differ in each case. Voluntary facial expressions are often socially conditioned and follow a cortical route in the brain. Conversely, involuntary facial expressions are believed to be innate and follow a subcortical route in the brain.
Facial recognition is often an emotional experience for the brain and the amygdala is highly involved in the recognition process.
The eyes are often viewed as important features of facial expressions. Aspects such as blinking rate can be used to indicate whether or not a person is nervous or whether or not he or she is lying. Also, eye contact is considered an important aspect of interpersonal communication. However, there are cultural differences regarding the social propriety of maintaining eye contact or not.
Beyond the accessory nature of facial expressions in spoken communication between people, they play a significant role in communication with sign language. Many phrases in sign language include facial expressions in the display.
There is controversy surrounding the question of whether or not facial expressions are worldwide and universal displays among humans. Supporters of the Universality Hypothesis claim that many facial expressions are innate and have roots in evolutionary ancestors. Opponents of this view question the accuracy of the studies used to test this claim and instead believe that facial expressions are conditioned and that people view and understand facial expressions in large part from the social situations around them.
Facial expressions are vital to social communication between humans. They are caused by the movement of muscles that connect to the skin and fascia in the face. These muscles move the skin, creating lines and folds and causing the movement of facial features, such as the mouth and eyebrows. These muscles develop from the second pharyngeal arch in the embryo. The temporalis, masseter, and internal and external pterygoid muscles, which are mainly used for chewing, have a minor effect on expression as well. These muscles develop from the first pharyngeal arch.
There are two brain pathways associated with facial expression; the first is voluntary expression. Voluntary expression travels from the primary motor cortex through the pyramidal tract, specifically the corticobulbar projections. The cortex is associated with display rules in emotion, which are social precepts that influence and modify expressions. Cortically related expressions are made consciously.
The second type of expression is emotional. These expressions originate from the extrapyramidal motor system, which involves subcortical nuclei. For this reason, genuine emotions are not associated with the cortex and are often displayed unconsciously. This is demonstrated in infants before the age of two; they display distress, disgust, interest, anger, contempt, surprise, and fear. Infants’ displays of these emotions indicate that they are not cortically related. Similarly, blind children also display emotions, proving that they are subconscious rather than learned. Other subcortical facial expressions include the “knit brow” during concentration, raised eyebrows when listening attentively, and short “punctuation” expressions to add emphasis during speech. People can be unaware that they are producing these expressions.
Neural mechanisms in face perceptionEdit
The amygdala plays an important role in facial recognition. Functional imaging studies have found that when shown pictures of faces, there is a large increase in the activity of the amygdala. The amygdala receives visual information from the thalamus via the subcortical pathways. The amygdala may also have a significant role in the recognition of fear and negative emotions. It is believed that the emotion disgust is recognized through activation of the insula and basal ganglia. The recognition of emotion may also utilize the occipitotemporal neocortex, orbitofrontal cortex and right frontoparietal cortices.
Gender and facial cuesEdit
More than anything though, what shapes a child's cognitive ability to detect facial expression is being exposed to it from the time of birth. The more an infant is exposed to different faces and expressions, the more able they are to recognize these emotions and then mimic them for themselves. Infants are exposed to an array of emotional expressions from birth, and evidence indicates that they imitate some facial expressions and gestures (e.g., tongue protrusion) as early as the first few days of life.[full citation needed] In addition, gender affects the tendency to express, perceive, remember, and forget specific emotions. For instance, angry male faces and happy female faces are more recognizable, compared to happy male faces and angry female faces.
A person's face, especially their eyes, creates the most obvious and immediate cues that lead to the formation of impressions. This article discusses eyes and facial expressions and the effect they have on interpersonal communication.
A person's eyes reveal much about how they are feeling, or what they are thinking. Blink rate can reveal how nervous or at ease a person may be. Research by Boston College professor Joe Tecce suggests that stress levels are revealed by blink rates. He supports his data with statistics on the relation between the blink rates of presidential candidates and their success in their races. Tecce claims that the faster blinker in the presidential debates has lost every election since 1980. Though Tecce's data is interesting, it is important to recognize that non-verbal communication is multi-channeled, and focusing on only one aspect is reckless. Nervousness can also be measured by examining each candidates' perspiration, eye contact and stiffness.
Within their first year, Infants learn rapidly that the looking behaviors of others conveys significant information. Infants prefer to look at faces that engage them in mutual gaze and that, from an early age, healthy babies show enhanced neural processing of direct gaze.
Eye contact is another major aspect of facial communication. Some have hypothesized that this is due to infancy, as humans are one of the few mammals who maintain regular eye contact with their mother while nursing. Eye contact serves a variety of purposes. It regulates conversations, shows interest or involvement, and establishes a connection with others.
- Eye contact regulates conversational turn taking, communicates involvement and interest, manifests warmth, and establishes connections with others…[and] it can command attention, be flirtatious, or seem cold and intimidating… [it] invites conversation. Lack of eye contact is usually perceived to be rude or inattentive.
But different cultures have different rules for eye contact. Certain Asian cultures can perceive direct eye contact as a way to signal competitiveness, which in many situations may prove to be inappropriate. Others lower their eyes to signal respect, and similarly eye contact is avoided in Nigeria; however, in western cultures this could be misinterpreted as lacking self-confidence.
Even beyond the idea of eye contact, eyes communicate more data than a person even consciously expresses. Pupil dilation is a significant cue to a level of excitement, pleasure, or attraction. Dilated pupils indicate greater affection or attraction, while constricted pupils send a colder signal.
Micro expressions are the facial expressions that last less than a second that can help to determine the true feelings or emotions of the sender in communication. The fundamental characteristics of a micro-expression, according to Ekman’s original definition, are involuntary leakage and fast speed.[full citation needed] These expressions have been gaining more attention over the years for many reasons. The show Lie To Me exhibits the art of watching the micro expressions of people and determining whether they are being truthful or not. Law enforcement can benefit from this practice to catch criminals. This is not something that is easy to do, as a University of San Francisco study shows that less than 1% of people are natural lie detectors who can detect micro expressions and lies without first being trained.
It is unknown how this tiny demographic has learned such a useful skill,[clarification needed] and researchers are still trying to determine what qualities people may possess to make them successful. So far, researchers have not been able to find a technology that can accomplish the same lie-detecting skills as people who are natural lie detectors. However, it is possible for anyone with a computer to be formally trained in the art of detecting micro expressions.
Cues that tip off lie-detectors can be through the mouth, eye movements, or even our eyebrows. Micro expressions have become increasingly studied over the years due to the possible help in detecting danger or someone's true, underlying emotions.
Facial expression is used in sign languages to convey specific meanings. In American Sign Language (ASL), for instance, raised eyebrows combined with a slightly forward head tilt indicate that what is being signed is a yes/no question. Lowered eyebrows are used for wh-word questions. Facial expression is also used in sign languages to show adverbs and adjectives such as distance or size: an open mouth, squinted eyes, and tilted back head indicate something far while the mouth pulled to one side and the cheek held toward the shoulder indicate something close, and puffed cheeks mean very large. It can also show the manner in which something is done, such as carelessly or routinely. Some of these expressions, also called non-manual signs, are used similarly in different sign languages while others are different from one language to another. For example, the expression used for 'carelessly' in ASL means 'boring or unpleasant' in British Sign Language.
The universality hypothesis is the assumption that certain facial expressions are signals of specific emotions (happiness, sadness, anger, fear, surprise, and disgust) that are recognized by people everywhere, regardless of culture or language. The evolutionary basis of these kinds of facial expressions can be traced back to Darwin’s The Expression of the Emotions in Man and Animals. Reviews of the universality hypothesis have been both supportive and critical. More recent work by Nelson and Russell and Jack et al. has been especially critical.
Ekman's work on facial expressions had its starting point in the work of psychologist Silvan Tomkins. Ekman showed that facial expressions of emotion are not culturally determined, but universal across human cultures.
To demonstrate his universality hypothesis, Ekman ran a test on a group of the South Fore people of New Guinea (a pre-industrial culture that was isolated from the west). The experiment participants were told brief stories about emotional events (happiness, sadness, anger, fear, surprise, and disgust). After each story, they were asked to select the matching facial expression from an array of three faces. The Fore selected the correct face on 64%-90% of trials but had difficulty distinguishing the fear face from the surprise face. Children selected from an array of only two faces, and their results were similar to the adults’. Subsequent cross-cultural studies found similar results.
Both sides of this debate agree that the face expresses emotion. The controversy surrounds the uncertainty about what specific emotional information is read from a facial expression. Opponents of the universality hypothesis believe that more general information is pieced together with other contextual information in order to determine how a person feels.
One argument against the evidence presented in support of the universality hypothesis is that the method typically used to demonstrate universality inflates recognition scores. Although each factor may contribute only a small amount to the inflation, combined, they can produce exaggerated scores. The three main factors are the following:
- The universality hypothesis focuses on people's abilities to recognize spontaneous facial expressions as they occur naturally. However, the facial expressions used to test this hypothesis are posed. Studies of spontaneous facial expressions are rare and find that participants’ recognition of the expressions is lower than that of the corresponding posed expressions.
- In most studies, participants are shown more than one facial expression (Ekman recommends six of each expression). However, people judge facial expressions relative to others that they have seen, and participants who judge more than one facial expression have higher recognition rates than those who judge only one.
- The response format that is most commonly used in emotion recognition studies is forced choice. In forced choice, for each facial expression, participants are asked to select their response from a short list of emotion labels. The forced choice method determines the emotion attributed to the facial expressions via the labels that are presented. That is, participants will select the best match to the facial expression even if it is not the emotion label they would have provided spontaneously and even if they would not have labeled the expression as an emotion at all.
Evolutionary significance of universalityEdit
Darwin argued that the expression of emotions has evolved in humans from animals, who would have used similar methods of expression. Darwin believed that expressions were unlearned and innate in human nature and were therefore evolutionarily significant for survival. Darwin obtained evidence of this through his research on different cultures and species and on infants. Ekman found that people shared many similar facial expressions despite never having met previously before. He was successfully able to confirm Darwin’s initial hypothesis that expressions were indeed unlearned behaviors that develop independently from cultured expressions.
Cross-cultural studies had shown that there are similarities in the way emotions are expressed across diverse cultures, but studies have even shown that there are similarities between species in how emotions are expressed. Research has shown that chimpanzees are able to communicate many of the same facial expressions as humans through the complex movements of the facial muscles. In fact, the facial cues were so similar that Ekman’s Facial Action Coding System could be applied to the chimps in evaluating their expressions. Of course, differences between the species' physical facial properties, such as white sclera and everted lips in chimps, would mean that some expressions could not be compared. Similarly, Darwin observed that infants’ method of expression not only was similar to those of adults, but seemed to be instinctive, as they were able to display emotional expressions they had not themselves yet witnessed. It is clear that facial morphology impacts expression recognition in important ways. Therefore, infant facial morphology may also serve some specific communicative function. These similarities in morphology and movement in emotional expression are important for the interpretation of emotions. Darwin was particularly interested in the functions of facial expression as evolutionarily important for survival. He looked at the functions of facial expression in terms of the utility of expression in the life on the animal and in terms of specific expressions in species. Darwin deduced that animals were communicating feelings of different emotional states with specific facial expressions. He further concluded that this communication was important for the survival of animals in group-dwelling species; the skill to effectively communicate or interpret another animal’s feelings and behaviors would be a principal trait in naturally fit species.
- Alan J. Fridlund (1994). Human facial expression (1 ed.). San Diego: Academic Press. ISBN 978-0-12-267630-7.
- J. A. Russell; J. M. Fernandez Dols (1997). The psychology of facial expression (1 ed.). Cambridge University Press. ISBN 978-0-521-58796-9.
- Freitas-Magalhães, A. (2017). Facial Action Coding System 2.0: Manual of Scientific Codification of the Human Face. Porto: FEELab Science Books. ISBN 978-989-8766-86-1.
- Rinn, William E. (1984). "The Neuropsychology of Facial Expression: A Review of the Neurological and Psychological Mechanisms for Producing Facial Expressions". Psychological Bulletin. American Psychological Association, Inc. 95 (1): 52–77. doi:10.1037/0033-2909.95.1.52.
- Carlson, Neil R. (2010). Physiology of behavior (10th ed.). Boston: Allyn & Bacon. pp. 386–389. ISBN 0-205-66627-2.
- Adolphs, Ralph (9 May 2002). "Neural systems for recognizing emotion". Current Opinion in Neurobiology. 12 (2): 169–177. doi:10.1016/S0959-4388(02)00301-X.
- (Field, Woodson, Greenberg, & Cohen, 1982; Meltzoff & Moore, 1983)
- Tay, Peter Kay Chai (2015-06-22). "The adaptive value associated with expressing and perceiving angry-male and happy-female faces". Frontiers in Psychology. 6. ISSN 1664-1078. PMC . PMID 26157405. doi:10.3389/fpsyg.2015.00851.
- Tay, Peter K. C.; Yang, Hwajin (2017-05-22). "Angry faces are more resistant to forgetting than are happy faces: directed forgetting effects on the identity of emotional faces". Journal of Cognitive Psychology. 0 (0): 1–11. ISSN 2044-5911. doi:10.1080/20445911.2017.1323907.
- Freitas-Magalhães, A. (2007). The Psychology of Emotions: The Allure of Human Face. Oporto: University Fernando Pessoa Press
- "In the blink of an eye." (October 21, 1999). Newsweek.
- Rothwell, J. Dan. In the Company of Others: An Introduction to Communication. United States: McGraw-Hill, 2004.
- Eye Contact Detection in Humans From Birth, PNAS VOL 99 N.14 2002.
- Spitz, Rene A., and Wolf, K. M. "The Smiling Response: A Contribution to the Ontogenesis of Social Relations." Genetic Psychology Monographs. 34 (August 1946). P. 57-125.
- Caring for Patients from Different Cultures, by Geri-Ann Galanti, p. 34
- Ekman and Friesen 1969
- Baker, Charlotte, and Dennis Cokely (1980). American Sign Language: A teacher's resource text on grammar and culture. Silver Spring, MD: T.J. Publishers.
- Sutton-Spence, Rachel, and Bencie Woll (1998). The linguistics of British Sign Language. Cambridge: Cambridge University Press.
- Ekman, P.; W. V. Friesen; P. Ellsworth (1972). "Emotion in the human face: Guidelines for research and a review of findings.". New York: Permagon.
- Izard, C. E. (1971). "The face of emotion". New York: Appleton-Century-Crofts.
- Woodworth, R. S.; Schlosberg, H. (1954). Experimental Psychology. New York: Henry Holt.
- Russell, James A. (1994). "Is there universal recognition of emotion from facial expression? A review of the cross-cultural studies". Psychological Bulletin. American Psychological Association, Inc. 115 (1): 102–141. PMID 8202574. doi:10.1037/0033-2909.115.1.102.
- Nelson, N. L.; Russell, J. A. (2013). "Universality revisited". Emotion Review. 5 (1): 8–15. doi:10.1177/1754073912457227.
- Jack, R. E.; Garrod, O. G.; Yu, H.; Caldara, R.; Schyns, P. G. (2012). "Facial expressions of emotion are not culturally universal". Proceedings of the National Academy of Sciences. 109 (19): 7241–7244. doi:10.1073/pnas.1200155109.
- Ekman, P.; W. V. Friesen (1971). "Constants across cultures in the face and emotion" (PDF). Journal of Personality and Social Psychology. 17 (2): 124–129. PMID 5542557. doi:10.1037/h0030377.
- Ekman, P.; Friesen, W.V.; O'Sullivan, M.; et al. (1987). "Universals and cultural differences in the judgments of facial expressions of emotion". Journal of Personality & Social Psychology. 53 (4): 712–717. doi:10.1037/0022-35188.8.131.522.
- Carroll, J. M.; J. A. Russell (1996). "Do facial expressions signal specific emotions? Judging emotion from the face in context". Journal of Personality and Social Psychology. 70: 205–218. doi:10.1037/0022-35184.108.40.206.
- Matsumoto, David; LeRoux, Jeff; Wilson-Cohn, Carida; et al. (September 2000). "A New Test to Measure Emotion Recognition Ability: Matsumoto and Ekman's Japanese and Caucasian Brief Affect Recognition Test (JACBART)". Journal of Nonverbal Behavior. 24 (3): 179–209.
- Naab, P. J.; J. A. Russell (2007). "Judgments of emotion from spontaneous facial expressions of New Guineans". Emotion. 7 (4): 736–744. doi:10.1037/1528-35220.127.116.116.
- Thayer, Stephen (1980). "The effect of expression sequence and expressor identity on judgments of the intensity of facial expression". Journal of Nonverbal Behavior. 5 (2): 71–79. doi:10.1007/bf00986510.
- Wagner, H. L. (2000). "The accessibility of the term "contempt" and the meaning of the unilateral lip curl". Cognition and Emotion. 14 (5): 689–710. doi:10.1080/02699930050117675.
- Ekman, edited by Paul (2006). Darwin and facial expression : a century of research in review. Cambridge, MA: Malor Books. p. 12. ISBN 1-883536-88-X.
- Carlson, Neil R. (2012). Physiology of behavior (11th ed.). New Jersey: Pearson Education Inc. p. 377. ISBN 0-205-23939-0.
- Vick, Sarah-Jane; Waller, Bridget M., Parr, Lisa A., Smith Pasqualini, Marcia C., Bard, Kim A. (15 December 2006). "A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS)". Journal of Nonverbal Behavior. 31 (1): 18. PMC . PMID 21188285. doi:10.1007/s10919-006-0017-z.
- Vick, Sarah-Jane; Waller, Bridget M., Parr, Lisa A., Smith Pasqualini, Marcia C., Bard, Kim A. (15 December 2006). "A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS)". Journal of Nonverbal Behavior. 31 (1): 16. PMC . PMID 21188285. doi:10.1007/s10919-006-0017-z.
- Russell, James (1994). "Is There Universal Recognition of Emotion From Facial Expression? A Review of the Cross-Cultural Studies". Psychological Bulletin. 115 (1): 102–141. PMID 8202574. doi:10.1037/0033-2909.115.1.102.
- Vick, Sarah-Jane; Waller, Bridget M., Parr, Lisa A., Smith Pasqualini, Marcia C., Bard, Kim A. (15 December 2006). "A Cross-species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS)". Journal of Nonverbal Behavior. 31 (1): 17. PMC . PMID 21188285. doi:10.1007/s10919-006-0017-z.
- Ekman, edited by Paul (2006). Darwin and facial expression : a century of research in review. Cambridge, MA: Malor Books. pp. 12–14. ISBN 1-883536-88-X.
|Wikiquote has quotations related to: Facial expression|
|Wikimedia Commons has media related to Facial expressions.|
- Facial Expressions Resources Page contains links to research concerning facial expressions
- Bell's Palsy information site Information for sufferers of facial palsy/facial paralysis
- The Umeå University Database of Facial Expressions, October 12, 2012. Journal of Medical Internet Research
- The JAFFE Database of Facial Expressions
- Facial expression analysis David Matsumoto and Paul Ekman Scholarpedia, 3(5):4237. doi:10.4249/scholarpedia.4237