- PII
- S30346274S0869541525020063-1
- DOI
- 10.7868/S3034627425020063
- Publication type
- Article
- Status
- Published
- Authors
- Volume/ Edition
- Volume / Issue number 2
- Pages
- 97-119
- Abstract
- Emotional facial expressions are one of the main sources of human non-verbal communication. At the same time, emotions are transmitted through facial expressions both consciously and unconsciously. In particular, micro-facial expressions and background facial expressions of low intensity are those that are poorly amenable to conscious control. According to many studies, micro-facial expressions can be considered a window into a person’s true feelings. However, due to their fleetingness and low intensity, micro expressions are very difficult to catch with the naked eye. This article presents an overview of scientific knowledge about human micro-facial expressions, starting from the discovery to the current level of development. We consider the history of studying the topic and describe in detail the current state of the art. We further discuss the limitations and presents ideas on the prospects for further studies of micro-facial expressions, taking into account the cross-cultural component.
- Keywords
- микромимика эмоциональная мимика невербальная коммуникация FaceReader распознавание обмана лицо человека
- Date of publication
- 01.02.2025
- Year of publication
- 2025
- Number of purchasers
- 0
- Views
- 30
References
- 1. Анохин П.К. Эмоции // Большая медицинская энциклопедия. Т. 35 / Под ред. А.Н. Бакулева. М.: Медгиз, 1964a. С. 339-341.
- 2. Анохин П.К. Эволюция эмоций // Большая медицинская энциклопедия. Т. 35 / Под ред. А.Н. Бакулева. М.: Медгиз, 1964б. С. 354-357.
- 3. Анохин П.К. Биология и нейрофизиология условного рефлекса. М.: Медицина, 1968.
- 4. Барабанщиков В.А. Экспрессии лица и их восприятие. М.: Институт психологии РАН, 2012.
- 5. Барабанщиков В.А., Хозе Е.Г. Конфигуративные признаки экспрессий спокойного лица // Экспериментальная психология. 2012. Т. 5. № 1. С. 45-68.
- 6. Бутовская М.Л. Язык тела: природа и культура. М.: Научный мир, 2004.
- 7. Павлов И.П. Двадцатилетний опыт объективного изучения высшей нервной деятельности (поведения) животных. Полное собрание сочинений. М.; Л.: Изд-во АН СССР, 1951.
- 8. Ростовцева В.В., Бутовская М.Л. Нейтральное лицо человека несет отпечаток его эмоциональности // Этнографическое обозрение. 2022. № 6. С. 160-177. https://doi.org/10.31857/S0869541522060094
- 9. Хозе Е.Г. и др. Кросс-культурные особенности восприятия базовых эмоциональных экспрессий лица // Лицо человека: познание, общение, деятельность / Под ред. К.И. Ананьевой, В.А. Барабанщикова, А.А. Демидова. М.: Московский институт психоанализа, 2019. С. 506-515.
- 10. Adams R.B., Jr. et al. Emotion in the Neutral Face: A Mechanism for Impression Formation? // Cognition & Emotion. 2012. Vol. 26 (3). P. 431-441. https://doi.org/10.1080/02699931.2012.666502
- 11. Al-Shawaf L., Shackelford T.K. The Oxford Handbook of Evolution and the Emotions. N.Y.: Oxford University Press, 2024.
- 12. Ben X. et al. Video-Based Facial Micro-Expression Analysis: A Survey of Datasets, Features and Algorithms // IEEE Transactions on Pattern Analysis and Machine Intelligence. 2021. Vol. 44 (9). P. 5826-5846. https://doi.org/10.1109/TPAMI.2021.3067464
- 13. Bhushan B. Study of Facial Micro-Expressions in Psychology // Understanding Facial Expressions in Communication / Eds. M. Mandal, A. Awasthi. New Delhi: Springer, 2015. P. 265-286. https://doi.org/10.1007/978-81-322-1934-7_13
- 14. Caeiro C. et al. OrangFACS: A Muscle-Based Facial Movement Coding System for Orangutans (Pongo spp.) // International Journal of Primatology. 2013. Vol. 34. P. 115-129. https://doi.org/10.1007/s10764-012-9652-x
- 15. Charlesworth W.R., Kreutzer M.A. Facial Expressions of Infants and Children // Darwin and Facial Expression: A Century of Research in Review / Ed. P. Ekman. Los Atlos: Malor Books, 2006. P. 91-168.
- 16. Cowen A.S. et al. How Emotion is Experienced and Expressed in Multiple Cultures: A Large-scale Experiment Across North America, Europe, and Japan // Frontiers in Psychology. 2024. Vol. 15. P. 1350631. https://doi.org/10.3389/fpsyg.2024.1350631
- 17. Dahl C.D., Wallraven C., Bülthoff H.H., Logothetis N.K. Humans and Macaques Employ Similar Face-Processing Strategies // Current Biology. 2009. Vol. 19 (6). P. 509-513. https://doi.org/10.1016/j.cub.2009.01.061
- 18. Darwin C.R. The Expression of the Emotions in Man and Animals. L.: John Murray, 1872.
- 19. Demetrioff S., Porter S., Baker A. I Know How You Feel: The Influence of Psychopathic Traits on the Ability to Identify Micro-Expressions // Psychology, Crime & Law. 2016. Vol. 23 (3). P. 274-290. https://doi.org/10.1080/1068316X.2016.1247159
- 20. Dong Z. et al. Spontaneous Facial Expressions and Micro-Expressions Coding: From Brain to Face // Frontiers in Psychology. 2022. Vol. 12. P. 784834. https://doi.org/10.3389/fpsyg.2021.784834
- 21. Du S., Tao Y., Martinez A.M. Compound Facial Expressions of Emotion // Proceedings of the National Academy of Sciences USA. 2014. Vol. 111 (15). P. E1454-E1462. https://doi.org/10.1073/pnas.1322355111
- 22. Edery R. Detecting Deception as a Probable Healing Tool for Clients: A Review of Dr. Paul Ekman // EC Psychology and Psychiatry. 2019. Vol. 8. P. 212-217.
- 23. Eggleston A., Tsantani M., Over H., Cook R. Preferential Looking Studies of Trustworthiness Detection Confound Structural and Expressive Cues to Facial Trustworthiness // Scientific Reports. 2022. Vol. 12 (1). P. 17709. https://doi.org/10.1038/s41598-022-21586-6
- 24. Ekman P. Universal Facial Expressions of Emotions // California Mental Health Research Digest. 1970. Vol. 8 (4). P. 151-158.
- 25. Ekman P. Universals and Cultural Differences in Facial Expressions of Emotions // Nebraska Symposium on Motivation / Ed. J. Cole. Lincoln: University of Nebraska Press, 1972. P. 207-282.
- 26. Ekman P. Microexpression Training Tool (METT). Stanford: Technical Reports, 2002.
- 27. Ekman P. (ed.) Darwin and Facial Expression: A Century of Research in Review. Los Atlos: Malor Books, 2006.
- 28. Ekman P. Lie Catching and Microexpressions // The Philosophy of Deception / Ed. C. Martin. N.Y.: Oxford University Press, 2009. P. 118-135.
- 29. Ekman P.E., Davidson R.J. The Nature of Emotion: Fundamental Questions. L.: Oxford University Press, 1994.
- 30. Ekman P., Friesen W.V. Nonverbal Leakage and Clues to Deception // Psychiatry. 1969. Vol. 32 (1). P. 88-106. https://doi.org/10.1080/00332747.1969.11023575
- 31. Ekman P., Friesen W.V. Constants Across Cultures in the Face and Emotion // Journal of Personality and Social Psychology. 1971. Vol. 17 (2). P. 124-129. https://doi.org/10.1037/h0030377
- 32. Ekman P., Friesen W.V. Manual for the Facial Action Code. Palo Alto: Consulting Psychologist Press, 1978.
- 33. Ekman P., Friesen W.V. Felt, False, and Miserable Smiles // Journal of Nonverbal Behavior. 1982. Vol. 6 (4). P. 238-252. https://doi.org/10.1007/BF00987191
- 34. Ekman P., Friesen W.V., Ellsworth P. Emotion in the Human Face: Guidelines for Research and an Integration of Findings. N.Y.: Pergamon Press Inc., 2013.
- 35. Ekman P., Friesen W.V., Hager J.C. Facial Action Coding System: The Manual. Salt Lake City: Research Nexus Division of Network Research Corporation, 2002.
- 36. Ekman P., Friesen W.V., Simons R.C. Is the Startle Reaction an Emotion? // Journal of Personality and Social Psychology. 1985. Vol. 49 (5). P. 1416.
- 37. Ekman P., Sorenson E.R., Friesen W.V. Pan-Cultural Elements in Facial Display of Emotions // Science. 1969. Vol. 164. P. 86-88. https://doi.org/10.1126/science.164.3875.86
- 38. Elfenbein H.A. Nonverbal Dialects and Accents in Facial Expressions of Emo-tion // Emotion Review. 2013. Vol. 5 (1). P. 90-96. https://doi.org/-10.1177/1754073912451332
- 39. Elfenbein H.A., Ambady N. On the Universality and Cultural Specificity of Emotion Recognition: A Meta-Analysis // Psychological Bulletin. 2002. Vol. 128 (2). P. 203-235. https://doi.org/10.1037/0033-2909.128.2.203
- 40. Esmaeili M., Kiani K. Generating Personalized Facial Emotions Using Emotional EEG Signals and Conditional Generative Adversarial Networks // Multimedia Tools and Applications. 2024. Vol. 83 (12). P. 36013-36038. https://doi.org/10.1007/s11042-023-17018-w
- 41. Fang X., Sauter D.A., Heerdink M.W., van Kleef G.A. Culture Shapes the Distinctiveness of Posed and Spontaneous Facial Expressions of Anger and Disgust // Journal of Cross-Cultural Psychology. 2022. Vol. 53 (5). P. 471-487. https://doi.org/10.1177/00220221221095208
- 42. Fox E. Perspectives from Affective Science on Understanding the Nature of Emotion // Brain and Neuroscience Advances. 2018. Vol. 2. P. 2398212818812628. https://doi.org/10.1177/2398212818812628
- 43. Frank M. et al. I See How You Feel: Training Laypeople and Professionals to Recognize Fleeting Emotions // The Annual Meeting of the International Communication Association, Sheraton, New York, New York City. 2009. P. 1-35.
- 44. Frank M.G., Svetieva E. Microexpressions and Deception // Understanding Facial Expressions in Communication: Cross-cultural and Multidisciplinary Perspectives / Eds. M. Mandal, A. Awasthi. New Delhi: Springer, 2015. P. 227-242. https://doi.org/10.1007/978-81-322-1934-7_11
- 45. Freeberg T.M., Dunbar R.I.M., Ord T.J. Social Complexity as a Proximate and Ultimate Factor in Communicative Complexity Introduction // Philosophical Transactions of the Royal Society B-Biological Sciences. 2012. Vol. 367. P. 1785-1801. https://doi.org/10.1098/rstb.2011.0213
- 46. Haggard E.A., Isaacs K.S. Micromomentary Facial Expressions as Indicators of Ego Mechanisms in Psychotherapy // Methods of Research in Psychotherapy / Eds. L.A. Gottschalk, A.H. Auerbach. Boston: Springer, 1966. P. 154-165. https://doi.org/10.1007/978-1-4684-6045-2_14
- 47. Hurley C.M. et al. Background Factors Predicting Accuracy and Improvement in Micro Expression Recognition // Motivation and Emotion. 2014. Vol. 38. P. 700-714. https://doi.org/10.1007/s11031-014-9410-9
- 48. Guerdelli H. et al. Macro- and Micro-Expressions Facial Datasets: A Survey // Sensors. 2022. Vol. 22 (4). P. 1524. https://doi.org/10.3390/s22041524
- 49. Hester N. Perceived Negative Emotion in Neutral Faces: Gender-Dependent Effects on Attractiveness and Threat // Emotion. 2019. Vol. 19 (8). P. 1490-1494. http://dx.doi.org/10.1037/emo0000525
- 50. Höfling T.T.A., Gerdes A.B., Föhl U., Alpers G.W. Read My Face: Automatic Facial Coding Versus Psychophysiological Indicators of Emotional Valence and Arousal // Frontiers in Psychology. 2020. Vol. 11. P. 1388. https://doi.org/10.3389/fpsyg.2020.01388
- 51. Iwasaki M., Noguchi Y. Hiding True Emotions: Micro-expressions in Eyes Retrospectively Concealed by Mouth Movements // Scientific Reports. 2016. Vol. 6 (1). P. 22049. https://doi.org/10.1038/srep22049
- 52. Jaeger B., Jones A.L. Which Facial Features are Central in Impression Formation? // Social Psychological and Personality Science. 2022. Vol. 13 (2). P. 553-561. https://doi.org/10.1177/19485506211034979
- 53. Julle-Danière E. et al. MaqFACS (Macaque Facial Action Coding System) Can Be Used to Document Facial Movements in Barbary Macaques (Macaca sylvanus) // PeerJ. 2015. Vol. 3. P. e1248. https://doi.org/10.7717/peerj.1248
- 54. Larsen J.T. et al. The Psychophysiology of Emotion // Handbook of Emotions / Eds. M. Lewis, J.M. Haviland-Jones, L.F. Barrett. N.Y.: The Guilford Press, 2008. P. 180-195.
- 55. Li J. Facial Micro-Expression Analysis: Computer Vision and Pattern Recognition. PhD diss., Rennes, CentraleSupélec, 2019.
- 56. Li Y., Huang X., Zhao G. Can Micro-Expression be Recognized Based on Single Apex Frame? // 2018 25th IEEE International Conference on Image Processing (ICIP). Athens: IEEE, 2018. P. 3094-3098. https://doi.org/10.1109/ICIP.2018.8451376
- 57. Li X. et al. 4DME: A Spontaneous 4D Micro-Expression Dataset with Multimodalities // IEEE Transactions on Affective Computing. 2022. Vol. 14 (4). P. 3031-3047. https://doi.org/10.1109/TAFFC.2022.3182342
- 58. Liong S.T., Wong K. Micro-Expression Recognition Using Apex Frame with Phase Information // 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC). Kuala Lumpur: IEEE, 2017. P. 534-537. https://doi.org/10.1109/APSIPAASC39710.2017
- 59. Lindquist K.A. et al. The Cultural Evolution of Emotion // Nature Reviews Psychology. 2022. Vol. 1 (11). P. 669-681. https://doi.org/10.1038/s44159-022-00105-4
- 60. Krautheim J.T. et al. Emotion Specific Neural Activation for the Production and Perception of Facial Expressions // Cortex. 2020. Vol. 127. P. 17-28. https://doi.org/10.1016/j.cortex.2020.01.026
- 61. Mandal M.K., Awasthi A. (eds.) Understanding Facial Expressions in Communication: Cross-Cultural and Multidisciplinary Perspectives. New Delhi: Springer, 2015.
- 62. Matsumoto D. Culture and Nonverbal Behavior // The SAGE Handbook of Nonverbal Communication / Eds. V. Manusov, M.L. Patterson. Thousand Oaks: SAGE Publications, 2006. P. 219-235.
- 63. Matsumoto D., Hwang H.S. Evidence for Training the Ability to Read Microexpressions of Emotion // Motivation and Emotion. 2011. Vol. 35. P. 181-191. https://doi.org/10.1007/s11031-011-9212-2
- 64. Matsumoto D., Hwang H.C. Microexpressions Differentiate Truths from Lies about Future Malicious Intent // Frontiers in Psychology. 2018. Vol. 9. P. 2545. https://doi.org/10.3389/fpsyg.2018.02545
- 65. Müri R.M. Cortical Control of Facial Expression // Journal of Comparative Neurology. 2016. Vol. 524 (8). P. 1578-1585. https://doi.org/10.1002/cne.23908
- 66. Okon-Singer H., Hendler T., Pessoa L., Shackman A.J. The Neurobiology of Emotion-Cognition Interactions: Fundamental Questions and Strategies for Future Research // Frontiers in Human Neuroscience. 2015. Vol. 9. P. 58. https://doi.org/10.3389/fnhum.2015.00058
- 67. Oh Y.H. et al. A Survey of Automatic Facial Micro-Expression Analysis: Databases, Methods, and Challenges // Frontiers in Psychology. 2018. Vol. 9. P. 1128. https://doi.org/10.3389/fpsyg.2018.01128
- 68. Parr L.A. et al. Brief Communication: MaqFACS: A Muscle Based Facial Movement Coding System for the Rhesus Macaque // American Journal of Physical Anthropology. 2010. Vol. 143. P. 433-445. https://doi.org/10.1002/ajpa.21401
- 69. Panksepp J. Affective Neuroscience: The Foundations of Human and Animal Emotions. L.: Oxford University Press, 2004.
- 70. Pessoa L. On the Relationship Between Emotion and Cognition // Nature Reviews Neuroscience. 2008. Vol. 9 (2). P. 148-158. https://doi.org/10.1038/nrn2317
- 71. Polikovsky S., Kameda Y., Ohta Y. Facial Micro-expressions Recognition Using High Speed Camera and 3D-gradient Descriptor // 3rd International Conference on Imaging for Crime Detection and Prevention. L., 2009. P. 16. https://doi.org/10.1049/ic.2009.0244
- 72. Porter S., Ten Brinke L. Reading Between the Lies: Identifying Concealed and Falsified Emotions in Universal Facial Expressions // Psychological Science. 2008. Vol. 19 (5). P. 508-514. https://doi.org/10.1111/j.1467-9280.2008.02116.x
- 73. Rincon A.V. et al. Higher Social Tolerance is Associated with More Complex Facial Behavior in Macaques // Elife. 2023. Vol. 12. P. RP87008. https://doi.org/10.7554/eLife.87008.3
- 74. Rinn W.E. The Neuropsychology of Facial Expression: A Review of the Neurological and Psychological Mechanisms for Producing Facial Expressions // Psychological Bulletin. 1984. Vol. 95 (1). P. 52. https://doi.org/10.1037/0033-2909.95.1.52
- 75. Rolls E.T. Limbic Systems for Emotion and for Memory, but No Single Limbic System // Сortex. 2015. Vol. 62. P. 119-157. https://doi.org/10.1016/j.cortex.2013.12.005
- 76. Russell J.A., Fernandez-Dols J.M. (eds.) The Psychology of Facial Expression. Melbourne: Cambridge University Press, 1997.
- 77. Pfister T., Li X., Zhao G., Pietikäinen M. Differentiating Spontaneous from Posed Facial Expressions within a Generic Facial Expression Recognition Framework // 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops). Barselona: IEEE, 2011. P. 868-875. https://doi.org/10.1109/ICCVW.2011.6130343
- 78. Pohl A. et al. Positive Facial Affect - an fMRI Study on the Involvement of Insula and Amygdala // PLoS One. 2013. Vol. 8 (8). P. e69886. https://doi.org/10.1371/journal.pone.0069886
- 79. Shen X.B., Wu Q., Fu X.L. Effects of the Duration of Expressions on the Recognition of Microexpressions // Journal of Zhejiang University Science B. 2012. Vol. 13. P. 221-230. https://doi.org/10.1631/jzus.B1100063
- 80. Shreve M. et al. Towards Macro-and Micro-Expression Spotting in Video Using Strain Patterns // 2009 Workshop on Applications of Computer Vision (WACV). Snowbird: IEEE, 2009. P. 1-6. https://doi.org/10.1109/WACV.2009.5403044
- 81. Svetieva E., Frank M.G. Empathy, Emotion Dysregulation, and Enhanced Micro-expression Recognition Ability // Motivation and Emotion. 2016. Vol. 40. P. 309-320. https://doi.org/10.1007/s11031-015-9528-4
- 82. Todorov A., Oh D. The Structure and Perceptual Basis of Social Judgments from Faces // Advances in Experimental Social Psychology. 2021. Vol. 63. P. 189-245. https://doi.org/10.1016/bs.aesp.2020.11.004
- 83. Tomkins S.S., McCarter R. What and Where Are the Primary Affects? Some Evidence for a Theory // Perceptual and Motor Skills. 1964. Vol. 18 (1). P. 119-158.
- 84. Tsikandilakis M. et al. Learning Emotional Dialects: A British Population Study of Cross-Cultural Communication // Perception. 2023. Vol. 52 (11-12). P. 812-843. https://doi.org/10.1177/03010066231204180
- 85. Van Hooff J.A.R.A.M. The Facial Displays of the Catarrhine Monkeys and Apes // Primate Ethology / Ed. D. Morris. L.: Weidenfels and Nicolson, 1967. P. 7-68.
- 86. Vick S.J. et al. A Cross-Species Comparison of Facial Morphology and Movement in Humans and Chimpanzees Using the Facial Action Coding System (FACS) // Journal of Nonverbal Behavior. 2007. Vol. 31. P. 1-20. https://doi.org/10.1007/s10919-006-0017-z
- 87. Vrij A. Deception and Truth Detection When Analyzing Nonverbal and Verbal Cues // Applied Cognitive Psychology. 2019. Vol. 33 (2). P. 160-167. https://doi.org/10.1002/acp.3457
- 88. Warren G., Schertler E., Bull P. Detecting Deception from Emotional and Unemotional Cues // Journal of Nonverbal Behavior. 2009. Vol. 33. P. 59-69. https://doi.org/10.1007/s10919-008-0057-7
- 89. Waller B.M. et al. Mapping the Contribution of Single Muscles to Facial Movements in the Rhesus Macaque // Physiology & Behavior. 2008. Vol. 95. P. 93-100. https://doi.org/10.1016/j.physbeh.2008.05.002
- 90. Waller B.M. et al. GibbonFACS: A Muscle-Based Facial Movement Coding System for Hylobatids // International Journal of Primatology. 2012. Vol. 33. P. 809-821. https://doi.org/10.1007/s10764-012-9611-6
- 91. Waller B.M. et al. Paedomorphic Facial Expressions Give Dogs a Selective Advantage // PLoS One. 2013. Vol. 8. P. e82686. https://doi.org/10.1371/journal.pone.0082686
- 92. Wathan J., Burrows A.M., Waller B.M., McComb K. EquiFACS: The Equine Facial Action Coding System // PLoS One. 2015. Vol. 10 (8). P. e0131738. https://doi.org/10.1371/journal.pone.0131738
- 93. Weber R., Li J., Soladié C., Séguier R. A Survey on Databases of Facial Macro-Expression and Micro-Expression // Computer Vision, Imaging and Computer Graphics Theory and Applications. VISIGRAPP 2018: Communications in Computer and Information Science. Vol. 997 / Eds. D. Bechmann et al. Cham: Springer, 2019. P. 298-325. https://doi.org/10.1007/978-3-030-26756-8_15
- 94. Weinberger S. Airport Security: Intent to Deceive? // Nature. 2010. Vol. 465 (7297). P. 412-416.
- 95. Whitehouse J. et al. Facial Expressivity in Dominant Macaques is Linked to Group Cohesion // Proceedings of the Royal Society B. 2024. Vol. 291 (2027). P. 20240984. https://doi.org/10.1098/rspb.2024.0984
- 96. Xie H.X., Lo L., Shuai H.H., Cheng W.H. An Overview of Facial Micro-Expression Analysis: Data, Methodology and Challenge // IEEE Transactions on Affective Computing. 2022. Vol. 14 (3). P. 1857-1875. https://doi.org/10.1109/TAFFC.2022.3143100
- 97. Yan W.J. et al. How Fast are the Leaked Facial Expressions: The Duration of Micro-Expressions // Journal of Nonverbal Behavior. 2013. Vol. 37. P. 217-230. https://doi.org/10.1007/s10919-013-0159-8
- 98. Yildirim S., Chimeumanu M.S., Rana Z.A. The Influence of Micro-Expressions on Deception Detection // Multimedia Tools and Applications. 2023. Vol. 82 (19). P. 29115-29133. https://doi.org/10.1007/s11042-023-14551-6
- 99. Zhao G., Li X., Li Y., Pietikäinen M. Facial Micro-Expressions: An Overview // Proceedings of the IEEE. 2023. Vol. 111 (10). P. 1215-1235. https://doi.org/10.1109/JPROC.2023.3275192
- 100. Zhao Y., Xu J. A Convolutional Neural Network for Compound Micro-Expression Recognition // Sensors. 2019. Vol. 19 (24). P. 5553. https://doi.org/10.3390/s19245553