Development of software based on a convolutional neural network for studying the influence of color on the psycho-emotional state of a person

E.E. Istratova

Abstract


The article presents the results of the development and testing of a hardware and software complex based on computer vision technology for studying the influence of color on the psycho-emotional state of a person. In the course of the work, an algorithm for recognizing emotions was proposed, which allows for real-time, promptly and with sufficient accuracy, classifying emotions presented in an image. A technique for determining the influence of color on the psycho-emotional state of a person was also proposed and tested. The convolutional neural network was trained on the FER-2013 dataset, containing 35887 labeled grayscale images of faces. The algorithm can highlight such emotions as joy, sadness, anger, calm. The results obtained using the convolutional neural network were compared with the results of expert assessment and subjective assessment of the study participants. The differences in the accuracy of emotion recognition were less than 2%. The developed software solution can be used not only to study the influence of color on a person's psycho-emotional state, but also to work with this state by stabilizing or correcting it.


Full Text:

PDF (Russian)

References


Anjani Suputri Devi D., Satyanarayana Ch. An efficient facial emotion recognition system using novel deep learning neural network-regression activation classifier. Multimed Tools Appl 80, 17543–17568 (2021). https://doi.org/10.1007/s11042-021-10547-2.

Verma G., Verma H. Hybrid-Deep Learning Model for Emotion Recognition Using Facial Expressions. Rev Socionetwork Strat 14, 171–180 (2020). https://doi.org/10.1007/s12626-020-00061-6.

Tamil P.D., Divya U.J. Transfer learning techniques for emotion classification on visual features of images in the deep learning network. Int J Speech Technol 23, 361–372 (2020). https://doi.org/10.1007/s10772-020-09707-w.

Khattak A., Asghar M.Z., Ali M. An efficient deep learning technique for facial emotion recognition. Multimed Tools Appl 81, 1649–1683 (2022). https://doi.org/10.1007/s11042-021-11298-w.

Said Y., Barr M. Human emotion recognition based on facial expressions via deep learning on high-resolution images. Multimed Tools Appl 80, 25241–25253 (2021). https://doi.org/10.1007/s11042-021-10918-9.

Chowdary M.K., Nguyen T.N., Hemanth D.J. Deep learning-based facial emotion recognition for human–computer interaction applications. Neural Comput & Applic (2021). https://doi.org/10.1007/s00521-021-06012-8.

Zhang Y., Cheng C., Zhang Y. Multimodal emotion recognition based on manifold learning and convolution neural network. Multimed Tools Appl 81, 33253–33268 (2022). https://doi.org/10.1007/s11042-022-13149-8.

Li S., Deng W. Blended Emotion in-the-Wild: Multi-label Facial Expression Recognition Using Crowdsourced Annotations and Deep Locality Feature Learning. Int J Comput Vis 127, 884–906 (2019). https://doi.org/10.1007/s11263-018-1131-1.

Wang Z., Zhou X., Wang W. Emotion recognition using multimodal deep learning in multiple psychophysiological signals and video. Int. J. Mach. Learn and Cyber. 11, 923–934 (2020). https://doi.org/10.1007/s13042-019-01056-8.

Gupta S., Kumar P., Tekchandani R.K. Facial emotion recognition based real-time learner engagement detection system in online learning context using deep learning models. Multimed Tools Appl (2022). https://doi.org/10.1007/s11042-022-13558-9.

Wang Y. Multimodal emotion recognition algorithm. Pers Ubiquit Comput 23, 383–392 (2019). https://doi.org/10.1007/s00779-018-01195-9.

Liliana D.Y., Basaruddin T., Widyanto M.R. Fuzzy emotion: a natural approach to automatic facial expression recognition from psychological perspective using fuzzy system. Cogn Process 20, 391–403 (2019). https://doi.org/10.1007/s10339-019-00923-0.

Li W., Chu M., Qiao J. Design of a hierarchical modular neural network and its application in multimodal emotion recognition. Soft Comput 23, 11817–11828 (2019). https://doi.org/10.1007/s00500-018-03735-03

Eluri S. A novel Leaky Rectified Triangle Linear Unit based Deep Convolutional Neural Network for facial emotion recognition. Multimed Tools Appl (2022). https://doi.org/10.1007/s11042-022-14186-z.

Hernández-Luquin F., Escalante H.J. Multi-branch deep radial basis function networks for facial emotion recognition. Neural Comput & Applic (2021). https://doi.org/10.1007/s00521-021-06420-w.

Toner H.L., Gates G.R. Emotional traits and recognition of facial expression of emotion. Nonverbal Behav 9, 48–66 (1985). https://doi.org/10.1007/BF00987558.

Hozjan V., Kačič Z. Context-Independent Multilingual Emotion Recognition from Speech Signals. International Journal of Speech Technology 6, 311–320 (2003). https://doi.org/10.1023/A:1023426522496.

Künecke J., Wilhelm O., Sommer W. Emotion Recognition in Nonverbal Face-to-Face Communication. J Nonverbal Behav 41, 221–238 (2017). https://doi.org/10.1007/s10919-017-0255-2.

Novikova L.V. Vliyanie tsveta i sveta na cheloveka / L.V. Novikova, I.YU. Ivanushkina // Biomeditsinskaya inzheneriya i ehlektronika. - 2022. - № 2 (2). - S. 11-13.

Galchinova T.A. Vliyanie tsveta na ehmotsional'noe sostoyanie cheloveka / T.A. Galchinova // Innovatsionnaya nauka. - 2020. - № 5. - S. 172-175.

Volkova K.EH. Vliyanie tsveta na ehmotsional'nyi fon i psikhologiyu cheloveka / K.EH. Volkova, YU.V. Barteneva // Kollektsiya gumanitarnykh issledovanii. - 2020. - № 1 (22). - S. 13-16.

Salido O.M., Rodríguez LF., Gutierrez-Garcia J.O. Towards emotion recognition from contextual information using machine learning // Ambient Intell Human Comput 11, 3187–3207 (2020). https://doi.org/10.1007/s12652-019-01485-x.


Refbacks

  • There are currently no refbacks.


Abava  Кибербезопасность ИБП для ЦОД СНЭ

ISSN: 2307-8162