Open Access

ARTICLE

Expression Recognition Method Based on Convolutional Neural Network and Capsule Neural Network

by Zhanfeng Wang¹, Lisha Yao^2,*

1 School of Computer Science and Artificial Intelligence, Chaohu University, Hefei, 238000, China
2 School of Big Data and Artificial Intelligence, Anhui Xinhua University, Hefei, 230088, China

* Corresponding Author: Lisha Yao. Email:

Computers, Materials & Continua 2024, 79(1), 1659-1677. https://doi.org/10.32604/cmc.2024.048304

Received 04 December 2023; Accepted 12 March 2024; Issue published 25 April 2024

Abstract

Convolutional neural networks struggle to accurately handle changes in angles and twists in the direction of images, which affects their ability to recognize patterns based on internal feature levels. In contrast, CapsNet overcomes these limitations by vectorizing information through increased directionality and magnitude, ensuring that spatial information is not overlooked. Therefore, this study proposes a novel expression recognition technique called CAPSULE-VGG, which combines the strengths of CapsNet and convolutional neural networks. By refining and integrating features extracted by a convolutional neural network before introducing them into CapsNet, our model enhances facial recognition capabilities. Compared to traditional neural network models, our approach offers faster training pace, improved convergence speed, and higher accuracy rates approaching stability. Experimental results demonstrate that our method achieves recognition rates of 74.14% for the FER2013 expression dataset and 99.85% for the CK+ expression dataset. By contrasting these findings with those obtained using conventional expression recognition techniques and incorporating CapsNet’s advantages, we effectively address issues associated with convolutional neural networks while increasing expression identification accuracy.

---

Keywords

---