Lingsheng Li¹, Weiqing Bai², Chong Han^2,*

CMC-Computers, Materials & Continua, Vol.81, No.1, pp. 1613-1640, 2024, DOI:10.32604/cmc.2024.056073 - 15 October 2024

Abstract Gestures are one of the most natural and intuitive approach for human-computer interaction. Compared with traditional camera-based or wearable sensors-based solutions, gesture recognition using the millimeter wave radar has attracted growing attention for its characteristics of contact-free, privacy-preserving and less environment-dependence. Although there have been many recent studies on hand gesture recognition, the existing hand gesture recognition methods still have recognition accuracy and generalization ability shortcomings in short-range applications. In this paper, we present a hand gesture recognition method named multiscale feature fusion (MSFF) to accurately identify micro hand gestures. In MSFF, not only the More >

Bijon Mallik¹, Md Abdur Rahim¹, Abu Saleh Musa Miah², Keun Soo Yun^3,*, Jungpil Shin²

Computer Systems Science and Engineering, Vol.48, No.2, pp. 555-570, 2024, DOI:10.32604/csse.2023.045981 - 19 March 2024

Abstract In the digital age, non-touch communication technologies are reshaping human-device interactions and raising security concerns. A major challenge in current technology is the misinterpretation of gestures by sensors and cameras, often caused by environmental factors. This issue has spurred the need for advanced data processing methods to achieve more accurate gesture recognition and predictions. Our study presents a novel virtual keyboard allowing character input via distinct hand gestures, focusing on two key aspects: hand gesture recognition and character input mechanisms. We developed a novel model with LSTM and fully connected layers for enhanced sequential data… More >

Jungpil Shin^1,*, Md. Al Mehedi Hasan², Abu Saleh Musa Miah¹, Kota Suzuki¹, Koki Hirooka¹

CMES-Computer Modeling in Engineering & Sciences, Vol.139, No.3, pp. 2605-2625, 2024, DOI:10.32604/cmes.2023.046334 - 11 March 2024

Abstract Sign language recognition is vital for enhancing communication accessibility among the Deaf and hard-of-hearing communities. In Japan, approximately 360,000 individuals with hearing and speech disabilities rely on Japanese Sign Language (JSL) for communication. However, existing JSL recognition systems have faced significant performance limitations due to inherent complexities. In response to these challenges, we present a novel JSL recognition system that employs a strategic fusion approach, combining joint skeleton-based handcrafted features and pixel-based deep learning features. Our system incorporates two distinct streams: the first stream extracts crucial handcrafted features, emphasizing the capture of hand and body… More >

Yanqiong Zhang, Xianwei Jiang^*

CMES-Computer Modeling in Engineering & Sciences, Vol.139, No.3, pp. 2399-2450, 2024, DOI:10.32604/cmes.2023.045731 - 11 March 2024

Abstract Sign language, a visual-gestural language used by the deaf and hard-of-hearing community, plays a crucial role in facilitating communication and promoting inclusivity. Sign language recognition (SLR), the process of automatically recognizing and interpreting sign language gestures, has gained significant attention in recent years due to its potential to bridge the communication gap between the hearing impaired and the hearing world. The emergence and continuous development of deep learning techniques have provided inspiration and momentum for advancing SLR. This paper presents a comprehensive and up-to-date analysis of the advancements, challenges, and opportunities in deep learning-based sign… More >

Khursheed Aurangzeb¹, Khalid Javeed², Musaed Alhussein¹, Imad Rida³, Syed Irtaza Haider¹, Anubha Parashar^4,*

CMC-Computers, Materials & Continua, Vol.78, No.1, pp. 127-144, 2024, DOI:10.32604/cmc.2023.042886 - 30 January 2024

Abstract Hand gestures have been used as a significant mode of communication since the advent of human civilization. By facilitating human-computer interaction (HCI), hand gesture recognition (HGRoc) technology is crucial for seamless and error-free HCI. HGRoc technology is pivotal in healthcare and communication for the deaf community. Despite significant advancements in computer vision-based gesture recognition for language understanding, two considerable challenges persist in this field: (a) limited and common gestures are considered, (b) processing multiple channels of information across a network takes huge computational time during discriminative feature extraction. Therefore, a novel hand vision-based convolutional neural network… More >

Muhammad Rizwan^1,*, Sana Ul Haq^1,*, Noor Gul^1,2, Muhammad Asif¹, Syed Muslim Shah³, Tariqullah Jan⁴, Naveed Ahmad⁵

CMC-Computers, Materials & Continua, Vol.76, No.1, pp. 1213-1247, 2023, DOI:10.32604/cmc.2023.038211 - 08 June 2023

Abstract Appearance-based dynamic Hand Gesture Recognition (HGR) remains a prominent area of research in Human-Computer Interaction (HCI). Numerous environmental and computational constraints limit its real-time deployment. In addition, the performance of a model decreases as the subject’s distance from the camera increases. This study proposes a 3D separable Convolutional Neural Network (CNN), considering the model’s computational complexity and recognition accuracy. The 20BN-Jester dataset was used to train the model for six gesture classes. After achieving the best offline recognition accuracy of 94.39%, the model was deployed in real-time while considering the subject’s attention, the instant of… More >

Adnan Hussain¹, Sareer Ul Amin², Muhammad Fayaz³, Sanghyun Seo^4,*

Computer Systems Science and Engineering, Vol.46, No.3, pp. 3509-3525, 2023, DOI:10.32604/csse.2023.037258 - 03 April 2023

Abstract Hand Gesture Recognition (HGR) is a promising research area with an extensive range of applications, such as surgery, video game techniques, and sign language translation, where sign language is a complicated structured form of hand gestures. The fundamental building blocks of structured expressions in sign language are the arrangement of the fingers, the orientation of the hand, and the hand’s position concerning the body. The importance of HGR has increased due to the increasing number of touchless applications and the rapid growth of the hearing-impaired population. Therefore, real-time HGR is one of the most effective… More >

Fadwa Alrowais¹, Radwa Marzouk^2,3, Fahd N. Al-Wesabi^4,*, Anwer Mustafa Hilal⁵

Intelligent Automation & Soft Computing, Vol.36, No.3, pp. 3325-3342, 2023, DOI:10.32604/iasc.2023.036354 - 15 March 2023

Abstract Sign language recognition can be treated as one of the efficient solutions for disabled people to communicate with others. It helps them to convey the required data by the use of sign language with no issues. The latest developments in computer vision and image processing techniques can be accurately utilized for the sign recognition process by disabled people. American Sign Language (ASL) detection was challenging because of the enhancing intraclass similarity and higher complexity. This article develops a new Bayesian Optimization with Deep Learning-Driven Hand Gesture Recognition Based Sign Language Communication (BODL-HGRSLC) for Disabled People.… More >

Saurabh Adhikari¹, Tushar Kanti Gangopadhayay¹, Souvik Pal^2,3, D. Akila⁴, Mamoona Humayun⁵, Majed Alfayad⁶, N. Z. Jhanjhi^7,*

Computer Systems Science and Engineering, Vol.46, No.2, pp. 2123-2140, 2023, DOI:10.32604/csse.2023.034431 - 09 February 2023

Abstract Machine learning is a technique for analyzing data that aids the construction of mathematical models. Because of the growth of the Internet of Things (IoT) and wearable sensor devices, gesture interfaces are becoming a more natural and expedient human-machine interaction method. This type of artificial intelligence that requires minimal or no direct human intervention in decision-making is predicated on the ability of intelligent systems to self-train and detect patterns. The rise of touch-free applications and the number of deaf people have increased the significance of hand gesture recognition. Potential applications of hand gesture recognition research… More >

Hammad Rustam¹, Muhammad Muneeb¹, Suliman A. Alsuhibany², Yazeed Yasin Ghadi³, Tamara Al Shloul⁴, Ahmad Jalal¹, Jeongmin Park^5,*

CMC-Computers, Materials & Continua, Vol.75, No.1, pp. 2331-2346, 2023, DOI:10.32604/cmc.2023.028712 - 06 February 2023

Abstract Hand gesture recognition (HGR) is used in a numerous applications, including medical health-care, industrial purpose and sports detection. We have developed a real-time hand gesture recognition system using inertial sensors for the smart home application. Developing such a model facilitates the medical health field (elders or disabled ones). Home automation has also been proven to be a tremendous benefit for the elderly and disabled. Residents are admitted to smart homes for comfort, luxury, improved quality of life, and protection against intrusion and burglars. This paper proposes a novel system that uses principal component analysis, linear More >