Open Access

ARTICLE

Automated Speech Recognition System to Detect Babies’ Feelings through Feature Analysis

Sana Yasin¹, Umar Draz^2,3,*, Tariq Ali⁴, Kashaf Shahid¹, Amna Abid¹, Rukhsana Bibi¹, Muhammad Irfan⁵, Mohammed A. Huneif⁶, Sultan A. Almedhesh⁶, Seham M. Alqahtani⁶, Alqahtani Abdulwahab⁶, Mohammed Jamaan Alzahrani⁶, Dhafer Batti Alshehri⁶, Alshehri Ali Abdullah⁷, Saifur Rahman⁵

1 Faculty of Computing, University of Okara, Okara, 57000, Pakistan
2 Department of Computer Science, University of Sahiwal, Sahiwal, 57000, Punjab, Pakistan
3 Computer Science Department, COMSATS University Islamabad, Lahore Campus, 57000, Pakistan
4 Department of Computer Science, CUI, Sahiwal Campus, Sahiwal, 57000, Pakistan
5 Electrical Engineering Department, College of Engineering, Najran University Saudi Arabia, Najran, 61441, Saudi Arabia
6 Pediatric Department, Medical College, Najran University Saudi Arabia, Najran, 61441, Saudi Arabia
7 Consultant of ORL&HNs and Facial Plastic Surgery, College of Medicine, Najran University Saudi Arabia, Najran, 61441, Saudi Arabia

* Corresponding Author: Umar Draz. Email:

Computers, Materials & Continua 2022, 73(2), 4349-4367. https://doi.org/10.32604/cmc.2022.028251

Received 06 February 2022; Accepted 13 May 2022; Issue published 16 June 2022

Abstract

Diagnosing a baby’s feelings poses a challenge for both doctors and parents because babies cannot explain their feelings through expression or speech. Understanding the emotions of babies and their associated expressions during different sensations such as hunger, pain, etc., is a complicated task. In infancy, all communication and feelings are propagated through cry-speech, which is a natural phenomenon. Several clinical methods can be used to diagnose a baby’s diseases, but nonclinical methods of diagnosing a baby’s feelings are lacking. As such, in this study, we aimed to identify babies’ feelings and emotions through their cry using a nonclinical method. Changes in the cry sound can be identified using our method and used to assess the baby’s feelings. We considered the frequency of the cries from the energy of the sound. The feelings represented by the infant’s cry are judged to represent certain sensations expressed by the child using the optimal frequency of the recognition of a real-world audio sound. We used machine learning and artificial intelligence to distinguish cry tones in real time through feature analysis. The experimental group consisted of 50% each male and female babies, and we determined the relevancy of the results against different parameters. This application produced real-time results after recognizing a child’s cry sounds. The novelty of our work is that we, for the first time, successfully derived the feelings of young children through the cry-speech of the child, showing promise for end-user applications.

---

Keywords

---