Open Access
ARTICLE
Improved Transient Search Optimization with Machine Learning Based Behavior Recognition on Body Sensor Data
1 ITM Department, Technical College of Administration, Duhok Polytechnic University, Duhok, Iraq
2 Information System Engineering Department, Erbil Technical Engineering College, Erbil Polytechnic University, Erbil, Iraq
3 Computer Science Department, College of Science, Nawroz University, Duhok, Iraq
4 Energy Eng. Department, Technical College of Engineering, Duhok Polytechnic University, Duhok, Iraq
* Corresponding Author: Subhi R. M. Zeebaree. Email:
Computers, Materials & Continua 2023, 75(2), 4593-4609. https://doi.org/10.32604/cmc.2023.037514
Received 07 November 2022; Accepted 08 February 2023; Issue published 31 March 2023
Abstract
Recently, human healthcare from body sensor data has gained considerable interest from a wide variety of human-computer communication and pattern analysis research owing to their real-time applications namely smart healthcare systems. Even though there are various forms of utilizing distributed sensors to monitor the behavior of people and vital signs, physical human action recognition (HAR) through body sensors gives useful information about the lifestyle and functionality of an individual. This article concentrates on the design of an Improved Transient Search Optimization with Machine Learning based Behavior Recognition (ITSOML-BR) technique using body sensor data. The presented ITSOML-BR technique collects data from different body sensors namely electrocardiography (ECG), accelerometer, and magnetometer. In addition, the ITSOML-BR technique extract features like variance, mean, skewness, and standard deviation. Moreover, the presented ITSOML-BR technique executes a micro neural network (MNN) which can be employed for long term healthcare monitoring and classification. Furthermore, the parameters related to the MNN model are optimally selected via the ITSO algorithm. The experimental result analysis of the ITSOML-BR technique is tested on the MHEALTH dataset. The comprehensive comparison study reported a higher result for the ITSOML-BR approach over other existing approaches with maximum accuracy of 99.60%.Keywords
Recent advancements in sensing technologies have enabled the healthcare industry to enhance the quality of its services [1]. Additionally, the design of lightweight and small smart sensors has enabled mechanisms to act as a vital part of advanced progress in unobtrusive and unsupervised methods of home rehabilitation and the continual monitoring of patient's health conditions. Nowadays, body sensors are becoming very popular for several realistic applications like healthcare, entertainment, security, and wellness [2]. One key benefit of utilizing body sensors in observing people is employed to recognize the behavior and vital signs of people very precisely than the ambient sensors. Thus, body sensors or personal computers were anticipated to take a disruptive effect on our life [3]. Therefore, the sensor will be implemented for ensuring and improving a person's sound living. Hence, the body sensor is quite striking to aid in transforming our life like a personal computer. During the commercial domains, a wearable sensor-related mechanism was utilized in the procedure of emergency buttons for asking for emergency aid, and it is commercially successful so far [4]. Recently, human activity recognition (HAR) in wearable body sensor network has gained popularity because of its immense effectiveness in various application regions like smart homes, smart healthcare, transportation, robotics, and security. HAR mechanism generally transforms particular body movements sensed by several wearable body sensors for certain sensor signal paradigms and is categorized through machine learning (ML) approaches [5]. For instance, many ML techniques were employed for identifying complicated activity paradigms like relaxing and sitting, climbing stairs, lying down, walking, and many more. Accordingly, recognition of day-to-day activities becomes essential for maintaining a healthy lifestyle between old people for preventing and monitoring serious illnesses [6].
But recognizing human activity becomes a challenge in the Internet of Medical Things (IoMT) field because of the current utility of batteryless or passive wearable body sensors for recognizing activity [7]. Such sensors will be lightweight and tiny, thus, are easily entrenched into patients’ clothes for unobtrusive activity monitoring. Furthermore, it is easily preserved as it does not employ any battery. Such inactive wearable body sensors seize data through harvested power technologies that denote such sensors should receive energy to function and sense data [8]. Conventional ML approaches like support vector machine and hidden Markov models (HMM) could not be directly applied to detecting action in passive sensor data since they are concentrated on single sensing modalities that have a regular sampling rate of data [9]. Furthermore, such techniques encounter difficulty when the features count were less, therefore offering the outcomes with minimal accuracy. Currently, deep learning (DL) techniques were employed to recognize human action from body sensor information in the IoMT platform. DL was a kind of neural network (NNs) that uses several non-linear data processing layers to derive features and carry out classification [10].
This article concentrates on the design of an Improved Transient Search Optimization with Machine Learning based Behavior Recognition (ITSOML-BR) technique using body sensor data. The presented ITSOML-BR technique collects data from different body sensors namely magnetometer, electrocardiography (ECG), and accelerometer. In addition, the ITSOML-BR technique extract features like variance, mean, skewness, and standard deviation. Moreover, the presented ITSOML-BR technique executes micro neural network (MNN) which can be employed for long term healthcare monitoring and classification. Furthermore, the parameters related to the MNN model are optimally selected via the ITSO algorithm. The experimental result analysis of the ITSOML-BR technique is tested on the MHEALTH dataset.
The rest of the paper is organized as follows. Section 2 offers a brief related review of HAR models and Section 3 introduces the proposed model. Later, Section 4 provides experimental validation and Section 5 concludes the study.
The author in [11] developed the generic HAR architecture for cell phone sensor data dependent upon long short term memory (LSTM) network for the time sequence domain. Four benchmark LSTM networks are relatively analyzed to study the effect of utilizing various cell phone sensor information. Furthermore, a hybrid LSTM network named 4-layer convolutional neural network (CNN)-LSTM is intended for improving detection accuracy. Wang et al. [12] developed a deep learning (DL) based system that finds the changes and certain actions amongst two dissimilar activities of lower frequency and shorter duration for healthcare applications. In the presented technique, a deep convolutional neural network (DCNN) is generated for extracting features from the information gathered by the sensor. Afterward, the LTSM network is utilized for capturing long-term dependency among 2 activities to moreover enhancing the HAR rate of detection. With the incorporation of LSTM and CNN, a wearable sensor based method is developed which specifically identifies transition and activity.
Nafea et al. [13] introduce a technique based on CNN with different kernel dimensional and bidirectional LSTM (Bi-LSTM) for capturing feature at different resolutions. The advance of this study lies in the efficiency selective of optimal video demonstration and in the efficient extraction of spatial and temporal characteristics in sensor information utilizing Bi-LSTM and CNN. Ghate [14] introduces different hybrid DL methodologies which integrate deep neural network (DNN) with other modules such as gated recurrent unit (GRU) and LSTM Models for efficient classification of engineered features from CNN. A modern framework which incorporates DCNN with random forest (RF) Classifiers for adding randomness to the model. The authors in [15] developed the transformer module, a DL-NN for the vision, and natural language processing (NLP) tasks are adopted for a time-sequence examination of motion signal.
A novel DNN framework for HAR dependent upon multiple sensor information was developed in [16]. Especially, the presented method encoder the time sequence of sensor information as images (encode one time series as to 2-channel image) and leverages the changed image to preserve the essential features of HAR. Especially, to permit heterogeneous sensor information that is cooperatively trained, the authors adopt fusion residual networks by combining 2 networks and training heterogeneous information with pixel-wise correspondence. Mondal et al. [17] introduced an end-to-end fast GNN that captures the individual sample data and the relationships with another instance in the procedure of undirected graph infrastructure. The time sequence information is converted into a structural demonstration of graph for HAR utilizing sensor information.
In this article, a novel ITSOML-BR system was introduced for the recognition of behaviors on-body sensor data. At the preliminary level, the presented ITSOML-BR technique performs the data collection phase using various body sensors, namely ECG, accelerometer, and magnetometer. Followed by the ITSOML-BR technique extracted the features, namely standard deviation, mean, skewness, and variance. For behavior recognition, the presented ITSOML-BR technique executed the MNN model for long-term healthcare monitoring and classification. Fig. 1 defines the overall process of the ITSOML-BR system.
At the introductory level, the presented ITSOML-BR technique performs the data collection phase using various body sensors namely ECG, accelerometer, and magnetometer. The place of attaching sensor is the chest, left ankle, and right wrist [18]. There exists an ECG health care sensor positioned on the chest that takes 2-lead ECG measurements of heart information. For example, the accelerometer provides magnetometer magnetic field orientation, body acceleration, and gyroscope the rate of turn. The body sensor information is characterized by the following.
ECG sensor information in the chest is given by
The accelerometer sensor information in the left ankle is shown below
The gyroscope sensor information in the left ankle is symbolized by
The magnetometer sensor information in the left ankle is shown below
The accelerometer sensor information in the right wrist is given by
The gyroscope sensor information from the left wrist is characterized by
The gyroscope sensor information from the right wrist is considered as
The magnetometer information on the right wrist is given by
Moreover, features like mean m, variance
3.2 Behavior Recognition Module
For behavior recognition, the presented ITSOML-BR technique executed the MNN model. Assume that the recurrent neural network (RNN) has a memory function while processing medicinal time sequence data and that its volume is small compared to the CNN [19]. Based on the shallow RNN, this study primarily adopted the set of multi-level RNNs as the feature extractor.
Initially, it can be set RNN gathered with 2 levels. Then, the slice data is set afterwards pre-processing as
Now, RNN characterizes the RNN technique of the initial level, and
Next, the outcome is fed to the RNN of the second level, and the outcome can be denoted as follows:
Whereas RNN signifies the RNN model of the next level, F denotes the activation function, and y represents the extracted feature. During the selective technique for MicroNN, a per-class classifier algorithm is adopted. e module establishes a separate mini-classifier for all the classes. Each mini-classifier is interconnected with the feature extractor. Furthermore, to enhance the classifier efficiency, a loss function is employed named one-class:
where
Note that the derivative outcome of
Consequently,
For making the parameter of classifiers among distinct classes in a similar variable space, the technique uses the parameter from 1 to
whereas
3.3 Parameter Adjustment Module
In this work, the parameters related to the MNN model are optimally selected via the ITSO algorithm. The TSOA is an alternative model based on electrical phenomena that incorporate two energy-saving mechanisms [20]. This can be inspired by the transient response (TR) of a switched electrical circuit (SEC). This component is a capacitor, resistor, and inductor. Therefore, the response-based voltage based on the capacitor in the circuit of R-C and R-L-C can be determined in the following:
The decision variable in TSOA is regarded as searching agent
In the presented ITSO method, the
Hence, the early population can be produced utilizing OLS.
The non-linearly decreasing strategy (NDS) is also employed for improving the TSOA efficiency in global and local explorations and accomplishing the desired balance between convergent efficiency and global convergence. Search efficiency is enhanced by the variations in the coefficient of
whereas,
Hence Eq. (20) can be modified by
The ITSOA could have a higher global search ability in pre-search, and its convergence speed can be faster. Fig. 2 demonstrates the flowchart of ITSOA.
The ITSO approach derives a fitness function from having better classification accuracy. It describes a positive integer to characterize the improved performance of the candidate solutions. During this study, the minimization of the classification error rate can be treated as the fitness function, as shown below.
The proposed model is simulated using Python 3.6.5 tool. The proposed model is experimented on PC i5-8600k, GeForce 1050Ti 4 GB, 16 GB RAM, 250 GB SSD, and 1 TB HDD. The parameter settings are given as follows: learning rate: 0.01, dropout: 0.5, batch size: 5, epoch count: 50, and activation: ReLU.
In this section, the behavior recognition of the ITSOML-BR approach is tested using the MHEALTH database [21], which is gathered from a set of 10 persons by the use of body motion and vital sign recordings of the SHIMMER2 wearable sensor. Table 1 defines the detailed description of the dataset.
The confusion matrices of the ITSOML-BR model are examined under several sizes of training (TR) and testing (TS) database, as shown in Fig. 3. The presented ITSOML-BR model has effectually categorized the data under 12 class labels.
Table 2 and Fig. 4 exhibit an overall recognition performance of the ITSOML-BR model on 70% of the TR database. The simulation outcomes indicated that the ITSOML-BR approach has achieved effectual recognition under all class labels. The results inferred that the ITSOML-BR model has gained an average
Table 3 and Fig. 5 demonstrate an overall recognition performance of the ITSOML-BR method on 30% of the TS database. The figure indicates that the ITSOML-BR system has achieved effectual recognition outcomes in all class labels. The outcomes revealed that the ITSOML-BR approach has attained an average
Table 4 and Fig. 6 showcase an overall recognition performance of the ITSOML-BR approach on 80% of the TR database. The simulation outcomes referred that the ITSOML-BR methodology has obtained effectual recognition results under all class labels. The results stated that the ITSOML-BR system had achieved an average
Table 5 and Fig. 7 depict an overall recognition performance of the ITSOML-BR algorithm on 20% of the TS database. The simulation outcomes revealed that the ITSOML-BR approach has achieved effective recognition under all class labels. The outcomes indicated that the ITSOML-BR technique has reached an average
The training accuracy (
The training loss (
To depict the improved performance of the ITSOML-BR approach, a detailed comparison study is made in Table 6 and Fig. 10. The simulation values indicated that the ITSOML-BR method has shown enhanced performance over other models with a maximum
At the same time, the Deep simple recurrent unit (SRU) approach has demonstrated lower classification performance. Although the other existing techniques have attained closer performance, the ITSOML-BR model has reached maximum classification performance.
This article introduced a novel ITSOML-BR system to recognise behaviors on-body sensor data. At the preliminary level, the presented ITSOML-BR technique performs the data collection phase using various body sensors, namely ECG, accelerometer, and magnetometer. Followed by the ITSOML-BR technique extracted the features like variance, mean, skewness, and standard deviation. For behavior recognition, the presented ITSOML-BR technique executed the MNN model for long-term healthcare monitoring and classification. At last, the parameters related to the MNN model are optimally selected via the ITSO algorithm. The experimental result analysis of the ITSOML-BR technique is tested on the MHEALTH dataset. The comprehensive comparison study reported the improved outcome of the ITSOML-BR methodology over other existing approaches with maximum accuracy of 99.60%. In future, the performance of the proposed model can be improved by hybrid DL classifiers.
Funding Statement: The authors received no specific funding for this study.
Conflicts of Interest: The authors declare that they have no conflicts of interest to report regarding the present study.
References
1. K. Chen, D. Zhang, L. Yao, B. Guo, Z. Yu et al., “Deep learning for sensor-based human activity recognition: Overview, challenges, and opportunities,” ACM Computing Surveys (CSUR), vol. 54, no. 4, pp. 1–40, 2021. [Google Scholar]
2. L. M. Dang, K. Min, H. Wang, M. J. Piran, C. H. Lee et al., “Sensor-based and vision-based human activity recognition: A comprehensive survey,” Pattern Recognition, vol. 108, pp. 107561, 2020. [Google Scholar]
3. W. Gao, L. Zhang, W. Huang, F. Min, J. He et al., “Deep neural networks for sensor-based human activity recognition using selective kernel convolution,” IEEE Transactions on Instrumentation and Measurement, vol. 70, pp. 1–13, 2021. [Google Scholar]
4. F. E. Erukainure, V. Parque, M. A. Hassan and A. M. R. FathEl-Bab, “Estimating the stiffness of kiwifruit based on the fusion of instantaneous tactile sensor data and machine learning schemes,” Computers and Electronics in Agriculture, vol. 201, 2022. https://doi.org/10.1016/j.compag.2022.107289 [Google Scholar] [CrossRef]
5. F. E. Erukainure, V. Parque, M. A. Hassan and A. M. R. FathElbab, “Towards estimating the stiffness of soft fruits using a piezoresistive tactile sensor and neural network schemes,” in 2022 IEEE/ASME Int. Conf. on Advanced Intelligent Mechatronics (AIM), Hokkaido, Japan, pp. 290–295, 2022. [Google Scholar]
6. N. Dua, S. N. Singh and V. B. Semwal, “Multi-input CNN-GRU based human activity recognition using wearable sensors,” Computing, vol. 103, no. 7, pp. 1461–1478, 2021. [Google Scholar]
7. J. Wang, Y. Chen, Y. Gu, Y. Xiao and H. Pan, “SensoryGANs: An effective generative adversarial framework for sensor-based human activity recognition,” in Int. Joint Conf. on Neural Networks (IJCNN), Rio de Janeiro, Brazil, pp. 1–8, 2018. [Google Scholar]
8. S. Gupta, “Deep learning based human activity recognition (HAR) using wearable sensor data,” International Journal of Information Management Data Insights, vol. 1, no. 2, pp. 100046, 2021. [Google Scholar]
9. Q. Teng, K. Wang, L. Zhang and J. He, “The layer-wise training convolutional neural networks using local loss for sensor-based human activity recognition,” IEEE Sensors Journal, vol. 20, no. 13, pp. 7265–7274, 2020. [Google Scholar]
10. N. A. Choudhury, S. Moulik and D. S. Roy, “Physique-based human activity recognition using ensemble learning and smartphone sensors,” IEEE Sensors Journal, vol. 21, no. 15, pp. 16852–16860, 2021. [Google Scholar]
11. S. Mekruksavanich and A. Jitpattanakul, “Lstm networks using smartphone data for sensor-based human activity recognition in smart homes,” Sensors, vol. 21, no. 5, pp. 1636, 2021. [Google Scholar] [PubMed]
12. H. Wang, J. Zhao, J. Li, L. Tian, P. Tu et al., “Wearable sensor-based human activity recognition using hybrid deep learning techniques,” Security and Communication Networks, vol. 2020, pp. 1–12, 2020. [Google Scholar]
13. O. Nafea, W. Abdul, G. Muhammad and M. Alsulaiman, “Sensor-based human activity recognition with spatio-temporal deep learning,” Sensors, vol. 21, no. 6, pp. 2141, 2021. [Google Scholar] [PubMed]
14. V. Ghate, “Hybrid deep learning approaches for smartphone sensor-based human activity recognition,” Multimedia Tool and Applications, vol. 80, no. 28, pp. 35585–35604, 2021. [Google Scholar]
15. I. D. Luptáková, M. Kubovčík and J. Pospíchal, “Wearable sensor-based human activity recognition with transformer model,” Sensors, vol. 22, no. 5, pp. 1911, 2022. [Google Scholar]
16. Z. Qin, Y. Zhang, S. Meng, Z. Qin and K. K. R. Choo, “Imaging and fusing time series for wearable sensor-based human activity recognition,” Information Fusion, vol. 53, pp. 80–87, 2020. [Google Scholar]
17. R. Mondal, D. Mukherjee, P. K. Singh, V. Bhateja and R. Sarkar, “A new framework for smartphone sensor-based human activity recognition using graph neural network,” IEEE Sensors Journal, vol. 21, no. 10, pp. 11461–11468, 2020. [Google Scholar]
18. M. Z. Uddin, M. M. Hassan, A. Alsanad and C. Savaglio, “A body sensor data fusion and deep recurrent neural network-based behavior recognition approach for robust healthcare,” Information Fusion, vol. 55, pp. 105–115, 2020. [Google Scholar]
19. J. Wu, L. Sun, D. Peng and S. Siuly, “A micro neural network for healthcare sensor data stream classification in sustainable and smart cities,” Computational Intelligence and Neuroscience, vol. 2022, pp. 1–9, 2022. [Google Scholar]
20. M. Alanazi, A. Alanazi, A. Almadhor and Z. A. Memon, “Multiobjective reconfiguration of unbalanced distribution networks using improved transient search optimization algorithm considering power quality and reliability metrics,” Scientific Reports, vol. 12, no. 1, pp. 1–19, 2022. [Google Scholar]
21. O. Banos, C. Villalonga, R. Garcia, A. Saez, M. Damas et al., “Design, implementation and validation of a novel open framework for agile development of mobile health applications,” Biomedical Engineering, vol. 14, no. 2, pp. S6, 2015. [Google Scholar]
Cite This Article
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.