Open Access
ARTICLE
Improved Symbiotic Organism Search with Deep Learning for Industrial Fault Diagnosis
Department of Information Technology, College of Computers and Information Technology, Taif University, Taif P.O. Box 11099, Taif, 21944, Saudi Arabia
* Corresponding Author: Mrim M. Alnfiai. Email:
Computers, Materials & Continua 2023, 74(2), 3763-3780. https://doi.org/10.32604/cmc.2023.033448
Received 16 June 2022; Accepted 04 August 2022; Issue published 31 October 2022
Abstract
Developments in data storage and sensor technologies have allowed the cumulation of a large volume of data from industrial systems. Both structural and non-structural data of industrial systems are collected, which covers data formats of time-series, text, images, sound, etc. Several researchers discussed above were mostly qualitative, and ceratin techniques need expert guidance to conclude on the condition of gearboxes. But, in this study, an improved symbiotic organism search with deep learning enabled fault diagnosis (ISOSDL-FD) model for gearbox fault detection in industrial systems. The proposed ISOSDL-FD technique majorly concentrates on the identification and classification of faults in the gearbox data. In addition, a Fast kurtogram based time-frequency analysis can be used for revealing the energy present in the machinery signals in the time-frequency representation. Moreover, the deep bidirectional recurrent neural network (DBiRNN) is applied for fault detection and classification. At last, the ISOS approach was derived for optimal hyperparameter tuning of the DL method so that the classification performance will be improvised. To illustrate the improvised performance of the ISOSDL-FD algorithm, a comprehensive experimental analysis can be performed. The experimental results stated the betterment of the ISOSDL-FD algorithm over current techniques.Keywords
In industrial production, any faults of rotating machines might lead to massive economic losses. Hence, fault diagnosis (FD) and fault detection become vital to the operative safety of latest production system [1]. Owing to the lack of fault samples, complications of fault kinds, problems of FD, and higher cost of manual annotation samples, the under small samples are still a research domain which requires continuous update, continual progress, and optimization [2,3]. With the continual growth of modern manufacturing sector, rotating machinery plays a crucial role in complicated electromechanical equipment, can be advanced toward complexity, intelligence, and large scale [4,5]. Rotating machinery generally operates for longer duration under high speeds and heavy loads. Bearing, gearboxes, and other significant elements were probably to suffer from fracture, wear, deformation, and other faults at the time under time-varying operating conditions and inherent degradation process [6]. The failure of such elements would affect the normal function and equipment usage [7].
Serious cases could lead to damage or downtime and they might occur huge economic losses and casualties [8,9]. Thus, research relating to condition monitoring and FD of rotating machinery was one such key which assures the normal function of equipment, minimizes unplanned maintenance, ignored catastrophic failures, and assures the security of industrial production that was most important one [10]. Main tasks of FD research on rotating machinery involve determination of functioning state, determining the fault kind, and estimating the fault trend. Recently, authors have made many research studies in the domain of rotating machinery FD that reached productive research outcomes and were implied in actual working states [11,12]. With the speedy advancement of intellectual methods, the recent study on deep learning (DL) in the FD of rotating machinery was rising year by year, and it grabbed the interest of many authors. For the promotion of the research growth in this domain, the paper assesses the related research from the two prospects of DL concept and its applications in FD [13]. (Research could grant inspiration and convenience for related authors and offer references for promoting and understanding the advancement of FD research.
This article presents an improved symbiotic organism search with deep learning enabled fault diagnosis (ISOSDL-FD) model for gearbox fault detection in industrial systems. The proposed ISOSDL-FD technique applies a Fast kurtogram based time-frequency analysis for revealing the energy present in the machinery signals in the time and frequency representation. In addition, the deep bidirectional recurrent neural network (DBiRNN) is applied for fault detection and classification. At last, the ISOS method can be derived for optimal hyperparameter tuning of the DL approach. To illustrate the improvised performance of the ISOSDL-FD algorithm, a comprehensive experimental analysis was performed.
The rest of the paper is organized as follows. Section 2 offers the literature review, Section 3 elaborates the proposed ISOSDL-FD model, Section 4 provides performance validation, and Section 5 concludes the paper.
Wang et al. [14] suggest a novel fault prognosis technique has infrared thermal images and least-square-interactive-support-matrix-machine (LSISMM). In this technique, a new matrix-form classifier known as LSISMM can be created over the idea of non-parallel interactive hyperplane to completely use the structure data of infrared thermal imageries. To enhance the computational efficacy, innovative least square loss constraints were projected for LSISMM. Additionally, the researchers extract an effectual solution structure on the basis of the alternative direction technique of the multiplier (ADMM) structure. In [15], an adaptive convolutional neural network (CNN) was built on the basis of the ontology representation of pump. Firstly, time–frequency features of pressure signals were acquired through continual wavelet transformation. Secondly, establishment of a deep CNN by setting initial hyperparameter. Thirdly, Bayesian optimization can be leveraged for achieving automatic learning of main significant hyperparameters for constructing an adaptive CNN. In [16], a new FD technique for rotating machinery on the basis of deep residual neural network (DRNN) and data fusion was suggested. Initially, the frequency domain and time domain features of the original signal were derived via the Short-time Fourier transform (STFT) layer, after which the DRNN and the fusion embedding layers were utilized for fusing the frequency domain, spatial domain, and time domain features for obtaining high quality low-dimension fusion features.
An FD technique for rotating machinery in time varying circumstances on the basis of DL and tacholess order tracking (TOT) was suggested in [14]. At first, estimated speed information and frequency domain periodic signals were attained by tracking the order. Next, the frequency domain periodic signals refer to a speed which can be standardized with the help of estimated speed data. At last, standardized features were derived by DL method for making feature vectors. The feature vector can be fed to softmax layers to finish FD of the gearboxes. Li et al. [17] advance an FD technique with the help of CNN for InfRared Thermal (IRT) images. Firstly, IRT method can be used for capturing the IRT images of rotating machinery. Secondly, the CNN can be implied for extraction of fault features from the IRT images. Finally, the acquired features were fed to the Softmax Regression (SR) classification for fault pattern identification. In [18], a novel DL related FD technique, that derives features from frequency as well as time domains were suggested. A set of 2 deep features from several domain was merged into global principle component analysis and intrinsic low-dimensional features by local. And a novel ensemble kernel extreme learning machine was suggested for fault pattern classifier on the basis of the fused feature.
In this study, a new ISOSDL-FD technique was introduced for the recognition of faults in industrial systems. The proposed ISOSDL-FD technique accomplished proficient identification and classification of faults in the gearbox data. In addition, a Fast kurtogram based time-frequency analysis is used for revealing the energy present in the machinery signals in the time and frequency representation. Moreover, the ISOS-DBiRNN is applied for fault detection and classification. Fig. 1 depicts the overall process of ISOSDL-FD approach.
Time-frequency analysis was helpful for revealing the energy restricted from the machinery signal from the time and frequency representation [19]. Different kinds of time-frequency transformations like spectral kurtosis diagram (kurtogram), wavelet transform (WT), empirical mode decomposition (EMD), and STFT are utilized to machinery FD. But, every approach are flaws. It can be complex for selecting the mother wavelet function to WT, but EMD models offer in mode mixing problems. Besides, in STFT approaches, the time and frequency resolutions were connected together. The fast kurtogram system offers any benefits on other methodologies as the present generation of fast kurtogram doesn’t need some parameters that set, creating the model simple for utilizing. So, the fast kurtogram has been selected to the presented analysis model for reducing the amount of parameters which required that set. The kurtogram is 4th order of spectral diagnosis that is called spectral kurtosis. Antoni imposed 4 constraints on kurtogram diagnosis for increasing the versatility of procedure that creates the method further sensitive to non-stationary signals. The kurtogram is determined utilizing in Eq. (1):
whereas
In which
3.2 Fault Detection and Classification Model
In this study, the DBiRNN is applied for fault detection and classification. The prediction network is carried out by means of a Recurrent Neural Network (RNN) [20]. The neural network takes the temporal series of observation
Now,
The main distinction among GRU and LSTM is that the content of GRU cell memory is exposed continuously to output and it is easily implemented because it needs fewer parameters in the network. Briefly, the RNN cell
Assisting LSTM with this bi-directional learning ability allows the system to access long-range context in input direction and enrich sequence data understanding. With the potential to disentangle complicated temporal dependency, deep RNN is constructed by stacking various RNN hidden layers, with the output series of one layer form the input series for the following. Assume the same hidden layer as for each N layer in the stack, the hidden vector sequence
where
DBiRNN is implemented by replacing every
3.3 Hyperparameter Tuning Model
At the final stage, the ISOS algorithm is derived for optimal hyperparameter tuning of the DL model in such a way that the classification performance gets improved. The SOS algorithm was first introduced by Cheng et al. [21]. The SOS technique is the new methodology to solve optimization problems depends on organism interaction in nature. Organism rarely lives in isolation because of the dependence on other species for survival and nutrition. This relation depends on trust that is called a symbiotic relationship. The process initiates by a population initialization named the ecosystem. During the primary ecosystem, a group of organisms is randomly generated. Every organism represents a proposed solution for the problem. The time complexity in the SOS is characterized as
Currently, both organism benefits from the relationships they have with one another. Assume honeybee relationships with flowers, for instance, the bees fly over the flower for collecting the nectar needed to produce honey. Also, it is useful to the flower since bees, scattering the pollen, facilitate their pollination. In this study,
Now, rand
Here, the organism benefit, and the other gains nothing from the relationships. For instance, assume the relationships among sharks and sticky fish. The shark gets little or no benefit and the sticky fish stick to the shark and feed on the residual food. As in the Mutualism stage, the organism
In Eq. (19),
In this phase, one organism gets benefits from the relationships, and others endure a loss. Once the parasite proliferates in human body causes that individual to die. In this study, the Xi, that is, malaria mosquito, creating an artificial parasite named “Parasite-Vector.” The Parasite-Vector is generated in the searching space by imitating Xi.
During iterative optimization of complex problems, the SOS algorithm falls into local optima. In such cases, the solution value remains the same in the iteration. To address the shortcoming and increased the probability of algorithm jump out of the local optima location, the ISOS algorithm has been derived by adding a Gaussian mutation or a random perturbation (the function ran two hundred times and the outcome remains unchanged), and continue to run the process as follows:
In Eq. (20), rand refers to a random integer within [0, 1],
In Eq. (21),
The ISOS approach extracts a fitness function for attaining enhanced classifier outcomes. It fixes a positive numeral for indicating superior outcome of the candidate solutions. In this paper, the reduction of a classifier error rate was regarded as a fitness function, as presented in Eq. (22).
The experimental data employed in this paper is accumulated on a planetary gearbox. The planetary gearbox data samples were categorized into five health states: normal state (Normal), K1 planetary gear failure (fault 1), K1 planetary gear failure (fault 2), K2 planetary gear failure (fault 3), and K3 planetary sun gear failure (fault 4). A set of 3000 samples were utilized in this study as represented in Tab. 1.
Fig. 3 highlights the confusion matrices produced by the ISOSDL-FD model on 70% of training (TR) data and 30% of testing (TS) data. With 70% of TR data, the ISOSDL-FD model has recognized 394 samples into normal, 393 samples into fault 1, 406 samples into fault 2, 400 samples into fault 3, and 405 samples into fault 4. Also, with 30% of TS data, the ISOSDL-FD method has identified 172 samples into normal, 177 samples into fault 1, 163 samples into fault 2, 171 samples into fault 3, and 172 samples into fault 4.
Tab. 2 illustrates a detailed classification result of the ISOSDL-FD model under 70% of TR and 30% of TS data. Fig. 4 shows the result analysis of ISOSDL-FD approach under 70% of TR data. The ISOSDL-FD model has recognized normal class with
Fig. 5 displays the result analysis of ISOSDL-FD method under 30% of TS data. The ISOSDL-FD approach has identified normal class with
Fig. 6 exhibits the confusion matrices generated by the ISOSDL-FD approach on 80% of TR data and 20% of TS data. With 80% of TR data, the ISOSDL-FD approach has recognized 469 samples into normal, 463 samples into fault 1, 468 samples into fault 2, 470 samples into fault 3, and 466 samples into fault 4. Moreover, with 30% of TS data, the ISOSDL-FD algorithm has identified 115 samples into normal, 118 samples into fault 1, 110 samples into fault 2, 119 samples into fault 3, and 123 samples into fault 4.
Tab. 3 demonstrates a brief classification result of the ISOSDL-FD method under 80% of TR and 20% of TS data. Fig. 7 displays the result analysis of ISOSDL-FD methodology under 80% of TR data. The ISOSDL-FD algorithm has recognized normal class with
Fig. 8 illustrates the result analysis of ISOSDL-FD method under 20% of TS data. The ISOSDL-FD algorithm has recognized normal class with
The training accuracy (TA) and validation accuracy (VA) acquired by the ISOSDL-FD technique on test dataset is demonstrated in Fig. 9. The experimental outcome represents the ISOSDL-FD methodology has reached higher values of TA and VA. To be specific, the VA is higher than TA.
The training loss (TL) and validation loss (VL) gained by the ISOSDL-FD method on test dataset are established in Fig. 10. The experimental outcome indicated the ISOSDL-FD technique has accomplished minimal values of TL and VL. Particularly, the VL is lower than TL.
At last, a comparative study of the ISOSDL-FD model with recent models interms of different measures is shown in Tab. 4 [22,23].
Fig. 11 inspects a detailed result analysis of the ISOSDL-FD model with existing models interms of
Fig. 12 reviews a comparative result analysis of the ISOSDL-FD methodology with existing models interms of
From the detailed results and discussion, it is apparent that the ISOSDL-FD model has shown enhanced classification performance over other models.
In this study, a new ISOSDL-FD technique was introduced for the recognition of faults in industrial systems. The proposed ISOSDL-FD technique accomplished proficient identification and classification of faults in the gearbox data. In addition, a Fast kurtogram based time-frequency analysis can be used for revealing the energy present in the machinery signals in the time and frequency representation. Moreover, the DBiRNN is applied for fault detection and classification. At last, the ISOS approach was derived for optimal hyperparameter tuning of the DL approach so that the classification performance will be improvised. To exhibit the enhanced performance of the ISOSDL-FD method, a comprehensive experimental analysis was performed. The experimental results stated the betterment of the ISOSDL-FD methodology over recent techniques with maximum accuracy of 99%. In future, the performance of the proposed model can be enhanced by the use of hybrid DL models.
Funding Statement: The author received no specific funding for this study.
Conflicts of Interest: The author declare that they have no conflicts of interest to report regarding the present study.
References
1. R. Liu, B. Yang, E. Zio and X. Chen, “Artificial intelligence for fault diagnosis of rotating machinery: A review,” Mechanical Systems and Signal Processing, vol. 108, pp. 33–47, 2018. [Google Scholar]
2. T. Zhou, T. Han and E. L. Droguett, “Towards trustworthy machine fault diagnosis: A probabilistic Bayesian deep learning framework,” Reliability Engineering & System Safety, vol. 224, pp. 108525, 2022. [Google Scholar]
3. Y. Qi, C. Shen, D. Wang, J. Shi, X. Jiang et al., “Stacked sparse autoencoder-based deep network for fault diagnosis of rotating machinery,” IEEE Access, vol. 5, pp. 15066–15079, 2017. [Google Scholar]
4. A. M. Hilal, J. S. Alzahrani, I. Abunadi, N. Nemri, F. N. Al-Wesabi et al., “Intelligent deep learning model for privacy preserving IIoT on 6G environment,” Computers, Materials & Continua, vol. 72, no. 1, pp. 333–348, 2022. [Google Scholar]
5. M. Kim, J. U. Ko, J. Lee, B. D. Youn, J. H. Jung et al., “A domain adaptation with semantic clustering (DASC) method for fault diagnosis of rotating machinery,” ISA Transactions, vol. 120, pp. 372–382, 2022. [Google Scholar]
6. M. A. Alohali, F. N. Al-Wesabi, A. M. Hilal, S. Goel, D. Gupta et al., “Artificial intelligence enabled intrusion detection systems for cognitive cyber-physical systems in industry 4.0 environment,” Cognitive Neurodynamics, 2022. https://doi.org/10.1007/s11571-022-09780-8. [Google Scholar]
7. Y. Ding, L. Ma, J. Ma, M. Suo, L. Tao et al., “Intelligent fault diagnosis for rotating machinery using deep Q-network based health state classification: A deep reinforcement learning approach,” Advanced Engineering Informatics, vol. 42, pp. 100977, 2019. [Google Scholar]
8. I. Abunadi, M. M. Althobaiti, F. N. Al-Wesabi, A. M. Hilal, M. Medani et al., “Federated learning with blockchain assisted image classification for clustered UAV networks,” Computers, Materials & Continua, vol. 72, no. 1, pp. 1195–1212, 2022. [Google Scholar]
9. Y. Zhang, T. Zhou, X. Huang, L. Cao and Q. Zhou, “Fault diagnosis of rotating machinery based on recurrent neural networks,” Measurement, vol. 171, pp. 108774, 2021. [Google Scholar]
10. T. Jin, C. Yan, C. Chen, Z. Yang, H. Tian et al., “Light neural network with fewer parameters based on CNN for fault diagnosis of rotating machinery,” Measurement, vol. 181, pp. 109639, 2021. [Google Scholar]
11. W. Zhang, X. Li and Q. Ding, “Deep residual learning-based fault diagnosis method for rotating machinery,” ISA Transactions, vol. 95, pp. 295–305, 2019. [Google Scholar]
12. L. C. Brito, G. A. Susto, J. N. Brito and M. A. V. Duarte, “An explainable artificial intelligence approach for unsupervised fault detection and diagnosis in rotating machinery,” Mechanical Systems and Signal Processing, vol. 163, pp. 108105, 2022. [Google Scholar]
13. W. Jiang, C. Wang, J. Zou and S. Zhang, “Application of deep learning in fault diagnosis of rotating machinery,” Processes, vol. 9, no. 6, pp. 919, 2021. [Google Scholar]
14. T. Wang, L. Zhang, H. Qiao and P. Wang, “Fault diagnosis of rotating machinery under time-varying speed based on order tracking and deep learning,” Journal of Vibroengineering, vol. 22, no. 2, pp. 366–382, 2020. [Google Scholar]
15. S. Tang, Y. Zhu and S. Yuan, “An adaptive deep learning model towards fault diagnosis of hydraulic piston pump using pressure signal,” Engineering Failure Analysis, vol. 138, pp. 106300, 2022. [Google Scholar]
16. B. Peng, H. Xia, X. Lv, M. A. Nyarko, S. Zhu et al., “An intelligent fault diagnosis method for rotating machinery based on data fusion and deep residual neural network,” Applied Intelligence, vol. 52, no. 3, pp. 3051–3065, 2022. [Google Scholar]
17. Y. Li, X. Du, F. Wan, X. Wang and H. Yu, “Rotating machinery fault diagnosis based on convolutional neural network and infrared thermal imaging,” Chinese Journal of Aeronautics, vol. 33, no. 2, pp. 427–438, 2020. [Google Scholar]
18. S. Pang, X. Yang, X. Zhang and X. Lin, “Fault diagnosis of rotating machinery with ensemble kernel extreme learning machine based on fused multi-domain features,” ISA Transactions, vol. 98, pp. 320–337, 2020. [Google Scholar]
19. S. R. Saufi, Z. A. B. Ahmad, M. S. Leong and M. H. Lim, “Gearbox fault diagnosis using a deep learning model with limited data sample,” IEEE Transactions on Industrial Informatics, vol. 16, no. 10, pp. 6263–6271, 2020. [Google Scholar]
20. O. Olabiyi, E. Martinson, V. Chintalapudi and R. Guo, “Driver action prediction using deep (bidirectional) recurrent neural network,” arXiv:1706.02257, pp. 1–7, 2017. [Google Scholar]
21. M. Y. Cheng and D. Prayogo, “Symbiotic organisms search: A new metaheuristic optimization algorithm,” Computers & Structures, vol. 139, pp. 98–112, 2014. [Google Scholar]
22. O. Essid, H. Laga and C. Samir, “Automatic detection and classification of manufacturing defects in metal boxes using deep neural networks,” PLoS One, vol. 13, no. 11, pp. e0203192, 2018. [Google Scholar]
23. P. Jiang, H. Cong, J. Wang and D. Zhang, “Fault diagnosis of gearbox in multiple conditions based on fine-grained classification cnn algorithm,” Shock and Vibration, vol. 2020, pp. 1–15, 2020. [Google Scholar]
Cite This Article
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.