Anitha Ramachandran, Sendhil Kumar K.S.^*

CMC-Computers, Materials & Continua, Vol.81, No.1, pp. 827-842, 2024, DOI:10.32604/cmc.2024.054768 - 15 October 2024

Abstract Research on panicle detection is one of the most important aspects of paddy phenotypic analysis. A phenotyping method that uses unmanned aerial vehicles can be an excellent alternative to field-based methods. Nevertheless, it entails many other challenges, including different illuminations, panicle sizes, shape distortions, partial occlusions, and complex backgrounds. Object detection algorithms are directly affected by these factors. This work proposes a model for detecting panicles called Border Sensitive Knowledge Distillation (BSKD). It is designed to prioritize the preservation of knowledge in border areas through the use of feature distillation. Our feature-based knowledge distillation method More >

Lirong Yin¹, Lei Wang¹, Zhuohang Cai², Siyu Lu^2,*, Ruiyang Wang², Ahmed AlSanad³, Salman A. AlQahtani³, Xiaobing Chen⁴, Zhengtong Yin⁵, Xiaolu Li⁶, Wenfeng Zheng^2,3,*

CMES-Computer Modeling in Engineering & Sciences, Vol.141, No.1, pp. 771-786, 2024, DOI:10.32604/cmes.2024.052622 - 20 August 2024

Abstract Recent advancements in natural language processing have given rise to numerous pre-training language models in question-answering systems. However, with the constant evolution of algorithms, data, and computing power, the increasing size and complexity of these models have led to increased training costs and reduced efficiency. This study aims to minimize the inference time of such models while maintaining computational performance. It also proposes a novel Distillation model for PAL-BERT (DPAL-BERT), specifically, employs knowledge distillation, using the PAL-BERT model as the teacher model to train two student models: DPAL-BERT-Bi and DPAL-BERT-C. This research enhances the dataset More >

Yang Yang¹, Yuhan Long¹, Yijing Lin², Zhipeng Gao¹, Lanlan Rui¹, Peng Yu^1,3,*

CMC-Computers, Materials & Continua, Vol.76, No.3, pp. 3623-3651, 2023, DOI:10.32604/cmc.2023.040250 - 08 October 2023

Abstract With the rapid development of the Internet of Things (IoT), the automation of edge-side equipment has emerged as a significant trend. The existing fault diagnosis methods have the characteristics of heavy computing and storage load, and most of them have computational redundancy, which is not suitable for deployment on edge devices with limited resources and capabilities. This paper proposes a novel two-stage edge-side fault diagnosis method based on double knowledge distillation. First, we offer a clustering-based self-knowledge distillation approach (Cluster KD), which takes the mean value of the sample diagnosis results, clusters them, and takes… More >

Ling Wang, Jingchi Jiang^*, Jingwen Song, Jie Liu

Intelligent Automation & Soft Computing, Vol.37, No.1, pp. 833-848, 2023, DOI:10.32604/iasc.2023.036402 - 29 April 2023

Abstract It is significant for agricultural intelligent knowledge services using knowledge graph technology to integrate multi-source heterogeneous crop and pest data and fully mine the knowledge hidden in the text. However, only some labeled data for agricultural knowledge graph domain training are available. Furthermore, labeling is costly due to the need for more data openness and standardization. This paper proposes a novel model using knowledge distillation for a weakly supervised entity recognition in ontology construction. Knowledge distillation between the target and source data domain is performed, where Bi-LSTM and CRF models are constructed for entity recognition. More >

Le Quang Thao^1,2,*, Duong Duc Cuong², Vu Manh Hung³, Le Thanh Vinh³, Doan Trong Nghia⁴, Dinh Ha Hai³, Nguyen Nhan Nhi³

Intelligent Automation & Soft Computing, Vol.35, No.3, pp. 3517-3530, 2023, DOI:10.32604/iasc.2023.031026 - 17 August 2022

Abstract The recent outbreak of the coronavirus disease of 2019 (Covid-19) has been causing many disruptions among the education systems worldwide, most of them due to the abrupt transition to online learning. The sudden upsurge in digital electronic devices usage, namely personal computers, laptops, tablets and smartphones is unprecedented, which leads to a new wave of both mental and physical health problems among students, for example eye-related illnesses. The overexposure to electronic devices, extended screen time usage and lack of outdoor sunlight have put a consequential strain on the student’s ophthalmic health because of their young… More >

Yang Wu¹, Lei Guo¹, Xiaodong Dai¹, Bin Zhang¹, Dong-Won Park², Ming Ma^1,*

CMC-Computers, Materials & Continua, Vol.73, No.3, pp. 5911-5924, 2022, DOI:10.32604/cmc.2022.031664 - 28 July 2022

Abstract Action recognition has become a current research hotspot in computer vision. Compared to other deep learning methods, Two-stream convolutional network structure achieves better performance in action recognition, which divides the network into spatial and temporal streams, using video frame images as well as dense optical streams in the network, respectively, to obtain the category labels. However, the two-stream network has some drawbacks, i.e., using dense optical flow as the input of the temporal stream, which is computationally expensive and extremely time-consuming for the current extraction algorithm and cannot meet the requirements of real-time tasks. In… More >

Siyuan Mei^1,2, Yingyi Chen^1,2,*, Hanxiang Qin^1,2, Huihui Yu³, Daoliang Li^1,2, Boyang Sun^1,2, Ling Yang^1,2, Yeqi Liu^1,2

CMES-Computer Modeling in Engineering & Sciences, Vol.131, No.3, pp. 1315-1335, 2022, DOI:10.32604/cmes.2022.019378 - 19 April 2022

Abstract Fish behavior analysis for recognizing stress is very important for fish welfare and production management in aquaculture. Recent advances have been made in fish behavior analysis based on deep learning. However, most existing methods with top performance rely on considerable memory and computational resources, which is impractical in the real-world scenario. In order to overcome the limitations of these methods, a new method based on knowledge distillation is proposed to identify the stress states of fish schools. The knowledge distillation architecture transfers additional inter-class information via a mixed relative loss function, and it forces a… More >