Lirong Yin¹, Lei Wang¹, Siyu Lu^2,*, Ruiyang Wang², Youshuai Yang², Bo Yang², Shan Liu², Ahmed AlSanad³, Salman A. AlQahtani³, Zhengtong Yin⁴, Xiaolu Li⁵, Xiaobing Chen⁶, Wenfeng Zheng^3,*

CMES-Computer Modeling in Engineering & Sciences, Vol.141, No.1, pp. 87-106, 2024, DOI:10.32604/cmes.2024.051083 - 20 August 2024

Abstract This study addresses the limitations of Transformer models in image feature extraction, particularly their lack of inductive bias for visual structures. Compared to Convolutional Neural Networks (CNNs), the Transformers are more sensitive to different hyperparameters of optimizers, which leads to a lack of stability and slow convergence. To tackle these challenges, we propose the Convolution-based Efficient Transformer Image Feature Extraction Network (CEFormer) as an enhancement of the Transformer architecture. Our model incorporates E-Attention, depthwise separable convolution, and dilated convolution to introduce crucial inductive biases, such as translation invariance, locality, and scale invariance, into the Transformer… More >

Jieren Cheng^1,2, Xiaolong Chen^1,*, Wenghang Xu³, Shuai Hua³, Zhu Tang¹, Victor S. Sheng⁴

CMC-Computers, Materials & Continua, Vol.77, No.2, pp. 1779-1793, 2023, DOI:10.32604/cmc.2023.042980 - 29 November 2023

Abstract In the realm of Multi-Label Text Classification (MLTC), the dual challenges of extracting rich semantic features from text and discerning inter-label relationships have spurred innovative approaches. Many studies in semantic feature extraction have turned to external knowledge to augment the model’s grasp of textual content, often overlooking intrinsic textual cues such as label statistical features. In contrast, these endogenous insights naturally align with the classification task. In our paper, to complement this focus on intrinsic knowledge, we introduce a novel Gate-Attention mechanism. This mechanism adeptly integrates statistical features from the text itself into the semantic… More >

Xiaoqi Xin^*, Dezhi Han, Mingming Cui

CMC-Computers, Materials & Continua, Vol.77, No.2, pp. 2407-2425, 2023, DOI:10.32604/cmc.2023.042308 - 29 November 2023

Abstract Person Search is a task involving pedestrian detection and person re-identification, aiming to retrieve person images matching a given objective attribute from a large-scale image library. The Person Search models need to understand and capture the detailed features and context information of smaller objects in the image more accurately and comprehensively. The current popular Person Search models, whether end-to-end or two-step, are based on anchor boxes. However, due to the limitations of the anchor itself, the model inevitably has some disadvantages, such as unbalance of positive and negative samples and redundant calculation, which will affect… More >