Kai Chen^1,2, Jinwei Wang³, James Msughter Adeke^1,2, Guangjie Liu^1,2,*, Yuewei Dai^1,4

CMC-Computers, Materials & Continua, Vol.78, No.3, pp. 3247-3265, 2024, DOI:10.32604/cmc.2024.046082

Abstract In recent years, various adversarial defense methods have been proposed to improve the robustness of deep neural networks. Adversarial training is one of the most potent methods to defend against adversarial attacks. However, the difference in the feature space between natural and adversarial examples hinders the accuracy and robustness of the model in adversarial training. This paper proposes a learnable distribution adversarial training method, aiming to construct the same distribution for training data utilizing the Gaussian mixture model. The distribution centroid is built to classify samples and constrain the distribution of the sample features. The natural and adversarial examples are… More >

Wenfeng Zheng¹, Siyu Lu¹, Zhuohang Cai¹, Ruiyang Wang¹, Lei Wang², Lirong Yin^2,*

CMES-Computer Modeling in Engineering & Sciences, Vol.139, No.3, pp. 2729-2745, 2024, DOI:10.32604/cmes.2023.046692

Abstract In the field of natural language processing (NLP), there have been various pre-training language models in recent years, with question answering systems gaining significant attention. However, as algorithms, data, and computing power advance, the issue of increasingly larger models and a growing number of parameters has surfaced. Consequently, model training has become more costly and less efficient. To enhance the efficiency and accuracy of the training process while reducing the model volume, this paper proposes a first-order pruning model PAL-BERT based on the ALBERT model according to the characteristics of question-answering (QA) system and language model. Firstly, a first-order network… More >

R. Sujatha, K. Nimala^*

CMC-Computers, Materials & Continua, Vol.78, No.2, pp. 1669-1686, 2024, DOI:10.32604/cmc.2023.046963

Abstract Sentence classification is the process of categorizing a sentence based on the context of the sentence. Sentence categorization requires more semantic highlights than other tasks, such as dependence parsing, which requires more syntactic elements. Most existing strategies focus on the general semantics of a conversation without involving the context of the sentence, recognizing the progress and comparing impacts. An ensemble pre-trained language model was taken up here to classify the conversation sentences from the conversation corpus. The conversational sentences are classified into four categories: information, question, directive, and commission. These classification label sequences are for analyzing the conversation progress and… More >

Mostafa Diba^*, Hossein Khosravi

Intelligent Automation & Soft Computing, Vol.38, No.3, pp. 315-332, 2023, DOI:10.32604/iasc.2023.046590

Abstract Convolutional neural networks continually evolve to enhance accuracy in addressing various problems, leading to an increase in computational cost and model size. This paper introduces a novel approach for pruning face recognition models based on convolutional neural networks. The proposed method identifies and removes inefficient filters based on the information volume in feature maps. In each layer, some feature maps lack useful information, and there exists a correlation between certain feature maps. Filters associated with these two types of feature maps impose additional computational costs on the model. By eliminating filters related to these categories of feature maps, the reduction… More >

Tianming Zhang¹, Zebin Chen¹, Haonan Guo², Bojun Ren¹, Quanmin Xie^3,*, Mengke Tian^4,*, Yong Wang⁴

CMES-Computer Modeling in Engineering & Sciences, Vol.139, No.2, pp. 2139-2154, 2024, DOI:10.32604/cmes.2023.043822

Abstract The data analysis of blasting sites has always been the research goal of relevant researchers. The rise of mobile blasting robots has aroused many researchers’ interest in machine learning methods for target detection in the field of blasting. Serverless Computing can provide a variety of computing services for people without hardware foundations and rich software development experience, which has aroused people’s interest in how to use it in the field of machine learning. In this paper, we design a distributed machine learning training application based on the AWS Lambda platform. Based on data parallelism, the data aggregation and training synchronization… More >

Soonshin Seo^1,2, Ji-Hwan Kim^2,*

CMC-Computers, Materials & Continua, Vol.77, No.3, pp. 2833-2856, 2023, DOI:10.32604/cmc.2023.042816

Abstract Automatic speech recognition (ASR) systems have emerged as indispensable tools across a wide spectrum of applications, ranging from transcription services to voice-activated assistants. To enhance the performance of these systems, it is important to deploy efficient models capable of adapting to diverse deployment conditions. In recent years, on-demand pruning methods have obtained significant attention within the ASR domain due to their adaptability in various deployment scenarios. However, these methods often confront substantial trade-offs, particularly in terms of unstable accuracy when reducing the model size. To address challenges, this study introduces two crucial empirical findings. Firstly, it proposes the incorporation of… More >

Abdennasser Dahmani¹, Yamina Ammi², Nadjem Bailek^3,4,*, Alban Kuriqi^5,6, Nadhir Al-Ansari^7,*, Salah Hanini², Ilhami Colak⁸, Laith Abualigah^{9,10,11,12,13,14}, El-Sayed M. El-kenawy¹⁵

CMC-Computers, Materials & Continua, Vol.77, No.2, pp. 2579-2594, 2023, DOI:10.32604/cmc.2023.040625

Abstract Increasing global energy consumption has become an urgent problem as natural energy sources such as oil, gas, and uranium are rapidly running out. Research into renewable energy sources such as solar energy is being pursued to counter this. Solar energy is one of the most promising renewable energy sources, as it has the potential to meet the world’s energy needs indefinitely. This study aims to develop and evaluate artificial intelligence (AI) models for predicting hourly global irradiation. The hyperparameters were optimized using the Broyden-Fletcher-Goldfarb-Shanno (BFGS) quasi-Newton training algorithm and STATISTICA software. Data from two stations in Algeria with different climatic… More >

Peidong Wu^1,*

The International Conference on Computational & Experimental Engineering and Sciences, Vol.26, No.1, pp. 1-1, 2023, DOI:10.32604/icces.2023.010491

Abstract The material anisotropy of an aluminum sheet alloy is determined by performing tensile tests at different angles with respect to the rolling direction (RD). To study the effect of pre-straining on the evolution of material anisotropy, a very wide sheet is stretched to different strains in the transverse direction (TD). The material in the central region is very close to a state of in-plane plane strain tension. Small tensile samples are cut from the central region of the pre-strained wide sample. Tensile tests are then performed on these small tensile samples. By comparing the differences in the flow stress vs.… More >

Bilal Khan¹, Muhammad Arshad², Sarwar Shah Khan^3,4,*

Journal of Cyber Security, Vol.5, pp. 1-11, 2023, DOI:10.32604/jcs.2023.042501

Abstract The proliferation of maliciously coded documents as file transfers increase has led to a rise in sophisticated attacks. Portable Document Format (PDF) files have emerged as a major attack vector for malware due to their adaptability and wide usage. Detecting malware in PDF files is challenging due to its ability to include various harmful elements such as embedded scripts, exploits, and malicious URLs. This paper presents a comparative analysis of machine learning (ML) techniques, including Naive Bayes (NB), K-Nearest Neighbor (KNN), Average One Dependency Estimator (A1DE), Random Forest (RF), and Support Vector Machine (SVM) for PDF malware detection. The study… More >

Mohammed Al Jaffal^*

International Journal of Mental Health Promotion, Vol.25, No.8, pp. 881-890, 2023, DOI:10.32604/ijmhp.2023.028982

Abstract Many individuals with autism spectrum disorder (ASD) experience delays in the development of social and communications skills, which can limit their opportunities in higher education and employment resulting in an overall negative impact to their quality of life. This systematic review identifies 15 studies that explored the effectiveness of Video-Based Interventions (VBIs) for those with ASD during the critical years of adolescence and young adulthood. The 15 studies described herein found this to be an effective intervention for this population for the improvement of their vocational, daily living, and academic skills. In addition, VBIs allow for the maintenance and generalization… More >