Tao Bao^*, Xiyuan Ma, Zhuohuan Li, Duotong Yang, Pengyu Wang, Changcheng Zhou

Energy Engineering, Vol.121, No.6, pp. 1713-1737, 2024, DOI:10.32604/ee.2023.046150

Abstract The stability problem of power grids has become increasingly serious in recent years as the size of novel power systems increases. In order to improve and ensure the stable operation of the novel power system, this study proposes an artificial emotional lazy Q-learning method, which combines artificial emotion, lazy learning, and reinforcement learning for static security and stability analysis of power systems. Moreover, this study compares the analysis results of the proposed method with those of the small disturbance method for a stand-alone power system and verifies that the proposed lazy Q-learning method is able More >

Hongliang Zhang^1,2, Yi Chen¹, Yuteng Zhang¹, Gongjie Xu^3,*

CMES-Computer Modeling in Engineering & Sciences, Vol.140, No.2, pp. 1459-1483, 2024, DOI:10.32604/cmes.2024.049756

Abstract The distributed flexible job shop scheduling problem (DFJSP) has attracted great attention with the growth of the global manufacturing industry. General DFJSP research only considers machine constraints and ignores worker constraints. As one critical factor of production, effective utilization of worker resources can increase productivity. Meanwhile, energy consumption is a growing concern due to the increasingly serious environmental issues. Therefore, the distributed flexible job shop scheduling problem with dual resource constraints (DFJSP-DRC) for minimizing makespan and total energy consumption is studied in this paper. To solve the problem, we present a multi-objective mathematical model for… More >

Othman S. Al-Heety^1,*, Zahriladha Zakaria^1,*, Ahmed Abu-Khadrah², Mahamod Ismail³, Sarmad Nozad Mahmood⁴, Mohammed Mudhafar Shakir⁵, Sameer Alani⁶, Hussein Alsariera¹

CMES-Computer Modeling in Engineering & Sciences, Vol.138, No.3, pp. 2103-2127, 2024, DOI:10.32604/cmes.2023.029509

Abstract Intelligent traffic control requires accurate estimation of the road states and incorporation of adaptive or dynamically adjusted intelligent algorithms for making the decision. In this article, these issues are handled by proposing a novel framework for traffic control using vehicular communications and Internet of Things data. The framework integrates Kalman filtering and Q-learning. Unlike smoothing Kalman filtering, our data fusion Kalman filter incorporates a process-aware model which makes it superior in terms of the prediction error. Unlike traditional Q-learning, our Q-learning algorithm enables adaptive state quantization by changing the threshold of separating low traffic from… More >

Rundong Yang^1,*, Kangfeng Zheng¹, Xiujuan Wang², Bin Wu¹, Chunhua Wu¹

Computer Systems Science and Engineering, Vol.47, No.2, pp. 2153-2170, 2023, DOI:10.32604/csse.2023.038917

Abstract Social engineering attacks are considered one of the most hazardous cyberattacks in cybersecurity, as human vulnerabilities are often the weakest link in the entire network. Such vulnerabilities are becoming increasingly susceptible to network security risks. Addressing the social engineering attack defense problem has been the focus of many studies. However, two main challenges hinder its successful resolution. Firstly, the vulnerabilities in social engineering attacks are unique due to multistage attacks, leading to incorrect social engineering defense strategies. Secondly, social engineering attacks are real-time, and the defense strategy algorithms based on gaming or reinforcement learning are… More >

You Lu^1,2,#,*, Linqian Cui^1,2,#,*, Yunzhe Wang^1,2, Jiacheng Sun^1,2, Lanhui Liu³

CMES-Computer Modeling in Engineering & Sciences, Vol.137, No.1, pp. 717-732, 2023, DOI:10.32604/cmes.2023.027032

Abstract Most studies have conducted experiments on predicting energy consumption by integrating data for model training. However, the process of centralizing data can cause problems of data leakage. Meanwhile, many laws and regulations on data security and privacy have been enacted, making it difficult to centralize data, which can lead to a data silo problem. Thus, to train the model while maintaining user privacy, we adopt a federated learning framework. However, in all classical federated learning frameworks secure aggregation, the Federated Averaging (FedAvg) method is used to directly weight the model parameters on average, which may… More >

Ratih Hikmah Puspita¹, Jehad Ali^1,*, Byeong-hee Roh²

CMC-Computers, Materials & Continua, Vol.75, No.2, pp. 4611-4631, 2023, DOI:10.32604/cmc.2023.033598

Abstract 5G use cases, for example enhanced mobile broadband (eMBB), massive machine-type communications (mMTC), and an ultra-reliable low latency communication (URLLC), need a network architecture capable of sustaining stringent latency and bandwidth requirements; thus, it should be extremely flexible and dynamic. Slicing enables service providers to develop various network slice architectures. As users travel from one coverage region to another area, the call must be routed to a slice that meets the same or different expectations. This research aims to develop and evaluate an algorithm to make handover decisions appearing in 5G sliced networks. Rules of… More >

D. Palanikkumar¹, R. Ramesh Kumar², Mehedi Masud³, Mrim M. Alnfiai⁴, Mohamed Abouhawwash^5,6,*

Intelligent Automation & Soft Computing, Vol.36, No.2, pp. 2425-2440, 2023, DOI:10.32604/iasc.2023.033879

Abstract The major environmental hazard in this pandemic is the unhygienic disposal of medical waste. Medical wastage is not properly managed it will become a hazard to the environment and humans. Managing medical wastage is a major issue in the city, municipalities in the aspects of the environment, and logistics. An efficient supply chain with edge computing technology is used in managing medical waste. The supply chain operations include processing of waste collection, transportation, and disposal of waste. Many research works have been applied to improve the management of wastage. The main issues in the existing… More >

Youngjun Kim¹, Taekook Kim², Hyungoo Choi¹, Jinwoo Park¹, Yeunwoong Kyung^3,*

Intelligent Automation & Soft Computing, Vol.36, No.1, pp. 193-204, 2023, DOI:10.32604/iasc.2023.032784

Abstract Mobility support to change the connection from one access point (AP) to the next (i.e., handover) becomes one of the important issues in IEEE 802.11 wireless local area networks (WLANs). During handover, the channel scanning procedure, which aims to collect neighbor AP (NAP) information on all available channels, accounts for most of the delay time. To reduce the channel scanning procedure, a neighbor beacon frame transmission scheme (N-BTS) was proposed for a seamless handover. N-BTS can provide a seamless handover by removing the channel scanning procedure. However, N-BTS always requires operating overhead even if there More >

Kandasamy Sellamuthu^*, Vishnu Kumar Kaliappan

Computer Systems Science and Engineering, Vol.45, No.1, pp. 715-736, 2023, DOI:10.32604/csse.2023.029017

Abstract Pesticides have become more necessary in modern agricultural production. However, these pesticides have an unforeseeable long-term impact on people's wellbeing as well as the ecosystem. Due to a shortage of basic pesticide exposure awareness, farmers typically utilize pesticides extremely close to harvesting. Pesticide residues within foods, particularly fruits as well as veggies, are a significant issue among farmers, merchants, and particularly consumers. The residual concentrations were far lower than these maximal allowable limits, with only a few surpassing the restrictions for such pesticides in food. There is an obligation to provide a warning about this… More >

Somia Belaidouni^1,2, Moeiz Miraoui^3,4,*, Chakib Tadj¹

Computer Systems Science and Engineering, Vol.43, No.3, pp. 1085-1098, 2022, DOI:10.32604/csse.2022.024056

Abstract A context-aware service in a smart environment aims to supply services according to user situational information, which changes dynamically. Most existing context-aware systems provide context-aware services based on supervised algorithms. Reinforcement algorithms are another type of machine-learning algorithm that have been shown to be useful in dynamic environments through trial-and-error interactions. They also have the ability to build excellent self-adaptive systems. In this study, we aim to incorporate reinforcement algorithms (Q-learning) into a context-aware system to provide relevant services based on a user’s dynamic context. To accelerate the convergence of reinforcement learning (RL) algorithms and More >