Li Wang^1,*, Xiaoyong Wang²

Energy Engineering, Vol.121, No.12, pp. 3953-3979, 2024, DOI:10.32604/ee.2024.056705 - 22 November 2024

Abstract Plug-in Hybrid Electric Vehicles (PHEVs) represent an innovative breed of transportation, harnessing diverse power sources for enhanced performance. Energy management strategies (EMSs) that coordinate and control different energy sources is a critical component of PHEV control technology, directly impacting overall vehicle performance. This study proposes an improved deep reinforcement learning (DRL)-based EMS that optimizes real-time energy allocation and coordinates the operation of multiple power sources. Conventional DRL algorithms struggle to effectively explore all possible state-action combinations within high-dimensional state and action spaces. They often fail to strike an optimal balance between exploration and exploitation, and… More >

Inna Bilous¹, Dmytro Biriukov¹, Dmytro Karpenko², Tatiana Eutukhova², Oleksandr Novoseltsev^2,*, Volodymyr Voloshchuk¹

Energy Engineering, Vol.121, No.12, pp. 3617-3634, 2024, DOI:10.32604/ee.2024.051684 - 22 November 2024

Abstract This article focuses on the challenges of modeling energy supply systems for buildings, encompassing both methods and tools for simulating thermal regimes and engineering systems within buildings. Enhancing the comfort of living or working in buildings often necessitates increased consumption of energy and material, such as for thermal upgrades, which consequently incurs additional economic costs. It is crucial to acknowledge that such improvements do not always lead to a decrease in total pollutant emissions, considering emissions across all stages of production and usage of energy and materials aimed at boosting energy efficiency and comfort in… More > Graphic Abstract

Farhad Mortezapour Shiri^*, Thinagaran Perumal, Norwati Mustapha, Raihani Mohamed

Journal on Artificial Intelligence, Vol.6, pp. 301-360, 2024, DOI:10.32604/jai.2024.054314 - 20 November 2024

Abstract Deep learning (DL) has emerged as a powerful subset of machine learning (ML) and artificial intelligence (AI), outperforming traditional ML methods, especially in handling unstructured and large datasets. Its impact spans across various domains, including speech recognition, healthcare, autonomous vehicles, cybersecurity, predictive analytics, and more. However, the complexity and dynamic nature of real-world problems present challenges in designing effective deep learning models. Consequently, several deep learning models have been developed to address different problems and applications. In this article, we conduct a comprehensive survey of various deep learning models, including Convolutional Neural Network (CNN), Recurrent… More >

Mehrdad Shoeibi¹, Mohammad Mehdi Sharifi Nevisi², Sarvenaz Sadat Khatami³, Diego Martín^2,*, Sepehr Soltani⁴, Sina Aghakhani⁵

CMC-Computers, Materials & Continua, Vol.81, No.2, pp. 2819-2843, 2024, DOI:10.32604/cmc.2024.056823 - 18 November 2024

Abstract In the evolving landscape of the smart grid (SG), the integration of non-organic multiple access (NOMA) technology has emerged as a pivotal strategy for enhancing spectral efficiency and energy management. However, the open nature of wireless channels in SG raises significant concerns regarding the confidentiality of critical control messages, especially when broadcasted from a neighborhood gateway (NG) to smart meters (SMs). This paper introduces a novel approach based on reinforcement learning (RL) to fortify the performance of secrecy. Motivated by the need for efficient and effective training of the fully connected layers in the RL… More >

Zhaoan Wang¹, Kishlay Jha², Shaoping Xiao^1,*

CMC-Computers, Materials & Continua, Vol.81, No.1, pp. 1319-1336, 2024, DOI:10.32604/cmc.2024.055809 - 15 October 2024

Abstract Climate change poses significant challenges to agricultural management, particularly in adapting to extreme weather conditions that impact agricultural production. Existing works with traditional Reinforcement Learning (RL) methods often falter under such extreme conditions. To address this challenge, our study introduces a novel approach by integrating Continual Learning (CL) with RL to form Continual Reinforcement Learning (CRL), enhancing the adaptability of agricultural management strategies. Leveraging the Gym-DSSAT simulation environment, our research enables RL agents to learn optimal fertilization strategies based on variable weather conditions. By incorporating CL algorithms, such as Elastic Weight Consolidation (EWC), with established… More >

Zhihong Lin¹, Zeng Zeng², Yituan Yu², Yinlin Ren¹, Xuesong Qiu^1,*, Jinqian Chen¹

CMC-Computers, Materials & Continua, Vol.81, No.1, pp. 1641-1665, 2024, DOI:10.32604/cmc.2024.055802 - 15 October 2024

Abstract For permanent faults (PF) in the power communication network (PCN), such as link interruptions, the time-sensitive networking (TSN) relied on by PCN, typically employs spatial redundancy fault-tolerance methods to keep service stability and reliability, which often limits TSN scheduling performance in fault-free ideal states. So this paper proposes a graph attention residual network-based routing and fault-tolerant scheduling mechanism (GRFS) for data flow in PCN, which specifically includes a communication system architecture for integrated terminals based on a cyclic queuing and forwarding (CQF) model and fault recovery method, which reduces the impact of faults by simplified… More >

Zeshuang Song¹, Xiao Wang^1,*, Qing Wu¹, Yanting Tao¹, Linghua Xu¹, Yaohua Yin², Jianguo Yan³

CMC-Computers, Materials & Continua, Vol.81, No.1, pp. 985-1008, 2024, DOI:10.32604/cmc.2024.055614 - 15 October 2024

Abstract This research is the first application of Unmanned Aerial Vehicles (UAVs) equipped with Multi-access Edge Computing (MEC) servers to offshore wind farms, providing a new task offloading solution to address the challenge of scarce edge servers in offshore wind farms. The proposed strategy is to offload the computational tasks in this scenario to other MEC servers and compute them proportionally, which effectively reduces the computational pressure on local MEC servers when wind turbine data are abnormal. Finally, the task offloading problem is modeled as a multi-intelligent deep reinforcement learning problem, and a task offloading model… More >

Hoi Chuen Cheng, Frederick Ziyang Hong, Babar Hussain, Yiru Wang, Chik Patrick Yue^*

CMC-Computers, Materials & Continua, Vol.81, No.1, pp. 161-181, 2024, DOI:10.32604/cmc.2024.053079 - 15 October 2024

Abstract Large-scale indoor 3D reconstruction with multiple robots faces challenges in core enabling technologies. This work contributes to a framework addressing localization, coordination, and vision processing for multi-agent reconstruction. A system architecture fusing visible light positioning, multi-agent path finding via reinforcement learning, and 360° camera techniques for 3D reconstruction is proposed. Our visible light positioning algorithm leverages existing lighting for centimeter-level localization without additional infrastructure. Meanwhile, a decentralized reinforcement learning approach is developed to solve the multi-agent path finding problem, with communications among agents optimized. Our 3D reconstruction pipeline utilizes equirectangular projection from 360° cameras to More >

Jianhua Liu^*, Peng Xie, Jiajia Liu, Xiaoguang Tu

CMES-Computer Modeling in Engineering & Sciences, Vol.141, No.2, pp. 1243-1273, 2024, DOI:10.32604/cmes.2024.054002 - 27 September 2024

Abstract In mobile edge computing, unmanned aerial vehicles (UAVs) equipped with computing servers have emerged as a promising solution due to their exceptional attributes of high mobility, flexibility, rapid deployment, and terrain agnosticism. These attributes enable UAVs to reach designated areas, thereby addressing temporary computing swiftly in scenarios where ground-based servers are overloaded or unavailable. However, the inherent broadcast nature of line-of-sight transmission methods employed by UAVs renders them vulnerable to eavesdropping attacks. Meanwhile, there are often obstacles that affect flight safety in real UAV operation areas, and collisions between UAVs may also occur. To solve… More >

Bum-Sok Kim¹, Hye-Won Suk¹, Yong-Hoon Choi², Dae-Sung Moon³, Min-Suk Kim^2,*

CMES-Computer Modeling in Engineering & Sciences, Vol.141, No.2, pp. 1551-1574, 2024, DOI:10.32604/cmes.2024.052375 - 27 September 2024

Abstract Currently, cybersecurity threats such as data breaches and phishing have been on the rise due to the many different attack strategies of cyber attackers, significantly increasing risks to individuals and organizations. Traditional security technologies such as intrusion detection have been developed to respond to these cyber threats. Recently, advanced integrated cybersecurity that incorporates Artificial Intelligence has been the focus. In this paper, we propose a response strategy using a reinforcement-learning-based cyber-attack-defense simulation tool to address continuously evolving cyber threats. Additionally, we have implemented an effective reinforcement-learning-based cyber-attack scenario using Cyber Battle Simulation, which is a… More >