Tengda Li, Gang Wang, Qiang Fu^*

CMES-Computer Modeling in Engineering & Sciences, Vol.140, No.3, pp. 2559-2586, 2024, DOI:10.32604/cmes.2024.052039

Abstract Aiming at the problems of low solution accuracy and high decision pressure when facing large-scale dynamic task allocation (DTA) and high-dimensional decision space with single agent, this paper combines the deep reinforcement learning (DRL) theory and an improved Multi-Agent Deep Deterministic Policy Gradient (MADDPG-D2) algorithm with a dual experience replay pool and a dual noise based on multi-agent architecture is proposed to improve the efficiency of DTA. The algorithm is based on the traditional Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm, and considers the introduction of a double noise mechanism to increase the action exploration… More >

Ziqiao Zhou¹, Tianyang Zhou^1,*, Jinghao Xu², Junhu Zhu¹

CMES-Computer Modeling in Engineering & Sciences, Vol.140, No.3, pp. 2613-2634, 2024, DOI:10.32604/cmes.2023.028553

Abstract Intelligent penetration testing is of great significance for the improvement of the security of information systems, and the critical issue is the planning of penetration test paths. In view of the difficulty for attackers to obtain complete network information in realistic network scenarios, Reinforcement Learning (RL) is a promising solution to discover the optimal penetration path under incomplete information about the target network. Existing RL-based methods are challenged by the sizeable discrete action space, which leads to difficulties in the convergence. Moreover, most methods still rely on experts’ knowledge. To address these issues, this paper… More >

Mehrdad Shoeibi¹, Mohammad Mehdi Sharifi Nevisi², Reza Salehi³, Diego Martín^3,*, Zahra Halimi⁴, Sahba Baniasadi⁵

CMC-Computers, Materials & Continua, Vol.79, No.3, pp. 3469-3493, 2024, DOI:10.32604/cmc.2024.049847

Abstract Hyperspectral (HS) image classification plays a crucial role in numerous areas including remote sensing (RS), agriculture, and the monitoring of the environment. Optimal band selection in HS images is crucial for improving the efficiency and accuracy of image classification. This process involves selecting the most informative spectral bands, which leads to a reduction in data volume. Focusing on these key bands also enhances the accuracy of classification algorithms, as redundant or irrelevant bands, which can introduce noise and lower model performance, are excluded. In this paper, we propose an approach for HS image classification using… More >

Shuming Sha^1,2, Naiwang Guo³, Wang Luo^1,2, Yong Zhang^1,2,*

CMC-Computers, Materials & Continua, Vol.79, No.3, pp. 5105-5124, 2024, DOI:10.32604/cmc.2024.049584

Abstract This paper focuses on the scheduling problem of workflow tasks that exhibit interdependencies. Unlike independent batch tasks, workflows typically consist of multiple subtasks with intrinsic correlations and dependencies. It necessitates the distribution of various computational tasks to appropriate computing node resources in accordance with task dependencies to ensure the smooth completion of the entire workflow. Workflow scheduling must consider an array of factors, including task dependencies, availability of computational resources, and the schedulability of tasks. Therefore, this paper delves into the distributed graph database workflow task scheduling problem and proposes a workflow scheduling methodology based… More >

Hantao Huang, Zhifang Zhang^*, Zhenhua Wu, Yao Liu

Structural Durability & Health Monitoring, Vol.18, No.4, pp. 409-423, 2024, DOI:10.32604/sdhm.2024.048597

Abstract In this paper, recycled carbon fiber reinforced polymer (CFRP) mixture (CFRP-M, including recycled carbon fiber and powder) and refined recycled CFRP fiber (CFRP-F, mostly recycled carbon fiber) were added to cement to study the influence of addition on the flexural strength, compressive strength, and fluidity of cement-based materials. The recycled CFRP were prepared by mechanically processing the prepreg scraps generated during the manufacture of CFRP products. For comparison, commercial carbon fiber powder was also added in cement and the performance was compared to that of addition of recycled CFRP. The hydration products and strengthening mechanism… More >

Guanfu Wang¹, Yudie Sun¹, Jinling Li^2,3,*, Yu Jiang¹, Chunhui Li¹, Huanan Yu^2,3, He Wang^2,3, Shiqiang Li^2,3

Energy Engineering, Vol.121, No.6, pp. 1671-1695, 2024, DOI:10.32604/ee.2024.047794

Abstract Traditional optimal scheduling methods are limited to accurate physical models and parameter settings, which are difficult to adapt to the uncertainty of source and load, and there are problems such as the inability to make dynamic decisions continuously. This paper proposed a dynamic economic scheduling method for distribution networks based on deep reinforcement learning. Firstly, the economic scheduling model of the new energy distribution network is established considering the action characteristics of micro-gas turbines, and the dynamic scheduling model based on deep reinforcement learning is constructed for the new energy distribution network system with a More >

Fuju Zhou^*, Li Li, Tengfei Jia, Yongchang Yin, Aixiang Shi, Shengrong Xu

Energy Engineering, Vol.121, No.6, pp. 1697-1711, 2024, DOI:10.32604/ee.2024.047680

Abstract When a line failure occurs in a power grid, a load transfer is implemented to reconfigure the network by changing the states of tie-switches and load demands. Computation speed is one of the major performance indicators in power grid load transfer, as a fast load transfer model can greatly reduce the economic loss of post-fault power grids. In this study, a reinforcement learning method is developed based on a deep deterministic policy gradient. The tedious training process of the reinforcement learning model can be conducted offline, so the model shows satisfactory performance in real-time operation, More >

Yunye Wan¹, Peng Chen², Yunni Xia^1,*, Yong Ma³, Dongge Zhu⁴, Xu Wang⁵, Hui Liu⁶, Weiling Li⁷, Xianhua Niu², Lei Xu⁸, Yumin Dong⁹

CMES-Computer Modeling in Engineering & Sciences, Vol.140, No.2, pp. 1997-2017, 2024, DOI:10.32604/cmes.2024.048723

Abstract Mobile Edge Computing (MEC) is a promising technology that provides on-demand computing and efficient storage services as close to end users as possible. In an MEC environment, servers are deployed closer to mobile terminals to exploit storage infrastructure, improve content delivery efficiency, and enhance user experience. However, due to the limited capacity of edge servers, it remains a significant challenge to meet the changing, time-varying, and customized needs for highly diversified content of users. Recently, techniques for caching content at the edge are becoming popular for addressing the above challenges. It is capable of filling… More >

Abdulghani M. Abdulghani, Mokhles M. Abdulghani, Wilbur L. Walters, Khalid H. Abed^*

Intelligent Automation & Soft Computing, Vol.39, No.2, pp. 337-352, 2024, DOI:10.32604/iasc.2024.047017

Abstract Multi-Agent Reinforcement Learning (MARL) has proven to be successful in cooperative assignments. MARL is used to investigate how autonomous agents with the same interests can connect and act in one team. MARL cooperation scenarios are explored in recreational cooperative augmented reality environments, as well as real-world scenarios in robotics. In this paper, we explore the realm of MARL and its potential applications in cooperative assignments. Our focus is on developing a multi-agent system that can collaborate to attack or defend against enemies and achieve victory with minimal damage. To accomplish this, we utilize the StarCraft… More >

Yutong Tian¹, Minghan Gao², Qiang Gao^1,*, Xiao-Hong Peng³

Intelligent Automation & Soft Computing, Vol.39, No.2, pp. 175-188, 2024, DOI:10.32604/iasc.2024.042762

Abstract How to find an effective trading policy is still an open question mainly due to the nonlinear and non-stationary dynamics in a financial market. Deep reinforcement learning, which has recently been used to develop trading strategies by automatically extracting complex features from a large amount of data, is struggling to deal with fast-changing markets due to sample inefficiency. This paper applies the meta-reinforcement learning method to tackle the trading challenges faced by conventional reinforcement learning (RL) approaches in non-stationary markets for the first time. In our work, the history trading data is divided into multiple… More >