Home / Advanced Search

  • Title/Keywords

  • Author/Affliations

  • Journal

  • Article Type

  • Start Year

  • End Year

Update SearchingClear
  • Articles
  • Online
Search Results (80)
  • Open Access

    ARTICLE

    A Deep Reinforcement Learning-Based Partitioning Method for Power System Parallel Restoration

    Changcheng Li1,2, Weimeng Chang1,2, Dahai Zhang1,*, Jinghan He1

    Energy Engineering, Vol.123, No.1, 2026, DOI:10.32604/ee.2025.069389 - 27 December 2025

    Abstract Effective partitioning is crucial for enabling parallel restoration of power systems after blackouts. This paper proposes a novel partitioning method based on deep reinforcement learning. First, the partitioning decision process is formulated as a Markov decision process (MDP) model to maximize the modularity. Corresponding key partitioning constraints on parallel restoration are considered. Second, based on the partitioning objective and constraints, the reward function of the partitioning MDP model is set by adopting a relative deviation normalization scheme to reduce mutual interference between the reward and penalty in the reward function. The soft bonus scaling mechanism… More >

  • Open Access

    ARTICLE

    A Multi-Objective Adaptive Car-Following Framework for Autonomous Connected Vehicles with Deep Reinforcement Learning

    Abu Tayab1,*, Yanwen Li1, Ahmad Syed2, Ghanshyam G. Tejani3,4,*, Doaa Sami Khafaga5, El-Sayed M. El-kenawy6, Amel Ali Alhussan7, Marwa M. Eid8,9

    CMC-Computers, Materials & Continua, Vol.86, No.2, pp. 1-27, 2026, DOI:10.32604/cmc.2025.070583 - 09 December 2025

    Abstract Autonomous connected vehicles (ACV) involve advanced control strategies to effectively balance safety, efficiency, energy consumption, and passenger comfort. This research introduces a deep reinforcement learning (DRL)-based car-following (CF) framework employing the Deep Deterministic Policy Gradient (DDPG) algorithm, which integrates a multi-objective reward function that balances the four goals while maintaining safe policy learning. Utilizing real-world driving data from the highD dataset, the proposed model learns adaptive speed control policies suitable for dynamic traffic scenarios. The performance of the DRL-based model is evaluated against a traditional model predictive control-adaptive cruise control (MPC-ACC) controller. Results show that the… More >

  • Open Access

    ARTICLE

    DRL-Based Cross-Regional Computation Offloading Algorithm

    Lincong Zhang1, Yuqing Liu1, Kefeng Wei2, Weinan Zhao1, Bo Qian1,*

    CMC-Computers, Materials & Continua, Vol.86, No.1, pp. 1-18, 2026, DOI:10.32604/cmc.2025.069108 - 10 November 2025

    Abstract In the field of edge computing, achieving low-latency computational task offloading with limited resources is a critical research challenge, particularly in resource-constrained and latency-sensitive vehicular network environments where rapid response is mandatory for safety-critical applications. In scenarios where edge servers are sparsely deployed, the lack of coordination and information sharing often leads to load imbalance, thereby increasing system latency. Furthermore, in regions without edge server coverage, tasks must be processed locally, which further exacerbates latency issues. To address these challenges, we propose a novel and efficient Deep Reinforcement Learning (DRL)-based approach aimed at minimizing average… More >

  • Open Access

    ARTICLE

    Energy Optimization for Autonomous Mobile Robot Path Planning Based on Deep Reinforcement Learning

    Longfei Gao*, Weidong Wang, Dieyun Ke

    CMC-Computers, Materials & Continua, Vol.86, No.1, pp. 1-15, 2026, DOI:10.32604/cmc.2025.068873 - 10 November 2025

    Abstract At present, energy consumption is one of the main bottlenecks in autonomous mobile robot development. To address the challenge of high energy consumption in path planning for autonomous mobile robots navigating unknown and complex environments, this paper proposes an Attention-Enhanced Dueling Deep Q-Network (AD-Dueling DQN), which integrates a multi-head attention mechanism and a prioritized experience replay strategy into a Dueling-DQN reinforcement learning framework. A multi-objective reward function, centered on energy efficiency, is designed to comprehensively consider path length, terrain slope, motion smoothness, and obstacle avoidance, enabling optimal low-energy trajectory generation in 3D space from the… More >

  • Open Access

    ARTICLE

    A Multi-Objective Deep Reinforcement Learning Algorithm for Computation Offloading in Internet of Vehicles

    Junjun Ren1, Guoqiang Chen2, Zheng-Yi Chai3, Dong Yuan4,*

    CMC-Computers, Materials & Continua, Vol.86, No.1, pp. 1-26, 2026, DOI:10.32604/cmc.2025.068795 - 10 November 2025

    Abstract Vehicle Edge Computing (VEC) and Cloud Computing (CC) significantly enhance the processing efficiency of delay-sensitive and computation-intensive applications by offloading compute-intensive tasks from resource-constrained onboard devices to nearby Roadside Unit (RSU), thereby achieving lower delay and energy consumption. However, due to the limited storage capacity and energy budget of RSUs, it is challenging to meet the demands of the highly dynamic Internet of Vehicles (IoV) environment. Therefore, determining reasonable service caching and computation offloading strategies is crucial. To address this, this paper proposes a joint service caching scheme for cloud-edge collaborative IoV computation offloading. By… More >

  • Open Access

    ARTICLE

    Enhancement of Frequency Regulation in AC-Excited Adjustable-Speed Pumped Storage Units during Pumping Operations

    Shuxin Tan1, Wei Yan2, Lei Zhao1, Xianglin Zhang3,*, Ziqiang Man2, Yu Lu2, Teng Liu2, Gaoyue Zhong2, Weiqun Liu2, Linjun Shi3

    Energy Engineering, Vol.122, No.12, pp. 5175-5197, 2025, DOI:10.32604/ee.2025.068692 - 27 November 2025

    Abstract The integration of large-scale renewable energy introduces frequency instability challenges due to inherent intermittency. While doubly-fed pumped storage units (DFPSUs) offer frequency regulation potential in pumping mode, conventional strategies fail to address hydraulic-mechanical coupling dynamics and operational constraints, limiting their effectiveness. This paper presents an innovative primary frequency control strategy for double-fed pumped storage units (DFPSUs) operating in pumping mode, integrating an adaptive parameter calculation method. This method is constrained by operational speed and power limits, addressing key performance factors. A dynamic model that incorporates the reversible pump-turbine characteristics is developed to translate frequency deviations… More >

  • Open Access

    ARTICLE

    Priority-Based Scheduling and Orchestration in Edge-Cloud Computing: A Deep Reinforcement Learning-Enhanced Concurrency Control Approach

    Mohammad A Al Khaldy1, Ahmad Nabot2, Ahmad Al-Qerem3,*, Mohammad Alauthman4, Amina Salhi5,*, Suhaila Abuowaida6, Naceur Chihaoui7

    CMES-Computer Modeling in Engineering & Sciences, Vol.145, No.1, pp. 673-697, 2025, DOI:10.32604/cmes.2025.070004 - 30 October 2025

    Abstract The exponential growth of Internet of Things (IoT) devices has created unprecedented challenges in data processing and resource management for time-critical applications. Traditional cloud computing paradigms cannot meet the stringent latency requirements of modern IoT systems, while pure edge computing faces resource constraints that limit processing capabilities. This paper addresses these challenges by proposing a novel Deep Reinforcement Learning (DRL)-enhanced priority-based scheduling framework for hybrid edge-cloud computing environments. Our approach integrates adaptive priority assignment with a two-level concurrency control protocol that ensures both optimal performance and data consistency. The framework introduces three key innovations: (1)… More >

  • Open Access

    ARTICLE

    A Lightweight Multimodal Deep Fusion Network for Face Antis Poofing with Cross-Axial Attention and Deep Reinforcement Learning Technique

    Diyar Wirya Omar Ameenulhakeem*, Osman Nuri Uçan

    CMC-Computers, Materials & Continua, Vol.85, No.3, pp. 5671-5702, 2025, DOI:10.32604/cmc.2025.070422 - 23 October 2025

    Abstract Face antispoofing has received a lot of attention because it plays a role in strengthening the security of face recognition systems. Face recognition is commonly used for authentication in surveillance applications. However, attackers try to compromise these systems by using spoofing techniques such as using photos or videos of users to gain access to services or information. Many existing methods for face spoofing face difficulties when dealing with new scenarios, especially when there are variations in background, lighting, and other environmental factors. Recent advancements in deep learning with multi-modality methods have shown their effectiveness in… More >

  • Open Access

    ARTICLE

    Mobility-Aware Edge Caching with Transformer-DQN in D2D-Enabled Heterogeneous Networks

    Yiming Guo, Hongyu Ma*

    CMC-Computers, Materials & Continua, Vol.85, No.2, pp. 3485-3505, 2025, DOI:10.32604/cmc.2025.067590 - 23 September 2025

    Abstract In dynamic 5G network environments, user mobility and heterogeneous network topologies pose dual challenges to the effort of improving performance of mobile edge caching. Existing studies often overlook the dynamic nature of user locations and the potential of device-to-device (D2D) cooperative caching, limiting the reduction of transmission latency. To address this issue, this paper proposes a joint optimization scheme for edge caching that integrates user mobility prediction with deep reinforcement learning. First, a Transformer-based geolocation prediction model is designed, leveraging multi-head attention mechanisms to capture correlations in historical user trajectories for accurate future location prediction.… More >

  • Open Access

    ARTICLE

    ELDE-Net: Efficient Light-Weight Depth Estimation Network for Deep Reinforcement Learning-Based Mobile Robot Path Planning

    Thai-Viet Dang1,*, Dinh-Manh-Cuong Tran1, Nhu-Nghia Bui1, Phan Xuan Tan2,*

    CMC-Computers, Materials & Continua, Vol.85, No.2, pp. 2651-2680, 2025, DOI:10.32604/cmc.2025.067500 - 23 September 2025

    Abstract Precise and robust three-dimensional object detection (3DOD) presents a promising opportunity in the field of mobile robot (MR) navigation. Monocular 3DOD techniques typically involve extending existing two-dimensional object detection (2DOD) frameworks to predict the three-dimensional bounding box (3DBB) of objects captured in 2D RGB images. However, these methods often require multiple images, making them less feasible for various real-time scenarios. To address these challenges, the emergence of agile convolutional neural networks (CNNs) capable of inferring depth from a single image opens a new avenue for investigation. The paper proposes a novel ELDE-Net network designed to… More >

Displaying 1-10 on page 1 of 80. Per Page