Johnson Kinyua¹, Lawrence Awuah^2,*

Intelligent Automation & Soft Computing, Vol.28, No.2, pp. 527-545, 2021, DOI:10.32604/iasc.2021.016240

Abstract Today’s cyber defense capabilities in many organizations consist of a diversity of tools, products, and solutions, which are very challenging for Security Operations Centre (SOC) teams to manage in current advanced and dynamic cyber threat environments. Security researchers and industry practitioners have proposed security orchestration, automation, and response (SOAR) solutions designed to integrate and automate the disparate security tasks, processes, and applications in response to security incidents to empower SOC teams. The next big step for cyber threat detection, mitigation, and prevention efforts is to leverage AI/ML in SOAR solutions. AI/ML will act as a force multiplier empowering SOC analysts… More >

Chunli Yin^1,*, Jinglong Han²

CMES-Computer Modeling in Engineering & Sciences, Vol.127, No.1, pp. 291-307, 2021, DOI:10.32604/cmes.2021.014347

Abstract With the continuous development of artificial intelligence technology, its application field has gradually expanded. To further apply the deep reinforcement learning technology to the field of dynamic pricing, we build an intelligent dynamic pricing system, introduce the reinforcement learning technology related to dynamic pricing, and introduce existing research on the number of suppliers (single supplier and multiple suppliers), environmental models, and selection algorithms. A two-period dynamic pricing game model is designed to assess the optimal pricing strategy for e-commerce platforms under two market conditions and two consumer participation conditions. The first step is to analyze the pricing strategies of e-commerce… More >

Jiongzhi Yang, Srivatsa Harish, Candy Li, Hengduo Zhao, Brittney Antous, Pinar Acar^*

CMC-Computers, Materials & Continua, Vol.68, No.1, pp. 1285-1302, 2021, DOI:10.32604/cmc.2021.016829

Abstract This paper presents a de-novo computational design method driven by deep reinforcement learning to achieve reliable predictions and optimum properties for periodic microstructures. With recent developments in 3-D printing, microstructures can have complex geometries and material phases fabricated to achieve targeted mechanical performance. These material property enhancements are promising in improving the mechanical, thermal, and dynamic performance in multiple engineering systems, ranging from energy harvesting applications to spacecraft components. The study investigates a novel and efficient computational framework that integrates deep reinforcement learning algorithms into finite element-based material simulations to quantitatively model and design 3-D printed periodic microstructures. These algorithms… More >

Yingya Guo^1,2,3,7, Kai Huang¹, Cheng Hu^4,*, Jiangyuan Yao⁵, Siyu Zhou⁶

CMC-Computers, Materials & Continua, Vol.68, No.1, pp. 655-670, 2021, DOI:10.32604/cmc.2021.016364

Abstract The emergence of Segment Routing (SR) provides a novel routing paradigm that uses a routing technique called source packet routing. In SR architecture, the paths that the packets choose to route on are indicated at the ingress router. Compared with shortest-path-based routing in traditional distributed routing protocols, SR can realize a flexible routing by implementing an arbitrary flow splitting at the ingress router. Despite the advantages of SR, it may be difficult to update the existing IP network to a full SR deployed network, for economical and technical reasons. Updating partial of the traditional IP network to the SR network,… More >

Arslan Musaddiq¹, Rashid Ali², Jin-Ghoo Choi¹, Byung-Seo Kim^3,*, Sung-Won Kim¹

CMC-Computers, Materials & Continua, Vol.67, No.1, pp. 799-814, 2021, DOI:10.32604/cmc.2021.014751

Abstract The Internet of Things (IoT) has numerous applications in every domain, e.g., smart cities to provide intelligent services to sustainable cities. The next-generation of IoT networks is expected to be densely deployed in a resource-constrained and lossy environment. The densely deployed nodes producing radically heterogeneous traffic pattern causes congestion and collision in the network. At the medium access control (MAC) layer, mitigating channel collision is still one of the main challenges of future IoT networks. Similarly, the standardized network layer uses a ranking mechanism based on hop-counts and expected transmission counts (ETX), which often does not adapt to the dynamic… More >

Janyl Jumadinova¹, Oliver Bonham-Carter¹, Hanzhong Zheng^1,2,*, Michael Camara¹, Dejie Shi³

Journal on Big Data, Vol.2, No.4, pp. 145-155, 2020, DOI:10.32604/jbd.2020.010090

Abstract Text mining has emerged as an effective method of handling and extracting useful information from the exponentially growing biomedical literature and biomedical databases. We developed a novel biomedical text mining model implemented by a multi-agent system and distributed computing mechanism. Our distributed system, TextMed, comprises of several software agents, where each agent uses a reinforcement learning method to update the sentiment of relevant text from a particular set of research articles related to specific keywords. TextMed can also operate on different physical machines to expedite its knowledge extraction by utilizing a clustering technique. We collected the biomedical textual data from… More >

Xuting Duan^1,2, Yuanhao Zhao^1,2, Kunxian Zheng^1,2,*, Daxin Tian^1,2, Jianshan Zhou^1,2,3, Jian Gao⁴

CMC-Computers, Materials & Continua, Vol.66, No.2, pp. 2127-2140, 2021, DOI:10.32604/cmc.2020.014484

Abstract Dynamic channel assignment (DCA) is significant for extending vehicular ad hoc network (VANET) capacity and mitigating congestion. However, the un-known global state information and the lack of centralized control make channel assignment performances a challenging task in a distributed vehicular direct communication scenario. In our preliminary field test for communication under V2X scenario, we find that the existing DCA technology cannot fully meet the communication performance requirements of VANET. In order to improve the communication performance, we firstly demonstrate the feasibility and potential of reinforcement learning (RL) method in joint channel selection decision and access fallback adaptation design in this… More >

Ehab Mahmoud Mohamed^{1, 2, *}, Sherief Hashima^{3, 4}, Kohei Hatano^{3, 5}, Hani Kasban⁴, Mohamed Rihan⁶

CMC-Computers, Materials & Continua, Vol.65, No.3, pp. 1987-2007, 2020, DOI:10.32604/cmc.2020.011816

Abstract The communication in the Millimeter-wave (mmWave) band, i.e., 30~300 GHz, is characterized by short-range transmissions and the use of antenna beamforming (BF). Thus, multiple mmWave access points (APs) should be installed to fully cover a target environment with gigabits per second (Gbps) connectivity. However, inter-beam interference prevents maximizing the sum rates of the established concurrent links. In this paper, a reinforcement learning (RL) approach is proposed for enabling mmWave concurrent transmissions by finding out beam directions that maximize the long-term average sum rates of the concurrent links. Specifically, the problem is formulated as a multiplayer multiarmed bandit (MAB), where mmWave… More >

Li Li^1,*, Yifei Wei¹, Lianping Zhang², Xiaojun Wang³

Journal of Cyber Security, Vol.2, No.3, pp. 141-150, 2020, DOI:10.32604/jcs.2020.010764

Abstract The rapid growth of Internet content, applications and services require more computing and storage capacity and higher bandwidth. Traditionally, internet services are provided from the cloud (i.e., from far away) and consumed on increasingly smart devices. Edge computing and caching provides these services from nearby smart devices. Blending both approaches should combine the power of cloud services and the responsiveness of edge networks. This paper investigates how to intelligently use the caching and computing capabilities of edge nodes/cloudlets through the use of artificial intelligence-based policies. We first analyze the scenarios of mobile edge networks with edge computing and caching abilities,… More >

Wanxin Zhang^1,*, Jihong Zhu²

CMES-Computer Modeling in Engineering & Sciences, Vol.124, No.3, pp. 1119-1130, 2020, DOI:10.32604/cmes.2020.010986

Abstract With the increasing demand for the automation of operations and processes in mechatronic systems, fault detection and diagnosis has become a major topic to guarantee the process performance. There exist numerous studies on the topic of applying artificial intelligence methods for fault detection and diagnosis. However, much of the focus has been given on the detection of faults. In terms of the diagnosis of faults, on one hand, assumptions are required, which restricts the diagnosis range. On the other hand, different faults with similar symptoms cannot be distinguished, especially when the model is not trained by plenty of data. In… More >