Christopher C. Rosser, Wilbur L. Walters, Abdulghani M. Abdulghani, Mokhles M. Abdulghani, Khalid H. Abed^*

Journal on Artificial Intelligence, Vol.4, No.4, pp. 261-277, 2022, DOI:10.32604/jai.2022.039703

Abstract Intrinsic motivation helps autonomous exploring agents traverse a larger portion of their environments. However, simulations of different learning environments in previous research show that after millions of timesteps of successful training, an intrinsically motivated agent may learn to act in ways unintended by the designer. This potential for unintended actions of autonomous exploring agents poses threats to the environment and humans if operated in the real world. We investigated this topic by using Unity’s Machine Learning Agent Toolkit (ML-Agents) implementation of the Proximal Policy Optimization (PPO) algorithm with the Intrinsic Curiosity Module (ICM) to train autonomous exploring agents in three… More >

Claire Prudhomme¹ , Ana Roxin² , Christophe Cruz² , Frank Boochs¹

Revue Internationale de Géomatique, Vol.30, No.1, pp. 37-65, 2020, DOI:10.3166/rig.2020.00102

Abstract Disaster management requires collaborative preparedness among the various stakeholders. Collaborative exercises aim to train stakeholders to apply the plans prepared and to identify potential problems and areas for improvement. As these exercises are costly, computer simulation is an interesting tool to optimize preparation through a wider variety of contexts. However, research on simulation and disaster management focuses on a particular problem rather than on the overall optimization of the plans prepared. This limitation is explained by the challenge of creating a simulation model that can represent and adapt to a wide variety of plans from various disciplines. The work presented… More >

Hélène Mathian¹, Lena Sanders²

Revue Internationale de Géomatique, Vol.31, No.1, pp. 21-45, 2022, DOI:10.3166/RIG.31.21-45

Abstract The aim of this article is to compare a statistical approach, “geometric data analysis” (GDA), and a simulation approach, the multi-agent systems (MAS), considered as representative, respectively, of a numerical and a symbolic approach of modelling. The case study concerns segregation of scholar space in the Parisian area. First the different steps leading from a thematic question to the development of an operational model to analyze this question are presented. The central and essential role of a conceptual framework at the interface of both is shown. Indeed, before operationalisation, it is necessary to verify the compatibility between the theoretical backgrounds… More >

Shen Guo^*, Wanxing Sheng, Shuaitao Bai, Jichuan Zhang, Peng Wang

Intelligent Automation & Soft Computing, Vol.37, No.1, pp. 799-814, 2023, DOI:10.32604/iasc.2023.038330

Abstract With the full development of disk-resident databases (DRDB) in recent years, it is widely used in business and transactional applications. In long-term use, some problems of disk databases are gradually exposed. For applications with high real-time requirements, the performance of using disk database is not satisfactory. In the context of the booming development of the Internet of things, domestic real-time databases have also gradually developed. Still, most of them only support the storage, processing, and analysis of data values with fewer data types, which can not fully meet the current industrial process control system data types, complex sources, fast update… More >

Hamida Litimein¹, Zhen-You Huang¹, Muhammad Shamrooz Aslam^2,*

Intelligent Automation & Soft Computing, Vol.37, No.1, pp. 321-341, 2023, DOI:10.32604/iasc.2023.036786

Abstract In this paper, we study the circular formation problem for the second-order multi-agent systems in a plane, in which the agents maintain a circular formation based on a probabilistic position. A distributed hybrid control protocol based on a probabilistic position is designed to achieve circular formation stabilization and consensus. In the current framework, the mobile agents follow the following rules: 1) the agent must follow a circular trajectory; 2) all the agents in the same circular trajectory must have the same direction. The formation control objective includes two parts: 1) drive all the agents to the circular formation; 2) avoid… More >

Ke Xu^1,2, Peng Liu^1,*, Hua Gong^1,2

Intelligent Automation & Soft Computing, Vol.36, No.3, pp. 3279-3294, 2023, DOI:10.32604/iasc.2023.036007

Abstract A two-agent production and transportation coordinated scheduling problem in a single-machine environment is suggested to compete for one machine from different downstream production links or various consumers. The jobs of two agents compete for the processing position on a machine, and after the processed, they compete for the transport position on a transport vehicle to be transported to two agents. The two agents have different objective functions. The objective function of the first agent is the sum of the makespan and the total transportation time, whereas the objective function of the second agent is the sum of the total completion… More >

Jaspreet Chawla^1,*, Anil Kr Ahlawat²

Intelligent Automation & Soft Computing, Vol.36, No.3, pp. 2787-2802, 2023, DOI:10.32604/iasc.2023.034775

Abstract Cloud computing has become one of the leading technologies in the world today. The benefits of cloud computing affect end users directly. There are several cloud computing frameworks, and each has ways of monitoring and providing resources. Cloud computing eliminates customer requirements such as expensive system configuration and massive infrastructure while improving dependability and scalability. From the user’s perspective, cloud computing makes it easy to upload multiagents and operate on different web services. In this paper, the authors used a restful web service and an agent system to discuss, deployments, and analysis of load performance parameters like memory use, central… More >

Adel Alshamrani^1,*, Abdullah Alshahrani²

Intelligent Automation & Soft Computing, Vol.36, No.3, pp. 2757-2771, 2023, DOI:10.32604/iasc.2023.032835

Abstract The static nature of cyber defense systems gives attackers a sufficient amount of time to explore and further exploit the vulnerabilities of information technology systems. In this paper, we investigate a problem where multiagent systems sensing and acting in an environment contribute to adaptive cyber defense. We present a learning strategy that enables multiple agents to learn optimal policies using multiagent reinforcement learning (MARL). Our proposed approach is inspired by the multiarmed bandits (MAB) learning technique for multiple agents to cooperate in decision making or to work independently. We study a MAB approach in which defenders visit a system multiple… More >

Zhengkai Ding^1,2, Qiming Fu^1,2,*, Jianping Chen^2,3,4,*, You Lu^1,2, Hongjie Wu¹, Nengwei Fang⁴, Bin Xing⁴

CMES-Computer Modeling in Engineering & Sciences, Vol.136, No.3, pp. 2759-2785, 2023, DOI:10.32604/cmes.2023.026091

Abstract The optimization of multi-zone residential heating, ventilation, and air conditioning (HVAC) control is not an easy task due to its complex dynamic thermal model and the uncertainty of occupant-driven cooling loads. Deep reinforcement learning (DRL) methods have recently been proposed to address the HVAC control problem. However, the application of single-agent DRL for multi-zone residential HVAC control may lead to non-convergence or slow convergence. In this paper, we propose MAQMC (Multi-Agent deep Q-network for multi-zone residential HVAC Control) to address this challenge with the goal of minimizing energy consumption while maintaining occupants’ thermal comfort. MAQMC is divided into MAQMC2 (MAQMC… More >

PRIYANKA SOLANKI¹, NISARG RANA¹, PRAKASH C. JHA², ANU MANHAS^1,*

BIOCELL, Vol.47, No.4, pp. 707-729, 2023, DOI:10.32604/biocell.2023.026615

Abstract Cancer is considered one of the most lethal diseases responsible for causing deaths worldwide. Although there have been many breakthroughs in anticancer development, cancer remains the major cause of death globally. In this regard, targeting cancer-causing enzymes is one of the efficient therapeutic strategies. Biological functions like cell cycle, transcription, metabolism, apoptosis, and other depend primarily on cyclin-dependent kinases (CDKs). These enzymes help in the replication of DNA in the normal cell cycle process, and deregulation in the functioning of any CDK can cause abnormal cell growth, which leads to cancer. This review is focused on anticancer drug discovery against… More >