Open Access

ARTICLE

Hyper-Heuristic Task Scheduling Algorithm Based on Reinforcement Learning in Cloud Computing

by Lei Yin¹, Chang Sun², Ming Gao³, Yadong Fang⁴, Ming Li¹, Fengyu Zhou^1,*

1 School of Control Science and Engineering, Shandong University, Jinan, 250061, Shandong, China
2 School of Software, Shandong University, Jinan, 250101, Shandong, China
3 Academy of Intelligent Innovation, Shandong University, Shunhua Road, Jinan, 250101, Shandong, China
4 Inspur Cloud Information Technology Co., Ltd., Inspur Group, Jinan, 250101, Shandong, China

* Corresponding Author: Fengyu Zhou. Email:

Intelligent Automation & Soft Computing 2023, 37(2), 1587-1608. https://doi.org/10.32604/iasc.2023.039380

Received 25 January 2023; Accepted 13 April 2023; Issue published 21 June 2023

Abstract

The solution strategy of the heuristic algorithm is pre-set and has good performance in the conventional cloud resource scheduling process. However, for complex and dynamic cloud service scheduling tasks, due to the difference in service attributes, the solution efficiency of a single strategy is low for such problems. In this paper, we presents a hyper-heuristic algorithm based on reinforcement learning (HHRL) to optimize the completion time of the task sequence. Firstly, In the reward table setting stage of HHRL, we introduce population diversity and integrate maximum time to comprehensively determine the task scheduling and the selection of low-level heuristic strategies. Secondly, a task computational complexity estimation method integrated with linear regression is proposed to influence task scheduling priorities. Besides, we propose a high-quality candidate solution migration method to ensure the continuity and diversity of the solving process. Compared with HHSA, ACO, GA, F-PSO, etc, HHRL can quickly obtain task complexity, select appropriate heuristic strategies for task scheduling, search for the the best makspan and have stronger disturbance detection ability for population diversity.

---

Keywords

---