Open Access


Data-Driven Self-Learning Controller for Power-Aware Mobile Monitoring IoT Devices

Michal Prauzek*, Tereza Paterova, Jaromir Konecny, Radek Martinek
VSB–Technical University of Ostrava, Department of Cybernetics and Biomedical Engineering, Ostrava, 708 00, Czech Republic
* Corresponding Author: Michal Prauzek. Email:

Computers, Materials & Continua 2022, 70(2), 2601-2618.

Received 22 April 2021; Accepted 22 June 2021; Issue published 27 September 2021


Nowadays, there is a significant need for maintenance free modern Internet of things (IoT) devices which can monitor an environment. IoT devices such as these are mobile embedded devices which provide data to the internet via Low Power Wide Area Network (LPWAN). LPWAN is a promising communications technology which allows machine to machine (M2M) communication and is suitable for small mobile embedded devices. The paper presents a novel data-driven self-learning (DDSL) controller algorithm which is dedicated to controlling small mobile maintenance-free embedded IoT devices. The DDSL algorithm is based on a modified Q-learning algorithm which allows energy efficient data-driven behavior of mobile embedded IoT devices. The aim of the DDSL algorithm is to dynamically set operation duty cycles according to the estimation of future collected data values, leading to effective operation of power-aware systems. The presented novel solution was tested on a historical data set and compared with a fixed duty cycle reference algorithm. The root mean square error (RMSE) and measurements parameters considered for the DDSL algorithm were compared to a reference algorithm and two independent criteria (the performance score parameter and normalized geometric distance) were used for overall evaluation and comparison. The experiments showed that the novel DDSL method reaches significantly lower RMSE while the number of transmitted data count is less than or equal to the fixed duty cycle algorithm. The overall criteria performance score is 40% higher than the reference algorithm base on static confirmation settings.


5G and beyond wireless; IoT; LPWAN; M2M; Q-learning

Cite This Article

M. Prauzek, T. Paterova, J. Konecny and R. Martinek, "Data-driven self-learning controller for power-aware mobile monitoring iot devices," Computers, Materials & Continua, vol. 70, no.2, pp. 2601–2618, 2022.

This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 811


  • 646


  • 0


Share Link

WeChat scan