Open Access

ARTICLE

A Deep Learning-Based Approach for Road Surface Damage Detection

Bakhytzhan Kulambayev^1,*, Gulbakhram Beissenova^2,3, Nazbek Katayev⁴, Bayan Abduraimova⁵, Lyazzat Zhaidakbayeva², Alua Sarbassova⁶, Oxana Akhmetova⁷, Sapar Issayev⁴, Laura Suleimenova⁸, Syrym Kasenov⁶, Kunsulu Shadinova⁹, Abay Shyrakbaev¹⁰

1 International Information Technology University, Almaty, Kazakhstan
2 M.Auezov South Kazakhstan University, Shymkent, Kazakhstan
3 University of Friendship of People’s Academician A. Kuatbekov, Shymkent, Kazakhstan
4 Kazakh National Women’s Teacher Training University, Almaty, Kazakhstan
5 L.N. Gumilyov Eurasian National University, Nur-Sultan, Kazakhstan
6 Al-Farabi Kazakh National University, Almaty, Kazakhstan
7 Abai Kazakh National Pedagogical University, Almaty, Kazakhstan
8 South Kazakhstan State Pedagogical University, Shymkent, Kazakhstan
9 Asfendiyarov Kazakh National Medical University, Almaty, Kazakhstan
10 International Taraz Innovative Institute, Taraz, Kazakhstan

* Corresponding Author: Bakhytzhan Kulambayev. Email:

Computers, Materials & Continua 2022, 73(2), 3403-3418. https://doi.org/10.32604/cmc.2022.029544

Received 06 March 2022; Accepted 07 May 2022; Issue published 16 June 2022

Abstract

Timely detection and elimination of damage in areas with excessive vehicle loading can reduce the risk of road accidents. Currently, various methods of photo and video surveillance are used to monitor the condition of the road surface. The manual approach to evaluation and analysis of the received data can take a protracted period of time. Thus, it is necessary to improve the procedures for inspection and assessment of the condition of control objects with the help of computer vision and deep learning techniques. In this paper, we propose a model based on Mask Region-based Convolutional Neural Network (Mask R-CNN) architecture for identifying defects of the road surface in the real-time mode. It shows the process of collecting and the features of the training samples and the deep neural network (DNN) training process, taking into account the specifics of the problems posed. For the software implementation of the proposed architecture, the Python programming language and the TensorFlow framework were utilized. The use of the proposed model is effective even in conditions of a limited amount of source data. Also as a result of experiments, a high degree of repeatability of the results was noted. According to the metrics, Mask R-CNN gave the high detection and segmentation results showing 0.9214, 0.9876, 0.9571 precision, recall, and F1-score respectively in road damage detection, and Intersection over Union (IoU)-0.3488 and Dice similarity coefficient-0.7381 in segmentation of road damages.

---

Keywords

---