Open Access

ARTICLE

Intelligent Risk-Identification Algorithm with Vision and 3D LiDAR Patterns at Damaged Buildings

by Dahyeon Kim¹, Jiyoung Min¹, Yongwoo Song¹, Chulsu Kim², Junho Ahn^1,*

1 Computer Information Technology, Korea National University of Transportation, Chungju, 27469, Korea
2 Department of Railway Vehicle System Engineering, Korea National University of Transportation, Uiwang, 16106, Korea

* Corresponding Author: Junho Ahn. Email:

Intelligent Automation & Soft Computing 2023, 36(2), 2315-2331. https://doi.org/10.32604/iasc.2023.034394

Received 15 July 2022; Accepted 29 September 2022; Issue published 05 January 2023

Abstract

Existing firefighting robots are focused on simple storage or fire suppression outside buildings rather than detection or recognition. Utilizing a large number of robots using expensive equipment is challenging. This study aims to increase the efficiency of search and rescue operations and the safety of firefighters by detecting and identifying the disaster site by recognizing collapsed areas, obstacles, and rescuers on-site. A fusion algorithm combining a camera and three-dimension light detection and ranging (3D LiDAR) is proposed to detect and localize the interiors of disaster sites. The algorithm detects obstacles by analyzing floor segmentation and edge patterns using a mask regional convolutional neural network (mask R-CNN) features model based on the visual data collected from a parallelly connected camera and 3D LiDAR. People as objects are detected using you only look once version 4 (YOLOv4) in the image data to localize persons requiring rescue. The point cloud data based on 3D LiDAR cluster the objects using the density-based spatial clustering of applications with noise (DBSCAN) clustering algorithm and estimate the distance to the actual object using the center point of the clustering result. The proposed artificial intelligence (AI) algorithm was verified based on individual sensors using a sensor-mounted robot in an actual building to detect floor surfaces, atypical obstacles, and persons requiring rescue. Accordingly, the fused AI algorithm was comparatively verified.

---

Keywords

---