Open Access

ARTICLE

3D Vehicle Detection Algorithm Based on Multimodal Decision-Level Fusion

by Peicheng Shi^1,*, Heng Qi¹, Zhiqiang Liu¹, Aixi Yang²

1 School of Mechanical Engineering, Anhui Polytechnic University, Wuhu, 241000, China
2 Department Polytechnic Institute of Zhejiang University, Hangzhou, 310000, China

* Corresponding Author: Peicheng Shi. Email:

Computer Modeling in Engineering & Sciences 2023, 135(3), 2007-2023. https://doi.org/10.32604/cmes.2023.022304

Received 03 March 2022; Accepted 01 August 2022; Issue published 23 November 2022

Abstract

3D vehicle detection based on LiDAR-camera fusion is becoming an emerging research topic in autonomous driving. The algorithm based on the Camera-LiDAR object candidate fusion method (CLOCs) is currently considered to be a more effective decision-level fusion algorithm, but it does not fully utilize the extracted features of 3D and 2D. Therefore, we proposed a 3D vehicle detection algorithm based on multimodal decision-level fusion. First, project the anchor point of the 3D detection bounding box into the 2D image, calculate the distance between 2D and 3D anchor points, and use this distance as a new fusion feature to enhance the feature redundancy of the network. Subsequently, add an attention module: squeeze-and-excitation networks, weight each feature channel to enhance the important features of the network, and suppress useless features. The experimental results show that the mean average precision of the algorithm in the KITTI dataset is 82.96%, which outperforms previous state-of-the-art multimodal fusion-based methods, and the average accuracy in the Easy, Moderate and Hard evaluation indicators reaches 88.96%, 82.60%, and 77.31%, respectively, which are higher compared to the original CLOCs model by 1.02%, 2.29%, and 0.41%, respectively. Compared with the original CLOCs algorithm, our algorithm has higher accuracy and better performance in 3D vehicle detection.

---

Graphic Abstract

---

Keywords

---