Open Access

ARTICLE

An Improved Two-stream Inflated 3D ConvNet for Abnormal Behavior Detection

by Jiahui Pan^1,2,*, Liangxin Liu¹, Mianfen Lin¹, Shengzhou Luo¹, Chengju Zhou¹, Huijian Liao³, Fei Wang^1,2

1 School of Software, South China Normal University, Foshan, 528225, China
2 Pazhou Lab, Guangzhou, 510330, China
3 Department of Mechanical, Materials and Manufacturing Engineering, University of Nottingham, Nottingham, NG7 2RD, United Kingdom

* Corresponding Author: Jiahui Pan. Email:

Intelligent Automation & Soft Computing 2021, 30(2), 673-688. https://doi.org/10.32604/iasc.2021.020240

Received 16 May 2021; Accepted 18 June 2021; Issue published 11 August 2021

Abstract

Abnormal behavior detection is an essential step in a wide range of application domains, such as smart video surveillance. In this study, we proposed an improved two-stream inflated 3D ConvNet network approach based on probability regression for abnormal behavior detection. The proposed approach consists of four parts: (1) preprocessing pretreatment for the input video; (2) dynamic feature extraction from video streams using a two-stream inflated 3D (I3D) ConvNet network; (3) visual feature transfer into a two-dimensional matrix; and (4) feature classification using a generalized regression neural network (GRNN), which ultimately achieves a probability regression. Compared with the traditional methods, two-stream I3D feature extraction technology is better able to extract visual features and retain the optical flow and red, green and blue (RGB) information in the video. Probabilistic regression technology is better able to quantify data and provide a more intuitive visual experience. The experimental results on 50 detection cases from the UCF-Crime dataset show that the developed model obtains a high average abnormal behavior recognition accuracy. The improved I3D models obtain an average accuracy of 93.7% based on UCF-101, which outperforms the state-of-the-art methods, verifying the robustness and effectiveness of our approach.

---

Keywords

---

Citations