Open Access iconOpen Access

ARTICLE

crossmark

An Improved Two-stream Inflated 3D ConvNet for Abnormal Behavior Detection

Jiahui Pan1,2,*, Liangxin Liu1, Mianfen Lin1, Shengzhou Luo1, Chengju Zhou1, Huijian Liao3, Fei Wang1,2

1 School of Software, South China Normal University, Foshan, 528225, China
2 Pazhou Lab, Guangzhou, 510330, China
3 Department of Mechanical, Materials and Manufacturing Engineering, University of Nottingham, Nottingham, NG7 2RD, United Kingdom

* Corresponding Author: Jiahui Pan. Email: email

Intelligent Automation & Soft Computing 2021, 30(2), 673-688. https://doi.org/10.32604/iasc.2021.020240

Abstract

Abnormal behavior detection is an essential step in a wide range of application domains, such as smart video surveillance. In this study, we proposed an improved two-stream inflated 3D ConvNet network approach based on probability regression for abnormal behavior detection. The proposed approach consists of four parts: (1) preprocessing pretreatment for the input video; (2) dynamic feature extraction from video streams using a two-stream inflated 3D (I3D) ConvNet network; (3) visual feature transfer into a two-dimensional matrix; and (4) feature classification using a generalized regression neural network (GRNN), which ultimately achieves a probability regression. Compared with the traditional methods, two-stream I3D feature extraction technology is better able to extract visual features and retain the optical flow and red, green and blue (RGB) information in the video. Probabilistic regression technology is better able to quantify data and provide a more intuitive visual experience. The experimental results on 50 detection cases from the UCF-Crime dataset show that the developed model obtains a high average abnormal behavior recognition accuracy. The improved I3D models obtain an average accuracy of 93.7% based on UCF-101, which outperforms the state-of-the-art methods, verifying the robustness and effectiveness of our approach.

Keywords


Cite This Article

J. Pan, L. Liu, M. Lin, S. Luo, C. Zhou et al., "An improved two-stream inflated 3d convnet for abnormal behavior detection," Intelligent Automation & Soft Computing, vol. 30, no.2, pp. 673–688, 2021.

Citations




cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1380

    View

  • 965

    Download

  • 1

    Like

Share Link