Open Access

ARTICLE

A Hybrid Duo-Deep Learning and Best Features Based Framework for Action Recognition

by Muhammad Naeem Akbar^1,*, Farhan Riaz¹, Ahmed Bilal Awan¹, Muhammad Attique Khan², Usman Tariq³, Saad Rehman²

1 National University of Sciences and Technology (NUST), Islamabad, 46000, Pakistan
2 Department of Computer Science, HITEC University, Taxila, Pakistan
3 College of Computer Engineering and Science, Prince Sattam Bin Abdulaziz University, Al-Kharaj 11942, Saudi Arabia

* Corresponding Author: Muhammad Naeem Akbar. Email:

Computers, Materials & Continua 2022, 73(2), 2555-2576. https://doi.org/10.32604/cmc.2022.028696

Received 15 February 2022; Accepted 06 April 2022; Issue published 16 June 2022

Abstract

Human Action Recognition (HAR) is a current research topic in the field of computer vision that is based on an important application known as video surveillance. Researchers in computer vision have introduced various intelligent methods based on deep learning and machine learning, but they still face many challenges such as similarity in various actions and redundant features. We proposed a framework for accurate human action recognition (HAR) based on deep learning and an improved features optimization algorithm in this paper. From deep learning feature extraction to feature classification, the proposed framework includes several critical steps. Before training fine-tuned deep learning models – MobileNet-V2 and Darknet53 – the original video frames are normalized. For feature extraction, pre-trained deep models are used, which are fused using the canonical correlation approach. Following that, an improved particle swarm optimization (IPSO)-based algorithm is used to select the best features. Following that, the selected features were used to classify actions using various classifiers. The experimental process was performed on six publicly available datasets such as KTH, UT-Interaction, UCF Sports, Hollywood, IXMAS, and UCF YouTube, which attained an accuracy of 98.3%, 98.9%, 99.8%, 99.6%, 98.6%, and 100%, respectively. In comparison with existing techniques, it is observed that the proposed framework achieved improved accuracy.

---

Keywords

---