Open Access iconOpen Access

ARTICLE

crossmark

Skeleton Split Strategies for Spatial Temporal Graph Convolution Networks

Motasem S. Alsawadi*, Miguel Rio

Electronic and Electrical Engineering Department, University College London, London, WC1E 7JE, England

* Corresponding Author: Motasem S. Alsawadi. Email: email

Computers, Materials & Continua 2022, 71(3), 4643-4658. https://doi.org/10.32604/cmc.2022.022783

Abstract

Action recognition has been recognized as an activity in which individuals’ behaviour can be observed. Assembling profiles of regular activities such as activities of daily living can support identifying trends in the data during critical events. A skeleton representation of the human body has been proven to be effective for this task. The skeletons are presented in graphs form-like. However, the topology of a graph is not structured like Euclidean-based data. Therefore, a new set of methods to perform the convolution operation upon the skeleton graph is proposed. Our proposal is based on the Spatial Temporal-Graph Convolutional Network (ST-GCN) framework. In this study, we proposed an improved set of label mapping methods for the ST-GCN framework. We introduce three split techniques (full distance split, connection split, and index split) as an alternative approach for the convolution operation. The experiments presented in this study have been trained using two benchmark datasets: NTU-RGB + D and Kinetics to evaluate the performance. Our results indicate that our split techniques outperform the previous partition strategies and are more stable during training without using the edge importance weighting additional training parameter. Therefore, our proposal can provide a more realistic solution for real-time applications centred on daily living recognition systems activities for indoor environments.

Keywords


Cite This Article

M. S. Alsawadi and M. Rio, "Skeleton split strategies for spatial temporal graph convolution networks," Computers, Materials & Continua, vol. 71, no.3, pp. 4643–4658, 2022.



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1397

    View

  • 790

    Download

  • 0

    Like

Share Link