Open Access

ARTICLE

Multi-Modality and Feature Fusion-Based COVID-19 Detection Through Long Short-Term Memory

Noureen Fatima¹, Rashid Jahangir², Ghulam Mujtaba¹, Adnan Akhunzada^3,*, Zahid Hussain Shaikh⁴, Faiza Qureshi¹

1 Center of Excellence for Robotics, Artificial Intelligence, and Blockchain, Department of Computer Science, Sukkur IBA University, Sukkur, Pakistan
2 Department of Computer Science, COMSATS University Islamabad–Vehari Campus, Pakistan
3 Faculty of Computing and Informatics, University Malaysia Sabah, Kota Kinabalu, 88400, Malaysia
4 Department of Mathematics, Sukkur IBA University, Sukkur, Pakistan

* Corresponding Author: Adnan Akhunzada. Email:

Computers, Materials & Continua 2022, 72(3), 4357-4374. https://doi.org/10.32604/cmc.2022.023830

Received 23 September 2021; Accepted 29 December 2021; Issue published 21 April 2022

Abstract

The Coronavirus Disease 2019 (COVID-19) pandemic poses the worldwide challenges surpassing the boundaries of country, religion, race, and economy. The current benchmark method for the detection of COVID-19 is the reverse transcription polymerase chain reaction (RT-PCR) testing. Nevertheless, this testing method is accurate enough for the diagnosis of COVID-19. However, it is time-consuming, expensive, expert-dependent, and violates social distancing. In this paper, this research proposed an effective multi-modality-based and feature fusion-based (MMFF) COVID-19 detection technique through deep neural networks. In multi-modality, we have utilized the cough samples, breathe samples and sound samples of healthy as well as COVID-19 patients from publicly available COSWARA dataset. Extensive set of experimental analyses were performed to evaluate the performance of our proposed approach. Several useful features were extracted from the aforementioned modalities that were then fed as an input to long short-term memory recurrent neural network algorithms for the classification purpose. Extensive set of experimental analyses were performed to evaluate the performance of our proposed approach. The experimental results showed that our proposed approach outperformed compared to four baseline approaches published recently. We believe that our proposed technique will assists potential users to diagnose the COVID-19 without the intervention of any expert in minimum amount of time.

---

Keywords

---