Open Access

ARTICLE

Binaural Sound Source Localization Based on Convolutional Neural Network

Lin Zhou^1,*, Kangyu Ma¹, Lijie Wang¹, Ying Chen^1,2, Yibin Tang³

1 School of Information Science and Engineering, Southeast University, Nanjing, 210096, China.
2 Department of Psychiatry, Columbia University and NYSPI, New York, 10032, USA.
3 College of Internet of Things Engineering, Hohai University, Changzhou, 213022, China.

* Corresponding Author: Lin Zhou. Email: .

Computers, Materials & Continua 2019, 60(2), 545-557. https://doi.org/10.32604/cmc.2019.05969

Abstract

Binaural sound source localization (BSSL) in low signal-to-noise ratio (SNR) and high reverberation environment is still a challenging task. In this paper, a novel BSSL algorithm is proposed by introducing convolutional neural network (CNN). The proposed algorithm first extracts the spatial feature of each sub-band from binaural sound signal, and then combines the features of all sub-bands within one frame to assemble a two-dimensional feature matrix as a grey image. To fully exploit the advantage of the CNN in extracting high-level features from the grey image, the spatial feature matrix of each frame is used as input to train the CNN model. The CNN is then used to predict azimuth of sound source. The experiments show that the proposed algorithm significantly improves the localization performance of BSSL in various acoustic environments, especially to deal with low SNR and high reverberation conditions.

---

Keywords

---

Citations