Inter-channel Conv-TasNet for source-agnostic multichannel audio enhancement

Abstract

Deepneural network ( models for the audio enhancement task have been developed in various ways. Most of them rely on the source dependent characteristics, such as temporal or spectral characteristics of speeches, to suppress noises embedded in measure d signals. Only a few studies have attempted to exploit the spatial information embedded in multichannel data. In this work, we propose a DNN architecture that fully exploits inter channel relations to realize source agnostic audio enhancement. The propose d model is based on the fully convolutional time domain audio separation network (Conv TasNet) but extended to extract and learn spatial features from multichannel input signals. The use of spatial information is facilitated by separating each convolutiona l layer into dedicated inter channel 1x1 Conv blocks and 2D spectro temporal Conv blocks. The performance of the proposed model is verified through the training and test with heterogeneous datasets including speech and other audio datasets, which demonstra tes that the enriched spatial information from the proposed architecture enables versatile audio enhancement in a source agnostic way.