Korean Singing Voice Synthesis Based on Auto-Regressive Boundary Equilibrium GAN

Cited 0 time in webofscience Cited 0 time in scopus
  • Hit : 78
  • Download : 0
Singing voice synthesis is a generative task that involves not only multidimensional controls of a singer model such as phonetic modulation by lyrics and pitch control by music score but also expressive elements such as breath sounds and vibrato. Recently, end-to-end learning models based on generative adversarial network (GAN) have drawn much interest as it requires less domain-specific processing but provides high sound quality. When GAN is applied to the audio domain, it entails several issues: the choice of audio representation to generate, handling temporal continuity between two adjacent outputs, and finding an effective loss metric for the audio representation. In this paper, we propose a Korean singing voice synthesis system that addresses the issues using an auto-regressive algorithm that generates spectrogram with the boundary equilibrium GAN objective. Through the qualitative test, we show the proposed methods are superior to the original GAN objective and non-auto-regressive model. We also show that our proposed method can render natural expressions such as continuous pitch contours and breath sounds.
Publisher
IEEE
Issue Date
2020-05-07
Language
English
Citation

International Conference on Acoustics, Speech and Signal Processing (ICASSP)

DOI
10.1109/ICASSP40776.2020.9053950
URI
http://hdl.handle.net/10203/274607
Appears in Collection
GCT-Conference Papers(학술회의논문)
Files in This Item
There are no files associated with this item.

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0