Please use this identifier to cite or link to this item:
Title: Code-switching detection using multilingual DNNS
Authors: Yilmaz E. 
Henk van den Heuvel
David van Leeuwen
Keywords: Language contact, multilingual DNN, code-switching, Frisian, under-resourced languages
Issue Date: 7-Feb-2017
Publisher: Institute of Electrical and Electronics Engineers Inc.
Citation: Yilmaz E., Henk van den Heuvel, David van Leeuwen (2017-02-07). Code-switching detection using multilingual DNNS. IEEE Workshop on Spoken Language Technology (SLT) : 610-616. ScholarBank@NUS Repository.
Abstract: Automatic speech recognition (ASR) of code-switching speech requires careful handling of unexpected language switches that may occur in a single utterance. In this paper, we investigate the feasibility of using multilingually trained deep neural networks (DNN) for the ASR of Frisian speech containing code-switches to Dutch with the aim of building a robust recognizer that can handle this phenomenon. For this purpose, we train several multilingual DNN models on Frisian and two closely related languages, namely English and Dutch, to compare the impact of single-step and two-step multilingual DNN training on the recognition and code-switching detection performance. We apply bilingual DNN retraining on both target languages by varying the amount of training data belonging to the higher-resourced target language (Dutch). The recognition results show that the multilingual DNN training scheme with an initial multilingual training step followed by bilingual retraining provides recognition performance comparable to an oracle baseline recognizer that can employ language-specific acoustic models. We further show that we can detect code-switches at the word level with an equal error rate of around 17% excluding the deletions due to ASR errors.
Source Title: IEEE Workshop on Spoken Language Technology (SLT)
ISBN: 9781509049035
DOI: 10.1109/SLT.2016.7846326
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
SLT2016.pdf424.9 kBAdobe PDF




checked on Aug 8, 2018

Page view(s)

checked on Aug 9, 2018


checked on Aug 9, 2018

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.