Semisupervised Speech Data Extraction from Basque Parliament Sessions and Validation on Fully Bilingual Basque–Spanish ASR
dc.contributor.author | Peñagarikano Badiola, Mikel ![]() | |
dc.contributor.author | Varona Fernández, Amparo | |
dc.contributor.author | Bordel García, German | |
dc.contributor.author | Rodríguez Fuentes, Luis Javier ![]() | |
dc.date.accessioned | 2023-08-01T08:47:56Z | |
dc.date.available | 2023-08-01T08:47:56Z | |
dc.date.issued | 2023-07-23 | |
dc.identifier.citation | Applied Sciences 13(14) : (2023) // Article ID 8492 | es_ES |
dc.identifier.issn | 2076-3417 | |
dc.identifier.uri | http://hdl.handle.net/10810/62077 | |
dc.description.abstract | In this paper, a semisupervised speech data extraction method is presented and applied to create a new dataset designed for the development of fully bilingual Automatic Speech Recognition (ASR) systems for Basque and Spanish. The dataset is drawn from an extensive collection of Basque Parliament plenary sessions containing frequent code switchings. Since session minutes are not exact, only the most reliable speech segments are kept for training. To that end, we use phonetic similarity scores between nominal and recognized phone sequences. The process starts with baseline acoustic models trained on generic out-of-domain data, then iteratively updates the models with the extracted data and applies the updated models to refine the training dataset until the observed improvement between two iterations becomes small enough. A development dataset, involving five plenary sessions not used for training, has been manually audited for tuning and evaluation purposes. Cross-validation experiments (with 20 random partitions) have been carried out on the development dataset, using the baseline and the iteratively updated models. On average, Word Error Rate (WER) reduces from 16.57% (baseline) to 4.41% (first iteration) and further to 4.02% (second iteration), which corresponds to relative WER reductions of 73.4% and 8.8%, respectively. When considering only Basque segments, WER reduces on average from 16.57% (baseline) to 5.51% (first iteration) and further to 5.13% (second iteration), which corresponds to relative WER reductions of 66.7% and 6.9%, respectively. As a result of this work, a new bilingual Basque–Spanish resource has been produced based on Basque Parliament sessions, including 998 h of training data (audio segments + transcriptions), a development set (17 h long) designed for tuning and evaluation under a cross-validation scheme and a fully bilingual trigram language model. | es_ES |
dc.description.sponsorship | This work was partially funded by the Spanish Ministry of Science and Innovation (OPEN-SPEECH project, PID2019-106424RB-I00) and by the Basque Government under the general support program to research groups (IT-1704-22). | es_ES |
dc.language.iso | eng | es_ES |
dc.publisher | MDPI | es_ES |
dc.relation | info:eu-repo/grantAgreement/MICINN/PID2019-106424RB-I00 | es_ES |
dc.rights | info:eu-repo/semantics/openAccess | es_ES |
dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | |
dc.subject | automatic speech recognition | es_ES |
dc.subject | multilingual speech | es_ES |
dc.subject | low-resource languages | es_ES |
dc.subject | code switching | es_ES |
dc.subject | semisupervised learning | es_ES |
dc.subject | spoken language resources | es_ES |
dc.title | Semisupervised Speech Data Extraction from Basque Parliament Sessions and Validation on Fully Bilingual Basque–Spanish ASR | es_ES |
dc.type | info:eu-repo/semantics/article | es_ES |
dc.date.updated | 2023-07-28T12:22:26Z | |
dc.rights.holder | © 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/ 4.0/). | es_ES |
dc.relation.publisherversion | https://www.mdpi.com/2076-3417/13/14/8492 | es_ES |
dc.identifier.doi | 10.3390/app13148492 | |
dc.departamentoes | Electricidad y electrónica | |
dc.departamentoeu | Elektrizitatea eta elektronika |
Files in this item
This item appears in the following Collection(s)
Except where otherwise noted, this item's license is described as © 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/ 4.0/).