Open Source State-Of-the-Art Solution for Romanian Speech Recognition
Abstract
In this work, we present a new state-of-the-art Romanian Automatic Speech Recognition (ASR) system based on NVIDIA's FastConformer architecture--explored here for the first time in the context of Romanian. We train our model on a large corpus of, mostly, weakly supervised transcriptions, totaling over 2,600 hours of speech. Leveraging a hybrid decoder with both Connectionist Temporal Classification (CTC) and Token-Duration Transducer (TDT) branches, we evaluate a range of decoding strategies including greedy, ALSD, and CTC beam search with a 6-gram token-level language model. Our system achieves state-of-the-art performance across all Romanian evaluation benchmarks, including read, spontaneous, and domain-specific speech, with up to 27% relative WER reduction compared to previous best-performing systems. In addition to improved transcription accuracy, our approach demonstrates practical decoding efficiency, making it suitable for both research and deployment in low-latency ASR applications.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The main contribution of this paper is the introduction of a state-of-the-art Romanian ASR system using the FastConformer architecture, achieving significant performance improvements across various benchmarks. This work not only advances the field of speech recognition for Romanian but also sets a precedent for future research in low-resource languages, showcasing the potential of modern architectures and hybrid decoding strategies.
Methodology
The paper presents a robust methodology by adapting the FastConformer architecture for Romanian ASR, leveraging a hybrid CTC-TDT decoder that allows for flexible decoding strategies. The use of both weakly supervised and high-quality transcriptions for training is innovative, particularly in the context of low-resource languages. The detailed exploration of various decoding strategies and their trade-offs adds depth to the methodology, showcasing a comprehensive understanding of ASR challenges.
Results & evaluation
The experimental evaluation is thorough, utilizing a diverse set of Romanian speech datasets, which strengthens the validity of the results. The paper reports significant improvements in WER across multiple benchmarks, demonstrating the effectiveness of the proposed system compared to existing models. The clear presentation of results, including comparisons with baseline systems, enhances the credibility of the findings.
Reproducibility
The authors commit to releasing their trained model and detailed training recipes, which is commendable for reproducibility. However, the paper could benefit from more explicit details on hyperparameter tuning and the specific configurations used during training and evaluation.
Limitations
While the paper achieves state-of-the-art results, it does not address potential limitations related to the reliance on weakly supervised data, which may affect the robustness of the model in real-world applications. Additionally, the computational demands of some decoding strategies may limit their applicability in low-latency scenarios.
Broader impact
The work has significant implications for the development of ASR systems in low-resource languages, potentially facilitating advancements in Romanian speech technology and contributing to more inclusive language processing tools. The open-source nature of the project encourages further research and development in this area. The main contribution of this paper is the introduction of a state-of-the-art Romanian ASR system using the FastConformer architecture, achieving significant performance improvements across various benchmarks. This work not only advances the field of speech recognition for Romanian but also sets a precedent for future research in low-resource languages, showcasing the potential of modern architectures and hybrid decoding strategies.
Author of this paper? Send a correction.