GAP-URGENet: A Generative-Predictive Fusion Framework for Universal Speech Enhancement
Abstract
We introduce GAP-URGENet, a generative-predictive fusion framework developed for Track 1 of the ICASSP 2026 URGENT Challenge. The system integrates a generative branch, which performs full-stack speech restoration in a self-supervised representation domain and reconstructs the waveform via a neural vocoder, along with a predictive branch that performs spectrogram-domain enhancement, providing complementary cues. Outputs from both branches are fused by a post-processing module, which also performs bandwidth extension to generate the enhanced waveform at 48 kHz, later downsampled to the original sampling rate. This generative-predictive fusion improves robustness and perceptual quality, achieving top performance in the blind-test phase and ranking 1st in the objective evaluation. Audio examples are available at https://xiaobin-rong.github.io/gap-urgenet_demo.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The main contribution of this paper is the introduction of GAP-URGENet, a novel generative-predictive fusion framework for universal speech enhancement that demonstrates state-of-the-art performance in the ICASSP 2026 URGENT Challenge. This work significantly advances the field of speech enhancement by effectively integrating generative and predictive methodologies, providing a comprehensive solution to improve speech quality across diverse conditions.
Methodology
The methodology presented in GAP-URGENet is innovative, combining generative and predictive models to enhance speech quality effectively. The generative branch focuses on full-stack speech restoration using self-supervised learning, while the predictive branch enhances the spectrogram domain, allowing for complementary improvements. The fusion of outputs from both branches through a post-processing module is a significant contribution, particularly the bandwidth extension to achieve high-quality waveforms. The architecture is well-structured, leveraging existing models like DeWavLM and TF-GridNet, which indicates a thoughtful integration of prior work with novel enhancements.
Results & evaluation
The experimental setup is robust, utilizing comprehensive datasets from the URGENT Challenge, which enhances the credibility of the results. The paper reports substantial improvements over baseline models, with detailed metrics provided for various objective evaluations (DNSMOS, NISQA, UTMOS, etc.), showcasing the effectiveness of the proposed framework. The results indicate that GAP-URGENet achieves superior performance in both objective and subjective evaluations, validating the proposed approach.
Reproducibility
The paper provides sufficient details regarding the architecture, training process, and datasets used, which facilitates reproducibility. However, the absence of a public code repository limits the ease of reproduction for other researchers. Including a link to the code or detailed implementation instructions would enhance reproducibility significantly.
Limitations
While the paper demonstrates impressive results, it does not address potential limitations such as the computational cost of the model, the need for extensive training data, or the model's performance in real-world applications outside the challenge context. Additionally, the reliance on specific architectures may limit generalizability to other tasks or domains.
Broader impact
The implications of this research extend to various applications in speech enhancement, including telecommunications, assistive technologies for the hearing impaired, and voice recognition systems. By improving speech quality in challenging conditions, the framework can enhance user experience across multiple platforms, making it a valuable contribution to the field of audio processing. The main contribution of this paper is the introduction of GAP-URGENet, a novel generative-predictive fusion framework for universal speech enhancement that demonstrates state-of-the-art performance in the ICASSP 2026 URGENT Challenge. This work significantly advances the field of speech enhancement by effectively integrating generative and predictive methodologies, providing a comprehensive solution to improve speech quality across diverse conditions.
Author of this paper? Send a correction.