Anomalous Sound Detection Meets Noise-Aware Self-Supervised Learning
Abstract
In this paper, we introduce noise-aware self-supervised learning (NA-SSL) models for noise-aware anomalous sound detection (NA-ASD). NA-ASD is an ASD task with two-channel audio recordings, where one microphone is located close to the target machine and the other is located farther away to capture noise. For this task, we simulate two-channel recordings using diverse audio datasets and train NA-SSL models to extract clean SSL representations of the close-microphone signal by using the far-microphone recording dominated by background noise as auxiliary information. The NA-SSL models are then used as frontends in the standard ASD framework. Our experimental evaluation on the DCASE 2026 Challenge Task 2 development dataset demonstrates the effectiveness of the NA-SSL framework across three base SSL models (BEATs, EAT, and Dasheng), both with and without discriminative fine-tuning. Furthermore, the challenge results proved the effectiveness of the proposed approach, where the NA-BEATs system won the challenge by a large margin, achieving an official score of 70.24%, while the second-place system achieved 65.46%.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The paper presents a robust and effective Noise-Aware Self-Supervised Learning framework that successfully leverages auxiliary noise information to improve Anomalous Sound Detection, achieving first place in the DCASE 2026 Challenge.
Methodology
The paper proposes a Noise-Aware Self-Supervised Learning (NA-SSL) framework tailored for the Noise-Aware Anomalous Sound Detection (NA-ASD) task. The core methodology involves adapting existing Self-Supervised Learning (SSL) models (BEATs, EAT, Dasheng) by inserting trainable Noise-Aware (NA) layers that utilize cross-attention to condition the representation of the close-microphone signal on the far-microphone noise signal. This approach leverages the physical setup of the NA-ASD task, where a distant microphone captures ambient noise. The authors simulate two-channel recordings using diverse datasets (FSD50K, WHAM!, DEMAND, QUT-NOISE) to pre-train these NA-SSL models. The method is then integrated into a standard ASD pipeline with discriminative fine-tuning and various backend aggregation techniques (BEAM, RDP). While the application of cross-attention for noise conditioning is not entirely new in speech processing, its systematic adaptation and evaluation across multiple modern, large-scale audio SSL backbones for the specific NA-ASD challenge context represents a solid engineering contribution. The novelty lies in the specific integration strategy and the demonstration of its efficacy across different architectural families (masked prediction, masked bootstrapping, masked autoencoder).
Results & evaluation
The experimental evaluation is comprehensive and rigorous, centered on the DCASE 2026 Challenge Task 2. The authors evaluate their method on the development set with detailed ablation studies across different base models, fine-tuning strategies (with/without discriminative fine-tuning), and backend techniques. The results show consistent improvements over the original SSL models. Crucially, the paper reports the official challenge results, where the proposed NA-BEATs system won the challenge with a significant margin (70.24% vs 65.46% for second place). This real-world validation on a blind test set provides strong evidence of the method's effectiveness and robustness. The inclusion of variance analysis and ensemble results further strengthens the empirical claims. The comparison against other top-performing systems highlights the efficiency of the proposed approach, which achieves state-of-the-art performance using a single model rather than large ensembles.
Reproducibility
The paper provides substantial implementation details, including the architecture of the NA layers (number of heads, hidden size), training hyperparameters (optimizer, learning rate, batch size, EMA decay), data simulation parameters (room impulse response settings, SNR ranges), and backend configurations. The use of standard libraries (Pyroomacoustics) and well-known base models facilitates reproduction. However, the specific random seeds for the "three trials" are mentioned but not explicitly listed in the text, which might introduce slight variability in exact replication. The code for the NA layers is not explicitly linked, though the architecture is described in sufficient detail for implementation.
Limitations
The primary limitation is the reliance on simulated data for pre-training the NA-SSL models. While the simulation uses diverse datasets, the gap between simulated room acoustics and real-world factory environments may still exist. The method is specifically designed for the NA-ASD task with two-microphone setups; its applicability to single-microphone scenarios or other noise-aware tasks is not explored. Additionally, the performance gain, while significant, comes with the computational overhead of the additional NA layers and the need for the far-microphone signal, which may not always be available or feasible to deploy in all industrial settings. The paper does not extensively discuss the failure cases or scenarios where the far-microphone signal might be corrupted or uninformative.
Broader impact
This work contributes to the field of industrial anomaly detection, which has significant implications for predictive maintenance, safety, and efficiency in manufacturing. By improving the robustness of ASD systems in noisy environments, it enables more reliable deployment of automated monitoring systems. The noise-aware SSL framework could potentially be adapted to other audio processing tasks requiring robustness to environmental noise, such as speech recognition or audio event detection in challenging acoustic conditions. The paper presents a robust and effective Noise-Aware Self-Supervised Learning framework that successfully leverages auxiliary noise information to improve Anomalous Sound Detection, achieving first place in the DCASE 2026 Challenge.
Author of this paper? Send a correction.