Sona: Real-Time Multi-Target Sound Attenuation for Noise Sensitivity
Abstract
For people with noise sensitivity, everyday soundscapes can be overwhelming. Existing tools such as active noise cancellation reduce discomfort by suppressing the entire acoustic environment, often at the cost of awareness of surrounding people and events. We present Sona, an interactive mobile system for real-time soundscape mediation that selectively attenuates bothersome sounds while preserving desired audio. Sona is built on a target-conditioned neural pipeline that supports simultaneous attenuation of multiple overlapping sound sources, overcoming the single-target limitation of prior systems. It runs in real time on-device and supports user-extensible sound classes through in-situ audio examples, without retraining. Sona is informed by a formative study with 68 noise-sensitive individuals. Through technical benchmarking and an in-situ study with 10 participants, we show that Sona achieves low-latency, multi-target attenuation suitable for live listening, and enables meaningful reductions in bothersome sounds while maintaining awareness of surroundings. These results point toward a new class of personal AI systems that support comfort and social participation by mediating real-world acoustic environments.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The main contribution of this paper is the development of Sona, an interactive mobile system that enables real-time, multi-target sound attenuation for individuals with noise sensitivity. This work represents a meaningful advancement in audio processing and accessibility technology, with the potential to significantly improve the daily experiences of users in noisy environments.
Methodology
The methodology employed in Sona is innovative, utilizing a target-conditioned neural pipeline that allows for real-time attenuation of multiple overlapping sound sources. This is a significant advancement over existing systems that typically focus on single-target noise cancellation. The incorporation of user-extensible sound classes through in-situ examples without the need for retraining is a notable feature that enhances user personalization and adaptability. The formative study involving 68 noise-sensitive individuals provides a solid foundation for understanding user needs and preferences, which is crucial for the design of the system.
Results & evaluation
The experimental evaluation is robust, featuring both technical benchmarking and an in-situ study with 10 participants. The results demonstrate low-latency performance and effective sound attenuation while preserving desired audio, which is critical for maintaining situational awareness. The use of subjective measures to assess user comfort and soundscape mediation effectiveness adds credibility to the findings. However, the small sample size in the in-situ study may limit the generalizability of the results.
Reproducibility
The paper does not provide explicit details regarding the implementation or access to the code, which raises concerns about reproducibility. While the methodology is described, without a publicly available implementation or detailed algorithmic descriptions, it may be challenging for other researchers to replicate the results or build upon this work.
Limitations
One limitation is the small participant size in the in-situ study, which may not adequately represent the broader population of noise-sensitive individuals. Additionally, while the system allows for user-defined sound classes, the effectiveness of the system in highly dynamic or complex sound environments remains to be fully evaluated. There may also be challenges in the real-world application of the technology, such as varying user preferences and environmental conditions.
Broader impact
The potential applications of Sona are significant, particularly for individuals with noise sensitivity, including those with neurodivergent conditions. By enabling users to manage their auditory environments, Sona could enhance comfort and social participation, leading to improved quality of life. The implications extend beyond personal use, as the technology could be adapted for various settings, including workplaces, educational environments, and public spaces. The main contribution of this paper is the development of Sona, an interactive mobile system that enables real-time, multi-target sound attenuation for individuals with noise sensitivity. This work represents a meaningful advancement in audio processing and accessibility technology, with the potential to significantly improve the daily experiences of users in noisy environments.
Author of this paper? Send a correction.