Stereo Audio Rendering for Personal Sound Zones Using a Binaural Spatially Adaptive Neural Network (BSANN)
Abstract
A binaural rendering framework for personal sound zones (PSZs) is proposed to enable multiple head-tracked listeners to receive fully independent stereo audio programs. Current PSZ systems typically rely on monophonic rendering and therefore cannot control the left and right ears separately, which limits the quality and accuracy of spatial imaging. The proposed method employs a Binaural Spatially Adaptive Neural Network (BSANN) to generate ear-optimized loudspeaker filters that reconstruct the desired acoustic field at each ear of multiple listeners. The framework integrates anechoically measured loudspeaker frequency responses, analytically modeled transducer directivity, and rigid-sphere head-related transfer functions (HRTFs) to enhance acoustic accuracy and spatial rendering fidelity. An explicit active crosstalk cancellation (XTC) stage further improves three-dimensional spatial perception. Experiments show significant gains in measured objective performance metrics, including inter-zone isolation (IZI), inter-program isolation (IPI), and crosstalk cancellation (XTC), with log-frequency-weighted values of 10.23/10.03 dB (IZI), 11.11/9.16 dB (IPI), and 10.55/11.13 dB (XTC), respectively, over 100-20,000 Hz. The combined use of ear-wise control, accurate acoustic modeling, and integrated active XTC produces a unified rendering method that delivers greater isolation performance, increased robustness to room asymmetry, and more faithful spatial reproduction in real acoustic environments.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The paper presents a novel framework for binaural audio rendering that significantly improves isolation and crosstalk cancellation for multiple listeners. The integration of physically informed acoustic modeling and the innovative two-stage training process represent substantial advancements in the field of spatial audio rendering.
Methodology
The proposed Binaural Spatially Adaptive Neural Network (BSANN) framework innovatively extends the existing monophonic Spatially Adaptive Neural Network (SANN) by enabling ear-wise control for multiple head-tracked listeners. The methodology is robust, integrating anechoically measured loudspeaker frequency responses, analytic piston directivity, and rigid-sphere HRTFs, which collectively enhance the acoustic realism and fidelity of the audio rendering. The two-stage training process, which includes a pretraining phase for personal sound zones followed by an active crosstalk cancellation (XTC) stage, is well-structured and addresses the limitations of previous models effectively.
Results & evaluation
The experimental setup is comprehensive, utilizing a 24-loudspeaker array and head-and-torso simulators to evaluate the performance of the BSANN framework under realistic acoustic conditions. The metrics for evaluation—inter-zone isolation (IZI), inter-program isolation (IPI), and crosstalk cancellation (XTC)—are appropriate and provide a clear indication of the framework's effectiveness. The results demonstrate significant improvements over the monophonic SANN, highlighting the benefits of the BSANN architecture in achieving balanced performance across listeners.
Reproducibility
While the paper provides a detailed description of the methodology and experimental setup, it lacks specific implementation details that would facilitate reproducibility, such as hyperparameter tuning processes and code availability. The absence of a project URL or demo page further limits the ability for others to replicate the findings.
Limitations
One limitation of the study is its focus on a two-listener scenario, which may not fully capture the complexities of larger multi-listener environments. Additionally, while the authors mention future work involving full six-degree-of-freedom head motion, this aspect remains unaddressed in the current framework. The reliance on specific loudspeaker configurations may also limit the generalizability of the findings to other setups.
Broader impact
The BSANN framework has significant implications for various applications, including home entertainment systems, automotive audio, and public environments, where personalized audio experiences are increasingly sought after. By enabling independent audio programs for multiple listeners within a shared space, this research contributes to the advancement of spatial audio technologies and enhances user experience in immersive environments. The paper presents a novel framework for binaural audio rendering that significantly improves isolation and crosstalk cancellation for multiple listeners. The integration of physically informed acoustic modeling and the innovative two-stage training process represent substantial advancements in the field of spatial audio rendering.
Author of this paper? Send a correction.