Binaural Signal Matching with Wearable Arrays for Near-Field Sources and Directional Focus
Abstract
This paper investigates the performance of Binaural Signal Matching (BSM) methods for near-field sound reproduction using a wearable glasses-mounted microphone array. BSM is a flexible, signal-independent approach for binaural rendering with arbitrary arrays, but its conventional formulation assumes far-field sources. In our previous work, we proposed a near-field extension of BSM (NF-BSM) that incorporates distance-dependent modeling and showed improved performance over far-field BSM using analytic data, though degradation persisted for sources very close to the array. In this study, we extend that analysis by using realistic simulated data of near-field Head-Related Transfer Functions (HRTFs) and Acoustic Transfer Functions (ATFs) of the array, accounting for listener head rotation and evaluating binaural cues such as interaural level and time differences (ILD and ITD). A key contribution is the introduction of a Field of View (FoV) weighting, designed to emphasize perceptually relevant directions and improve robustness under challenging conditions. Results from both simulation and a listening test confirm that NF-BSM outperforms traditional far-field BSM in near-field scenarios, and that the proposed NF-FoV-BSM method achieves the best perceptual and objective quality among all tested methods, particularly at close source distances and under head rotation. These findings highlight the limitations for far-field models in near-field sources and demonstrate that incorporating source distance and directional weighting can significantly improve binaural reproduction performance for wearable spatial audio systems.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The paper makes a significant contribution by advancing the understanding of binaural sound reproduction in near-field scenarios, demonstrating that incorporating distance and directional weighting can enhance audio quality for wearable systems. The innovative approach and thorough evaluation position this work as a valuable resource for researchers and practitioners in the audio and machine learning fields.
Methodology
The paper presents a comprehensive methodology for enhancing binaural sound reproduction in near-field scenarios using a wearable microphone array. The authors extend the Binaural Signal Matching (BSM) framework by incorporating realistic simulated data and a novel Field of View (FoV) weighting approach. The mathematical formulations are well-defined, and the introduction of mixed error criteria for different frequency ranges demonstrates a sophisticated understanding of the problem. However, the complexity of the models and the reliance on simulations may limit practical applicability without real-world validation.
Results & evaluation
The experimental evaluation includes both simulation and listening tests, providing a robust framework for assessing the proposed methods. The results clearly show that the near-field BSM outperforms traditional far-field BSM, particularly in challenging conditions. The use of perceptual metrics such as interaural level and time differences adds depth to the evaluation. However, the paper could benefit from a larger variety of test conditions and more extensive user studies to validate the findings across diverse scenarios.
Reproducibility
While the paper provides a detailed description of the methods and experimental setup, the lack of publicly available code or datasets limits reproducibility. The authors should consider sharing their simulation parameters and results to facilitate further research and validation by the community.
Limitations
The primary limitation is the performance degradation observed at very close source distances, indicating that the current models may not fully capture the complexities of binaural reproduction in extreme near-field conditions. Additionally, the reliance on simulated data raises questions about the generalizability of the results to real-world applications.
Broader impact
The findings have significant implications for applications in virtual reality, teleconferencing, and wearable audio systems, where accurate binaural sound reproduction is crucial for immersive experiences. By addressing the limitations of existing far-field models, this research opens avenues for improved audio technologies that can adapt to dynamic environments and user interactions. The paper makes a significant contribution by advancing the understanding of binaural sound reproduction in near-field scenarios, demonstrating that incorporating distance and directional weighting can enhance audio quality for wearable systems. The innovative approach and thorough evaluation position this work as a valuable resource for researchers and practitioners in the audio and machine learning fields.
Author of this paper? Send a correction.