What Do Neural Networks Learn for TDOA Estimation? A Cross-Architecture Probing Study
Abstract
Neural networks outperform classical GCC-PHAT for Time-Difference-of-Arrival (TDOA) estimation in noise and reverberation, yet their internal strategy remains unexplored. To uncover it, we turn GCC-PHAT's mathematical steps into diagnostic targets, probing hidden layers of three architectures (MLP, CNN, Transformer) and complementing with gradient attribution and causal frequency masking. We find that cross-power computation consistently emerges across all architectures and conditions, while PHAT whitening, the defining step of GCC-PHAT, fails to emerge. Instead, networks learn a magnitude-aware frequency weighting that preserves per-frequency reliability information discarded by PHAT. This makes PHAT an information bottleneck: removing it from both classical and neural GCC pipelines improves performance under additive noise. On real-world reverberant data, PHAT remains the best classical weighting, but end-to-end networks achieve lower error by learning data-adaptive weighting.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
This paper provides a compelling interpretability study of neural networks for TDOA estimation, demonstrating that networks bypass the classical PHAT whitening step in favor of magnitude-aware weighting, thereby offering actionable insights for improving hybrid audio processing pipelines.
Methodology
The paper employs a rigorous interpretability framework, specifically representation probing, to analyze the internal representations of neural networks trained for Time-Difference-of-Arrival (TDOA) estimation. By mapping hidden layer activations to specific mathematical steps of the classical GCC-PHAT algorithm (cross-power spectrum, PHAT whitening, phase), the authors create a precise diagnostic tool. The methodology is sound, utilizing linear and nonlinear probes, gradient attribution, and causal frequency masking to disentangle what information is represented versus how it is weighted. The choice of architectures (MLP, CNN, Transformer) with varying frequency connectivity allows for a controlled study of how different inductive biases affect the emergence of these algorithmic components.
Results & evaluation
The experimental design is comprehensive, covering synthetic data with controlled noise and reverberation, simulated speech data, and real-world recordings from the LOCATA challenge. The results are robust, consistently showing that while cross-power computation emerges reliably across all models and conditions, PHAT whitening does not. Instead, networks learn a magnitude-aware weighting scheme that correlates with signal reliability. The causal masking experiments strongly support the gradient attribution findings, demonstrating that high-energy bins are causally important for performance. The finding that removing PHAT whitening improves performance in additive noise is a significant empirical contribution, challenging a long-standing assumption in the audio signal processing community.
Reproducibility
The paper provides a clear description of the network architectures, training procedures (AdamW, Huber loss, etc.), and data generation processes. The code is publicly available on GitHub, and the use of standard libraries (LibriSpeech, pyroomacoustics, LOCATA) ensures that the experimental setup can be replicated. The inclusion of specific hyperparameters and dataset sizes enhances reproducibility.
Limitations
The study focuses primarily on pairwise TDOA estimation using short-time Fourier transform (STFT) representations. It does not explore waveform-domain models or end-to-end systems that might learn different internal representations. Additionally, the analysis is limited to single-source scenarios; the behavior in multi-source environments with overlapping speech or noise is noted as an open question. The reliance on linear probes, while standard, might miss complex nonlinear interactions, although the authors mitigate this with nonlinear probe controls.
Broader impact
This work has significant implications for the design of hybrid signal processing and neural network systems. By identifying PHAT whitening as an information bottleneck in noisy conditions, it suggests that classical pipelines can be improved by removing this step or replacing it with learned, data-adaptive weighting. It also provides a template for using probing to understand and improve other audio processing algorithms, bridging the gap between classical signal processing theory and modern deep learning practices. The findings encourage a re-evaluation of fixed preprocessing steps in favor of learnable, interpretable alternatives. This paper provides a compelling interpretability study of neural networks for TDOA estimation, demonstrating that networks bypass the classical PHAT whitening step in favor of magnitude-aware weighting, thereby offering actionable insights for improving hybrid audio processing pipelines.
Author of this paper? Send a correction.