HVAC-EAR: Eavesdropping Human Speech Using HVAC Systems
Abstract
Pressure sensors are widely integrated into modern Heating, Ventilation and Air Conditioning (HVAC) systems. As they are sensitive to acoustic pressure, they can be a source of eavesdropping. This paper introduces HVAC-EAR, which reconstructs intelligible speech from low-resolution, noisy pressure data with two key contributions: (i) We achieve intelligible reconstruction from as low as 0.5 kHz sampling rate, surpassing prior work limited to hot word detection, by employing a complex-valued conformer with a Complex Unified Attention Block to capture phoneme dependencies; (ii) HVAC-EAR mitigates transient HVAC noise by reconstructing both magnitude and phase of missing frequencies. For the first time, evaluations on real-world HVAC deployments show significant intelligibility, raising novel privacy concerns.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The paper presents HVAC-EAR, a novel approach to eavesdropping human speech using HVAC systems, demonstrating significant advancements in speech reconstruction from low-resolution pressure data. The methodology and experimental results indicate a meaningful contribution to the fields of audio processing and security, although further work is needed to enhance reproducibility and address limitations.
Methodology
The methodology presented in HVAC-EAR is innovative, leveraging a complex-valued conformer architecture with a Complex Unified Attention Block to reconstruct intelligible speech from low-resolution pressure sensor data. The approach is well-structured, addressing both the reconstruction of missing frequencies and the mitigation of transient HVAC noise. The use of complex-valued networks for capturing phoneme dependencies is a notable advancement over traditional methods. However, the paper could benefit from a more detailed explanation of the training process and hyperparameter tuning.
Results & evaluation
The experimental evaluation is robust, utilizing real-world HVAC deployments and multiple metrics (LSD, NISQA-MOS, PESQ, STOI, SI-SDR) to assess intelligibility and quality. The results demonstrate significant improvements over baseline models, indicating the effectiveness of the proposed method. The inclusion of subjective analysis through Mean Opinion Scores adds credibility to the findings. Nonetheless, the limited dataset and focus on English-only speech may restrict the generalizability of the results.
Reproducibility
The paper provides a reasonable level of detail regarding the architecture and evaluation metrics, but lacks comprehensive implementation details that would facilitate reproducibility. The absence of a publicly available code repository is a significant drawback.
Limitations
Key limitations include the focus on a single language (English), the performance drop beyond 1.2 meters from the sensor, and the need for a minimum sampling frequency of 500 Hz. Additionally, the paper does not explore the implications of varying environmental conditions on the model's performance.
Broader impact
The findings raise critical privacy concerns regarding the use of HVAC systems in sensitive environments, such as healthcare and cleanrooms. The potential for eavesdropping using existing infrastructure highlights the need for improved security measures in building management systems. This research could lead to further investigations into privacy-preserving technologies in acoustic sensing. The paper presents HVAC-EAR, a novel approach to eavesdropping human speech using HVAC systems, demonstrating significant advancements in speech reconstruction from low-resolution pressure data. The methodology and experimental results indicate a meaningful contribution to the fields of audio processing and security, although further work is needed to enhance reproducibility and address limitations.
Author of this paper? Send a correction.