Audio ML PapersLandmark papers
← All papers
RESEARCH PAPER / 2025-10-28

Your Microphone Array Retains Your Identity: A Robust Voice Liveness Detection System for Smart Speakers

Yan Meng, Jiachun Li, Matthew Pillari ...Full author list in the original paper.

Shanghai Jiao Tong University +1 · USENIX Security 2022

Affiliations: Shanghai Jiao Tong University, University of Virginia

Abstract

Though playing an essential role in smart home systems, smart speakers are vulnerable to voice spoofing attacks. Passive liveness detection, which utilizes only the collected audio rather than the deployed sensors to distinguish between live-human and replayed voices, has drawn increasing attention. However, it faces the challenge of performance degradation under the different environmental factors as well as the strict requirement of the fixed user gestures. In this study, we propose a novel liveness feature, array fingerprint, which utilizes the microphone array inherently adopted by the smart speaker to determine the identity of collected audios. Our theoretical analysis demonstrates that by leveraging the circular layout of microphones, compared with existing schemes, array fingerprint achieves a more robust performance under the environmental change and user's movement. Then, to leverage such a fingerprint, we propose ARRAYID, a lightweight passive detection scheme, and elaborate a series of features working together with array fingerprint. Our evaluation on the dataset containing 32,780 audio samples and 14 spoofing devices shows that ARRAYID achieves an accuracy of 99.84%, which is superior to existing passive liveness detection schemes.

The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.

Research summary

The paper presents a novel approach to voice liveness detection using microphone array technology, significantly improving the robustness of smart speakers against spoofing attacks. The technical contributions are substantial, and the methodology is sound, though there are areas for improvement in reproducibility and experimental detail.

Methodology

The paper introduces a novel liveness detection feature called "array fingerprint," which utilizes the microphone array of smart speakers to enhance the robustness of voice liveness detection against spoofing attacks. The methodology is well-structured, leveraging theoretical analysis to support the proposed feature's effectiveness. The authors detail the system design and the integration of multiple features alongside the array fingerprint, which enhances the overall detection capability. However, while the approach is innovative, the paper could benefit from a more thorough exploration of alternative methods and a clearer explanation of the theoretical underpinnings of the array fingerprint concept.

Results & evaluation

The evaluation is robust, utilizing a substantial dataset of 32,780 audio samples and 14 different spoofing devices. The reported accuracy of 99.84% is impressive and indicates a significant improvement over existing passive liveness detection schemes. However, the paper lacks detailed information on the experimental setup, such as the specific conditions under which the data was collected and how the spoofing attacks were simulated. This information is crucial for assessing the generalizability of the results.

Reproducibility

The paper does not provide sufficient details regarding the implementation of the proposed methods, which raises concerns about reproducibility. There are no links to code repositories or supplementary materials that would allow other researchers to replicate the experiments. Clearer documentation of the experimental setup and access to the code would enhance reproducibility.

Limitations

One notable limitation is the reliance on a specific microphone array configuration, which may not be universally applicable across all smart speaker models. Additionally, the performance in highly variable real-world environments remains to be thoroughly tested, as the evaluation primarily focuses on controlled conditions. The paper also does not address potential adversarial attacks that could exploit the system.

Broader impact

The implications of this research are significant, particularly in enhancing the security of smart home devices against voice spoofing attacks. As smart speakers become more integrated into daily life, improving their security through robust liveness detection could help protect user privacy and data. The proposed system could be adapted for various applications beyond smart speakers, potentially influencing the design of secure voice recognition systems in other domains. The paper presents a novel approach to voice liveness detection using microphone array technology, significantly improving the robustness of smart speakers against spoofing attacks. The technical contributions are substantial, and the methodology is sound, though there are areas for improvement in reproducibility and experimental detail.

Author of this paper? Send a correction.