Anonymization, Not Elimination: Utility-Preserved Speech Anonymization
Abstract
The growing reliance on large-scale speech data has made privacy protection a critical concern. However, existing anonymization approaches often degrade data utility, for example by disrupting acoustic continuity or reducing vocal diversity, which compromises the value of speech data for downstream tasks such as Automatic Speech Recognition (ASR), Text-to-Speech (TTS), and Speech Emotion Recognition (SER). Current evaluation practices are also limited, as they mainly rely on direct testing of anonymized speech with pretrained models, providing only a partial view of utility. To address these issues, we propose a novel two-stage framework that protects both linguistic content and acoustic identity while maintaining usability. For content privacy, we employ a generative speech editing model to seamlessly replace personally identifiable information (PII), and for voice privacy, we introduce F3-VA, a flow-matching-based anonymization framework with a three-stage design that produces diverse and distinct anonymized speakers. To enable a more comprehensive assessment, we evaluate privacy using both acoustic- and content-based speaker verification metrics, and assess utility by training ASR, TTS, and SER models from scratch. Experimental results show that our framework achieves stronger privacy protection with minimal utility degradation compared to baselines from the VoicePrivacy Challenge, while the proposed evaluation protocol provides a more realistic reflection of the utility of anonymized speech under privacy protection.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
The paper presents a comprehensive two-stage framework for utility-preserved speech anonymization, effectively balancing privacy and usability in speech data. The technical contributions, particularly in generative modeling and evaluation methodologies, are significant advancements in the field of speech privacy protection.
Methodology
The proposed two-stage framework for speech anonymization is innovative, combining generative speech editing for content anonymization and a flow-matching-based approach for voice anonymization. This dual focus on linguistic and voice privacy is a significant advancement over existing methods that often compromise one for the other. The use of a generative model for seamless replacement of personally identifiable information (PII) while maintaining acoustic integrity is a notable strength. The flow-matching model allows for controlled generation of diverse speaker embeddings, addressing the challenge of speaker identity preservation effectively.
Results & evaluation
The experimental setup is robust, utilizing well-known datasets (LibriSpeech, LibriTTS, IEMOCAP) for evaluating the framework's performance across ASR, TTS, and SER tasks. The results demonstrate a clear advantage of the proposed methods over baseline models, particularly in terms of privacy preservation and utility retention. The use of multiple evaluation metrics, including A-EER and C-EER for privacy, alongside WER and SECS for utility, provides a comprehensive assessment of the framework's effectiveness.
Reproducibility
The paper provides detailed implementation specifics, including model architectures, training configurations, and evaluation protocols, which enhances reproducibility. However, the absence of publicly available code or a demo URL limits the practical reproducibility of the results.
Limitations
One limitation is the reliance on specific datasets, which may not generalize to all speech data scenarios. Additionally, while the proposed methods show promise, the paper does not fully explore the performance under diverse real-world conditions, such as background noise or varied speaker demographics, which could impact the effectiveness of the anonymization.
Broader impact
The research addresses a critical need for privacy-preserving techniques in speech data, which is increasingly important given regulatory frameworks like GDPR. The potential applications span various domains, including healthcare, legal services, and voice-assisted technologies, where maintaining user privacy is paramount. The framework could significantly influence future research and development in speech processing and privacy protection. The paper presents a comprehensive two-stage framework for utility-preserved speech anonymization, effectively balancing privacy and usability in speech data. The technical contributions, particularly in generative modeling and evaluation methodologies, are significant advancements in the field of speech privacy protection.
Author of this paper? Send a correction.