Audio-Zero: Label-Free Self-Evolution for Fine-Grained Audio Reasoning
Abstract
Large Audio Language models (LALMs) have made rapid progress on acoustic understanding, yet they still struggle with fine-grained audio reasoning (e.g., recognizing event order, repetitions and duration). Existing post-training methods heavily rely on expensive external labels or provide only coarse semantic signals. To bridge this gap, we introduce Audio-Zero, the first label-free self-evolution framework in the field of LALMs that improves fine-grained auditory perception and reasoning. Audio-Zero constructs an auditory self-play game from unlabeled audio contrast pairs: most players hear a reference audio, while one odd listener hears a subtle variant. The model first generates clues describing what it hears and then identifies the odd listener by reasoning over inconsistencies among clues. Since the odd listener is known by construction, the game provides verifiable rewards without any annotated answers. Experiments with Qwen2-Audio-7B-Instruct and Qwen2.5-Omni-7B on TREA, MMAU Test-mini and MMAR show that Audio-Zero improves fine-grained audio reasoning while preserving broad audio understanding. Evolutionary and diagnostic analyses further reveal that increasingly fine-grained auditory descriptions emerge naturally from game pressure.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
Audio-Zero introduces a label-free self-evolution framework for LALMs that uses an auditory self-play game to improve fine-grained reasoning without external annotations. The paper presents a novel and technically sophisticated approach to enhancing the fine-grained reasoning capabilities of Large Audio Language Models. By formulating the learning process as a self-play game with verifiable intrinsic rewards, Audio-Zero effectively circumvents the bottleneck of scarce fine-grained annotations. The methodology is well-grounded in recent advances in self-evolution and reinforcement learning, and the experimental results demonstrate its efficacy across multiple benchmarks and model architectures. The diagnostic analysis provides valuable insights into how fine-grained auditory descriptions emerge from game pressure. This work is a significant contribution to the field of audio AI, offering a scalable and efficient path to improving model performance.
Methodology
The paper proposes Audio-Zero, a label-free self-evolution framework for Large Audio Language Models (LALMs). The core innovation is an "auditory self-play game" that converts unlabeled audio contrast pairs into verifiable training signals. The method involves two coupled stages: a listening stage where the model generates descriptive clues for multiple "players" (some hearing a reference, one hearing a variant), and an attribution stage where the model acts as a judge to identify the "odd listener" based on inconsistencies in the clues. The reward signal is intrinsic to the game mechanics (correct identification) and a rule-based content utility score for the clues. The optimization uses Group Relative Policy Optimization (GRPO). The approach is theoretically sound and addresses a genuine gap in the field: the lack of fine-grained, label-free supervision for audio reasoning. The mechanism of using the "odd-one-out" task to force fine-grained perceptual description is clever and aligns well with recent trends in self-play and self-evolution for LLMs and VLMs.
Results & evaluation
The authors evaluate Audio-Zero on three benchmarks: TREA (temporal reasoning), MMAU Test-mini (general audio understanding), and MMAR (deep audio reasoning). Experiments are conducted on two strong backbones: Qwen2-Audio-7B-Instruct and Qwen2.5-Omni-7B. The results show consistent improvements over the base policies and several strong baselines (both label-dependent and label-free). Notably, the gains are most pronounced on TREA, the fine-grained temporal reasoning benchmark, which supports the paper's claim of improving fine-grained perception. The ablation studies effectively demonstrate the necessity of each component (listening stage, attribution stage, vote-aware feedback). The self-evolution dynamics analysis (tracking win rates, clue length, and benchmark scores over iterations) provides compelling evidence that the model is indeed learning and evolving rather than just overfitting to a static reward. The use of only 2k unlabeled pairs is a significant efficiency advantage.
Reproducibility
The paper provides detailed implementation details, including hyperparameters (learning rate, KL coefficient, number of players/rounds), dataset construction (filtering 2k pairs from Audio-Alpaca), and prompt templates. The GRPO implementation details are standard but well-specified. The diagnostic metrics for analyzing clue quality are clearly defined. While the code is not explicitly linked in the provided text, the description is sufficient for reproduction by researchers familiar with RLHF/GRPO pipelines. The reliance on rule-based scorers for the listening reward is a potential point of variability, but the rules are described.
Limitations
The method relies on the availability of audio contrast pairs. While the paper claims to use "unlabeled" pairs, it sources them from Audio-Alpaca, which is a preference dataset. The filtering process to create contrast pairs (ensuring they share semantics but differ in fine-grained details) is not fully detailed, raising questions about the scalability and generalizability of the pair generation process. The rule-based listening reward, while effective, may not capture all nuances of good auditory description compared to a learned reward model. Furthermore, the performance gains, while significant, are still modest in absolute terms on some benchmarks (e.g., MMAU Avg. 60.50 vs 57.50 for Qwen2-Audio), suggesting that self-evolution alone may not solve all reasoning deficits without some form of structured supervision or larger-scale data.
Broader impact
This work contributes to the development of more autonomous and data-efficient AI systems. By reducing reliance on expensive human annotations, it lowers the barrier to training high-capability audio models. The improved fine-grained audio reasoning capabilities could benefit applications in accessibility (e.g., better descriptions for the visually impaired), audio forensics, and interactive AI assistants. The self-play paradigm could be extended to other modalities or tasks where verifiable rewards are hard to construct. Audio-Zero introduces a label-free self-evolution framework for LALMs that uses an auditory self-play game to improve fine-grained reasoning without external annotations. The paper presents a novel and technically sophisticated approach to enhancing the fine-grained reasoning capabilities of Large Audio Language Models. By formulating the learning process as a self-play game with verifiable intrinsic rewards, Audio-Zero effectively circumvents the bottleneck of scarce fine-grained annotations. The methodology is well-grounded in recent advances in self-evolution and reinforcement learning, and the experimental results demonstrate its efficacy across multiple benchmarks and model architectures. The diagnostic analysis provides valuable insights into how fine-grained auditory descriptions emerge from game pressure. This work is a significant contribution to the field of audio AI, offering a scalable and efficient path to improving model performance.
Author of this paper? Send a correction.