EvoAudio: Recursive Self-Improvement for Audio Understanding
Abstract
Audio language models understand what is said far better than how it sounds. Closing this gap takes more than data. Detailed acoustic annotation is costly, labels from stronger models inherit their errors and limits, and fixed data cannot adapt as the learner improves. We therefore propose EvoAudio, a recursive self-improvement system for audio understanding. To our knowledge, it is the first to evolve the model, waveforms, questions, and difficulty in one closed loop. EvoAudio uses the current model's performance to set the focus and difficulty of the next training data. A library of audio tools then constructs questions whose answers follow from how the audio was made, providing verifiable supervision without new human annotation. Reinforcement learning updates the model, and validation decides whether it enters the next evolution round. Across 13 rounds, EvoAudio improves five models with different audio encoders and language backbones on MMSU, MMAU-Pro, and MMAR. It achieves the highest average for every backbone, raising overall performance by up to 6.3 points. The improvement unfolds over successive rounds, with each stronger model starting the next round.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
EvoAudio introduces a recursive self-improvement system that jointly evolves the model, waveforms, questions, and difficulty in a closed loop, achieving significant gains in audio understanding across multiple LALM backbones. The paper presents a rigorous methodology for generating verifiable synthetic data and adapting curricula based on model performance, demonstrating that recursive self-improvement is effective for enhancing perceptual skills in audio language models.
Methodology
The paper proposes EvoAudio, a recursive self-improvement framework for Large Audio Language Models (LALMs). The core innovation is a closed-loop system where the model's performance on a fixed set of verifiable skills dictates the curriculum for the next training round. Unlike previous methods that use static synthetic data or rely on stronger teacher models for labeling (which introduces bias and error propagation), EvoAudio generates training data using a library of 24 audio tools that construct waveforms with known ground-truth properties (e.g., pitch, tempo, speaker count). This ensures "verifiable supervision" without human annotation. The system uses GRPO (Group Relative Policy Optimization) for reinforcement learning, where rewards are derived from the verifiable answers. A key methodological strength is the adaptive difficulty adjustment: the system monitors the "mixed rate" (variance in model responses) to ensure questions remain in the model's learning zone, avoiding saturation or frustration. The separation of the "verifier" (checking if the answer matches the construction) and the "acoustic check" (ensuring the rendered audio actually contains the intended cue) is a robust design choice that mitigates synthesis errors.
Results & evaluation
The experiments are extensive and rigorous. The authors evaluate five different LALM backbones (Qwen2.5-Omni, Audio Flamingo 3, Kimi-Audio, MiMo-Audio, MiniCPM-o) across three major benchmarks (MMSU, MMAU-Pro, MMAR). The results show consistent improvements over base models and strong baselines (Static-profile GRPO, Pooled GRPO). The ablation studies are particularly valuable, isolating the impact of adaptive difficulty, skill quotas, and acoustic verification. The finding that removing acoustic verification leads to "reward hacking" (where the model learns to exploit rendering errors) is a significant insight. The improvement of up to 6.3 points on average is substantial in the context of audio understanding, where progress is often incremental. The comparison against "Pooled GRPO" effectively demonstrates the necessity of the recursive, adaptive nature of the curriculum rather than just having a large pool of synthetic data.
Reproducibility
The paper provides high-level details on the system architecture, the number of tools (24), question types (47), and training hyperparameters (learning rate, KL coefficient, number of rounds). However, the specific implementation of the "audio tools" library is not fully detailed in the text, and the code repository is not linked in the provided text (only a demo page). The reliance on specific TTS models (Qwen3-TTS) and datasets (LibriSpeech, FSD50K) is clear, but the exact prompts for the LLM proposer and the specific logic for the "acoustic checks" (e.g., how pitch is remeasured) would require the code for full reproduction. The demo page suggests some availability, but a full open-source release of the tool library would be necessary for high reproducibility.
Limitations
The primary limitation is the scope of the tool library. The system can only improve on skills that can be synthesized and verified by the current 24 tools. Complex semantic or cultural reasoning (tested in MMAR) sees less improvement because these aspects are harder to construct synthetically with verifiable ground truth. The method is also computationally expensive, requiring 13 rounds of training and multiple rollouts per question. Additionally, the "verifiable" nature of the data means the model may not generalize well to open-ended audio questions that do not have a single correct answer derived from construction parameters.
Broader impact
This work has significant implications for the training of multimodal models. The concept of "self-evolving" curricula with verifiable rewards is applicable beyond audio to other modalities where ground truth can be constructed (e.g., code, math, visual geometry). It addresses the bottleneck of high-quality, diverse training data for perceptual tasks. By demonstrating that models can improve their own perceptual abilities without human labels, it offers a scalable path for developing more robust audio understanding systems. The insights into reward variance and curriculum adaptation are also valuable for the broader reinforcement learning community. EvoAudio introduces a recursive self-improvement system that jointly evolves the model, waveforms, questions, and difficulty in a closed loop, achieving significant gains in audio understanding across multiple LALM backbones. The paper presents a rigorous methodology for generating verifiable synthetic data and adapting curricula based on model performance, demonstrating that recursive self-improvement is effective for enhancing perceptual skills in audio language models.
Author of this paper? Send a correction.