From Prediction to Collaboration: Interactive Symbolic Music Analysis
Abstract
Automatic symbolic music analysis has made substantial progress, yet existing systems are typically designed for a single mode of use, such as full-score prediction, and therefore do not match the broader range of operations that arise in analysis workflows, including partial completion, local correction, and iterative refinement. As a result, there remains a gap between strong benchmark models and systems that can support interactive analytical use. We present a unified framework for symbolic Roman-numeral (RN) analysis that narrows this gap by combining strong predictive performance with direct support for constrained completion and revision. The method is designed to provide a practical trade-off between accuracy and interactive responsiveness by computing expensive pretrained representations once and reusing them during iterative refinement, making powerful pretrained models more amenable to interactive settings. It supports complete score analysis, targeted revision of existing labels, and inference of missing annotations from partial context through a shared modeling framework. Experiments on Dilemmadata, the largest and most heterogeneous benchmark of its kind, show that the proposed approach is a strong RN-analysis baseline while also supporting masked completion from partial labels. Together with a prototype interface for multi-level candidate inspection and editing, these results position automatic RN analysis not only as a prediction problem, but also as a foundation for future interactive tools for music analysis.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
This paper presents a unified framework for interactive Roman Numeral analysis that effectively bridges the gap between high-accuracy predictive models and practical, analyst-in-the-loop workflows through a hybrid MusicBERT-GNN architecture and edit-conditioned masked prediction.
Methodology
The paper proposes a hybrid architecture combining a pretrained MusicBERT sequence encoder with a Graph Neural Network (GNN) for symbolic Roman Numeral (RN) analysis. The core methodological contribution is the "prediction-to-analysis continuum," which unifies blind full-score prediction, masked completion, and interactive revision within a single framework. The authors introduce an edit-conditioned masked-prediction model that uses label-conditioning modules to inject known labels as biases, allowing for constrained completion. They also employ conflict-aware optimizers (PCGrad, CAGrad) to handle gradient conflicts in the multi-task learning setup (20 tasks). The approach is technically sound, leveraging the complementary strengths of sequence modeling (context) and graph modeling (structural coherence). However, the architectural novelty is incremental, primarily consisting of combining existing strong components (RNBert + AnalysisGNN) and adding a specific conditioning mechanism for interactivity.
Results & evaluation
The evaluation is conducted on "Dilemmadata," a new benchmark combining AugmentedNet and Distant Listening Corpus. The experiments demonstrate that the hybrid model achieves state-of-the-art or competitive results on blind full-score inference compared to baselines like RNBert and AnalysisGNN. Crucially, the paper provides empirical evidence for the interactive use case: masked completion accuracy improves monotonically as more contextual labels are provided, validating the model's ability to leverage partial information. The inclusion of a prototype interface and the analysis of post-hoc decoding strategies (voters, beam search) adds practical value. The results are robust, though the paper notes that post-hoc decoding modules do not improve blind inference, highlighting the specific design for the interactive regime.
Reproducibility
The paper provides a GitHub repository and a demo URL. The methodology is described in sufficient detail, including the tokenization scheme (REMI), graph construction, and training objectives (multi-task cross-entropy, KL distillation, L2-SP). The use of standard optimizers and augmentation techniques aids reproducibility. The definition of the Dilemmadata benchmark and the specific masking protocols are clearly outlined, facilitating future comparisons.
Limitations
The paper acknowledges that the evaluation of masked completion uses randomly sampled masks rather than realistic analyst correction patterns, which may overestimate performance in real-world interactive settings. Additionally, the post-hoc decoding modules (voters, beam search) did not improve blind inference accuracy, suggesting they are specialized for the interactive regime and their utility is context-dependent. The study is primarily technical and lacks user studies with musicologists to quantify the actual benefit of the interactive workflow.
Broader impact
This work significantly advances the field of symbolic music analysis by shifting the focus from static prediction to interactive, analyst-in-the-loop tools. By providing a unified framework and a prototype interface, it lowers the barrier for developing practical music analysis software. The emphasis on interpretability (multi-level candidates, contradiction highlighting) and the handling of ambiguous musical passages aligns with the needs of musicologists, potentially bridging the gap between computational models and human analytical practices. This paper presents a unified framework for interactive Roman Numeral analysis that effectively bridges the gap between high-accuracy predictive models and practical, analyst-in-the-loop workflows through a hybrid MusicBERT-GNN architecture and edit-conditioned masked prediction.
Author of this paper? Send a correction.