MindMelody: A Closed-Loop EEG-Driven System for Personalized Music Intervention
Abstract
Driven by the escalating global burden of mental health conditions, music-based interventions have attracted significant attention as a non-invasive, cost-effective modality for emotion regulation and psychological stress relief. However, current digital music services rely on static preferences and fail to adapt to users' instantaneous psychological states. Furthermore, directly mapping electroencephalography (EEG) to music generation remains challenging due to severe paired-data scarcity and a lack of interpretability. To address these limitations, we propose MindMelody, a fully functional, closed-loop real-time system for EEG-driven personalized music intervention. MindMelody introduces an emotion-mediated semantic bridge. Specifically, a hybrid Transformer-GNN first decodes real-time EEG signals into global Valence-Arousal states and local temporal affect trajectories. These states are then fed into a Retrieval-Augmented Generation (RAG)-equipped Large Language Model (LLM) to formulate structured intervention plans. Subsequently, a novel Hierarchical EEG Controller injects global affect prefixes and local temporal guidance into a pretrained music backbone, enabling fine-grained controllable audio synthesis. Crucially, the system incorporates a continuous feedback loop that updates generation parameters on the fly based on the user's evolving EEG dynamics. Extensive experiments show that MindMelody improves control adherence and emotional alignment, and receives higher perceived helpfulness in a short-term listening setting, suggesting its promise as an adaptive affect-aware music generation framework.
The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.
Research summary
MindMelody presents a novel approach to EEG-driven personalized music intervention, demonstrating a sophisticated integration of machine learning techniques that enhance the adaptability and effectiveness of music therapy. The paper's contributions to the field of affective computing and music generation are substantial, offering a promising direction for future research and applications in mental health.
Methodology
The methodology presented in MindMelody is innovative, integrating a hybrid Transformer-GNN architecture for EEG decoding with a Retrieval-Augmented Generation (RAG) mechanism to formulate structured intervention plans. The use of a Hierarchical EEG Controller to modulate a pretrained music generation backbone is particularly noteworthy, as it allows for fine-grained control over the music output based on real-time EEG data. The closed-loop feedback mechanism that continuously adapts to user feedback enhances the system's responsiveness and personalization, which is a significant advancement over static music generation systems.
Results & evaluation
The experiments conducted are robust, utilizing established datasets like DEAP for EEG affect modeling and MusicCaps for controllable music generation. The paper provides comprehensive quantitative metrics, including FAD and various subjective evaluations (Nat.-MOS, Emo.-MOS, Help.), which demonstrate the system's effectiveness in emotional alignment and perceived helpfulness. The pilot user study adds valuable qualitative insights into user experience, although it is limited in scope.
Reproducibility
The paper includes detailed descriptions of the experimental setup, including hyperparameters and training procedures, which aids in reproducibility. However, the lack of publicly available code or a demo limits the ability for others to replicate the findings fully.
Limitations
One limitation is the reliance on a relatively small dataset for training, which may affect the generalizability of the model across diverse populations. Additionally, while the pilot study shows promising results, it is not a clinical validation, and further research is needed to establish long-term efficacy and safety in real-world applications.
Broader impact
The potential applications of MindMelody are significant, particularly in mental health interventions, where personalized music therapy could provide non-invasive and cost-effective support for individuals experiencing emotional distress. The integration of EEG data with music generation could pave the way for more adaptive therapeutic tools in the field of affective computing. MindMelody presents a novel approach to EEG-driven personalized music intervention, demonstrating a sophisticated integration of machine learning techniques that enhance the adaptability and effectiveness of music therapy. The paper's contributions to the field of affective computing and music generation are substantial, offering a promising direction for future research and applications in mental health.
Author of this paper? Send a correction.