Audio ML PapersLandmark papers
← All papers
RESEARCH PAPER / 2026-10-08

Breaking the Group Size Barrier: Parameter-Efficient Group Dance Generation with Chain-of-Dancers

Jing Xu, Cunjian Chen, Qiuhong Ke

Monash University · NeurIPS 2026

Affiliations: Monash University

Abstract

Group dance generation aims to synthesize coordinated multi-dancer choreography from music, with broad applications in animation and interactive content creation. This task requires modeling dense inter-person dependencies to ensure spatial coordination, while naturally preserving individual dancer identities. Existing approaches model all dancers jointly with end-to-end transformers, which tie the architecture to a fixed group size and entangle per-dancer identities across frames. We propose ChainDance, a scalable framework that reformulates group dance generation as a Chain-of-Dancers: a sequential decomposition over per-dancer conditional distributions, allowing a single model to scale across variable group sizes without retraining and naturally preserving per-dancer identity. Built on a frozen single-dancer diffusion backbone, ChainDance introduces two lightweight modules: a Role-Aware Text Encoder (RATE) for per-dancer semantic conditioning, and a Group-Aware Motion Encoder (GAME) that aggregates previously generated dancers via a distance-weighted graph convolutional network, and incorporates a training-free noise optimization procedure at inference time to enforce global spatial coherence. Experiments on AIOZ-GDance demonstrate that ChainDance achieves state-of-the-art motion quality and group coordination while structurally preserving per-dancer identity, with $3$-$4\times$ fewer parameters and requiring $3$-$6\times$ less training time compared to prior approaches.

The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.

Research summary

The paper introduces a scalable and parameter-efficient framework for group dance generation by reformulating the problem as a sequential chain of conditional single-dancer generations, effectively addressing the rigidity and identity entanglement issues of joint modeling approaches.

Methodology

The paper proposes ChainDance, a framework that reformulates group dance generation as a sequential "Chain-of-Dancers" rather than a joint multi-agent generation task. This is a sound architectural decision that addresses the rigidity of fixed group sizes in transformer-based joint models. The method leverages a frozen single-dancer diffusion backbone, injecting group awareness via two lightweight modules: RATE (Role-Aware Text Encoder) for semantic conditioning and GAME (Group-Aware Motion Encoder) for spatial/kinematic conditioning using a distance-weighted GCN. The use of LoRA for parameter efficiency is appropriate. The inference-time optimization (PINO-based) to enforce global coherence is a clever workaround for the lack of global attention in the sequential generation process, though it introduces computational overhead. The decomposition into pairwise leader-follower interactions is a reasonable approximation of the full joint distribution, though it may struggle with complex non-pairwise dynamics (e.g., three-person interactions).

Results & evaluation

The paper claims state-of-the-art performance on the AIOZ-GDance dataset with significant reductions in parameters and training time. However, the provided text is truncated before the detailed results tables, making it difficult to verify the magnitude of improvements or the specific metrics used (e.g., FID, FVD, MPJPE, collision rate). The claim of "3-4x fewer parameters" is strong but needs verification against baseline architectures. The reliance on a single dataset (AIOZ-GDance) limits the generalizability of the claims. The use of ChatGPT-4o for instruction generation is a practical choice but introduces a dependency on external LLMs for data preparation, which may not be reproducible for all users.

Reproducibility

The paper provides high-level algorithmic descriptions but lacks specific hyperparameters, learning rates, and detailed implementation choices for the GCN and LoRA modules in the visible text. The use of a "frozen single-dancer diffusion backbone" is not specified (which model? e.g., MoDi, DMD?), which is critical for reproducibility. The rule-based detection for interaction keywords is mentioned but not detailed. The absence of code links or a project page in the extracted text reduces reproducibility.

Limitations

The sequential generation approach may suffer from error accumulation, where errors in early dancers propagate to later ones. The pairwise approximation may fail to capture higher-order group dynamics. The inference-time optimization adds latency, which may be prohibitive for real-time applications. The method relies on a pre-trained single-dancer model, so its performance is upper-bounded by the quality of that backbone. The use of LLMs for instruction generation may introduce biases or inconsistencies in the training data.

Broader impact

The work has significant implications for scalable motion generation in animation, VR, and interactive media. By decoupling group size from model architecture, it enables flexible deployment in applications where the number of agents varies. The parameter efficiency makes it more accessible for researchers and developers with limited computational resources. The approach could be extended to other multi-agent generation tasks, such as crowd simulation or multi-robot coordination. The paper introduces a scalable and parameter-efficient framework for group dance generation by reformulating the problem as a sequential chain of conditional single-dancer generations, effectively addressing the rigidity and identity entanglement issues of joint modeling approaches.

Author of this paper? Send a correction.