Audio ML PapersLandmark papers
← All papers
RESEARCH PAPER / 2026-06-06

FXplorer: A Map-Based Interface for Exploratory Audio Effect Design

Annie Chu, Jason Brent Smith, Bryan Pardo

Northwestern University · NIME 2026

Affiliations: Northwestern University

Abstract

Audio effects (FX) shape sound in contemporary music practice. However, most interfaces present them as discrete modules and parameters that favor targeted adjustment over exploratory listening. This separation can make it difficult to build intuition about the broader space of possible transformations or to move fluidly between searching and refinement. We present FXplorer, an interface that organizes audio effects within a perceptually informed 2D space, allowing sound transformations to be browsed as a continuous landscape rather than as isolated presets. By combining established spatial interaction approaches and interpretable DAW-style controls with recent embedding-based machine learning methods for similarity and semantic search, the system brings exploration and parameter refinement into a single workspace. FXplorer supports composition, production, or performance by allowing users to edit and interpolate between effect presets interactively.

The following analysis is generated by AI and may contain errors. It is separate from the authors’ abstract and is not peer review.

Research summary

The main contribution of this paper is FXplorer, an innovative interface that transforms audio effect design into an exploratory spatial experience, enhancing the creative process for musicians. This work represents a significant advancement in the field of audio interaction design, addressing key challenges in audio effect manipulation while integrating machine learning techniques for improved user experience.

Methodology

The methodology presented in FXplorer is innovative, combining perceptually informed 2D spatial organization with machine learning embeddings to facilitate exploratory audio effect design. The design requirements derived from user needs are well-articulated and address significant challenges in audio effect manipulation. The hybrid architecture effectively balances computational efficiency with user interactivity, allowing for real-time exploration and parameter adjustment. The use of dual embedding models (AFx-Rep and CLAP) to capture both timbral and semantic similarities is a notable strength, enhancing the user experience by providing multiple entry points into the effect space.

Results & evaluation

The paper lacks extensive empirical evaluation of FXplorer's effectiveness compared to existing systems. While it describes the system's functionality and potential user interactions, it does not provide quantitative metrics or user studies to validate its claims. Future work should include user evaluations and comparative studies to assess the impact of the interface on sound design workflows and creativity.

Reproducibility

The implementation details are generally clear, with a description of the system architecture and the tools used (Svelte, Tone.js, Flask). However, the absence of a publicly available code repository limits reproducibility. Providing access to the source code and detailed setup instructions would enhance the ability of other researchers to replicate the work.

Limitations

One limitation is the reliance on pre-rendered audio variants, which may restrict the diversity of effects explored. Additionally, the system's performance may vary based on the user's hardware and the complexity of the audio processing tasks. The authors also acknowledge the potential for embedding-based suggestions to stifle creativity, which is a critical consideration in the design of creative tools.

Broader impact

FXplorer has the potential to significantly influence how musicians and sound designers interact with audio effects, promoting a more exploratory and intuitive approach to sound design. By bridging the gap between novice and expert users, it could democratize access to sophisticated audio manipulation techniques. The integration of machine learning into creative workflows also opens avenues for future research in human-computer interaction and music technology. The main contribution of this paper is FXplorer, an innovative interface that transforms audio effect design into an exploratory spatial experience, enhancing the creative process for musicians. This work represents a significant advancement in the field of audio interaction design, addressing key challenges in audio effect manipulation while integrating machine learning techniques for improved user experience.

Author of this paper? Send a correction.