Visualization of music collections based on structural content similarity

Abstract

Users interact a lot with their personal music collections, typically using standard text-based interfaces that offer constrained functionalities based on assigned metadata or tags. Alternative visual interfaces have been developed, both to display graphical views of music collections that attempt to reflect some chosen property or organization, or to display abstract visual representations of specific songs. Yet, there are many dimensions involved in the perception and handling of music and mapping musical information into computer tractable models is a challenging problem. With a wide variety of possible approaches, the search for novel strategies to visually represent songs and/or collections persists, targeted either at the general public or at musically trained individuals. In this paper we describe a visual interface to browse music collections that relies on a graphical metaphor designed to convey the underlying musical structure of a song. An iconic representation of individual songs is coupled with a spatial placement of songs that reflects their structural similarity. The song icon is derived from features extracted from MIDI files, rather than from audio signals. The very nature of MIDI descriptions enables the identification of simple, yet meaningful, musical structures, allowing us to extract features that support both creating the icon and comparing songs. A similarity-based spatial placement is created projecting the feature vectors with the Least Square Projection multidimensional projection, employing the Dynamic Time Warping distance function to evaluate feature similarity. We describe the process of generating such visual representations and illustrate potentially interesting usage scenarios.