Laurence Cliffe

intermedia art, research and design

Home | Archive | Publications

The Symphony Reimagined: A Next Generation Audio (NGA) player

The Symphony Reimagined: A Next Generation Audio (NGA) player

The Symphony Reimagined is an interactive binaural audio app that allows listeners to reimagine three pieces of classical music by changing the spatial location of the instrumental parts within the 360 degree binaural audio field and swap instrumental parts for other instruments. For example, a violin part can be brought very close to your left ear, as if the violinist was standing right next you and a soprano vocal part can be moved to sound like it is being sung from the back of a large virtual concert hall. In addition to this, each part can be played by a number of different instruments, for example, the piano part can be played by the violin, and the violin part played by the cello, and so on. Through this level of interactivity, the three packaged symphonic arrangements can be spatially and instrumentally reimagined, it is also possible to mute individual instrumental parts so that, for example, the nuances of the individual instrumental parts can be listened to in isolation. The app harnesses the computational capabilities of modern smartphone technology to render binaural audio in response to listeners’ interactions in real time. The app also visualises the musical output of the selected instruments using colour scale theory. A number of historical colour scales are included for the listener to explore and select, these colour scales map notes of the western musical scale to visible colours of the spectrum and, once selected by the user, the different notes being played by the different instrumental parts are visualised as the music plays. The Symphony Reimagined is an interactive binaural music player demonstrates the potential functionality of the NGA (next generation audio) experience.

Download and install the iOS/MacOS version here

Please connect your headphones before listening to the video demonstration below.