Immersive Audio for 360 degree Audiovisual Performance

Dr Philip Harrison is a Research Software Engineer Team Lead at the University of York and a digital visual artist.

Philip’s R&D residency project with XR Stories aims to explore the creative and technical possibilities of immersive audio using a series of audiovisual performance pieces, “Atomic Flute”.

A collaboration with contemporary flute composer and performer Naomi Perera, Atomic Flute comprises five compositions (Hydrogen, Plutonium, Strontium, Carbon and Iron) that utilise musical scales inspired by the energy states of the atomic elements. 

Each piece is accompanied by visuals programmed in p5.js (a free and open-source JavaScript library for accessible creative coding) that are generated live from the flute notes, blending live performance with algorithmic randomness.

Currently, the audio which accompanies the flute (musical drones, audio effects applied to the live flute signal and live visually-triggered sound effects) relies on a traditional stereo setup. Philip’s goal for this residency is to move beyond the limitations of two channels.

The primary output will be an immersive audio version of each Atomic Flute piece that seamlessly combines multichannel immersive audio with the live flute performance and real-time generative 360-degree visuals. The pieces will be performance-ready for spaces with 360-degree projection capabilities such as York College’s Cube 360 Room or the University of York’s new Wolfson visualisation suite.

Philip will utilise the XR Stories immersive R&D lab to experiment with spatial mapping and explore how sonic elements can dynamically track 360-degree visual elements. Philip will also test the limits of multi-speaker array configurations to balance live instrumentation with synthesized soundscapes and sonic elements.

The research and development activities undertaken as part of this residency will form a strong basis for Philip to apply for funding to further develop the works, and to perform and present them further afield. 

Categories: Audio, Research, Technology