MR Music Concert

Project Members

Andrea Bianchi

Marcel Zaes Sagesser

Liu Zhaorui

Jongik Jeon

Youjin Choi

Danbinaerin Han

MY ROLE

Music Arrangement

TOOLS

Unity

Meta Oculus Quest 3

SonoBus

MuseScore

Ableton Live

SURPPOTED BY

Sound Studies Group

This concert is a pioneering exploration of technologically mediated performance, showcasing a novel framework for remote musical collaboration. Four instrumentalists—on piano, guitar, haegŭm (a traditional Korean bowed string instrument), and DJ — are situated in acoustically isolated rooms.

The core innovation lies in the application of immersive Mixed Reality (XR) technology. Each performer is equipped with a high-fidelity XR headset (e.g., Varjo, Meta Quest Pro), rendering a shared virtual environment in which they see both their own instrument and the photorealistic, spatially-tracked avatars of their collaborators. This creates a co-presence that is critical for nuanced, real-time interaction.

The auditory component is facilitated by a low-latency, high-resolution audio network. Each musician receives a spatially-mixed audio feed of the other performers directly into their headset, allowing for precise listening and rhythmic synchronization.

Finally, the discrete multitrack audio streams from all four locations are routed to a central mixing system for real-time summation and spatialization. This synthesized audio output is then rendered for the audience through a concert-grade sound system, presenting a unified and dynamic musical work. This project demonstrates a scalable model for distributed musical performance, leveraging XR visualization and networked audio to overcome geographical barriers, enabling a new paradigm of collaborative live music.

<< Previous

To be continued ...