COSMIC-R

Accessible Music Device

2022.6--2022.7

Project Members

Xiyao Jin

Yixue Xu

Weitao Jiang

Zhaorui Liu

Yunhao Jia

MY ROLE

Sound Interactive Designer

TOOLS

Arduino

Capacitive Sensor Modules

Max/MSP, Ableton Live

TouchDesigner

SURPPOTED BY

Cosmic-R originated from a design workshop aimed at exploring innpvative ways for blind or deaf people to better perceive, perform and create music, as well as a workshop approach to design innovative music installations through co-creation activities.

We used an embodied approach that analogized abstract sound modulation activities to finger movements, creating an intuitive interface for blind users to operate in real-time. The final demo was about the size of an A4 paper and designed for two-handed play. 50 touch-sensitive capacitive sensors, 2 pressure sensors, 10 piezoelectric ceramic vibration sensors, and a joystick were applied to construct the tangible interface. Collaborating with blind advisors, multiple soundscapes were produced and modulated using Ableton Live in combination with Max/Msp, and were matched with corresponding tangible textures such as grid, tracks and arcs. The size, length, and undulations of the textures metaphorically represented musical elements such as pitch, timbre, and rhythm.

Live Performance

西岸美术馆 · West Bund Museum, Shanghai, 2022

临港科技智慧图书馆 · Wisdom Library in Lingang, Shanghai, 2023

上海音乐厅 · 万象声息——电子音乐与数字影像音乐会 ECHOES OF EXISTENCE -- An Aural Canvas & Visual Concert, Shanghai, 2024

Related Papers

Wang, Y., Zhang, Y., Zhang, J.,and Li, Z.(2023) Inclusive harmonies: Co-creating accessible music experiences with deaf or blind advisors through interdisciplinary design workshop, in De Sainz, D., Galluzzo, L., Rizzo, F., Spallazzo, D. (eds.), IASDR 2023: Life-Changing Design, 9-13 October, Milan, Italy. https://doi.org/10.21606/iasdr.2023.264

Award