COSMIC-R
Accessible Music Device
2022.6--2022.7
Project Members
Xiyao Jin
Yixue Xu
Weitao Jiang
Zhaorui Liu
Yunhao Jia
MY ROLE
Sound Interactive Designer
TOOLS
Arduino
Capacitive Sensor Modules
Max/MSP, Ableton Live
TouchDesigner
SURPPOTED BY
Cosmic-R originated from a design workshop aimed at exploring innpvative ways for blind or deaf people to better perceive, perform and create music, as well as a workshop approach to design innovative music installations through co-creation activities.
We used an embodied approach that analogized abstract sound modulation activities to finger movements, creating an intuitive interface for blind users to operate in real-time. The final demo was about the size of an A4 paper and designed for two-handed play. 50 touch-sensitive capacitive sensors, 2 pressure sensors, 10 piezoelectric ceramic vibration sensors, and a joystick were applied to construct the tangible interface. Collaborating with blind advisors, multiple soundscapes were produced and modulated using Ableton Live in combination with Max/Msp, and were matched with corresponding tangible textures such as grid, tracks and arcs. The size, length, and undulations of the textures metaphorically represented musical elements such as pitch, timbre, and rhythm.
Live Performance
西岸美术馆 · West Bund Museum, Shanghai, 2022
临港科技智慧图书馆 · Wisdom Library in Lingang, Shanghai, 2023
上海音乐厅 · 万象声息——电子音乐与数字影像音乐会 ECHOES OF EXISTENCE -- An Aural Canvas & Visual Concert, Shanghai, 2024
Related Papers
Wang, Y., Zhang, Y., Zhang, J.,and Li, Z.(2023) Inclusive harmonies: Co-creating accessible music experiences with deaf or blind advisors through interdisciplinary design workshop, in De Sainz, D., Galluzzo, L., Rizzo, F., Spallazzo, D. (eds.), IASDR 2023: Life-Changing Design, 9-13 October, Milan, Italy. https://doi.org/10.21606/iasdr.2023.264
Award