Abstract: Named with reference to “viewable” music (and pronounced similarly to music), Vuzik allows a person to compose computer music graphically by full-scale painting gestures through an mapping of sound to visuals that effectively allows people to "see" their music as they hear it, using a vertical interactive surface, paintbrush, and icon palette. Use of an interactive surface provides direct freehand painting input of the sound with a tangible paintbrush (as well as alternate tools or possibly fingers), which additionally nurtures the connection of physical gestures to the resultant sound and visuals. The brushstroke is the performance and creation gesture that is both seen (as an action and in creating a visual representation) and heard. Another integral part of Vuzik’s design is the use of tangibles to control the attributes of the sound. Vuzik employs an explicit mapping of visual elements to sound elements, such that the sound produced is consistently related to what is painted on the canvas. This capability of Vuzik to directly link sound to visuals lets people visualize the music they are creating. Through these interactive elements of combined tangibles and visual-music metaphors, Vuzik attempts to offer people a range of informative, engaging and fun mechanisms for composing music, hopefully inspiring increased understanding of music and a desire to explore further.

Researchers: Aura Pon, Ehud Sharlin, Sheelagh Carpendale, Nicolas d’Alessandro, David Eagle, Johnty Wang, Sidney Fels, Junko Ichino