Vocal and tangible interaction in RHYME

Abstract

In this article we explore the voice in tangible interaction design and its possibility to strengthen health by reducing isolation and passivity. Our approach is to use knowledge about the voice from music therapy and multi-sensory stimulation for designing computer-based tangible interaction. We argue that the use of resource-oriented methods by these two fields strengthens all participants involved and is particularly interesting for interaction design and computer-based interactive sound design when working with a diverse mix of people with or without disabilities. In two design cases we explore vocal, bodily and tactile interaction as input, and music, tactile sensations and lighting as output. The two cases are first and second generation of interactive, tangible installations in the on-going research project RHYME (Rhyme, 2010). To analyse and integrate the findings in the design we have followed user-oriented research-by-design methods conducted as cycles of actions with design, interviews and video observations of families with children who have severe disabilities.