SID WG4/Sonification: Projects
The following list of projects and applications gives examples for sonic interaction design at the intersection to sonification. Please contact us if you think your application/project should be listed here as well. We hope to grow the Project Forum over the next years to a convincing and inspiring repository that shows novel and attractive ways how (a) sonification can enhance interactions, and (b) how interaction can support sonification and thereby the understanding of data.
Project: AcouMotion/Blindminton
AcouMotion is a hard/software system to realize the closure of human-computer interaction loops that involve (a) a simulation, (b) sensor-based recognition of human activity, and (c) communication of states of the simulation via sound. This allows novel sports games that can be played without any visual display, like our first prototype called Blindminton. Blindminton is a novel sports game developed for visually impaired players. All necessary information about the (virtual) simulated ball is conveyed by sonification. Further applications of AcouMotion include the support of practise in physiotherapy, cognitive research, and interactive data exploration.
http://richie.idc.ul.ie/eoin/COSTSIDWG4/Blindminton_sketch.jpg
Project Coordinator: Thomas Hermann
Interaction Examples: http://sonification.de/publications/paper-media.shtml (follow the AcouMotion link on that site)
Project: Growing Neural Gas Sonification (GNGS)
GNGS is a sonification model following the approach of Model-based Sonification that uses Growing Neural Gases to create a topology-preser ving representation of high-dimensional data distributions. Excitation (via Mouse clicks in a visual display) injects energy to a selected neuron (node of the graph) which then propagates along the network according to a given energy flow dynamics. In result, local properties – here the intrinsic data dimensionality (id) – can be perceived as sound complexity. GNGS demonstrate an interaction-driven data sonification - the user receives acoustic responses in real-time only on his interactions with the data-driven model. The sonifications sound like glass impacts.
http://richie.idc.ul.ie/eoin/COSTSIDWG4/GNGS.jpg
Project Coordinator: Thomas Hermann
Interaction Examples: http://www.techfak.uni-bielefeld.de/ags/ni/projects/datamining/datason/demo/M2Vis2004/GNGSon.html
