Perceptually Motivated Sonification of Moving Images
A paper describing how Gestalt principles can be used as the basis for mapping parameters in moving image sonification.
. Perceptually Motivated Sonification of Moving Images. In Proceedings of the 2009 International Computer Music Conference (Montréal, Canada, August 16 – 21, 2009). International Computer Music Association. 207-210.
La sonification de séquences d’images à des fins musicales
Another paper on the sonification of moving images through sparce motion flow fields and perceptual mapping. In French.
. La sonification de séquences d’images à des fins musicales. In Actes des 14èmes Journées d’Informatique Musicale (Grenoble, France, 1er – 3 avril 2009). 121-125.
Sonified Motion Flow Fields as a Means of Musical Expression
A paper that describes how moving images can be used to control sound synthesis.
. Sonified motion flow fields as a means of musical expression. In Proceedings of the 2008 Conference on New interfaces For Musical Expression (Genova, Italy, June 5 – 7, 2008). New Interfaces For Musical Expression. 158-163.
A Graphical Interface for Real-Time Signal Routing
A paper describing the DspMap graphical user interfaces, that allows users to very rapidly and intuitively alter fairly complex signal routings.
. A graphical interface for real-time signal routing. In Proceedings of the 2005 Conference on New interfaces For Musical Expression (Vancouver, Canada, May 26 – 28, 2005). New Interfaces For Musical Expression. National University of Singapore, Singapore. 89-92.
A Shape-Based Approach to Computer Vision Musical Performance Systems
A paper that describes how some simple visual shape descriptors can be used to control sound synthesis.
. A shape-based approach to computer vision musical performance systems. In Proceedings of the 2004 Conference on New interfaces For Musical Expression (Hamamatsu, Shizuoka, Japan, June 03 – 05, 2004). M. J. Lyons, Ed. New Interfaces For Musical Expression. National University of Singapore, Singapore. 197-198.
Sound and Sight: Composition for Image Analysis Systems
IAMAS Master’s thesis. Through the terminology of Rudolph Laban and Pierre Schaeffer, aesthetic links between visual shapes and sounds are explored. Computer vision techniques to extract shape descriptors are described as well as practical mappings of these descriptors to sonic parameters.
. Sound and sight: Composition for image analysis systems. Master’s Thesis, Institute of Advanced Media and Sciences, Gifu, Japan.