Konferenzbeitrag
Navigating audio-visual Grainspace
Lade...
Volltext URI
Dokumententyp
Text/Conference Paper
Dateien
Zusatzinformation
Datum
2012
Autor:innen
Zeitschriftentitel
ISSN der Zeitschrift
Bandtitel
Verlag
Oldenbourg Verlag
Zusammenfassung
Building upon the timbreID library for Pure Data, which is an audio feature analysis and classification tool with three-dimensional grading capabilities, I created an audio-visual instrument. Video frames can be cued to according to the auditory properties of the audio track by moving the hand inside a virtual cloud of snippets. This was achieved by combining three pre-existing things: 1. concatenative synthesis with a three-dimensional plot of the snippets 2. A Kinect sensor as an interface, and 3. Video playback along the audio.