This paper presents an overview of techniques for creating visual displays of human body movement based on video recordings. First a review of early movement and video visualization techniques is given. Then follows an ...

The term coarticulation designates the fusion of small-scale events, such as single sounds and single sound-producing actions, into larger units of combined sound and body motion, resulting in qualitative new features at ...

Schoenberg’s concept of the work as the presentation (Darstellung) of the ‘musical idea’ (Gedanke) entails that the work is considered a vehicle by means of which the composer shares musical ideas with the performer and ...

This SIG intends to investigate the ongoing dialogue between music technology and the field of human-computer interaction. Our specific aims are to consider major findings of musical interface research over recent years ...

In this paper we present some custom designed filters for real-time motion capture applications. Our target application is motion controllers, i.e. systems that interpret hand motion for musical interaction. In earlier ...

The paper presents sonomotiongram, a technique for the creation of auditory displays of human body motion based on motiongrams. A motiongram is a visual display of motion, based on frame differencing and reduction of a ...

The conceptual starting point for an `action-sound approach' to teaching music technology is the acknowledgment of the couplings that exist in acoustic instruments between sounding objects, sound-producing actions and the ...

Links between music and body motion can be studied through experiments called sound-tracing. One of the main challenges in such research is to develop robust analysis techniques that are able to deal with the multidimensional ...

The paper presents a non-realtime implementation of the sonomotiongram method, a method for the sonification of motiongrams. Motiongrams are spatiotemporal displays of motion from video recordings, based on frame-differencing ...

Apart from the sounds they make, synthesis models are distinguished by how the sound is controlled by synthesis parameters. Smoothness under parameter changes is often a desirable aspect of a synthesis model. The concept ...

The paper presents the Kinectofon, an instrument for creating sounds through free-hand interaction in a 3D space. The instrument is based on the RGB and depth image streams retrieved from a Microsoft Kinect sensor device. ...

In a musical context, the word ‘sound’ implies a set of sonic characteristics. Within popular music, this notion of sound sometimes supplies the very identity of a tune, a band or a musician. Sound is often conceptualised ...

Ernst Krenek’s opera Jonny spielt auf (1927) was, according to the composer, concerned with ‘the problem of freedom’. But in what ways did it grapple with this problem? This article offers a new interpretation of Krenek’s ...