Pitch and spatial height are often associated when describing music. In this paper we present results from a sound tracing study in which we investigate such sound–motion relationships. The subjects were asked to move as ...

How do dancers engage with electronic dance music (EDM) when dancing? This paper reports on an empirical study of dancers' pleasurable engagement with three structural properties of EDM: (1) breakdown, (2) build-up, and ...

This paper explores sonic microinteraction using muscle sensing through the Myo armband. The first part presents results from a small series of experiments aimed at finding the baseline micromotion and muscle activation ...

The attack phase of sound events plays an important role in how sounds and music are perceived. Several approaches have been suggested for locating salient time points and critical time spans within the attack portion of ...

The perception of musical meter is fundamental for rhythm production and perception in much music. Underlying structures such as pulse, meter, and metrical subdivisions are often described as successive points in time. ...

This paper describes an experiment in which the subjects performed a sound-tracing task to vocal melodies. They could move freely in the air with two hands, and their motion was captured using an infrared, marker-based ...

The paper presents results from an experiment in which 91 subjects stood still on the floor for 6 minutes, with the first 3 minutes in silence, followed by 3 minutes with mu- sic. The head motion of the subjects was captured ...

For many, the pursuit and enjoyment of musical performance goes hand-in-hand with collaborative creativity, whether in a choir, jazz combo, orchestra, or rock band. However, few musical interfaces use the affordances of ...

This article describes how percussive interaction informed the design, development and deployment of a series of touchscreen digital musical instruments for ensembles. Percussion has previously been defined by techniques ...

Johan Svendsen is one of the most influential Scandinavian composers of the nineteenth century. He contributed in particular to the orchestral repertoire in Scandinavia and he was a celebrated conductor throughout Europe. ...

Bind 1-2 er en undersøkelse av Johan Halvorsens kunstneriske virke og en stilistisk gjennomgang av hans komposisjoner, mens bind 3 inneholder en tematisk verkoversikt, en kronologisk fortegnelse over Halvorsens konsertvirksomhet ...

Recording music-related motions in ecologically valid situations can be challenging. We investigate the performance of three devices providing 3D acceleration data, namely Axivity AX3, iPhone 4s and a Wii controller tracking ...

What type of motion capture system is best suited for studying dancing to electronic dance music? The paper discusses positive and negative sides of using camera-based and sensor-based motion tracking systems for group ...

This thesis investigates the interaction between perceived rhythm and underlying reference structures in the experience of rhythm in music. The point of departure is that both music performers’ and perceivers’ body motions ...

This paper addresses how to determine a sufficient frame (sampling) rate for an optical motion tracking system using passive reflective markers. When using passive markers for the optical motion tracking, avoiding identity ...

This paper provides an overview of the process of editing the forthcoming anthology “A NIME Reader—Fifteen years of New Interfaces for Musical Expression.” The selection process is presented, and we reflect on some of the ...

This workshop will explore the potential creation of a community database of digital musical instrument (DMI) designs. In other research communities, reproducible research practices are common, including open-source software, ...

Despite increasingly accessible and user-friendly multi-channel compositional tools, many composers still choose stereo formats for their work, where the compositional process is allied to diffusion performance over a ...

The pulse level in music is often described as a series of isochronous beats that provides an underlying reference structure against which we perceive rhythmic patterns. This notion is challenged by music styles that seem ...

Pulse is a fundamental reference for the production and perception of rhythm. In this paper, we study entrainment to changes in the micro-rhythmic design of the basic pulse of the groove in ‘Left & Right’ by D’Angelo. In ...

This paper presents the scientific-artistic project Sverm, which has focused on the use of micromotion and microsound in artistic practice. Starting from standing still in silence, the artists involved have developed ...

The MYO armband from Thalmic Labs is a complete and wireless motion and muscle sensing platform. This paper evaluates the armband’s sensors and its potential for NIME applications. This is followed by a presentation of the ...

Certain traditional Norwegian and Swedish dance tunes in triple meter are referred to as being in so-called asymmetrical meter—that is, the three beats in the measure are of uneven duration. Norwegian telespringar is ...

Recording music-related motions in ecological valid situa- tions can be challenging. We investigate the performance of three devices providing 3D acceleration data, namely Axivity AX3, iPhone 4s and a Wii controller tracking ...

This paper reports on an experiment investigating the expressive means with which performers of groove-based musics signal the intended timing of a rhythmic event. Ten expert drummers were instructed to perform a rock ...

This project deals with how notions of urban space in rap music might attach to certain meanings or identification through cultural practices. Through my case studies I present analyses and readings of the Norwegian rap ...

This thesis aims to demonstrate that Tchaikovsky’s symphonic style is explicitly contrapuntal. Not only has this aspect of the composer been significantly undervalued in western musicology until today, it would be about ...

The term ‘gesture’ has represented a buzzword in the NIME community since the beginning of its conference series. But how often is it actually used, what is it used to describe, and how does its usage here differ from its ...

Norwegian telespringar is often referred to as being in so-called asymmetrical triple meter—that is, the three beats in the measure are of uneven duration. Previous studies report that a systematic long–medium–short beat ...

We present the results of a series of observation studies of ourselves standing still on the floor for 10 minutes at a time. The aim has been to understand more about our own standstill, and to develop a heightened sensitivity ...

We consider the issue of how a flexible musical space can be manipulated by users of an active music system. The musical space is navigated within by selecting transitions between different sections of the space. We take ...

Human body motion is integral to all parts of musical experience, from performance to perception. But how is it possible to study body motion in a systematic manner? This article presents a set of video-based visualisation ...

In this thesis, I investigate into the politics of gendered representation in Norwegian popular music, and how these function in a transcultural context. To this end, I take Norwegian pop artists Marit Larsen and Marion ...

Schoenberg’s concept of the work as the presentation (Darstellung) of the ‘musical idea’ (Gedanke) entails that the work is considered a vehicle by means of which the composer shares musical ideas with the performer and ...

This paper presents an overview of techniques for creating visual displays of human body movement based on video recordings. First a review of early movement and video visualization techniques is given. Then follows an ...

Apart from the sounds they make, synthesis models are distinguished by how the sound is controlled by synthesis parameters. Smoothness under parameter changes is often a desirable aspect of a synthesis model. The concept ...

The term coarticulation designates the fusion of small-scale events, such as single sounds and single sound-producing actions, into larger units of combined sound and body motion, resulting in qualitative new features at ...

This SIG intends to investigate the ongoing dialogue between music technology and the field of human-computer interaction. Our specific aims are to consider major findings of musical interface research over recent years ...

In this paper we present some custom designed filters for real-time motion capture applications. Our target application is motion controllers, i.e. systems that interpret hand motion for musical interaction. In earlier ...

The paper presents sonomotiongram, a technique for the creation of auditory displays of human body motion based on motiongrams. A motiongram is a visual display of motion, based on frame differencing and reduction of a ...

Links between music and body motion can be studied through experiments called sound-tracing. One of the main challenges in such research is to develop robust analysis techniques that are able to deal with the multidimensional ...

The conceptual starting point for an `action-sound approach' to teaching music technology is the acknowledgment of the couplings that exist in acoustic instruments between sounding objects, sound-producing actions and the ...

The paper presents a non-realtime implementation of the sonomotiongram method, a method for the sonification of motiongrams. Motiongrams are spatiotemporal displays of motion from video recordings, based on frame-differencing ...

The paper presents the Kinectofon, an instrument for creating sounds through free-hand interaction in a 3D space. The instrument is based on the RGB and depth image streams retrieved from a Microsoft Kinect sensor device. ...

Barn i barnehagealder har rik tilgang til musikk. Kanskje har de allerede som seksåringer hørt mer musikk enn deres oldeforeldre gjorde gjennom et helt liv. Men hvorfor hører barn på musikk? Hva betyr musikken for barna ...

We present a new wireless transceiver board for the CUI32 sensor interface, aimed at creating a solution that is flexible, reliable, and with little power consumption. Communication with the board is based on the ZigFlea ...

This article presents the development of the improvisation piece Transformation for electric violin and live electronics. The aim of the project was to develop an “invisible” technological setup that would allow the performer ...

Autonomous instruments are computer programmes that generate music algorithmically and without realtime interaction, from the waveform level up to the large scale form. This thesis addresses questions of aesthetics and the ...

Motiongrams are visual representations of human motion, generated from regular video recordings. This paper evaluates how different video features may influence the generated motiongram: inversion, colour, filtering, ...

We report on the Music Ball Project, a longterm, exploratory project focused on creating novel instruments/controllers with a spherical shape as the common denominator. Besides a simple and attractive geometrical shape, ...

The paper presents a method for sonification of human body motion based on motiongrams. Motiongrams show the spatiotemporal development of body motion by plotting average matrices of motion images over time. The resultant ...

With musical applications in mind, this paper reports on the level of noise observed in two commercial infrared marker-based motion capture systems: one high-end (Qualisys) and one affordable (OptiTrack). We have tested ...

Spectral flux is usually measured with the FFT, but here a constant-Q IIR filterbank implementation is proposed. This leads to a relatively efficient sliding feature extractor with the benefit of keeping the time resolution ...

In this paper we present the Dance Jockey System, a system developed for using a full body inertial motion capture suit (Xsens MVN) in music/dance performances. We present different strategies for extracting relevant ...

The paper presents an analysis of the quality of motion data from an iPod Touch (4th gen.). Acceleration and orientation data derived from internal sensors of an iPod is compared to data from a high end optical infrared ...

The paper presents the interactive music system SoloJam, which allows a group of participants with little or no musical training to effectively play together in a ``band-like'' setting. It allows the participants to take ...

Our research on music-related actions is based on the conviction that sensations of both sound and body motion are inseparable in the production and perception of music. The expression "musicrelated actions" is here used ...

This paper presents an experiment on sound tracing, meaning an experiment on how people relate motion to sound. 38 participants were presented with 18 short sounds, and instructed to move their hands in the air while acting ...

The authors present an experimental musical performance called Dance Jockey, wherein sounds are controlled by sensors on the dancer's body. These sensors manipulate music in real time by acquiring data about body actions ...

We present the results of a pilot study on how micromovements may be used in an interactive dance/music performance. Micromovements are subtle body movements that cannot be easily seen by the human eye. Using an infrared ...

We report on a performance study of a French-Canadian fiddler. The fiddling tradition forms an interesting contrast to classical violin performance in several ways. Distinguishing features include special elements in the ...

Editors: Alexander Refsum Jensenius, Anders Tveit, Rolf Inge Godøy, Dan Overholt Table of Contents -Tellef Kvifte: Keynote Lecture 1: Musical Instrument User Interfaces: the Digital Background of the Analog Revolution ...

Simultaneous handling and synchronisation of data related to music, such as score annotations, MIDI, video, motion descriptors, sensor data, etc. requires special tools due to the diversity of this data. We present a toolbox ...

The paper presents research about implementing a full body inertial motion capture system, the Xsens MVN suit, for musical interaction. Three di erent approaches for streaming real time and prerecorded motion capture data ...

The paper presents the SoundSaber - a musical instrument based on motion capture technology. We present technical details of the instrument and discuss the design development process. The SoundSaber may be used as an example ...

The paper presents a conceptual overview of how optical infrared marker based motion capture systems (IrMoCap) can be used in musical interaction. First we present a review of related work of using IrMoCap for musical ...

This paper presents a comparison of different configurations of a wireless sensor system for capturing human motion. The systems consist of sensor elements which wirelessly transfers motion data to a receiver element. The ...

The paper reports on the development and activities in the recently established fourMs lab (Music, Mind, Motion, Machines) at the University of Oslo, Norway. As a meeting place for researchers in music and informatics, the ...

The paper reports on the development of prototypes of glass instruments. The focus has been on developing acoustic instruments specifically designed for electronic treatment, and where timbral qualities have had priority ...

In this paper we present a method for studying relationships between features of sound and features of movement. The method has been tested by carrying out an experiment with people moving an object in space along with ...

We report on the development of a video based analysis system that controls concatenative sound synthesis and sound spatialisation in realtime in concert performances. The system has been used in several pieces, most ...

We report on a study of perceptual and acoustic features related to the placement of microphones around a custom made glass instrument. Different microphone setups were tested: above, inside and outside the instrument and ...

The paper addresses possibilities of extracting information from music-related actions, in the particular case of what we call sound-tracings. These tracings are recordings from a graphics tablet of subjects' drawings ...

Tremolo is usually regarded as belonging to the domain of note embellishments. Rapid tremolo, taken into the audio range, is an interesting synthesis technique which is related to FMand granular synthesis. We present a ...

Based on innumerable informal accounts and a number of scientific studies, there can be no doubt that people often have quite vivid images of musical sound in their minds, and that this is the case regardless of levels of ...

In our own and other research on music-related actions, findings suggest that perceived action and sound are broken down into a series of chunks in people’s minds when they perceive or imagine music. Chunks are here ...

The “PoumTchak” pattern is a rhythmic pattern consisting of a continuous alternation between bass drum and hi-hat sounds. It forms the basic rhythmic structure in myriads of dance music tracks. This suggests a connection ...

We can see many and strong links between music and human body movement in musical performance, in dance, and in the variety of movements that people make in listening situations. There is evidence that sensations of human ...

The paper presents Nymophone2, an acoustic instrument with a complex relationship between performance actions and emergent sound. A method for describing the multidimensional control actions needed to play the instrument ...

The Robotics and Intelligent Systems group conducts research in the interdisciplinary field of robotics, machine learning, reconfigurable hardware and sensing human actions. The group is affiliated to the Department of ...

As may be seen at concerts and in various everyday listening situa- tions, people often make spontaneous gestures when listening to music. We believe these gestures are interesting to study because they may reveal important ...

Mobile music technology opens many new opportunities in terms of location-aware systems, social interaction etc., but we should not forget that many challenges faced in immobile music technology research are also apparent ...

Fundamental to the development of musical or artistic creative work is the ability to transform raw materials. This ability implies the facility to master many facets of the material, and to shape it with plasticity. ...

Technical report from pilot studies in the Sensing Music-related Actions group. The report presents simple motion sensor technology and issues regarding pre-processing of music-related motion data. In cognitive music ...

The purpose of this Short-Term Scientific Mission has been to investigate the use of the Sound Description Interchange Format (SDIF) as a container format for Gesture Description Interchange Format (GDIF) recordings. Much ...

The paper presents some challenges faced in developing an experimental setup for studying coarticulation in music-related body movements. This has included solutions for storing and synchronising motion capture, biosensor ...

An approach for creating structured Open Sound Control (OSC) messages by separating the addressing of node values and node properties is suggested. This includes a method for querying values and properties. As a result, ...

This thesis explores the way we perceive correspondences between music and body movement. This is done by analysing similarities between music and movement in terms of specific features in music and movement. The analyses ...

This paper summarises a panel discussion at the 2007 International Computer Music Conference on movement and gesture data formats, presents some of the formats currently in development in the computer music community, and ...

This report summarises the results of my COST Action 287 ConGAS Short Term Scientific Mission (STSM) to the the Input Devices and Music Interaction Laboratory (IDMIL) at McGill University in February 2007.

This paper describes the concept and realization of The Drum Pants, a pair of pants with sensors and control switches, allowing the performer to play and record a virtual drum set or percussion rack by hitting the thighs ...

This is an exploration of listeners association of gestures with musical sounds. The subjects listen to sounds that have been chosen for various salient features, and the tracing movements made by the subjects are recorded ...

This paper discusses the need for a framework for describing musical instruments and their design, and discusses some possible elements in such a framework. The framework is meant as an aid in the development of a coherent ...

This paper presents our work on building low-cost music controllers intended for educational and creative use. The main idea was to build an electronic music controller, including sensors and a sensor interface, on a "10 ...

Both musicians and non-musicians can often be seen making sound-producing gestures in the air without touching any real instruments. Such air playing can be regarded as an expression of how people perceive and imagine ...