push and pull

Music Interaction

push and pull is performed in a virtual environment that enables the performer to articulate musical gestures through a virtual extension of their physical body. Through a combination of gestures and controller input the performer can manipulate floating orbs using simulated gravitational forces to control sound generating collisions between the orbs and other objects.

Each of the objects in the scene has a specific virtual instrument assigned to it. This is achieved through OSC communication between Unity 3D and Ableton Live, where collision data is mapped to the MIDI input of different virtual instruments. Pitch is determined by the size of the floating orbs, while other parameters such as velocity and note length are mapped to the speed value at the moment of collision between virtual objects.