Point Cloud

Virtual Musical Instrument

Point Cloud was created using Unreal Engine 5 and Max/MSP, with both softwares communicating via OSC. Using the FluCoMa library in Max, a collection of sounds is sliced into points. These points are then clustered based on how similar the sounds are to each other, creating a 3D point cloud of the sound corpus. A video game controller or keybaord and mouse can be used to perform this virtual musical instrument by flying through the point cloud at various speeds, activating the sound slices associated with each point as the player collides with them. There are different sound effects that can be selected with the game controller and are used to create more complex sonic gestures. These effects are represented by the color to which the points turn to upon activation. The coloring of the points also serves as a visual trail for the movement trajectories performed.

More information here https://github.com/matvilap/3D-Corpus-Navigator