Skip to main content

FMOD inspiration

Tom Dale Company- 'Step Sonic'

'Digital soundscapes triggered by motion' (Dale, 2019)

The piece explores the collaboration between the dancers bodies, and the creation of digital music, through live movement. Contact and shotgun microphones pick up non-diegetic sounds produced from movement, sampling them to create audio.
https://vimeo.com/214642770 

This was interesting to explore as inspiration, as it is the dancers themselves that create the initial sounds, i.e. stamping, rather than responding to silent movements. The movements are therefore created with the intention to create sound, which although works well for this piece, restricts the movement style the dancers can work in, not allowing them to freely improvise to collaborate with the tech- here they are more governed by what the tech initially wants and needs them to do.

'The relationships that matter are to be found in this dimension of musicking with the beings, shapes, textures, presences that are encountered (regardless of their source entity being flesh or machine)' (Vear, 2019)


Yamaha- AI

A dancers movements were translated into music at a concert in collaboration with the Berlin Philharmonic Orchestra Scharoun Ensemble. At the concert, Yamaha 'Dance to Piano Performance System' was used. It can detect a dancers movements in real time, by using four kinds of sensors on the dancers body. Next, the system analyses the information and translates it into a music data format, such as MIDI, instantaneously. The music data is transmitted to a Yamaha disklavier piano player, which performs it.
This was a beautiful piece to watch, and accentuated the corporeality of the moving body, which sometimes technology can fail to do. Often, it is easy as audiences to look past the body at the spectacles of technology that are occurring around it, or even on it, but this piece held a real focus on celebrating the body in motion


‘Researchers have reported that 3-D sound increases the immersive feeling in virtual reality (VR) environments, which provides a more realistic virtual environment’ (Cheok et al, 2007)

Darkfield


Use 360 binaural sound to immerse participants in intense developing narrative environments.

Binaural or Binaural 3D audio is captured identically to the way we hear the world. It captures the exact location of every sound source, and where it is in relation to the microphone upon capture 

Binaural audio must be recorded with a binaural microphone:
A binaural microphone consists of two omni directional microphones wherein one mic is positioned very precisely within each ear. When a microphone is placed within the pinnae of each ear, a recordist is capable of recording audio identically to the way they hear it (hookaudio, n.d.)

This use of 360 sound is successful in creating full immersion for a participant in this case, although in my prototype, it is more the dancer themselves I wished to immerse. Binaural sound would be a fascinating addition to the prototype, as it could respond directly to where the dancer was in space, and play the audio that corresponded- if the dancer was downstage left, the music would also play from downstage left.

Comments