Atau Tanaka Sony CSL Paris Malleable Mobile Music
Deploying music on mobile infrastructures Not for musicians…for music listeners Go beyond Kazaa and iPod New modes of music listening using: Social dynamic Wireless networks Sensor embedded devices Mobile Music Making
Talk Overview Background The System Demo/video
Backgrounds: Music and Research Network music
Backgrounds: Music and Research Network music Remote concerts
Backgrounds: Music and Research Network music Remote concerts Netmusic
Backgrounds: Music and Research Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002)
Backgrounds: Music and Research Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002) Research
Backgrounds: Music and Research Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002) Research P2P + adhoc
Backgrounds: Music and Research Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002) Research P2P + adhoc Bootstrapping Trust
Backgrounds: Music and Research Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002) Research P2P + adhoc Bootstrapping Trust Location Sensitive Audio
Objectives How to leverage wireless networks for music? The infrastructure can do more than file sharing Enhance sense of community via music Making a new music listening experience Draw upon musician’s experience Dynamic and new, yet familiar songs Could this point to new content models?
The System Mobile terminal PDA Wireless network
The System Mobile terminal PDA Wireless network Sensor subsystem
The System Mobile terminal PDA Wireless network Sensor subsystem FSR Accelerometer GPS (in simulation)
The System Mobile terminal PDA Wireless network Sensor subsystem FSR Accelerometer GPS (in simulation) Music engine Server-side Network control in Stream out
Malleable Music Take a hit song, and make it interactive
Malleable Music Take a hit song, and make it interactive Bjork: I miss you (1995)
Malleable Music Take a hit song, and make it interactive Bjork: I miss you (1995) The Meters: Look-ka Py Py (1970)
Malleable Music Take a hit song, and make it interactive Bjork: I miss you (1995) The Meters: Look-ka Py Py (1970) Shaping Mixing filtering  Familiar song, new experience Instantaneous “versions” following your mood Flexible time - 3 min hit song now  fits your train ride time
Malleable Music Familiar song, new experience Instantaneous “versions” following your mood Flexible time - 3 min hit song now  fits your train ride time Mobility and participatory listening Musical content reflecting social dynamic
Malleable Music Engine Time domain segmentation and reconstruction Generalized temporal reorganization model Song structure (song level) Variations (measure level) Melodic/rhythmic (sub-measure level)
Malleable Social Dynamic Community Navi Re-mix Group participation in a single musical piece Collective Mobility - moving about town Intuitive, subconscious input  Actions while listening swinging along gripping the Walkman Remote yet collective Future content model?
 

Music mobile

  • 1.
    Atau Tanaka SonyCSL Paris Malleable Mobile Music
  • 2.
    Deploying music onmobile infrastructures Not for musicians…for music listeners Go beyond Kazaa and iPod New modes of music listening using: Social dynamic Wireless networks Sensor embedded devices Mobile Music Making
  • 3.
    Talk Overview BackgroundThe System Demo/video
  • 4.
    Backgrounds: Music andResearch Network music
  • 5.
    Backgrounds: Music andResearch Network music Remote concerts
  • 6.
    Backgrounds: Music andResearch Network music Remote concerts Netmusic
  • 7.
    Backgrounds: Music andResearch Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002)
  • 8.
    Backgrounds: Music andResearch Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002) Research
  • 9.
    Backgrounds: Music andResearch Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002) Research P2P + adhoc
  • 10.
    Backgrounds: Music andResearch Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002) Research P2P + adhoc Bootstrapping Trust
  • 11.
    Backgrounds: Music andResearch Network music Remote concerts Netmusic Installations Global String (Ars Electronica 2002) Research P2P + adhoc Bootstrapping Trust Location Sensitive Audio
  • 12.
    Objectives How toleverage wireless networks for music? The infrastructure can do more than file sharing Enhance sense of community via music Making a new music listening experience Draw upon musician’s experience Dynamic and new, yet familiar songs Could this point to new content models?
  • 13.
    The System Mobileterminal PDA Wireless network
  • 14.
    The System Mobileterminal PDA Wireless network Sensor subsystem
  • 15.
    The System Mobileterminal PDA Wireless network Sensor subsystem FSR Accelerometer GPS (in simulation)
  • 16.
    The System Mobileterminal PDA Wireless network Sensor subsystem FSR Accelerometer GPS (in simulation) Music engine Server-side Network control in Stream out
  • 17.
    Malleable Music Takea hit song, and make it interactive
  • 18.
    Malleable Music Takea hit song, and make it interactive Bjork: I miss you (1995)
  • 19.
    Malleable Music Takea hit song, and make it interactive Bjork: I miss you (1995) The Meters: Look-ka Py Py (1970)
  • 20.
    Malleable Music Takea hit song, and make it interactive Bjork: I miss you (1995) The Meters: Look-ka Py Py (1970) Shaping Mixing filtering Familiar song, new experience Instantaneous “versions” following your mood Flexible time - 3 min hit song now fits your train ride time
  • 21.
    Malleable Music Familiarsong, new experience Instantaneous “versions” following your mood Flexible time - 3 min hit song now fits your train ride time Mobility and participatory listening Musical content reflecting social dynamic
  • 22.
    Malleable Music EngineTime domain segmentation and reconstruction Generalized temporal reorganization model Song structure (song level) Variations (measure level) Melodic/rhythmic (sub-measure level)
  • 23.
    Malleable Social DynamicCommunity Navi Re-mix Group participation in a single musical piece Collective Mobility - moving about town Intuitive, subconscious input Actions while listening swinging along gripping the Walkman Remote yet collective Future content model?
  • 24.