Bio-Inspired Computing for Music
Charles Martin - Univ. Oslo, Dept. Informatics https://folk.uio.no/charlepm https://charlesmartin.com.au
But why??
Predictive Musical Interaction - How can musical instruments be more “intelligent” ? - What would that mean for musicians , music making , and music ? microjam.info
Music and Research we make new musical instruments, measure musical experiences, find new ways to express ourselves with technology. Why? - Expression and creativity is important. - Music is everywhere; people care about it. - Music is hard; realtime, high standards. - It’s fun. You don’t have to be a professional musician to do a great musical project!
Space: the final frontier. These are the voyages
Now... Models Then...
Music Generation: Predicting note-by-note Mozer (1994) Eck & Schmidhuber (2003) Magenta (Google) 2016-2017
Representations of Music Thin Medium? Thick folkRNN Performance RNN WaveNet
Theme: Creative Machine Learning - Using Deep Learning to represent and create music and art! - Compose music for video games? - Mobile apps that generate music endlessly! - MIREX Competition Tasks - music information retrieval - Techniques: Deep Learning, Recurrent Networks, Convolutional Networks,
Theme: Intelligent Instruments How can we integrate ML/AI into NIMEs? - Help users make better music. - “Guess” intentions (key, scale, harmony). - Generate extra sounds (ensemble experience) using ANNs or evolution. - Make sound/music in response to sensors/cameras (sonification). - Challenge/fun here is interacting with Data → ML → Interaction! ML algorithms.
Theme: Embedded Instruments - Use microcontrollers / single board computers to make stand-alone NIMEs - Includes prototyping, hardware creation, programming. - Could be for augmented instruments as well? - e.g.,
Theme: Social Music Making How can music bring people together? - Make “ensemble” playing easier. - Instruments that change to support “parts” in a group. - Asynchronous music making: performing as a group via facebook or the web
Mixture Density RNN
Neural Touchscreen Ensemble
Neural iPad Ensemble
Embodied Musical Predictions EMPI: Embodied Musical Predictive Instrument
RITMO: Centre for Interdisciplinary Studies in Rhythm, Time and Motion
MusicLab vol. 3: Rhythm MusicLab Vol. 3 explores the phenomenon of rhythm - in music and in the body - all within MusicLab’s unique blend of research and edutainment through and intellectual warm-up with world-leading experts, music-dance performances and data jockeying with our house DJ and anyone else interested. Time and place: Nov. 15, 2018 7:00 PM, Escape, Ole Johan Dahls hus https://www.hf.uio.no/ritmo/english/n ews-and-events/events/musiclab/201 8/rhythm/index.html
Recommend
More recommend
