Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases

Anna Xambó, Gerard Roma, Alexander Lerch, Mathieu Barthet, György Fazekas

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The recent increase in the accessibility and size of personal and crowdsourced digital sound collections brought about a valuable resource for music creation. Finding and retrieving relevant sounds in performance leads to challenges that can be approached using music information retrieval (MIR). In this paper, we explore the use of MIR to retrieve and repurpose sounds in musical live coding. We present a live coding system built on SuperCollider enabling the use of audio content from online Creative Commons (CC) sound databases such as Freesound or personal sound databases. The novelty of our approach lies in exploiting high-level MIR methods (e.g., query by pitch or rhythmic cues) using live coding techniques applied to sounds. We demonstrate its potential through the reflection of an illustrative case study and the feedback from four expert users. The users tried the system with either a personal database or a crowdsourced database and reported its potential in facilitating tailorability of the tool to their own creative workflows.
LanguageEnglish
Title of host publicationNIME 2018: New Interfaces for Musical Expression
Pages364-369
Number of pages6
Publication statusPublished - 18 Jun 2018
EventNew Interfaces For Musical Expression - Virginia Tech, Blacksburg, United States
Duration: 3 Jun 20186 Jun 2018
http://www.nime2018.org/ (Link to Conference Website )

Publication series

Name
ISSN (Electronic)2220-4806

Conference

ConferenceNew Interfaces For Musical Expression
Abbreviated titleNIME 2018
CountryUnited States
CityBlacksburg
Period3/06/186/06/18
Internet address

Fingerprint

Information retrieval
Acoustic waves
Feedback

Cite this

Xambó, A., Roma, G., Lerch, A., Barthet, M., & Fazekas, G. (2018). Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases. In NIME 2018: New Interfaces for Musical Expression (pp. 364-369)
Xambó, Anna ; Roma, Gerard ; Lerch, Alexander ; Barthet, Mathieu ; Fazekas, György. / Live Repurposing of Sounds : MIR Explorations with Personal and Crowdsourced Databases. NIME 2018: New Interfaces for Musical Expression. 2018. pp. 364-369
@inproceedings{1d8e0dab5427404b9327ad88828601d4,
title = "Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases",
abstract = "The recent increase in the accessibility and size of personal and crowdsourced digital sound collections brought about a valuable resource for music creation. Finding and retrieving relevant sounds in performance leads to challenges that can be approached using music information retrieval (MIR). In this paper, we explore the use of MIR to retrieve and repurpose sounds in musical live coding. We present a live coding system built on SuperCollider enabling the use of audio content from online Creative Commons (CC) sound databases such as Freesound or personal sound databases. The novelty of our approach lies in exploiting high-level MIR methods (e.g., query by pitch or rhythmic cues) using live coding techniques applied to sounds. We demonstrate its potential through the reflection of an illustrative case study and the feedback from four expert users. The users tried the system with either a personal database or a crowdsourced database and reported its potential in facilitating tailorability of the tool to their own creative workflows.",
keywords = "Creative Commons, live coding, MIR, sound samples",
author = "Anna Xamb{\'o} and Gerard Roma and Alexander Lerch and Mathieu Barthet and Gy{\"o}rgy Fazekas",
year = "2018",
month = "6",
day = "18",
language = "English",
pages = "364--369",
booktitle = "NIME 2018: New Interfaces for Musical Expression",

}

Xambó, A, Roma, G, Lerch, A, Barthet, M & Fazekas, G 2018, Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases. in NIME 2018: New Interfaces for Musical Expression. pp. 364-369, New Interfaces For Musical Expression, Blacksburg, United States, 3/06/18.

Live Repurposing of Sounds : MIR Explorations with Personal and Crowdsourced Databases. / Xambó, Anna; Roma, Gerard; Lerch, Alexander; Barthet, Mathieu; Fazekas, György.

NIME 2018: New Interfaces for Musical Expression. 2018. p. 364-369.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Live Repurposing of Sounds

T2 - MIR Explorations with Personal and Crowdsourced Databases

AU - Xambó, Anna

AU - Roma, Gerard

AU - Lerch, Alexander

AU - Barthet, Mathieu

AU - Fazekas, György

PY - 2018/6/18

Y1 - 2018/6/18

N2 - The recent increase in the accessibility and size of personal and crowdsourced digital sound collections brought about a valuable resource for music creation. Finding and retrieving relevant sounds in performance leads to challenges that can be approached using music information retrieval (MIR). In this paper, we explore the use of MIR to retrieve and repurpose sounds in musical live coding. We present a live coding system built on SuperCollider enabling the use of audio content from online Creative Commons (CC) sound databases such as Freesound or personal sound databases. The novelty of our approach lies in exploiting high-level MIR methods (e.g., query by pitch or rhythmic cues) using live coding techniques applied to sounds. We demonstrate its potential through the reflection of an illustrative case study and the feedback from four expert users. The users tried the system with either a personal database or a crowdsourced database and reported its potential in facilitating tailorability of the tool to their own creative workflows.

AB - The recent increase in the accessibility and size of personal and crowdsourced digital sound collections brought about a valuable resource for music creation. Finding and retrieving relevant sounds in performance leads to challenges that can be approached using music information retrieval (MIR). In this paper, we explore the use of MIR to retrieve and repurpose sounds in musical live coding. We present a live coding system built on SuperCollider enabling the use of audio content from online Creative Commons (CC) sound databases such as Freesound or personal sound databases. The novelty of our approach lies in exploiting high-level MIR methods (e.g., query by pitch or rhythmic cues) using live coding techniques applied to sounds. We demonstrate its potential through the reflection of an illustrative case study and the feedback from four expert users. The users tried the system with either a personal database or a crowdsourced database and reported its potential in facilitating tailorability of the tool to their own creative workflows.

KW - Creative Commons

KW - live coding

KW - MIR

KW - sound samples

M3 - Conference contribution

SP - 364

EP - 369

BT - NIME 2018: New Interfaces for Musical Expression

ER -

Xambó A, Roma G, Lerch A, Barthet M, Fazekas G. Live Repurposing of Sounds: MIR Explorations with Personal and Crowdsourced Databases. In NIME 2018: New Interfaces for Musical Expression. 2018. p. 364-369