Rich Contacts: Corpus-Based Convolution of Audio Contact Gestures for Enhanced Musical Expression

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We propose ways of enriching the timbral potential of gestural sonic material captured via piezo or contact microphones, through latency-free convolution of the microphone signal with grains from a sound corpus. This creates a new way to combine the sonic richness of large sound corpora, easily accessible via navigation through a timbral descriptor space, with the intuitive gestural interaction with a surface, captured by any contact microphone. We use convolution to excite the grains from the corpus via the microphone input, capturing the contact interaction sounds, which allows articulation of the corpus by hitting, scratching, or strumming a surface with various parts of the hands or objects. We also show how changes of grains have to be carefully handled, how one can smoothly interpolate between neighbouring grains, and finally evaluate the system against previous attempts.
LanguageEnglish
Title of host publicationProceedings of the International Conference on New Interfaces for Musical Expression
PublisherGoldsmiths, University of London, UK
Pages247-250
Number of pages4
Publication statusPublished - Jun 2014

Publication series

Name
ISSN (Electronic)2220-4806

Fingerprint

Microphones
Convolution
Acoustic waves
Navigation

Cite this

Schwarz, D., Tremblay, P. A., & Harker, A. (2014). Rich Contacts: Corpus-Based Convolution of Audio Contact Gestures for Enhanced Musical Expression. In Proceedings of the International Conference on New Interfaces for Musical Expression (pp. 247-250). Goldsmiths, University of London, UK.
Schwarz, Diemo ; Tremblay, Pierre Alexandre ; Harker, Alexander. / Rich Contacts : Corpus-Based Convolution of Audio Contact Gestures for Enhanced Musical Expression. Proceedings of the International Conference on New Interfaces for Musical Expression. Goldsmiths, University of London, UK, 2014. pp. 247-250
@inproceedings{675124d6345343cd8dd8e275ea777d6a,
title = "Rich Contacts: Corpus-Based Convolution of Audio Contact Gestures for Enhanced Musical Expression",
abstract = "We propose ways of enriching the timbral potential of gestural sonic material captured via piezo or contact microphones, through latency-free convolution of the microphone signal with grains from a sound corpus. This creates a new way to combine the sonic richness of large sound corpora, easily accessible via navigation through a timbral descriptor space, with the intuitive gestural interaction with a surface, captured by any contact microphone. We use convolution to excite the grains from the corpus via the microphone input, capturing the contact interaction sounds, which allows articulation of the corpus by hitting, scratching, or strumming a surface with various parts of the hands or objects. We also show how changes of grains have to be carefully handled, how one can smoothly interpolate between neighbouring grains, and finally evaluate the system against previous attempts.",
keywords = "Audio Gesture, Contact Microphones, Convolution, Corpus-Based Concatenative Synthesis, Expressivity",
author = "Diemo Schwarz and Tremblay, {Pierre Alexandre} and Alexander Harker",
year = "2014",
month = "6",
language = "English",
publisher = "Goldsmiths, University of London, UK",
pages = "247--250",
booktitle = "Proceedings of the International Conference on New Interfaces for Musical Expression",

}

Schwarz, D, Tremblay, PA & Harker, A 2014, Rich Contacts: Corpus-Based Convolution of Audio Contact Gestures for Enhanced Musical Expression. in Proceedings of the International Conference on New Interfaces for Musical Expression. Goldsmiths, University of London, UK, pp. 247-250.

Rich Contacts : Corpus-Based Convolution of Audio Contact Gestures for Enhanced Musical Expression. / Schwarz, Diemo; Tremblay, Pierre Alexandre; Harker, Alexander.

Proceedings of the International Conference on New Interfaces for Musical Expression. Goldsmiths, University of London, UK, 2014. p. 247-250.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Rich Contacts

T2 - Corpus-Based Convolution of Audio Contact Gestures for Enhanced Musical Expression

AU - Schwarz, Diemo

AU - Tremblay, Pierre Alexandre

AU - Harker, Alexander

PY - 2014/6

Y1 - 2014/6

N2 - We propose ways of enriching the timbral potential of gestural sonic material captured via piezo or contact microphones, through latency-free convolution of the microphone signal with grains from a sound corpus. This creates a new way to combine the sonic richness of large sound corpora, easily accessible via navigation through a timbral descriptor space, with the intuitive gestural interaction with a surface, captured by any contact microphone. We use convolution to excite the grains from the corpus via the microphone input, capturing the contact interaction sounds, which allows articulation of the corpus by hitting, scratching, or strumming a surface with various parts of the hands or objects. We also show how changes of grains have to be carefully handled, how one can smoothly interpolate between neighbouring grains, and finally evaluate the system against previous attempts.

AB - We propose ways of enriching the timbral potential of gestural sonic material captured via piezo or contact microphones, through latency-free convolution of the microphone signal with grains from a sound corpus. This creates a new way to combine the sonic richness of large sound corpora, easily accessible via navigation through a timbral descriptor space, with the intuitive gestural interaction with a surface, captured by any contact microphone. We use convolution to excite the grains from the corpus via the microphone input, capturing the contact interaction sounds, which allows articulation of the corpus by hitting, scratching, or strumming a surface with various parts of the hands or objects. We also show how changes of grains have to be carefully handled, how one can smoothly interpolate between neighbouring grains, and finally evaluate the system against previous attempts.

KW - Audio Gesture

KW - Contact Microphones

KW - Convolution

KW - Corpus-Based Concatenative Synthesis

KW - Expressivity

M3 - Conference contribution

SP - 247

EP - 250

BT - Proceedings of the International Conference on New Interfaces for Musical Expression

PB - Goldsmiths, University of London, UK

ER -

Schwarz D, Tremblay PA, Harker A. Rich Contacts: Corpus-Based Convolution of Audio Contact Gestures for Enhanced Musical Expression. In Proceedings of the International Conference on New Interfaces for Musical Expression. Goldsmiths, University of London, UK. 2014. p. 247-250