Audio Morphing Using Matrix Decomposition and Optimal Transport

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a system for morphing between audio recordings in a continuous parameter space. The proposed approach combines matrix decompositions used for audio source separation with displacement interpolation enabled by 1D optimal transport. Using NMF decompositions, the system allows varying the timbre of a sound in real time, while reproducing the temporal activations of its main components. Using HPSS as a preprocessing step, the system affords more detailed control of the interpolation in perceptually meaningful dimensions.
Original languageEnglish
Title of host publicationProceedings of the 23rd International Conference on Digital Audio Effects
EditorsGianpaolo Evangelista
Pages147-154
Number of pages8
Volume1
Publication statusPublished - 9 Sep 2020
Event23rd International Conference on Digital Audio Effects - Virtual Conference
Duration: 9 Sep 202111 Sep 2021
Conference number: 23
http://www.dafx.de/index.html

Publication series

NameDigital Audio Effects (DAFx) Proceedings Series
ISSN (Print)2413-6700
ISSN (Electronic)2413-6689

Conference

Conference23rd International Conference on Digital Audio Effects
Abbreviated titleeDAFx2020
Period9/09/2111/09/21
Internet address

Fingerprint Dive into the research topics of 'Audio Morphing Using Matrix Decomposition and Optimal Transport'. Together they form a unique fingerprint.

  • Cite this

    Roma, G., Green, O., & Tremblay, P. A. (2020). Audio Morphing Using Matrix Decomposition and Optimal Transport. In G. Evangelista (Ed.), Proceedings of the 23rd International Conference on Digital Audio Effects (Vol. 1, pp. 147-154). (Digital Audio Effects (DAFx) Proceedings Series). https://dafx2020.mdw.ac.at/proceedings/DAFx2020Proceedings.pdf