Evaluation of audio source separation models using hypothesis-driven non-parametric statistical methods

Andrew JR Simpson, Gerard Roma, Emad M Grais, Russell D Mason, Chris Hummersone, Antoine Liutkus, Mark D Plumbley

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

Audio source separation models are typically evaluated using objective separation quality measures, but rigorous statistical methods have yet to be applied to the problem of model comparison. As a result, it can be difficult to establish whether or not reliable progress is being made during the development of new models. In this paper, we provide a hypothesis-driven statistical analysis of the results of the recent source separation SiSEC challenge involving twelve competing models tested on separation of voice and accompaniment from fifty pieces of “professionally produced” contemporary music. Using non-parametric statistics, we establish reliable evidence for meaningful conclusions about the performance of the various models.
Original languageEnglish
Title of host publication2016 24th European Signal Processing Conference (EUSIPCO)
PublisherIEEE
Pages1763-1767
Number of pages5
ISBN (Electronic)9780992862657
DOIs
Publication statusPublished - 1 Dec 2016
Externally publishedYes
Event24th European Signal Processing Conference - Budapest, Hungary
Duration: 29 Aug 20162 Sep 2016
Conference number: 24
http://www.eusipco2016.org/ (Link to Conference Website )

Publication series

Name
ISSN (Electronic)2076-1465

Conference

Conference24th European Signal Processing Conference
Abbreviated titleEUSIPCO 2016
CountryHungary
CityBudapest
Period29/08/162/09/16
Internet address

Fingerprint Dive into the research topics of 'Evaluation of audio source separation models using hypothesis-driven non-parametric statistical methods'. Together they form a unique fingerprint.

  • Cite this

    Simpson, A. JR., Roma, G., Grais, E. M., Mason, R. D., Hummersone, C., Liutkus, A., & Plumbley, M. D. (2016). Evaluation of audio source separation models using hypothesis-driven non-parametric statistical methods. In 2016 24th European Signal Processing Conference (EUSIPCO) (pp. 1763-1767). IEEE. https://doi.org/10.1109/EUSIPCO.2016.7760551