SCI★FI★HI★FI: Machine Learning Remix

Owen Green (Developer), Matt Brennan (Composer)

Research output: Non-textual formComposition

Abstract

A machine learning remix of the "Build A Thing Of Beauty" album that is generative, unstoreable, and infinite in length.

The process works by constructing a naïve model of music as rhythmic patterns of similarity and difference at different time scales, albeit one that doesn't yet have any notion of interdependency between different voices in a song (such as pitch relationships, or rhythmic counterpoint). Each voice in the multi-track of a song is independently analysed using a small selection of machine learning (i.e. pattern recognition) and machine listening techniques to construct a 'map' that tries to estimate where the major sections, sub-sections, phrases and individual events (notes, drum hits) may be. This takes a while, so is done offline. At each of these musical time scales, the program makes a two-dimensional map that shows how ‘similar’ one chunk is to another. The algorithmic ‘remixes’ are then generated by taking the original song to be represented as particular paths taken through these maps. The original paths are warped and redrawn to produce new sequences based on the patterns of rhythm and similarity in the original.
Original languageEnglish
Publication statusPublished - 2019

Fingerprint

Dive into the research topics of 'SCI★FI★HI★FI: Machine Learning Remix'. Together they form a unique fingerprint.

Cite this