GAMuT documentation

_images/gamut-logo.png

Description

GAMuT is a high-level, user-friendly granular audio musaicking toolkit implemented in Python. Audio musaicking (also spelled mosaicking), can be defined as “the process of recomposing the temporal evolution of a given target audio file from segments cut out of source audio materials”.

Audio musaicking: A visual analogy

If you’re new to audio musaicking, let’s consider the following visual analogy:

• Let's imagine we want the computer to reconstruct this portait of Bob Ross, but only using bits and pieces of other images. We will call this portait the target, and the collection of other images the corpus.
bob-ross The target: A portrait of Bob Ross
• Now, let's imagine we tell the computer that the corpus will be all available emojis. The computer will then try to find the best subset of emojis, based on how similar they are in shape, color, and other features to the target, and attempt to reconstruct the portrait of Bob Ross.
emoji The corpus: A collection of emoji
• Thus, the computer might give us something like this — a portrat of Bob Ross, made with several emoji.

Although this wasn't actually done by a computer, but manually drawn by LA-based artist Yung Jake with the emoji.ink tool, the idea still holds — audio mosaicking consists of reconstructing a target using a corpus, but with audio instead of images.

The computer would then go through a collection of audio files, analyze every sound, and try to pick the bits and pieces (i.e., audio grains) that are most similar to the target, and assembled them into an audio mosaic.
jung-jake Visual analogy of audio musaicking: Emoji Bob Ross (by Yung Jake)

Audio examples

Here are 4 examples of audio musaicking made with GAMuT, each using different corpora on the same audio target.

Example 1

Target name
Audio input
Excerpt of Ángel Gonzalez' muerte en el olvido:

Yo sé que existo
porque tú me imaginas.
Soy alto porque tú me crees
alto, y limpio porque tú me miras
con buenos ojos,
con mirada limpia.
Corpus name
Corpus size
Audio output
Female singer voice corpus
1221 audio files
Cmaj7 chord notes corpus
340 audio files
Tam-tam corpus
2878 audio files

Example 2

Target name
Audio input
Drumset loop
Corpus name
Corpus size
Audio output
Guitar corpus
28 audio files
Animal sounds corpus
51 audio files
Vocal sounds corpus
768 audio files

Example 3

Target name
Audio input
Excerpt from J.S. Bach's Badinerie
Corpus name
Corpus size
Audio output
Orchestral music corpus
64 audio files
Percussion corpus
282 audio files
Violin sounds corpus
658 audio files

Example 4

Target name
Audio input
Female pop singer
Corpus name
Corpus size
Audio output
Piano corpus
177 audio files
Violin corpus
658 audio files
Commercial music corpus
140 audio files

To visualize contents in alphabetical order, see Index.