The Chordinator: Modeling Music Harmony By Implementing Transformer Networks and Token Strategies - Archive ouverte HAL Access content directly
Conference Papers Year : 2024

The Chordinator: Modeling Music Harmony By Implementing Transformer Networks and Token Strategies

Abstract

This paper compares two tokenization strategies for modeling chord progressions using the encoder transformer architecture trained with a large dataset of chord progressions in a variety of styles. The first strategy includes a tokenization method treating all different chords as unique elements, which results in a vocabulary of 5202 independent tokens. The second strategy expresses the chords as a dynamic tuple describing root, nature (e.g., major, minor, diminished, etc.), and extensions (e.g., additions or alterations), producing a specific vocabulary of 59 tokens related to chords and 75 tokens for style, bars, form, and format. In the second approach, MIDI embeddings are added into the positional embedding layer of the transformer architecture, with an array of eight values related to the notes forming the chords. We propose a trigram analysis addition to the dataset to compare the generated chord progressions with the training dataset, which reveals common progressions and the extent to which a sequence is duplicated. We analyze progressions generated by the models comparing HITS@k metrics and human evaluation of 10 participants, rating the plausibility of the progressions as potential music compositions from a musical perspective. The second model reported lower validation loss, better metrics, and more musical consistency in the suggested progressions.
Fichier principal
Vignette du fichier
TheChordinator_Evomusart-3.pdf (2.16 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04465285 , version 1 (19-02-2024)

Licence

Identifiers

  • HAL Id : hal-04465285 , version 1

Cite

David Dalmazzo, Ken Déguernel, Bob L. T. Sturm. The Chordinator: Modeling Music Harmony By Implementing Transformer Networks and Token Strategies. EvoMUSART, 2024, Aberystwyth, United Kingdom. ⟨hal-04465285⟩
72 View
72 Download

Share

Gmail Mastodon Facebook X LinkedIn More