Which of these five sequences best represents the song “Happy Birthday to You”?
In the figure above, sequence 1 is the score—that is, an encoding of the song; sequence 2 is an enhanced encoding that “represents,” in the mathematical sense, the four musical phrases while remaining close to the score; sequence 3 presents images that evoke birthdays but without attempting to mirror the music’s form; sequence 4 is extracted from a playback by Media Player; and sequence 5 is the result of an analysis of audio and visual signals based on their digitization.
The website examines associations between music and images, music and smells, and smells and images, and presents some results I obtained using distance-matrix matching techniques.