Thursday, November 12, 2009

Arc diagram


This is a current project I have been working for a while. Check out Shape of Song, Martin Wattenberg created this way to visualize a song, but from midi data, which you know exactly the notes. What I did is using the similar arc diagram on real audio data, to be specific, on the feature extracted from real audio data.

From the plot, basically the structure of the song is described. The idea of this arc diagram is that when those two points are identical (highly similar) you draw an arc line to connect those two dots. So when there are repeated patterns, they will be displayed. I am still exploring different features to be used while the same time trying to figure out better way to put the information in this plot. BTW, this song is a classical piano song "Fur Elise" (aka the trash truck song in Taiwan if I did not mix match).

No comments: