Arc diagram

This is a current project I have been working for a while. Check out Shape of Song, Martin Wattenberg created this way to visualize a song, but from midi data, which you know exactly the notes. What I did is using the similar arc diagram on real audio data, to be specific, on the feature extracted from real audio data.

From the plot, basically the structure of the song is described. The idea of this arc diagram is that when those two points are identical (highly similar) you draw an arc line to connect those two dots. So when there are repeated patterns, they will be displayed. I am still exploring different features to be used while the same time trying to figure out better way to put the information in this plot. BTW, this song is a classical piano song "Fur Elise" (aka the trash truck song in Taiwan if I did not mix match).

IDEA: Piano paint

Oh well, I know the name is kinda lame. Anyway, cause the idea is vague too. Just a quick note about an idea come up to my mind the other day.

What if we can paint by playing instrument? Try to narrow down, the first experiment will be build a system which takes the input of a keyboard as midi signal and then plot something on to the screen. I have a feeling that this is gonna be fun and a pretty cool interactive art. Though I have not put much thought to it yet.

Below are some quick memos:
Randomly pick the starting point for each music sentence. According to the note and harmony you played, different color can be chosen and the size of the stroke and touch can be related to how hard you play the keyboard (loudness). Like I can imagine that if some weird chord series are played loudly, there will be some explosive color objects appeared on the screen.

I am sure that this idea must be down by someone already. But I would love to build one too. Maybe when I have time, can start doing some literature search first (google...). And I am thinking about taking this as a chance to learn max/msp.

Visualization

Recently I am pretty into information/data visualization. The idea is to explore some ways to visualize music in different levels. Level here means from within a song level to further the whole music collection level.

So the idea for visualization is to show something human might not be able to perceive if they are described in the old ways. For example, when you are listening to music, it is harder to tell the structure of the music (verse vs chorus, how many times the chorus got repeated, so on and so forth). However, those information can be easily shown by a simple 2-D plot. This is just one application and we believe that there are much more possibilities out there for exploration. If the plot does not mean anything, at least it needs to be beautiful and pleasant to see.

Just had a meeting with my adviser who also has an engineering background and claim that he does not really know about aesthetic. Oh well, neither do I... I just started to read the book "Visualizing Data" by Ben Fry, a guy from MIT media lab who did his PhD work in "Computational Information Design" and also the co-inventor of a well known visualization sketch tool called "Processing". I do not have much to discuss about the book yet, so far I can see that the whole process of visualizing data is laid out in the book. And I have played with processing a bit, pretty friendly and intuitive programming language.

Good start though, will see how far I can go, probably will go take one to two classes about visualization and graphical design next semester in order to learn the thinking process of a designer. Looking forward to it!

The new role of this blog

I am going to add one more function to this blog here, that I would like to write down things related to my research including thoughts, idea, memos, etc. Just try to catch some transient memory and see what I can really achieve.

Music, Visualization, Machine Learning and Interaction

Well, 需要關注的領域越來越多了
這是念phD的毛病嗎?
我以為phD是要越念越專精的
只不過在我找到自己覺得很酷的研究題目之前
看的東西越來越多

只希望有一天
這些所有我看過的東西
能夠變成一個很酷炫又對人類有幫助的題目

現在對我來說
還是兩條不太有焦點的線
科技 工程 vs 音樂 藝術 設計 互動
有沒有一個道理可以把他們串起來呢

一發不可收拾
這些問題
一輩子也解不完吧

只希望可以讓自己開心

所謂的好的創作

或許就是可以歷久不衰吧
對於我
過了很久的一段時間
再回去聽某些歌曲
我還是會覺得好聽
聽到還是有想要哭的感覺

那就是我夢想中有朝一日我也能做出來的好的創作!

(這是我在聽完黃小楨的幾首歌以後的感覺)

I wonder...

anyone still comes to this place?

Bye Bye SF

這幾個月來實在太多情緒了
連續地相聚別離其實讓我有點疲憊
不知不覺因為害怕在某個時間點突然崩潰而先把自己的堤防蓋好
於是我很早就開始不想要感覺到我要走了
很努力地當作什麼都沒發生
而且其實也是這樣
沒有什麼離去的
因為已經緊密地連結了就不會分開
這是我相信著的而我也會努力去維持

前幾天回LA
Shelly問我說
"你覺得哪裡是你的家"
我說
"我也不曉得
這次回台灣開始覺得台北不是我的家了"
想說加州是我的家又覺得那我又要離開
其實也不盡然
想了想
說了
"哪裡有朋友哪裡就是我的家"

我想我真的是這樣覺得吧
流浪了幾年
早就練就了一身其實到哪裡都可以的本領
雖然我是個慢熟的人
但是因為我很宅
只要有網路的地方
我就可以活得好好的
也越來越會處理自己跟自己相處的情緒
只要感覺到我有一群好朋友
我就覺得我是幸福的
因此可以賴以維生

從LA回來以後
照常打打球
跟小家庭hang out
一直都很正常很低調
就是不喜歡感傷的場面

真的很謝謝快樂兒童餐陪我笑得半死
每天笑一笑就過去了
讓這段日子變得很輕鬆很自在

我想
physically我就是個過客吧
來來去去
但是我永遠不會離開
就像地縛靈一樣
所以你們也不用擔心
只要想到我
我就會在的

Shelly John 肇偉一家人 你們都要好好的
小家庭 我很愛你們 你們都要幸福

是的 我回來了

終於回到美國
兩個月好像讓我開始有點習慣台灣而覺得美國有點怪怪的
但是好像又不會太嚴重
所以我搞不清楚到底怎麼了

還好第一站就是到Shelly姊姊家
這個地方永遠都是那麼安全
我馬上回復我的宅男身分
(躺在沙發上抱著睡袋+電腦)
決定要好好放空一兩天順便調時差還要整理心情

這趟回台灣
真的好像做了很多事情發生很多事情的感覺
很多心情跟感覺都來不及消化就過去了
是不是有點可惜
不過所有發生過的事情
我想都會記在我的某個地方
在我孤單又很長的phD之路的某個時間
被我拿出來仔細回想吧...

我很慶幸我之所以為我
有你們的陪伴
所以我現在很開心很滿足
有很多愛我的人跟我愛的人
所以我可以繼續努力

你們都要好好的
我會一直很愛你們

Woody Woody

因為張譯仁的關係
星期一晚上跑到謝維家
他是Woody Woody的吉他手
Woody Woody是個兩把木吉他的雙吉他組合
沒有vocal
純粹木吉他finger style的呈現
另外一個人叫做仲麟

Woody Woody之湛藍海岸


謝維是張譯仁東海的同學
建築念完以後
就開始了吉他表演的生活
已經在蠻多大大小小的場地
包括河岸留言有定期的表演

跟謝維小聊了一下
然後就把吉他拿出來
我跟他就這樣jam了起來
其實我很害怕
我一向就是個說的一嘴好音樂的人
但是真的要彈要jam的時候
整個半調子沒信心

結果我們隨便亂jam一通
就還蠻好玩的
只不過時間有點短
後來仲麟來跟他開會
我就覺得留在那邊吵人好像有點不好意思
就拉著張譯仁走了
一點都還沒有過癮
等我回去練琴以後再來玩

喔 還有
我們有聽他們最新製作出來的ep
還沒有開始賣
有一種純手工製作
很純粹喜歡音樂的感覺

我也想來做ep
不過要等我把新歌都寫完

再貼上幾個Woody Woody的表演