TY - GEN
T1 - The acousticvisual emotion guassians model for automatic generation of music video
AU - Wang, Ju Chiang
AU - Yang, Yi Hsuan
AU - Jhuo, I. Hong
AU - Lin, Yen-Yu
AU - Wang, Hsin Min
PY - 2012/12/26
Y1 - 2012/12/26
N2 - This paper presents a novel content-based system that utilizes the perceived emotion of multimedia content as a bridge to connect music and video. Specifically, we propose a novel machine learning framework, called Acousticvisual Emotion Guassians (AVEG), to jointly learn the tripartite relationship among music, video, and emotion from an emotion-annotated corpus of music videos. For a music piece (or a video sequence), the AVEG model is applied to predict its emotion distribution in a stochastic emotion space from the corresponding low-level acoustic (resp. visual) features. Finally, music and video are matched by measuring the similarity between the two corresponding emotion distributions, based on a distance measure such as KL divergence.
AB - This paper presents a novel content-based system that utilizes the perceived emotion of multimedia content as a bridge to connect music and video. Specifically, we propose a novel machine learning framework, called Acousticvisual Emotion Guassians (AVEG), to jointly learn the tripartite relationship among music, video, and emotion from an emotion-annotated corpus of music videos. For a music piece (or a video sequence), the AVEG model is applied to predict its emotion distribution in a stochastic emotion space from the corresponding low-level acoustic (resp. visual) features. Finally, music and video are matched by measuring the similarity between the two corresponding emotion distributions, based on a distance measure such as KL divergence.
KW - cross-modal media retrieval
KW - emotion recognition
UR - http://www.scopus.com/inward/record.url?scp=84871398713&partnerID=8YFLogxK
U2 - 10.1145/2393347.2396494
DO - 10.1145/2393347.2396494
M3 - Conference contribution
AN - SCOPUS:84871398713
SN - 9781450310895
T3 - MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia
SP - 1379
EP - 1380
BT - MM 2012 - Proceedings of the 20th ACM International Conference on Multimedia
T2 - 20th ACM International Conference on Multimedia, MM 2012
Y2 - 29 October 2012 through 2 November 2012
ER -