TY - GEN
T1 - Photosense
T2 - 2011 12th IEEE International Conference on Multimedia and Expo, ICME 2011
AU - Su, Ja Hwung
AU - Ming-Hua Hsieh, Hsieh
AU - Tao Mei, Mei
AU - Tseng, S.
PY - 2011
Y1 - 2011
N2 - This paper proposes a novel audiovisual presentation system, called PhotoSense, to enrich photo navigation experience by associating emotionally harmonic music with a given photo collection. Different from many conventional photo visualization systems which predominantly focus on the visual elements for presentation, we explore both visual and aural perspectives which can enhance the browsing experience from each other. This is achieved by building an emotion space shared by visual and aural domains, and a set of emotion classifiers which can associate each visual and aural element with this space. Furthermore, we design a sequence matching algorithm to associate a set of music with a photo collection by maximizing similarity in the emotion space. Photo-Sense represents one of the first mash-up applications which build a natural connection between the ever increasing personal photo collections on the Web and music-sharing sites. Experiments show that PhotoSense provides better browsing experience for photo collections.
AB - This paper proposes a novel audiovisual presentation system, called PhotoSense, to enrich photo navigation experience by associating emotionally harmonic music with a given photo collection. Different from many conventional photo visualization systems which predominantly focus on the visual elements for presentation, we explore both visual and aural perspectives which can enhance the browsing experience from each other. This is achieved by building an emotion space shared by visual and aural domains, and a set of emotion classifiers which can associate each visual and aural element with this space. Furthermore, we design a sequence matching algorithm to associate a set of music with a photo collection by maximizing similarity in the emotion space. Photo-Sense represents one of the first mash-up applications which build a natural connection between the ever increasing personal photo collections on the Web and music-sharing sites. Experiments show that PhotoSense provides better browsing experience for photo collections.
KW - Multimedia presentation
KW - affective content analysis
KW - emotion
UR - http://www.scopus.com/inward/record.url?scp=80155122654&partnerID=8YFLogxK
U2 - 10.1109/ICME.2011.6011994
DO - 10.1109/ICME.2011.6011994
M3 - Conference contribution
AN - SCOPUS:80155122654
SN - 9781612843490
T3 - Proceedings - IEEE International Conference on Multimedia and Expo
BT - Electronic Proceedings of the 2011 IEEE International Conference on Multimedia and Expo, ICME 2011
Y2 - 11 July 2011 through 15 July 2011
ER -