Semantic video retrieval by integrating concept- and content-aware mining

Bo Wen Wang, Ja Hwung Su, Chien Li Chou, Vincent S. Tseng*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Video retrieval has been a hot topic due to the prevalence of video capturing devices and media-sharing services such as YouTube. Until now, few past studies has focused on querying the videos by images due to the semantic gap between images and videos is not easy to narrow. To this end, in this paper, we propose a novel semantic video retrieval system that integrates web image annotation and concept matching function to bridge images, concepts and videos. For web image annotation, we exploit textual and visual information in the web image to achieve effective image annotation. For concept matching function, we identify the concept relations by calculating the similarity between two concepts via WordNet. On the basis of web image annotation and concept matching function, the proposed system reaches the goals of usability and intelligence on semantic video retrieval. The experimental results reveal that our proposed system can successfully capture the user's intention between image concepts and video concepts for semantic video retrieval.

Original languageEnglish
Title of host publicationProceedings - 2011 Conference on Technologies and Applications of Artificial Intelligence, TAAI 2011
Pages32-37
Number of pages6
DOIs
StatePublished - 2011
Event16th Annual Conference on Technologies and Applications of Artificial Intelligence, TAAI 2011 - Chung-Li, Taiwan
Duration: 11 Nov 201113 Nov 2011

Publication series

NameProceedings - 2011 Conference on Technologies and Applications of Artificial Intelligence, TAAI 2011

Conference

Conference16th Annual Conference on Technologies and Applications of Artificial Intelligence, TAAI 2011
Country/TerritoryTaiwan
CityChung-Li
Period11/11/1113/11/11

Keywords

  • Cross media retrieval
  • Image annotation
  • Query-by-example
  • Video retrieval

Fingerprint

Dive into the research topics of 'Semantic video retrieval by integrating concept- and content-aware mining'. Together they form a unique fingerprint.

Cite this