LifeConcept: An Interactive Approach for Multimodal Lifelog Retrieval through Concept Recommendation

Wei Hong Ang, An Zi Yen, Tai Te Chu, Hen Hsen Huang, Hsin Hsi Chen

研究成果: Conference contribution同行評審

10 引文 斯高帕斯(Scopus)

摘要

The major challenge in visual lifelog retrieval is the semantic gap between textual queries and visual concepts. This paper presents our work on the Lifelog Search Challenge 2021 (LSC'21), an annual comparative benchmarking activity for comparing approaches to interactive retrieval from multimodal lifelogs. We propose LifeConcept, an interactive lifelog search system that is aimed at accelerating the retrieval process and retrieving more precise results. In this work, we introduce several new features such as the number of people, location cluster, and object with color. Moreover, we obtain visual concepts from the images with computer vision models and propose a concept recommendation method to reduce the semantic gap. In this way, users can efficiently set up the related conditions for their requirements and search the desired images with appropriate query terms based on the suggestion.

原文English
主出版物標題LSC 2021 - Proceedings of the 4th Annual Lifelog Search Challenge
發行者Association for Computing Machinery, Inc
頁面47-51
頁數5
ISBN(電子)9781450385336
DOIs
出版狀態Published - 21 8月 2021
事件4th Annual Lifelog Search Challenge, LSC 2021, held with ICMR 2021 - Taipei, Taiwan
持續時間: 21 8月 2021 → …

出版系列

名字LSC 2021 - Proceedings of the 4th Annual Lifelog Search Challenge

Conference

Conference4th Annual Lifelog Search Challenge, LSC 2021, held with ICMR 2021
國家/地區Taiwan
城市Taipei
期間21/08/21 → …

指紋

深入研究「LifeConcept: An Interactive Approach for Multimodal Lifelog Retrieval through Concept Recommendation」主題。共同形成了獨特的指紋。

引用此