Eye-tracking Data for Weakly Supervised Object Detection

Ching Hsi Tseng, Yen Hsu, Shyan Ming Yuan

研究成果: Conference contribution同行評審

1 引文 斯高帕斯(Scopus)

摘要

We propose a weakly supervised object detection network based on eye-tracking data. A large number of training samples cannot be used due to the following problems: (1) the labels of training samples in object detection are not all pixel-level and (2) the cost of labeling is too high. Thus, we introduce a framework whose input combines images with only image-level labels and eye-tracking data. Based on the position given by the eye-tracking data, the framework has effective performance even in the case of incomplete sample annotation. Thus, we use an eye-tracker to collect the data on the most interesting area in the sample images and present the data in the fixations way. Then, the bounding boxes produced by the fixations data and the original image-level label become the input data of the object detection network. In this way, eye-tracking data helps us selecting the bounding boxes and providing detailed location information. Experiment results verify that the framework is effective with the support of eye-tracking data.

原文English
主出版物標題2nd IEEE Eurasia Conference on IOT, Communication and Engineering 2020, ECICE 2020
編輯Teen-Hang Meen
發行者Institute of Electrical and Electronics Engineers Inc.
頁面223-225
頁數3
ISBN(電子)9781728180601
DOIs
出版狀態Published - 23 10月 2020
事件2nd IEEE Eurasia Conference on IOT, Communication and Engineering, ECICE 2020 - Yunlin, Taiwan
持續時間: 23 10月 202025 10月 2020

出版系列

名字2nd IEEE Eurasia Conference on IOT, Communication and Engineering 2020, ECICE 2020

Conference

Conference2nd IEEE Eurasia Conference on IOT, Communication and Engineering, ECICE 2020
國家/地區Taiwan
城市Yunlin
期間23/10/2025/10/20

指紋

深入研究「Eye-tracking Data for Weakly Supervised Object Detection」主題。共同形成了獨特的指紋。

引用此