TY - GEN
T1 - A Hierarchical Task Assignment for Manual Image Labeling
AU - Chang, Chia Ming
AU - Mishra, Siddharth Deepak
AU - Igarashi, Takeo
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/10
Y1 - 2019/10
N2 - Manual image labeling (selecting an appropriate 'category' for an image) is very tedious and time consuming especially when selecting labels from a large number of categories. In this study, we propose a hierarchical assignment of labeling tasks where the labelers recursively classify images in a category group into sub category groups, working on a single level at a time. This significantly makes each labeler's task easier, reducing the number of choices from 1,000 to 27 on average. In the user study, we compared our hierarchical assignment to a normal (non-hierarchical) assignment for a labeling task. The results show that the hierarchical assignment requires less total time to complete the labeling task. In addition, the learning effect in the labeling process is more profound in the hierarchical assignment.
AB - Manual image labeling (selecting an appropriate 'category' for an image) is very tedious and time consuming especially when selecting labels from a large number of categories. In this study, we propose a hierarchical assignment of labeling tasks where the labelers recursively classify images in a category group into sub category groups, working on a single level at a time. This significantly makes each labeler's task easier, reducing the number of choices from 1,000 to 27 on average. In the user study, we compared our hierarchical assignment to a normal (non-hierarchical) assignment for a labeling task. The results show that the hierarchical assignment requires less total time to complete the labeling task. In addition, the learning effect in the labeling process is more profound in the hierarchical assignment.
KW - hierarchical assignment
KW - human-computer interaction
KW - image labeling
KW - machine learning
UR - http://www.scopus.com/inward/record.url?scp=85078876838&partnerID=8YFLogxK
U2 - 10.1109/VLHCC.2019.8818828
DO - 10.1109/VLHCC.2019.8818828
M3 - Conference contribution
AN - SCOPUS:85078876838
T3 - Proceedings of IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC
SP - 139
EP - 143
BT - Proceedings - 2019 IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC 2019
A2 - Smith, Justin
A2 - Bogart, Christopher A.
A2 - Good, Judith
A2 - Fleming, Scott D.
PB - IEEE Computer Society
T2 - 2019 IEEE Symposium on Visual Languages and Human-Centric Computing, VL/HCC 2019
Y2 - 14 October 2019 through 18 October 2019
ER -