Using gamification to create and label photos that are challenging for computer vision and people

Piotr Kotlinski, Xi Jing Chang, Yang Chih-Yun, Wei-Chen Chiu, Yung Ju Chang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

It would be hard to overstate the importance of Computer Vision (CV), applications of which can be found from self-driving cars, through facial recognition to augmented reality and the healthcare industry. Recent years have witnessed dramatic progress in visual-object recognition, partially ascribable to the availability of labeled data. Unfortunately, recognition of obscure, unclear and ambiguous photos that are taken from unusual angles or distances remains a major challenge, as recently shown by the creation of the ObjectNet [1]. This paper complements that work via a game in which obscure, unclear and ambiguous photos are collaboratively created and labeled by the players, who adopt the role of detectives collecting evidence against in-game criminals. The game rules enforce the creation of images that are challenging to identify for CV and people alike, as a means of ensuring the high quality of players' input.

Original languageEnglish
Title of host publicationUbiComp/ISWC 2020 Adjunct - Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers
PublisherAssociation for Computing Machinery
Pages59-62
Number of pages4
ISBN (Electronic)9781450380768
DOIs
StatePublished - 10 Sep 2020
Event2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2020 ACM International Symposium on Wearable Computers, UbiComp/ISWC 2020 - Virtual, Online, Mexico
Duration: 12 Sep 202017 Sep 2020

Publication series

NameUbiComp/ISWC 2020 Adjunct - Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers

Conference

Conference2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and 2020 ACM International Symposium on Wearable Computers, UbiComp/ISWC 2020
Country/TerritoryMexico
CityVirtual, Online
Period12/09/2017/09/20

Keywords

  • computer vision
  • gamification
  • human-computer interactions
  • mobile crowdsourcing

Fingerprint

Dive into the research topics of 'Using gamification to create and label photos that are challenging for computer vision and people'. Together they form a unique fingerprint.

Cite this