Developing ubiquitous multi-touch sensing and displaying systems with vision-based finger detection and event identification techniques

Yen Lin Chen*, Chuan Yen Chiang, Wen Yew Liang, Tung Ju Hsieh, Da Cheng Lee, Shyan-Ming Yuan, Yang Lang Chang

*此作品的通信作者

研究成果: Conference contribution同行評審

摘要

This study presents efficient vision-based finger detection, tracking, and event identification techniques, as well as a low-cost hardware framework for multi-touch sensing and display applications. A fast bright-blob segmentation process based on automatic multilevel histogram thresholding is performed to extract pixels of touch blobs from the captured image sequences obtained from the scattered infrared lights by the video camera. Given the touch blobs extracted from each of the captured frames, a blob tracking and event recognition process is then conducted to analyze the spatial and temporal information of these touch blobs from consecutive frames and determine the possible touch events issued by users. This process also refines the detection results and corrects for errors and occlusions caused by noise and errors during the blob extraction processes. Our proposed blob tracking and touch event recognition process includes two phases. First, the phase of blob tracking associates the motion correspondence of blobs in succeeding frames by analyzing their spatial and temporal features. Then the phase of touch event recognition process can identify meaningful touch events activated by users from the motion information of touch blobs. Experimental results demonstrate that the proposed vision-based finger detection, tracking, and event identification system is feasible and effective for multi-touch sensing applications in various operational environments and conditions.

原文English
主出版物標題Proc.- 2011 IEEE International Conference on HPCC 2011 - 2011 IEEE International Workshop on FTDCS 2011 - Workshops of the 2011 Int. Conf. on UIC 2011- Workshops of the 2011 Int. Conf. ATC 2011
頁面898-903
頁數6
DOIs
出版狀態Published - 24 11月 2011
事件13th IEEE International Workshop on FTDCS 2011, the 8th International Conference on ATC 2011, the 8th International Conference on UIC 2011 and the 13th IEEE International Conference on HPCC 2011 - Banff, AB, Canada
持續時間: 2 9月 20114 9月 2011

出版系列

名字Proc.- 2011 IEEE International Conference on HPCC 2011 - 2011 IEEE International Workshop on FTDCS 2011 -Workshops of the 2011 Int. Conf. on UIC 2011- Workshops of the 2011 Int. Conf. ATC 2011

Conference

Conference13th IEEE International Workshop on FTDCS 2011, the 8th International Conference on ATC 2011, the 8th International Conference on UIC 2011 and the 13th IEEE International Conference on HPCC 2011
國家/地區Canada
城市Banff, AB
期間2/09/114/09/11

指紋

深入研究「Developing ubiquitous multi-touch sensing and displaying systems with vision-based finger detection and event identification techniques」主題。共同形成了獨特的指紋。

引用此