Augmenting VR/AR applications with EEG/EOG monitoring and oculo-vestibular recoupling

John K. Zao*, Tzyy Ping Jung, Hung Ming Chang, Tchin Tze Gan, Yu Te Wang, Yuan Pin Lin, Wen Hao Liu, Guang Yu Zheng, Chin Kuo Lin, Chia Hung Lin, Yu Yi Chien, Fang Cheng Lin, Yi-Pai Huang, Sergio José Rodríguez Méndez, Felipe A. Medeiros

*此作品的通信作者

研究成果: Conference contribution同行評審

20 引文 斯高帕斯(Scopus)

摘要

Head-mounted virtual reality and augmented reality displays (a.k.a. VR/AR goggles) created a revolutionary multimedia genre that is seeking ever-broadening applications and novel natural human interfaces. Adding neuromonitoring and neurofeedback to this genre is expected to introduce a new dimension to user interaction with the cyber-world. This study presents the development of a Neuromonitoring VR/AR Goggle armed with electroencephalo- gram and electrooculogram sensors, programmable milli-Ampere current stimulators and wireless fog/cloud computing support. Beside of its potential use in mitigating cybersickness, this device may have potential applications in augmented cognition ranging from feedback-controlled perceptual training to on-line learning and virtual social interactions. A prototype of the device has been made from a Samsung Gear VR for S6. This study explains its technical design to ensure precision data sampling, synchronous event marking, real-time signal processing and big data cloud computing support. This study also demonstrates the effective-ness in measuring the event-related potentials during a visual oddball experiment.

原文English
主出版物標題Foundations of Augmented Cognition
主出版物子標題Neuroergonomics and Operational Neuroscience - 10th International Conference, AC 2016 and Held as Part of HCI International 2016, Proceedings
編輯Cali M. Fidopiastis, Dylan D. Schmorrow
發行者Springer Verlag
頁面121-131
頁數11
ISBN(列印)9783319399546
DOIs
出版狀態Published - 1 1月 2016
事件10th International Conference on Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience, AC 2016 and Held as Part of 18th International Conference on Human-Computer Interaction, HCI International 2016 - Toronto, 加拿大
持續時間: 17 7月 201622 7月 2016

出版系列

名字Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
9743
ISSN(列印)0302-9743
ISSN(電子)1611-3349

Conference

Conference10th International Conference on Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience, AC 2016 and Held as Part of 18th International Conference on Human-Computer Interaction, HCI International 2016
國家/地區加拿大
城市Toronto
期間17/07/1622/07/16

指紋

深入研究「Augmenting VR/AR applications with EEG/EOG monitoring and oculo-vestibular recoupling」主題。共同形成了獨特的指紋。

引用此