Associating Real Objects with Virtual Models for VR Interaction

Wan Ting Hsu, I-Chen Lin

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations


In this paper, we present a prototype system that is capable of associating real objects with virtual models and turning the table top into imaginary virtual scenes. A user can interact with these objects when she or he is immersed in the virtual environment. To accomplish this goal, a vision-based system is developed to online recognize and track the real objects in the scene. The corresponding virtual models are retrieved based on their tactile shapes. They are displayed and moved on a head-mounted display (HMD) according to tracked object poses. The experiment demonstrates that our prototype system can find reasonable association between real and virtual objects, and users are interested in the novel interaction.
Original languageEnglish
Title of host publicationSIGGRAPH Asia 2021 Posters
Number of pages2
StatePublished - Dec 2021


Dive into the research topics of 'Associating Real Objects with Virtual Models for VR Interaction'. Together they form a unique fingerprint.

Cite this