TY - GEN
T1 - A NATURAL HUMAN-DRONE INTERFACE FOR BETTER SPATIAL PRESENCE EXPERIENCES
AU - Lo, Chun Yu
AU - Hou, June Hao
N1 - Publisher Copyright:
© 2022, The Association for Computer-Aided Architectural Design Research in Asia. All rights reserved.
PY - 2022
Y1 - 2022
N2 - As many remote construction projects increase in size and complexity, being able to manage personnel schedules, delegate tasks, and check work progress can improve work efficiency and productivity. Hence, video conferencing and remote monitoring software have been attempting to pursue an immersive and intuitive experience, but with limited developments. To better achieve that, we propose a system with a natural user interface (NUI) that can offer a vivid experience, facilitating AEC personnel who is novice drone operator to interact with the Unmanned Aerial Vehicle (UAV) by voice instructions and body posture to conduct remote site surveying, monitoring, and inspections instead of physical visiting. In addition, the proposed system is capable of on-demand path planning and camera movements for various tasks and enhances the spatial experience. We integrate these techniques to develop a human-drone interface, including a VR simulator and a haptic vest system, which offer a perceivable experience of spatial presence for different purposes. Compared with other relative works, the proposed system allows users to actively control the viewing angle and movements in the remote space more intuitively. Moreover, drones can augment human vision and let users gain mobile autonomy.
AB - As many remote construction projects increase in size and complexity, being able to manage personnel schedules, delegate tasks, and check work progress can improve work efficiency and productivity. Hence, video conferencing and remote monitoring software have been attempting to pursue an immersive and intuitive experience, but with limited developments. To better achieve that, we propose a system with a natural user interface (NUI) that can offer a vivid experience, facilitating AEC personnel who is novice drone operator to interact with the Unmanned Aerial Vehicle (UAV) by voice instructions and body posture to conduct remote site surveying, monitoring, and inspections instead of physical visiting. In addition, the proposed system is capable of on-demand path planning and camera movements for various tasks and enhances the spatial experience. We integrate these techniques to develop a human-drone interface, including a VR simulator and a haptic vest system, which offer a perceivable experience of spatial presence for different purposes. Compared with other relative works, the proposed system allows users to actively control the viewing angle and movements in the remote space more intuitively. Moreover, drones can augment human vision and let users gain mobile autonomy.
KW - Body Posture Recognition
KW - Human-drone Interaction
KW - Natural User Interface
KW - Remote Working
KW - SDG 9
KW - Spatial Presence
KW - Speech Recognition
KW - Virtual Reality
UR - http://www.scopus.com/inward/record.url?scp=85189146253&partnerID=8YFLogxK
U2 - 10.52842/conf.caadria.2022.1.099
DO - 10.52842/conf.caadria.2022.1.099
M3 - Conference contribution
AN - SCOPUS:85189146253
SN - 9789887891772
T3 - Proceedings of the International Conference on Computer-Aided Architectural Design Research in Asia
SP - 99
EP - 108
BT - POST-CARBON, Proceedings of the 27th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2022, Volume 1
A2 - van Ameijde, Jeroen
A2 - Gardner, Nicole
A2 - Hyun, Kyung Hoon
A2 - Luo, Dan
A2 - Sheth, Urvi
PB - The Association for Computer-Aided Architectural Design Research in Asia
T2 - 27th International Conference of the Association for Computer-Aided Architectural Design Research in Asia, CAADRIA 2022
Y2 - 9 April 2022 through 15 April 2022
ER -