Exploring pseudo hand-eye interaction on the head-mounted display as a novel interaction technique

Abstract

Virtual and augmented reality devices and applications have enabled the average user to experience a variety of experiences through first-person visual, auditory, and haptic feedback. However, among the numerous everyday interactions that have been emulated, the familiar interaction of touching or rubbing the eyes is yet to be explored and remains to be understood. In this thesis, we aim to understand the components of natural hand-eye interaction, develop a proof-of-concept prototype head-mounted display implementing interaction components, evaluate the user experience of the prototype through user study, organize the results and insights into a preliminary guideline for future work, and propose developed versions of the hardware and software implementations based on user feedback.