Palm&Fingers

Abstract

Unlike existing mobile devices - with a small display - AR/VR devices can display Desktop GUI without depreciation. We propose Palm&Fingers interaction technique that can maintain interaction skills and practice of Desktop - even in a desk-less mobile situation. The technique utilize the palm as a trackpad and the finger as a shortcut. Exploring whether using Desktop applications with Palm&Fingers is possible: 1) we quantified the palm-trackpad performance, 2) we quantified the finger-shortcut performance, and 3) we explored the remaining challenges of Palm&Fingers on the use of the real Desktop application. The results show that Palm&Fingers has sufficient interaction performance and can be improved by designing 1) rules to define a trackpad-shortcut area and 2) quasi-mode interaction.