FDPipette

Abstract

To achieve a comprehensive augmented reality (AR), a computer must abstract the user’s environment to a level that is perceived by the user. However, users are not simple processors that accept a given stimulus passively. Rather, users actively apply force to the environment and observe the changes in the environment to obtain kinetic information. Based on this dynamic nature of human, this study introduces FDPipette, a novel interaction tech- nique in AR. In this technique, users apply force to surrounding objects through a rod-shaped device equipped with a loadcell and a depth sensing camera. The force and deformation measured from this device allow the AR system to estimate kinetic information such as stiffness and motion resistance of the surrounding objects. This enables the augmentation of the kinetic reality.