TiTAN: Exploring midair text entry using freehand input

Abstract

TiTAN is a spatial user interface that enables freehand, midair text entry with a distant display while only requiring a low-cost depth sensor. Our system aims to leverage one's familiarity with the QWERTY layout. It allows users to input text, in midair, by mimicking the typing action they typically perform on a physical keyboard or touchscreen. Here, both hands and ten fingers are individually tracked, along with click action detection which enables a wide variety of interactions. We propose three midair text entry techniques and evaluate the TiTAN system with two different sensors.