Mo-Bi: Contextual Mobile Interfaces through Bimanual Posture Sensing with Wrist-Worn Devices

Abstract

Using multiple sensor-embedded devices enables detection of usage contexts that extend new interaction opportunities (e.g., a gesture and posture composite interface). In this study, we explored a design space of contextual interactions using a mobile device and two wrist-worn devices, suggesting Mo-Bi, the bimanual posture-based mobile interface system. Mo-Bi recognizes a user’s hand posture compositely utilizing the spatial configurations of the three devices. It provides the contextually appropriate interface layout or application function according to the inference based on bimanual posture information. We suggested four interface scenarios of Mo-Bi that are applicable for common use applications in mobile context. A technical evaluation shows the feasibility of the system, and users found that Mo-Bi enhanced physical comfort and stability, providing interfaces that fit their context without increasing interaction steps for the adaptive interface.