Gesture-based Interface using Multiple Cameras for Home Appliance Control

Abstract

In this paper, we describe a novel human-friendly interface based on hand gesture recognition using multiple cameras. The proposed system allows the users to control various home appliances naturally without any body-attached devices within a smart home. Through the developed system, the user first selects the device that he/she wants to control by pointing to it with his/her hand. Then, the user can command the operation of desired functions via 10 predefined basic hand motion commands. In order to complement the errors in recognizing the user’s pointing directions, we adopt the concept of feedback by which the user can adjust the pointing direction and confirm the recognition result. The developed system complements some inconveniences of conventional remote controllers specifically by giving additional freedom to persons with movement deficits.