Augmentation of Visual Experiences using Deep Learning for Peripheral Vision based Extended Display Application

Abstract

We propose the system that provides an immersive experience by automatically extending the video content of the TV to the wall. Though it is possible to manually create the appropriate content that works on the existing TV screen, the cost is too expensive to create. The proposed deep neural network uses the center of the video as input and the outside area as output. The trained network automatically generates the extrapolated video according to the input video and a projector projects the resulting content on the living room wall around the TV thereby improving the immersive feeling. The proposed system is expected to pave a new road to the home appliance industry by transforming the living room into the new immersive experience platform.