FaceDirector: Continuous control of facial performance in video

Cited 0 time in webofscience Cited 0 time in scopus
  • Hit : 91
  • Download : 0
We present a method to continuously blend between multiple facial performances of an actor, which can contain different facial expressions or emotional states. As an example, given sad and angry video takes of a scene, our method empowers the movie director to specify arbitrary weighted combinations and smooth transitions between the two takes in post-production. Our contributions include (1) a robust nonlinear audio-visual synchronization technique that exploits complementary properties of audio and visual cues to automatically determine robust, dense spatiotemporal correspondences between takes, and (2) a seamless facial blending approach that provides the director full control to interpolate timing, facial expression, and local appearance, in order to generate novel performances after filming. In contrast to most previous works, our approach operates entirely in image space, avoiding the need of 3D facial reconstruction. We demonstrate that our method can synthesize visually believable performances with applications in emotion transition, performance correction, and timing control.
Publisher
IEEE Computer Society and the Computer Vision Foundation (CVF)
Issue Date
2015-12-11
Language
English
Citation

15th IEEE International Conference on Computer Vision, ICCV 2015, pp.3979 - 3987

DOI
10.1109/ICCV.2015.453
URI
http://hdl.handle.net/10203/225737
Appears in Collection
GCT-Conference Papers(학술회의논문)
Files in This Item
There are no files associated with this item.

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0