Partial Matching of Facial Expression Sequence Using Over-Complete Transition Dictionary for Emotion Recognition

Cited 8 time in webofscience Cited 0 time in scopus
  • Hit : 355
  • Download : 0
Facial dynamics contain useful information for facial expression recognition (FER). However, exploiting dynamics in FER is challenging. This is mainly due to a variety of expression transitions. For example, video sequences belonging to a same emotion class may have different characteristics in transition duration and/or transition type (e.g., onset versus offset). The temporal mismatches between query and training video sequences could degrade the FER. This paper proposes a new partial matching framework that aims to overcome the temporal mismatch of expression transition. During the training stage, we construct an over-complete transition dictionary where many possible partial expression transitions are contained. During the test stage, we extract a number of partial expression transitions from a query video sequence. Each partial expression transition is analyzed individually. This increases the possibility of matching a partial expression transition in the query video sequence against the partial expression transitions in the over-complete transition dictionary. To make a partial matching subject-independent and robust to the temporal mismatch, each partial expression transition is defined as facial shape displacement between a pair of face clusters. Experimental results show that the proposed method is robust to variations of transition duration and transition type in subject-independent recognition.
Publisher
Institute of Electrical and Electronics Engineers
Issue Date
2016-10
Language
English
Article Type
Article
Keywords

LOCAL BINARY PATTERNS; SPARSE REPRESENTATION; FACE RECOGNITION; IMAGE SEQUENCES; MINIMIZATION; REDUCTION; ALGORITHM; FEATURES; MANIFOLD; PCA

Citation

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, v.7, no.4, pp.389 - 408

ISSN
1949-3045
DOI
10.1109/TAFFC.2015.2496320
URI
http://hdl.handle.net/10203/219660
Appears in Collection
EE-Journal Papers(저널논문)
Files in This Item
There are no files associated with this item.
This item is cited by other documents in WoS
⊙ Detail Information in WoSⓡ Click to see webofscience_button
⊙ Cited 8 items in WoS Click to see citing articles in records_button

qr_code

  • mendeley

    citeulike


rss_1.0 rss_2.0 atom_1.0