Thesis: Irfan Essa’s PhD Thesis (1994): “Analysis, interpretation and synthesis of facial expressions”

Irfan Essa (1994), “Analysis, interpretation and synthesis of facial expressions“, PhD Thesis, MIT, Cambridge, MA, USA. (Advisor: Alex (Sandy) Pentland) [PDF]


This thesis describes a computer vision system for observing the “action units” of a face using video sequences as input. The visual observation (sensing) is achieved by using an optimal estimation optical flow method coupled with a geometric and a physical (muscle) model describing the facial structure. This modeling results in a time-varying spatial patterning of facial shape and a parametric representation of the independent muscle action groups responsible for the observed facial motions. These muscle action patterns are then used for analysis, interpretation, recognition, and synthesis of facial expressions. Thus, by interpreting facial motions within a physics-based optimal estimation framework, a new control model of facial movement is developed. The newly extracted action units (which we name “FACS+”) are both physics and geometry-based, and extend the well known FACS parameters for facial expressions by adding temporal information and non-local spatial patterning of facial motion.

Irfan Essa’s PhD Thesis

Tags: , , , , , | Categories: Face and Gesture, Thesis | Date: August 30th, 1994 | By: Irfan Essa |


You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.

3 Responses to “Thesis: Irfan Essa’s PhD Thesis (1994): “Analysis, interpretation and synthesis of facial expressions””

  1. arthur asa berger Says:

    Can I obtain permission to use these images in a book on visual communication that I’ve written? I’ll be having a discussion of facial emotions and your images would fit in
    very well.


  2. arthur asa berger Says:

    can I obtain permission to use these images in a book I’ve
    written on visual communication?

  3. Malligaarjun R Says:

    I’m working on a facial expression recognition and i need of set of facial expressions of single person with quality image. If you able to provide me a help, it will be so kind of you.

Leave a Reply