 |
As mentioned, instead of using landmark-derived heatmaps as direct input features, we generate AU-guided heatmaps that serve purely as supervisory signals to guide attention learning—essentially teaching the network where to focus on expression-critical regions.
The Facial Action Coding System (FACS) by Ekman in 1978 provides an anatomically grounded framework for decomposing facial expressions into Action Units (AUs)—elementary muscle movements that form the basis of emotional displays. Each basic emotion is characterized by a distinctive subset of AUs localized to specific facial regions, enabling systematic computational analysis of expressions. This established knowledge enables us to construct AU-guided heatmaps that direct attention toward expression-relevant areas.
|
IEEE/ICACT20260151 Slide.10
[Big Slide]