EMOCA: Emotion Driven Monocular Face Capture and Animation

2022-04-07

EMOCA takes a single in-the-wild image as input and reconstructs a 3D face with sufficient facial expression detail to convey the emotional state of the input image. EMOCA advances the state-of-the-art monocular face reconstruction in-the-wild, putting emphasis on accurate capture of emotional content.

The repository provides:

• An approach to reconstruct animatable 3D faces from an in-the-wild images, that is capable of recovering facial expressions that convey the correct emotional state.
• A novel perceptual emotion-consistency loss that rewards the accuracy of the reconstructed emotion.
• A 3D geometry-based framework for in-the-wild emotion recognition, with comparable performance to current state-of-the-art image-based methods.
• Different pre-trained image-based emotion recognition networks.