Dyna: A Model of Dynamic Human Shape in Motion (SIGGRAPH 2015)

15 May 2015

07:08

SIGGRAPH 2015 Paper Video: Dyna: A Model of Dynamic Human Shape in Motion, Pons-Moll, G., Romero, J., Mahmood, N. and Black, M.J., ACM Transactions on Graphics, (Proc. SIGGRAPH), 2015. pdf: http://files.is.tue.mpg.de/black/papers/dyna.pdf project and data: http://dyna.is.tue.mpg.de/ Abstract: To look human, digital full-body avatars need to have soft tissue deformations like those of real people. We learn a model of soft-tissue deformations from examples using a high-resolution 4D capture system and a method that accurately registers a template mesh to sequences of 3D scans. Using over 40,000 scans of ten subjects, we learn how soft tissue motion causes mesh triangles to deform relative to a base 3D body model. Our Dyna model uses a low-dimensional linear subspace to approximate soft-tissue deformation and relates the subspace coefficients to the changing pose of the body. Dyna uses a second-order auto-regressive model that predicts soft-tissue deformations based on previous deformations, the velocity and acceleration of the body, and the angular velocities and accelerations of the limbs. Dyna also models how deformations vary with a person’s body mass index (BMI), producing different deformations for people with different shapes. Dyna realistically represents the dynamics of soft tissue for previously unseen subjects and motions. We provide tools for animators to modify the deformations and apply them to new stylized characters. Supplemental material: All 40,000 training alignments are shown in this video: https://www.youtube.com/watch?v=AjZ24UbwvLU This gives a sense of the alignment quality, the training motions, and the variety of soft-tissue deforms exhibited by different people.