Perceiving Systems, Computer Vision

Dyna: A Model of Dynamic Human Shape in Motion

2015

Article

ps


To look human, digital full-body avatars need to have soft tissue deformations like those of real people. We learn a model of soft-tissue deformations from examples using a high-resolution 4D capture system and a method that accurately registers a template mesh to sequences of 3D scans. Using over 40,000 scans of ten subjects, we learn how soft tissue motion causes mesh triangles to deform relative to a base 3D body model. Our Dyna model uses a low-dimensional linear subspace to approximate soft-tissue deformation and relates the subspace coefficients to the changing pose of the body. Dyna uses a second-order auto-regressive model that predicts soft-tissue deformations based on previous deformations, the velocity and acceleration of the body, and the angular velocities and accelerations of the limbs. Dyna also models how deformations vary with a person’s body mass index (BMI), producing different deformations for people with different shapes. Dyna realistically represents the dynamics of soft tissue for previously unseen subjects and motions. We provide tools for animators to modify the deformations and apply them to new stylized characters.

Author(s): Gerard Pons-Moll and Javier Romero and Naureen Mahmood and Michael J. Black
Journal: ACM Transactions on Graphics, (Proc. SIGGRAPH)
Volume: 34
Number (issue): 4
Pages: 120:1--120:14
Year: 2015
Month: August
Publisher: ACM

Department(s): Perceiving Systems
Research Project(s): 4D Shape
Virtual Humans (2011-2015)
Bibtex Type: Article (article)
Paper Type: Journal

DOI: /10.1145/2766993

Links: pdf preprint
video
data
Video:

BibTex

@article{Dyna:SIGGRAPH:2015,
  title = {Dyna: A Model of Dynamic Human Shape in Motion},
  author = {Pons-Moll, Gerard and Romero, Javier and Mahmood, Naureen and Black, Michael J.},
  journal = {ACM Transactions on Graphics, (Proc. SIGGRAPH)},
  volume = {34},
  number = {4},
  pages = {120:1--120:14},
  publisher = {ACM},
  month = aug,
  year = {2015},
  doi = {/10.1145/2766993},
  month_numeric = {8}
}