Body Talk: Crowdshaping Realistic 3D Avatars with Words (SIGGRAPH 2016)

26 July 2016

05:17

Try BodyTalk here: http://bodytalk.is.tue.mpg.de/ Realistic, metrically accurate, 3D human avatars are useful for games, shopping, virtual reality, and health applications. Such avatars are not in wide use because solutions for creating them from high-end scanners, low-cost range cameras, and tailoring measurements all have limitations. Here we propose a simple solution and show that it is surprisingly accurate. We use crowdsourcing to generate attribute ratings of 3D body shapes corresponding to standard linguistic descriptions of 3D shape. We then learn a linear function relating these ratings to 3D human shape parameters. Given an image of a new body, we again turn to the crowd for ratings of the body shape. The collection of linguistic ratings of a photograph provides remarkably strong constraints on the metric 3D shape. We call the process crowdshaping and show that our Body Talk system produces shapes that are perceptually indistinguishable from bodies created from high-resolution scans and that the metric accuracy is sufficient for many tasks. This makes body “scanning” practical without a scanner, opening up new applications including database search, visualization, and extracting avatars from books. Citation: Streuber, S., Quiros-Ramirez, M., Hill, M., Hahn, C., Zuffi, S., O’Toole, A., Black, M. J., Body Talk: Crowdshaping Realistic 3D Avatars with Words, ACM Trans. Graph. (Proc. SIGGRAPH), 35(4), July 2016. pdf: http://files.is.tue.mpg.de/black/papers/BodyTalkSIGGRAPH2016.pdf project page: https://ps.is.tuebingen.mpg.de/research_projects/bodies-from-words web tool, data, meshes: http://bodytalk.is.tue.mpg.de/