Fast-SNARF: A Fast Deformer for Articulated Neural Fields

2023

Article

ps

Neural fields have revolutionized the area of 3D reconstruction and novel view synthesis of rigid scenes. A key challenge in making such methods applicable to articulated objects, such as the human body, is to model the deformation of 3D locations between the rest pose (a canonical space) and the deformed space. We propose a new articulation module for neural fields, Fast-SNARF, which finds accurate correspondences between canonical space and posed space via iterative root finding. Fast-SNARF is a drop-in replacement in functionality to our previous work, SNARF, while significantly improving its computational efficiency. We contribute several algorithmic and implementation improvements over SNARF, yielding a speed-up of 150× . These improvements include voxel-based correspondence search, pre-computing the linear blend skinning function, and an efficient software implementation with CUDA kernels. Fast-SNARF enables efficient and simultaneous optimization of shape and skinning weights given deformed observations without correspondences (e.g. 3D meshes). Because learning of deformation maps is a crucial component in many 3D human avatar methods and since Fast-SNARF provides a computationally efficient solution, we believe that this work represents a significant step towards the practical creation of 3D virtual humans.

@article{Chen:PAMI:2023,
  title = {{Fast-SNARF}: A Fast Deformer for Articulated Neural Fields},
  author = {Chen, Xu and Jiang, Tianjian and Song, Jie and Rietmann, Max and Geiger, Andreas and Black, Michael J. and Hilliges, Otmar},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI)},
  pages = {1--15},
  month = apr,
  year = {2023},
  doi = {https://doi.org/10.1109/TPAMI.2023.3271569},
  month_numeric = {4}
}