2024
HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Video
(Accepted as Highlight: Top 11.9%)
Fan, Z., Parelli, M., Kadoglou, M. E., Kocabas, M., Chen, X., Black, M. J., Hilliges, O.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling
Liu, H., Zhu, Z., Becherini, G., Peng, Y., Su, M., Zhou, Y., Zhe, X., Iwamoto, N., Zheng, B., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
HUGS: Human Gaussian Splats
Kocabas, M., Chang, R., Gabriel, J., Tuzel, O., Ranjan, A.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes
Sanyal, S., Ghosh, P., Yang, J., Black, M. J., Thies, J., Bolkart, T.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
HIT: Estimating Internal Human Implicit Tissues from the Body Surface
Keller, M., Arora, V., Dakri, A., Chandhok, S., Machann, J., Fritsche, A., Black, M. J., Pujades, S.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion
Shin, S., Kim, J., Halilaj, E., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
WANDR: Intention-guided Human Motion Generation
Diomataris, M., Athanasiou, N., Taheri, O., Wang, X., Hilliges, O., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
Text-Conditioned Generative Model of 3D Strand-based Human Hairstyles
Sklyarova, V., Zakharov, E., Hilliges, O., Black, M. J., Thies, J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
4D-DRESS: A 4D Dataset of Real-World Human Clothing With Semantic Annotations
Wang, W., Ho, H., Guo, C., Rong, B., Grigorev, A., Song, J., Zarate, J. J., Hilliges, O.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
VAREN: Very Accurate and Realistic Equine Network
Zuffi, S., Mellbin, Y., Li, C., Hoeschle, M., Kjellstrom, H., Polikovsky, S., Hernlund, E., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
ChatPose: Chatting about 3D Human Pose
Feng, Y., Lin, J., Dwivedi, S. K., Sun, Y., Patel, P., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
Generative Proxemics: A Prior for 3D Social Interaction from Images
Müller, L., Ye, V., Pavlakos, G., Black, M., Kanazawa, A.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
MonoHair: High-Fidelity Hair Modeling from a Monocular Video
(Oral)
Wu, K., Yang, L., Kuang, Z., Feng, Y., Han, X., Shen, Y., Fu, H., Zhou, K., Zheng, Y.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
A Unified Approach for Text- and Image-guided 4D Scene Generation
Zheng, Y., Li, X., Nagano, K., Liu, S., Hilliges, O., Mello, S. D.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
AMUSE: Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion
Chhatre, K., Daněček, R., Athanasiou, N., Becherini, G., Peters, C., Black, M. J., Bolkart, T.
In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages: 1942-1953, June 2024 (inproceedings)
Real-time Monocular Full-body Capture in World Space via Sequential Proxy-to-Motion Learning
Zhang, H., Zhang, Y., Hu, L., Zhang, J., Yi, H., Zhang, S., Liu, Y.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesis
Retsinas, G., Filntisis, P. P., Danecek, R., Abrevaya, V. F., Roussos, A., Bolkart, T., Maragos, P.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
Ghost on the Shell: An Expressive Representation of General 3D Shapes
(Oral)
Liu, Z., Feng, Y., Xiu, Y., Liu, W., Paull, L., Black, M. J., Schölkopf, B.
In Proceedings of the Twelfth International Conference on Learning Representations, May 2024 (inproceedings) Accepted
Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization
Liu, W., Qiu, Z., Feng, Y., Xiu, Y., Xue, Y., Yu, L., Feng, H., Liu, Z., Heo, J., Peng, S., Wen, Y., Black, M. J., Weller, A., Schölkopf, B.
In Proceedings of the Twelfth International Conference on Learning Representations, May 2024 (inproceedings) Accepted
TADA! Text to Animatable Digital Avatars
Liao, T., Yi, H., Xiu, Y., Tang, J., Huang, Y., Thies, J., Black, M. J.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings) Accepted
POCO: 3D Pose and Shape Estimation using Confidence
Dwivedi, S. K., Schmid, C., Yi, H., Black, M. J., Tzionas, D.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings)
PACE: Human and Camera Motion Estimation from in-the-wild Videos
(Spotlight Presentation)
Kocabas, M., Yuan, Y., Molchanov, P., Guo, Y., Black, M. J., Hilliges, O., Kautz, J., Iqbal, U.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings)
Physically plausible full-body hand-object interaction synthesis
Braun, J., Christen, S., Kocabas, M., Aksan, E., Hilliges, O.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings)
TECA: Text-Guided Generation and Editing of Compositional 3D Avatars
Zhang, H., Feng, Y., Kulits, P., Wen, Y., Thies, J., Black, M. J.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings) To be published
ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation
Zhang, H., Christen, S., Fan, Z., Zheng, L., Hwangbo, J., Song, J., Hilliges, O.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings) Accepted
TeCH: Text-guided Reconstruction of Lifelike Clothed Humans
Huang, Y., Yi, H., Xiu, Y., Liao, T., Tang, J., Cai, D., Thies, J.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings) Accepted
Adversarial Likelihood Estimation With One-Way Flows
Ben-Dov, O., Gupta, P. S., Abrevaya, V., Black, M. J., Ghosh, P.
In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages: 3779-3788, January 2024 (inproceedings)
2023
Controlling Text-to-Image Diffusion by Orthogonal Finetuning
Qiu*, Z., Liu*, W., Feng, H., Xue, Y., Feng, Y., Liu, Z., Zhang, D., Weller, A., Schölkopf, B.
Advances in Neural Information Processing Systems 36 (NeurIPS 2023), 36, pages: 79320-79362, (Editors: A. Oh and T. Neumann and A. Globerson and K. Saenko and M. Hardt and S. Levine), Curran Associates, Inc., December 2023, *equal contribution (conference)
Emotional Speech-Driven Animation with Content-Emotion Disentanglement
Daněček, R., Chhatre, K., Tripathi, S., Wen, Y., Black, M., Bolkart, T.
In ACM, December 2023 (inproceedings) Accepted
Optimizing the 3D Plate Shape for Proximal Humerus Fractures
Keller, M., Krall, M., Smith, J., Clement, H., Kerner, A. M., Gradischar, A., Schäfer, Ü., Black, M. J., Weinberg, A., Pujades, S.
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), pages: 487-496, Springer, October 2023 (conference)
DECO: Dense Estimation of 3D Human-Scene Contact in the Wild
Tripathi, S., Chatterjee, A., Passy, J., Yi, H., Tzionas, D., Black, M. J.
In Proc. International Conference on Computer Vision (ICCV), October 2023 (inproceedings) Accepted
Generalizing Neural Human Fitting to Unseen Poses With Articulated SE(3) Equivariance
(Oral)
Feng, H., Kulits, P., Liu, S., Black, M. J., Abrevaya, V. F.
In Proc. International Conference on Computer Vision (ICCV), October 2023 (inproceedings) To be published
D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field
Yang, X., Luo, Y., Xiu, Y., Wang, W., Xu, H., Fan, Z.
In Proc. International Conference on Computer Vision (ICCV), October 2023 (inproceedings) Accepted
AG3D: Learning to Generate 3D Avatars from 2D Image Collections
Dong, Z., Chen, X., Yang, J., J.Black, M., Hilliges, O., Geiger, A.
In Proc. International Conference on Computer Vision (ICCV), October 2023 (inproceedings)
SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation
Athanasiou, N., Petrovich, M., Black, M. J., Varol, G.
In Proc. International Conference on Computer Vision (ICCV), pages: 9984-9995, October 2023 (inproceedings)
TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis
Petrovich, M., Black, M. J., Varol, G.
In Proc. International Conference on Computer Vision (ICCV), pages: 9488-9497, October 2023 (inproceedings)
Pairwise Similarity Learning is SimPLE
Wen*, Y., Liu*, W., Feng, Y., Raj, B., Singh, R., Weller, A., Black, M. J., Schölkopf, B.
In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023 (inproceedings)
Synthetic Data-Based Detection of Zebras in Drone Imagery
Synthesizing Physical Character-scene Interactions
Hassan, M., Guo, Y., Wang, T., Black, M., Fidler, S., Peng, X. B.
In SIGGRAPH Conf. Track, August 2023 (inproceedings)
High-Fidelity Clothed Avatar Reconstruction from a Single Image
Liao, T., Zhang, X., Xiu, Y., Yi, H., Liu, X., Qi, G., Zhang, Y., Wang, X., Zhu, X., Lei, Z.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 8662-8672, June 2023 (inproceedings) Accepted
ECON: Explicit Clothed humans Optimized via Normal integration
(Highlight Paper)
Xiu, Y., Yang, J., Cao, X., Tzionas, D., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 512-523, June 2023 (inproceedings) Accepted
HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics
Grigorev, A., Thomaszewski, B., Black, M. J., Hilliges, O.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 16965-16974, June 2023 (inproceedings)
Instant Volumetric Head Avatars
Zielonka, W., Bolkart, T., Thies, J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2023 (inproceedings)
BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion
(Highlight Paper)
Black, M. J., Patel, P., Tesch, J., Yang, J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 8726-8737, June 2023 (inproceedings)
BITE: Beyond Priors for Improved Three-D Dog Pose Estimation
Rüegg, N., Tripathi, S., Schindler, K., Black, M. J., Zuffi, S.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 8867-8876, June 2023 (inproceedings)
MIME: Human-Aware 3D Scene Generation
Yi, H., Huang, C. P., Tripathi, S., Hering, L., Thies, J., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 12965-12976, June 2023 (inproceedings) Accepted
Learning from synthetic data generated with GRADE
Bonetto, E., Xu, C., Ahmad, A.
In ICRA 2023 Pretraining for Robotics (PT4R) Workshop, June 2023 (inproceedings) Accepted
PointAvatar: Deformable Point-Based Head Avatars From Videos
Zheng, Y., Yifan, W., Wetzstein, G., Black, M. J., Hilliges, O.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 21057-21067, June 2023 (inproceedings)
Generating Holistic 3D Human Motion from Speech
Yi, H., Liang, H., Liu, Y., Cao, Q., Wen, Y., Bolkart, T., Tao, D., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 469-480, June 2023 (inproceedings) Accepted