2024
HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Video
(Accepted as Highlight: Top 11.9%)
Fan, Z., Parelli, M., Kadoglou, M. E., Kocabas, M., Chen, X., Black, M. J., Hilliges, O.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling
Liu, H., Zhu, Z., Becherini, G., Peng, Y., Su, M., Zhou, Y., Zhe, X., Iwamoto, N., Zheng, B., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
HUGS: Human Gaussian Splats
Kocabas, M., Chang, R., Gabriel, J., Tuzel, O., Ranjan, A.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes
Sanyal, S., Ghosh, P., Yang, J., Black, M. J., Thies, J., Bolkart, T.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
HIT: Estimating Internal Human Implicit Tissues from the Body Surface
Keller, M., Arora, V., Dakri, A., Chandhok, S., Machann, J., Fritsche, A., Black, M. J., Pujades, S.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion
Shin, S., Kim, J., Halilaj, E., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
WANDR: Intention-guided Human Motion Generation
Diomataris, M., Athanasiou, N., Taheri, O., Wang, X., Hilliges, O., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
Text-Conditioned Generative Model of 3D Strand-based Human Hairstyles
Sklyarova, V., Zakharov, E., Hilliges, O., Black, M. J., Thies, J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
4D-DRESS: A 4D Dataset of Real-World Human Clothing With Semantic Annotations
Wang, W., Ho, H., Guo, C., Rong, B., Grigorev, A., Song, J., Zarate, J. J., Hilliges, O.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
VAREN: Very Accurate and Realistic Equine Network
Zuffi, S., Mellbin, Y., Li, C., Hoeschle, M., Kjellstrom, H., Polikovsky, S., Hernlund, E., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
ChatPose: Chatting about 3D Human Pose
Feng, Y., Lin, J., Dwivedi, S. K., Sun, Y., Patel, P., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
Generative Proxemics: A Prior for 3D Social Interaction from Images
Müller, L., Ye, V., Pavlakos, G., Black, M., Kanazawa, A.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representation
Dwivedi, S. K., Sun, Y., Patel, P., Feng, Y., Black, M. J.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
MonoHair: High-Fidelity Hair Modeling from a Monocular Video
(Oral)
Wu, K., Yang, L., Kuang, Z., Feng, Y., Han, X., Shen, Y., Fu, H., Zhou, K., Zheng, Y.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
A Unified Approach for Text- and Image-guided 4D Scene Generation
Zheng, Y., Li, X., Nagano, K., Liu, S., Hilliges, O., Mello, S. D.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
AMUSE: Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion
Chhatre, K., Daněček, R., Athanasiou, N., Becherini, G., Peters, C., Black, M. J., Bolkart, T.
In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages: 1942-1953, June 2024 (inproceedings)
Real-time Monocular Full-body Capture in World Space via Sequential Proxy-to-Motion Learning
Zhang, H., Zhang, Y., Hu, L., Zhang, J., Yi, H., Zhang, S., Liu, Y.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesis
Retsinas, G., Filntisis, P. P., Danecek, R., Abrevaya, V. F., Roussos, A., Bolkart, T., Maragos, P.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), June 2024 (inproceedings)
Ghost on the Shell: An Expressive Representation of General 3D Shapes
(Oral)
Liu, Z., Feng, Y., Xiu, Y., Liu, W., Paull, L., Black, M. J., Schölkopf, B.
In Proceedings of the Twelfth International Conference on Learning Representations, May 2024 (inproceedings) Accepted
Exploring Weight Bias and Negative Self-Evaluation in Patients with Mood Disorders: Insights from the BodyTalk Project,
Meneguzzo, P., Behrens, S. C., Pavan, C., Toffanin, T., Quiros-Ramirez, M. A., Black, M. J., Giel, K., Tenconi, E., Favaro, A.
Frontiers in Psychiatry, 15, Sec. Psychopathology, May 2024 (article)
Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization
Liu, W., Qiu, Z., Feng, Y., Xiu, Y., Xue, Y., Yu, L., Feng, H., Liu, Z., Heo, J., Peng, S., Wen, Y., Black, M. J., Weller, A., Schölkopf, B.
In Proceedings of the Twelfth International Conference on Learning Representations, May 2024 (inproceedings) Accepted
The Poses for Equine Research Dataset (PFERD)
Li, C., Mellbin, Y., Krogager, J., Polikovsky, S., Holmberg, M., Ghorbani, N., Black, M. J., Kjellström, H., Zuffi, S., Hernlund, E.
Nature Scientific Data, 11, May 2024 (article)
TADA! Text to Animatable Digital Avatars
Liao, T., Yi, H., Xiu, Y., Tang, J., Huang, Y., Thies, J., Black, M. J.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings) Accepted
POCO: 3D Pose and Shape Estimation using Confidence
Dwivedi, S. K., Schmid, C., Yi, H., Black, M. J., Tzionas, D.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings)
PACE: Human and Camera Motion Estimation from in-the-wild Videos
(Spotlight Presentation)
Kocabas, M., Yuan, Y., Molchanov, P., Guo, Y., Black, M. J., Hilliges, O., Kautz, J., Iqbal, U.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings)
Physically plausible full-body hand-object interaction synthesis
Braun, J., Christen, S., Kocabas, M., Aksan, E., Hilliges, O.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings)
TECA: Text-Guided Generation and Editing of Compositional 3D Avatars
Zhang, H., Feng, Y., Kulits, P., Wen, Y., Thies, J., Black, M. J.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings) To be published
ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation
Zhang, H., Christen, S., Fan, Z., Zheng, L., Hwangbo, J., Song, J., Hilliges, O.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings) Accepted
TeCH: Text-guided Reconstruction of Lifelike Clothed Humans
Huang, Y., Yi, H., Xiu, Y., Liao, T., Tang, J., Cai, D., Thies, J.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings) Accepted
GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistency
Taheri, O., Zhou, Y., Tzionas, D., Zhou, Y., Ceylan, D., Pirk, S., Black, M. J.
In International Conference on 3D Vision (3DV 2024), March 2024 (inproceedings)
Adversarial Likelihood Estimation With One-Way Flows
Ben-Dov, O., Gupta, P. S., Abrevaya, V., Black, M. J., Ghosh, P.
In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), pages: 3779-3788, January 2024 (inproceedings)
InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interaction from Multi-view RGB-D Images
Huang, Y., Taheri, O., Black, M. J., Tzionas, D.
International Journal of Computer Vision (IJCV), 2024 (article)
HMP: Hand Motion Priors for Pose and Shape Estimation from Video
2023
FLARE: Fast learning of Animatable and Relightable Mesh Avatars
Bharadwaj, S., Zheng, Y., Hilliges, O., Black, M. J., Abrevaya, V. F.
ACM Transactions on Graphics, 42(6):204:1-204:15, December 2023 (article) Accepted
Controlling Text-to-Image Diffusion by Orthogonal Finetuning
Qiu*, Z., Liu*, W., Feng, H., Xue, Y., Feng, Y., Liu, Z., Zhang, D., Weller, A., Schölkopf, B.
Advances in Neural Information Processing Systems 36 (NeurIPS 2023), 36, pages: 79320-79362, (Editors: A. Oh and T. Neumann and A. Globerson and K. Saenko and M. Hardt and S. Levine), Curran Associates, Inc., December 2023, *equal contribution (conference)
Emotional Speech-Driven Animation with Content-Emotion Disentanglement
Daněček, R., Chhatre, K., Tripathi, S., Wen, Y., Black, M., Bolkart, T.
In ACM, December 2023 (inproceedings) Accepted
From Skin to Skeleton: Towards Biomechanically Accurate 3D Digital Humans
(Honorable Mention for Best Paper)
Keller, M., Werling, K., Shin, S., Delp, S., Pujades, S., Liu, C. K., Black, M. J.
ACM Transaction on Graphics (ToG), 42(6):253:1-253:15, December 2023 (article)
Optimizing the 3D Plate Shape for Proximal Humerus Fractures
Keller, M., Krall, M., Smith, J., Clement, H., Kerner, A. M., Gradischar, A., Schäfer, Ü., Black, M. J., Weinberg, A., Pujades, S.
International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), pages: 487-496, Springer, October 2023 (conference)
DECO: Dense Estimation of 3D Human-Scene Contact in the Wild
Tripathi, S., Chatterjee, A., Passy, J., Yi, H., Tzionas, D., Black, M. J.
In Proc. International Conference on Computer Vision (ICCV), October 2023 (inproceedings) Accepted
Generalizing Neural Human Fitting to Unseen Poses With Articulated SE(3) Equivariance
(Oral)
Feng, H., Kulits, P., Liu, S., Black, M. J., Abrevaya, V. F.
In Proc. International Conference on Computer Vision (ICCV), October 2023 (inproceedings) To be published
D-IF: Uncertainty-aware Human Digitization via Implicit Distribution Field
Yang, X., Luo, Y., Xiu, Y., Wang, W., Xu, H., Fan, Z.
In Proc. International Conference on Computer Vision (ICCV), October 2023 (inproceedings) Accepted
AG3D: Learning to Generate 3D Avatars from 2D Image Collections
Dong, Z., Chen, X., Yang, J., J.Black, M., Hilliges, O., Geiger, A.
In Proc. International Conference on Computer Vision (ICCV), October 2023 (inproceedings)
SINC: Spatial Composition of 3D Human Motions for Simultaneous Action Generation
Athanasiou, N., Petrovich, M., Black, M. J., Varol, G.
In Proc. International Conference on Computer Vision (ICCV), pages: 9984-9995, October 2023 (inproceedings)
TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis
Petrovich, M., Black, M. J., Varol, G.
In Proc. International Conference on Computer Vision (ICCV), pages: 9488-9497, October 2023 (inproceedings)
Pairwise Similarity Learning is SimPLE
Wen*, Y., Liu*, W., Feng, Y., Raj, B., Singh, R., Weller, A., Black, M. J., Schölkopf, B.
In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023 (inproceedings)
Synthetic Data-Based Detection of Zebras in Drone Imagery
Synthesizing Physical Character-scene Interactions
Hassan, M., Guo, Y., Wang, T., Black, M., Fidler, S., Peng, X. B.
In SIGGRAPH Conf. Track, August 2023 (inproceedings)
BARC: Breed-Augmented Regression Using Classification for 3D Dog Reconstruction from Images
Rueegg, N., Zuffi, S., Schindler, K., Black, M. J.
Int. J. of Comp. Vis. (IJCV), 131(8):1964–1979, August 2023 (article)
High-Fidelity Clothed Avatar Reconstruction from a Single Image
Liao, T., Zhang, X., Xiu, Y., Yi, H., Liu, X., Qi, G., Zhang, Y., Wang, X., Zhu, X., Lei, Z.
In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pages: 8662-8672, June 2023 (inproceedings) Accepted