Science

Meshcapade takes the scientific understanding of human body and brings it to you using patented technology.

Want to join our research team? Look at our open positions.

Our Publications

ChatHuman Cover

ChatHuman: Language-driven 3D human understanding with retrieval-augmented tool reasoning

Jing Lin , Yao Feng , Weiyang Liu , Michael J. Black

CVPR 2024

Project page Paper
ChatPose Cover

ChatPose: Chatting about 3D human pose

Yao Feng , Jing Lin , Sai Kumar Dwivedi , Yu Sun , Priyanka Patel , Michael J. Black

CVPR 2024

Project page Paper
Token HMR Cover

TokenHMR: Advancing human mesh recovery with a tokenized pose representation

Sai Kumar Dwivedi , Yu Sun , Priyanka Patel , Yao Feng , Michael J. Black

CVPR 2024

Project page Paper
AMASS Cover

AMASS: Archive of motion capture as surface shapes

Naureen Mahmood , Nima Ghorbani , Nikolaus F. Troje , Gerard Pons-Moll , Michael J. Black

ICCV 2019

Project page Paper

Other selected publications by Meshcapade scientists

Naureen Mahmood

Learning from synthetic humans

G. Varol, J. Romero, X. Martin, N. Mahmood, M.J. Black, I. Laptev, C. Schmid

CVPR 2017

Project page Paper

SMPL: A skinned multi-person linear model

M. Loper, N. Mahmood, J. Romero, G. Pons-Moll, M.J. Black

ACM transactions on graphics (TOG) 34 (6), 1-16, 2015

Project page Paper

Dyna: A model of dynamic human shape in motion

G. Pons-Moll, J. Romero, N. Mahmood, M.J. Black

ACM Transactions on Graphics (TOG) 34 (4), 1-14, 2015

Project page Paper

MoSh: Motion and shape capture from sparse markers

M. Loper, N. Mahmood, M.J. Black

ACM Transactions on Graphics (TOG) 33 (6), 1-13, 2014

Project page Paper

Muhammed Kocabas

HUGS: Human gaussian splats

M. Kocabas, J.H.R. Chang, J. Gabriel, O. Tuzel, A. Ranjan

CVPR 2024

Project page Paper

ARCTIC: A dataset for dexterous bimanual hand-object manipulation

Z. Fan, O. Taheri, D. Tzionas, M. Kocabas, M. Kaufmann, M.J. Black, O. Hilliges

CVPR 2023

Project page Paper

SPEC: Seeing people in the wild with an estimated camera

M. Kocabas, C.H.P. Huang, J. Tesch, L. Müller, O. Hilliges, M.J. Black

CVPR 2021

Project page Paper

PARE: Part attention regressor for 3D human body estimation

M. Kocabas, C.H.P. Huang, O. Hilliges, M.J. Black

CVPR 2021

Project page Paper

VIBE: Video inference for human body pose and shape estimation

M. Kocabas, N. Athanasiou, M.J. Black

CVPR 2020

Project page Paper

Yu Sun

TRACE: 5D temporal regression of avatars with dynamic cameras in 3D environments

Y. Sun, Q. Bao, W. Liu, T. Mei, M.J. Black

CVPR 2023

Project page Paper

Putting people in their place: Monocular regression of 3D people in depth

Y. Sun, W. Liu, Q. Bao, Y. Fu, T. Mei, M.J. Black

CVPR 2022

Project page Paper

Monocular, one-stage, regression of multiple 3D people

Y. Sun, Q. Bao, W. Liu, Y. Fu, M.J. Black, T. Mei

CVPR 2021

Project page Paper

Yan Zhang

The wanderings of Odysseus in 3D scenes

Y. Zhang, S. Tang

CVPR 2022

Project page Paper

We are more than our joints: Predicting how 3D bodies move

Y. Zhang, M.J. Black, S. Tang

CVPR 2021

Project page Paper

LEAP: Learning articulated occupancy of people

M. Mihajlovic, Y. Zhang, M.J. Black, S. Tang

CVPR 2021

Project page Paper

Generating 3D people in scenes without people

Y. Zhang, M. Hassan, H. Neumann, M.J. Black, S. Tang

CVPR 2020

Project page Paper

Yao Feng

Ghost on the shell: An expressive representation of general 3D shapes

Z. Liu, Y. Feng, Y. Xiu, W. Liu, L. Paull, M.J. Black, B. Schölkopf

ICLR 2024

Project page Paper

MonoHair: High-fidelity hair modeling from a monocular video

K. Wu, L. Yang, Z. Kuang, Y. Feng, X. Han, Y. Shen, H. Fu, K. Zhou, Y. Zheng

CVPR 2024

Project page Paper

Parameter-efficient orthogonal finetuning via butterfly factorization

W. Liu, Z. Qiu, Y. Feng, Y. Xiu, Y. Xue, L. Yu, H. Feng, Z. Liu, J. Heo, S. Peng

ICLR 2024

Project page Paper

MeshDiffusion: Score-based generative 3D mesh modeling

Z. Liu, Y. Feng, M.J. Black, D. Nowrouzezahrai, L. Paull, W. Liu

ICLR 2023 (Spotlight)

Project page Paper

Capturing and animation of body and clothing from monocular video

Y. Feng, J. Yang, M. Pollefeys, M.J. Black, T. Bolkart

SIGGRAPH Asia 2022

Project page Paper

Collaborative regression of expressive bodies using moderation

Y. Feng, V. Choutas, T. Bolkart, D. Tzionas, M.J. Black

3DV 2021

Project page Paper

Learning an animatable detailed 3D face model from in-the-wild images

Y. Feng, H. Feng, M.J. Black, T. Bolkart

SIGGRAPH 2021

Project page Paper

Radu Alexandru Rosu

PermutoSDF: Fast multi-view reconstruction with implicit surfaces using permutohedral lattices

R.A. Rosu, S. Behnke

CVPR 2023

Project page Paper

NeuralMVS: Bridging multi-view stereo and novel view synthesis

R.A. Rosu, S. Behnke

IJCNN 2022

Project page Paper

Neural strands: Learning hair geometry and appearance from multi-view images

R.A. Rosu, S. Saito, Z. Wang, C. Wu, S. Behnke, G. Nam

ECCV 2022

Project page Paper

Nitin Saini

SmartMocap: Joint estimation of human and camera motion using uncalibrated RGB cameras

N. Saini, C.P. Huang, M.J. Black, A. Ahmad

IEEE Robotics and Automation Letters, 8(6):3206-3213, 2023

Project page Paper

AirPose: Multi-view fusion network for aerial 3D human pose and shape estimation

N. Saini, E. Bonetto, E. Price, A. Ahmad, M.J. Black

IEEE Robotics and Automation Letters, 7(2):4805-4812, IEEE, April 2022

Project page Paper

AirCapRL: Autonomous aerial human motion capture using deep reinforcement learning

R. Tallamraju, N. Saini, E. Bonetto, M. Pabst, Y. T Liu, M. J. Black, A. Ahmad

IEEE Robotics and Automation Letters, 7(2):4805-4812, IEEE, April 2022

Project page Paper

Markerless outdoor human motion capture using multiple autonomous micro aerial vehicles

N. Saini, E. Price, R. Tallamraju, R. Enficiaud, R. Ludwig, I. Martinović, A. Ahmad, M.J. Black

ICCV 2019

Project page Paper

Priyanka Patel

BEDLAM: A synthetic dataset of bodies exhibiting detailed lifelike animated motion

M.J. Black, P. Patel, J. Tesch, J. Yang

CVPR 2023 (Highlight Paper)

Project page Paper

AGORA: Avatars in geography optimized for regression analysis

P. Patel, C.P. Huang, J. Tesch, D.T. Hoffmann, S. Tripathi, M.J. Black

CVPR 2021

Project page Paper

Maria Korosteleva

GarmentCodeData: A dataset of 3D made-to-measure garments with sewing patterns

M. Korosteleva, T.L. Kesdogan, F. Kemper, S. Wenninger, J. Koller, Y. Zhang, M. Botsch, O. Sorkine-Hornung

ECCV 2024

Project page Paper

GarmentCode: Programming parametric sewing patterns

M. Korosteleva, O. Sorkine-Hornung

SIGGRAPH Asia 2023

Project page Paper

NeuralTailor: Reconstructing sewing pattern structures from 3D point clouds of garments

M. Korosteleva, S.H. Lee

SIGGRAPH 2022

Project page Paper

Estimating garment patterns from static scan data

S. Bang, M. Korosteleva, S.H. Lee

Computer Graphics Forum 2021

Project page Paper

Generating datasets of 3D garments with sewing patterns

M. Korosteleva, S.H. Lee

NeurIPS 2021

Project page Paper

Michael J. Black

WHAM: Reconstructing world-grounded humans with accurate 3D motion

S. Shin, J. Kim, E. Halilaj, M.J. Black

CVPR 2024

Project page Paper

ICON: Implicit clothed humans obtained from normals

Y. Xiu, J. Yang, D. Tzionas, M.J. Black

CVPR 2022

Project page Paper

TEMOS: Generating diverse human motions from textual descriptions

Y. Xiu, J. Yang, D. Tzionas, M.J. Black

ECCV 2022

Project page Paper

Action-conditioned 3D human motion synthesis with transformer vae

M. Petrovich, M.J. Black, G. Varol

CVPR 2021

Project page Paper

Learning to reconstruct 3D human pose and shape via model-fitting in the loop

N. Kolotouros, G. Pavlakos, M.J. Black, K. Daniilidis

ICCV 2019

Project page Paper

Expressive body capture: 3D hands, face, and body from a single image

G. Pavlakos, V. Choutas, N. Ghorbani, T. Bolkart, A.A.A. Osman, D. Tzionas, M.J. Black

CVPR 2019

Project page Paper

End-to-end recovery of human shape and pose

A. Kanazawa, M.J. Black, D.W. Jacobs, J. Malik

CVPR 2018

Project page Paper

Recovering accurate 3D human pose in the wild using IMUs and a moving camera

T. von Marcard, R. Henschel, M.J. Black, B. Rosenhahn, G. Pons-Moll

ECCV 2018

Project page Paper

Learning a model of facial shape and expression from 4D scans

T. Li, T. Bolkart, M.J. Black, H. Li, J. Romero

ACM Trans. Graph. 36 (6), 194:1-194:17, 2017

Project page Paper

Embodied hands: Modeling and capturing hands and bodies together

J. Romero, D. Tzionas, M.J. Black

ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), 36(6):245:1-245:17, 245:1–245:17, ACM, November 2017

Project page Paper

Keep it SMPL: Automatic estimation of 3D human pose and shape from a single image

F. Bogo, A. Kanazawa, C. Lassner, P. Gehler, J. Romero, M.J. Black

ECCV 2016

Project page Paper

Detailed human shape and pose from images

A.O. Balan, L. Sigal, M.J. Black, J.E. Davis, H.W. Haussecker

CVPR 2007

Project page Paper