Can I read Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing on EtoBox?

Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing by Dai, Lu; Ma, Liqian; Qian, Shenhan; Liu, Hao; Liu, Ziwei; Xiong, Hui is a scholarly article available to read on EtoBox.

What is Cloth2Body: Generating 3D Human Body Mesh from 2D Clothing about?

In this paper, we define and study a new Cloth2Body problem which has a goal of generating 3D human body meshes from a 2D clothing image. Unlike the existing human mesh recovery problem, Cloth2Body needs to address new and emerging challenges raised by the partial observation of the input and the high diversity of the output. Indeed, there are three specific challenges. First, how to locate and pose human bodies into the clothes. Second, how to effectively estimate body shapes out of various clothing types. Finally, how to generate diverse and plausible results from a 2D clothing image. To this end, we propose an end-to-end framework that can accurately estimate 3D body mesh parameterized by pose and shape from a 2D clothing image. Along this line, we first utilize Kinematics-aware Pose Estimation to estimate body pose parameters. 3D skeleton is employed as a proxy followed by an inverse kinematics module to boost the estimation accuracy. We additionally design an adaptive depth trick to align the re-projected 3D mesh better with 2D clothing image by disentangling the effects of object size and camera extrinsic. Next, we propose Physics-informed Shape Estimation to estimate body sh

Author

Dai, Lu; Ma, Liqian; Qian, Shenhan; Liu, Hao; Liu, Ziwei; Xiong, Hui

Published

2023

Language

EN