This website requires JavaScript.
DOI: 10.48550/arXiv.2212.07422

ECON: Explicit Clothed humans Obtained from Normals

Yuliang XiuJinlong YangXu CaoDimitrios TzionasMichael J. Black
Dec 2022
摘要
The combination of artist-curated scans, and deep implicit functions (IF), is enabling the creation of detailed, clothed, 3D humans from images. However, existing methods are far from perfect. IF-based methods recover free-form geometry but produce disembodied limbs or degenerate shapes for unseen poses or clothes. To increase robustness for these cases, existing work uses an explicit parametric body model to constrain surface reconstruction, but this limits the recovery of free-form surfaces such as loose clothing that deviates from the body. What we want is a method that combines the best properties of implicit and explicit methods. To this end, we make two key observations: (1) current networks are better at inferring detailed 2D maps than full-3D surfaces, and (2) a parametric model can be seen as a "canvas" for stitching together detailed surface patches. ECON infers high-fidelity 3D humans even in loose clothes and challenging poses, while having realistic faces and fingers. This goes beyond previous methods. Quantitative, evaluation of the CAPE and Renderpeople datasets shows that ECON is more accurate than the state of the art. Perceptual studies also show that ECON's perceived realism is better by a large margin. Code and models are available for research purposes at https://xiuyuliang.cn/econ
展开全部
图表提取

论文十问由沈向洋博士提出，鼓励大家带着这十个问题去阅读论文，用有用的信息构建认知模型。写出自己的十问回答，还有机会在当前页面展示哦。

  1. Q1
    论文试图解决什么问题？
    修宇亮 论文作者 2023/01/17

    ICON (CVPR22) 从单张图片中重建的人物几何，其mesh的质量，相比于其预测的normal map，有明显的差距，对于宽松衣服，这种落差尤其明显。ECON重新思考人物单目重建这个问题，既然normal map包含丰富的几何表面细节，而SMPL-X本身又提供了足够的人体结构姿态先验，那么，有没有可能从normal map出发，结合已有的SMPL-X，直接“优化”出拥有更好细节及灵活拓扑的三维人物？

  2. Q2
    这是否是一个新的问题？
    修宇亮 论文作者 2023/01/17

    单目人物重建这个问题，不新；三明治结构做重建这个思路，不新；用IF-Nets做补全，不新；Normal Integration，不新；但把以上几点有机地融合到一块，最终实现ECON这样的效果，还是蛮新的。

  3. Q3
    这篇文章要验证一个什么科学假设？
    修宇亮 论文作者 2023/01/17

    单目人物重建三大要素: details (normal), pose (SMPL-X), continuity (poisson)。两味原料，一勺汤，三者完备，直接上优化，不需要data-driven，就可以解决这个问题。

  4. Q4
    有哪些相关研究？如何归类？谁是这一课题在领域内值得关注的研究员？
  5. Q5
    论文中提到的解决方案之关键是什么？
  6. Q6
    论文中的实验是如何设计的？
  7. Q7
    用于定量评估的数据集是什么？代码有没有开源？
  8. Q8
    论文中的实验及结果有没有很好地支持需要验证的科学假设？
  9. Q9
    这篇论文到底有什么贡献？
  10. Q10
    下一步呢？有什么工作可以继续深入？
0
被引用
39
笔记
0
问答
领域
· Computer Science· CV· Surface Reconstruction