Can I read Text2Tex: Text-driven Texture Synthesis via Diffusion Models on EtoBox?

Text2Tex: Text-driven Texture Synthesis via Diffusion Models by Chen, Dave Zhenyu; Siddiqui, Yawar; Lee, Hsin-Ying; Tulyakov, Sergey; Nießner, Matthias is a scholarly article available to read on EtoBox.

What is Text2Tex: Text-driven Texture Synthesis via Diffusion Models about?

We present Text2Tex, a novel method for generating high-quality textures for 3D meshes from the given text prompts. Our method incorporates inpainting into a pre-trained depth-aware image diffusion model to progressively synthesize high resolution partial textures from multiple viewpoints. To avoid accumulating inconsistent and stretched artifacts across views, we dynamically segment the rendered view into a generation mask, which represents the generation status of each visible texel. This partitioned view representation guides the depth-aware inpainting model to generate and update partial textures for the corresponding regions. Furthermore, we propose an automatic view sequence generation scheme to determine the next best view for updating the partial texture. Extensive experiments demonstrate that our method significantly outperforms the existing text-driven approaches and GAN-based methods.

Author

Chen, Dave Zhenyu; Siddiqui, Yawar; Lee, Hsin-Ying; Tulyakov, Sergey; Nießner, Matthias

Published

2023

Language

EN