Litcius/Paper detail

Deep geometric texture synthesis

Amir Hertz, Rana Hanocka, Raja Giryes, Daniel Cohen-Or

2020ACM Transactions on Graphics52 citationsDOIOpen Access PDF

Abstract

Recently, deep generative adversarial networks for image generation have advanced rapidly; yet, only a small amount of research has focused on generative models for irregular structures, particularly meshes. Nonetheless, mesh generation and synthesis remains a fundamental topic in computer graphics. In this work, we propose a novel framework for synthesizing geometric textures. It learns geometric texture statistics from local neighborhoods ( i.e. , local triangular patches) of a single reference 3D model. It learns deep features on the faces of the input triangulation, which is used to subdivide and generate offsets across multiple scales, without parameterization of the reference or target mesh. Our network displaces mesh vertices in any direction ( i.e. , in the normal and tangential direction), enabling synthesis of geometric textures, which cannot be expressed by a simple 2D displacement map. Learning and synthesizing on local geometric patches enables a genus-oblivious framework, facilitating texture transfer between shapes of different genus.

Topics & Concepts

Texture synthesisArtificial intelligenceComputer scienceGenerative grammarImage synthesisDisplacement mappingGenerative adversarial networkComputer visionTexture (cosmology)Displacement (psychology)Texture mappingGeometric shapeImage (mathematics)Deep learningGeometric modelingSimple (philosophy)Generative modelTexture atlasView synthesisPattern recognition (psychology)Mesh generationSolid modelingImage textureAlgorithmGeometryGeometric transformationTriangle meshComputer graphics (images)Geometric primitiveImage processingComputational geometryMathematicsTransformation geometryTexture filteringGeometric networksGeometric design3D Shape Modeling and AnalysisGenerative Adversarial Networks and Image SynthesisComputer Graphics and Visualization Techniques
Deep geometric texture synthesis | Litcius