Solid Textures Solid Textures Solid Texture Synthesis Solid Texture Synthesis Solid Texture Synthesis from 2D Exemplars from 2D Exemplars from 2D Exemplars Johannes Kopf, University of Konstanz Chi-Wing Fu, Hong Kong Sc & Tech Daniel Cohen-Or, Tel Aviv University Input: 2D Oliver Deussen, University of Konstanz Dani Lischinski, The Hebrew University Tien-Tsin Wong, The Chinese University Input: 3D Solid Textures Modeling Natural Materials Solid Textures Modeling Natural Materials No Complex Parameterization No Complex Parameterization Textured interior Textured interior 1
Procedural Textures Procedural Textures Related Work Related Work Related Work Parametric approach Parametric approach 3D to 3D synthesis 3D to 3D synthesis [Heeger and Bergen 1995] [Heeger and Bergen 1995] • Simple extension of 2D � 2D algorithms • 3rd dimension mostly time • Many, many papers [Szummer and Picard 1996] [Schödl et al. 2000] [Wei and Levoy 2000] [Bar-Joseph et al. 2001] [Soatto et al. 2001] [Kwatra et al. 2003] ... Non-parametric approach Non-parametric approach Stereology Stereology [Wei 2002; 2003] [Wei 2002; 2003] [Jagnow et al. 2004] [Jagnow et al. 2004] ... = + ... 2
Hybrid Approach Hybrid Approach • Non-parametric: texture optimization texture optimization – [Kwatra et al. 2005, Wexler et al. 2007] Our Technique Our Technique Our Technique – Enforces local neighborhoods • Parametric: histogram matching histogram matching – [Heeger and Bergen 1995] – Enforces global statistics Solid Texture Optimization Solid Texture Optimization Solid Texture Optimization Solid Texture Optimization • Two phases: – Optimization – Search Solid Texture Optimization Solid Texture Optimization Optimization Phase Optimization Phase • Iteratively re-weighted least squares (IRLS) – [Kwatra et al. 2005] 3
Optimization Phase Optimization Phase Optimization Phase Optimization Phase Average Average Exemplar Synthesized Texture Search Histogram Matching Search Histogram Matching • Nearest neighbor in high-dimensional space (standard problem) • Speed-ups – PCA projection (6X-20X) – ANN (approximate nearest neighbor) (10X-100X) Exemplar – Sparsity (4X) Synthesis Exemplar Synthesis Histogram Matching Histogram Matching Histogram Matching Histogram Matching … 4
Histogram Matching Histogram Matching Histogram Matching Histogram Matching Implementation Details Implementation Details • Three level multi-resolution • Fixed 8x8 neighborhood size Results Results Results • Synthesis time: – 128³ volume: 10 – 90 minutes – Has to be done only once and for all – Preview after 10-20 seconds Results Results Results Results 5
Multi-Channel Textures Multi-Channel Textures Multi-Channel Textures Multi-Channel Textures RGB Specular Shininess Displacement Finished Wood Finished Wood Finished Wood Finished Wood [Marschner et al. 2005] Diffuse Fiber reflectance Fiber axis Synthesis Control Synthesis Control Synthesis Control Synthesis Control • Different exemplar for each view • Constrain Colors 6
Synthesis Control Synthesis Control Synthesis Control Synthesis Control Limitations Limitations Limitations Limitations Conclusions Conclusions Try it out at home! Try it out at home! • New method for solid texture synthesis • http://www.johanneskopf.de/solid • http://www.johanneskopf.de/solid • Optimization + Histogram matching • Available Online: • Widely applicable – Volume files – Anisotropic textures – Plugin for Maya – Large coherent structures • Coming soon – Multi-channel textures – Synth application 7
Video Video Thank You Thank You Future Research Future Research • Improve quality & speed • Additional kinds of histograms Unused Slides Unused Slides Unused Slides – Heeger & Bergen’s steerable pyramids • Wang cubes • More control Related Work Related Work Aura 3D Textures Aura 3D Textures • Shell Textures [Chen et al. 2004] • Basic Gray Level Aura Matrices (BGLAM) [Qin and Yang 2007] 8
decorrrcrvtfvytvy decorrrcrvtfvytvy Optimization Phase Optimization Phase • Mean Shift Exemplar Independent Synth Our Result Decorrelated Color Channels Comparison with [ Wei 2002, 2003 ] Comparison with [ Wei 2002, 2003 ] Comparison with Aura 3D Textures Comparison with Aura 3D Textures Aura 3D Result Our Result Aura 3D Result Our Result Our Result Wei’s result Aura 3D Result Our Result Comparison with [ Jagnow 2004 ] Comparison with [ Jagnow 2004 ] Histogram Matching Histogram Matching • H s,j – j-th histogram of the synth‘ed solid • H e,j – j-th histogram of the exemplar • b j (c) – bin containing c Our Result Jagnow’s result 9
Limitations Limitations 10
Recommend
More recommend
