virtual textures
play

Virtual Textures Dealing with Enormous Texture-Based Resources - PowerPoint PPT Presentation

Feb 13, 2023 •170 likes •966 views

Virtual Textures Dealing with Enormous Texture-Based Resources Anders Scheel Nielsen 1 Anders Scheel Nielsen Textures 2 Anders Scheel Nielsen Textures 3 Anders Scheel Nielsen Mipmaps 4 Anders Scheel Nielsen Mipmaps 5 Anders Scheel

  1. Virtual Textures Dealing with Enormous Texture-Based Resources Anders Scheel Nielsen 1 Anders Scheel Nielsen

  2. Textures 2 Anders Scheel Nielsen

  3. Textures 3 Anders Scheel Nielsen

  4. Mipmaps 4 Anders Scheel Nielsen

  5. Mipmaps 5 Anders Scheel Nielsen

  6. Real life problems Problems: • Limited amount of resources (avg. 256 MB) • Large variation in system resources • Maximum texture sizes from: fra 2048 x 2048 til 8192 x 8192 • Atomic Resource 6 Anders Scheel Nielsen

  7. Real life problems Problems: • Limited amount of resources (avg. 256 MB) • Large variation in system resources • Maximum texture sizes from: fra 2048 x 2048 til 8192 x 8192 • Atomic Resource 6 Anders Scheel Nielsen

  8. Real life problems Problems: • Limited amount of resources (avg. 256 MB) • Large variation in system resources • Maximum texture sizes from: fra 2048 x 2048 til 8192 x 8192 • Atomic Resource 6 Anders Scheel Nielsen

  9. Real life problems Problems: • Limited amount of resources (avg. 256 MB) • Large variation in system resources • Maximum texture sizes from: fra 2048 x 2048 til 8192 x 8192 • Atomic Resource Solution for ’large’ models: • Repeating textures • Blending 6 Anders Scheel Nielsen

  10. Repeating Textures 7 Anders Scheel Nielsen

  11. Repeating textures 8 Anders Scheel Nielsen

  12. Texture blending 9 Anders Scheel Nielsen

  13. Static handling of Texture budget Using too much memory? • Permanently reduce the texture resolution • Load lower mip map levels 10 Anders Scheel Nielsen

  14. Static handling of Texture budget Using too much memory? • Permanently reduce the texture resolution • Load lower mip map levels 10 Anders Scheel Nielsen

  15. Static handling of Texture budget Using too much memory? • Permanently reduce the texture resolution • Load lower mip map levels 10 Anders Scheel Nielsen

  16. Static handling of Texture budget Using too much memory? • Permanently reduce the texture resolution • Load lower mip map levels 10 Anders Scheel Nielsen

  17. Observations 11 Anders Scheel Nielsen

  18. Observations Large Textures • All ’points’ in a surface can be truly unique • Artists can add all the details to the texture they want 11 Anders Scheel Nielsen

  19. Observations Large Textures • All ’points’ in a surface can be truly unique • Artists can add all the details to the texture they want Texture loading with higher granularity • Load only visible parts of the texture 11 Anders Scheel Nielsen

  20. Observations Large Textures • All ’points’ in a surface can be truly unique • Artists can add all the details to the texture they want Texture loading with higher granularity • Load only visible parts of the texture Load Textures Runtime: • Artists/developers: No headaches from keeping texture budgets! • Smoother scaling for different hardware configurations • Artists can (in theory) work in arbitrary resolution 11 Anders Scheel Nielsen

  21. The Method 12 Anders Scheel Nielsen

  22. Basic Data Structures 13 Anders Scheel Nielsen

  23. Flow 14 Anders Scheel Nielsen

  24. Calculation of visible tiles Readback of the framebuffer: 15 Anders Scheel Nielsen

  25. Barrett’s Fragment shader 1 float mipmapLevel = calcMipmapLevel(uv * textureSize); 2 float2 tilePos = floor(uv * indirectionSize); 3 tilePos /= 256.0; 4 float2 tilePos_low = frac(tilePos); 5 float2 tilePos_high = floor(tilePos); 6 color.bg = floor(tilePos_low * 256.0 + 0.5)/255.0; 7 color.r = (tilePos_high.x + tilePos_high.y * 16)/255.0; 8 color.a = (mipmapLevel + textureId * 16)/255.0; 9 10 float calcTextureMipmapLevel(float2 uv) { 11 float2 dtdx = dFdx(uv); 12 float2 dtdy = dFdy(uv); 13 float2 dtex = dtdx*dtdx + dtdy*dtdy; 14 float minDelta = max(dtex.x,dtex.y); 15 float miplevel = max(0.5 * log2(minDelta), 0.0); 16 return miplevel; 17 } 16 Anders Scheel Nielsen

  26. Barrett’s Fragment shader 1 float mipmapLevel = calcMipmapLevel(uv * textureSize); 2 float2 tilePos = floor(uv * indirectionSize); 3 tilePos /= 256.0; 4 float2 tilePos_low = frac(tilePos); 5 float2 tilePos_high = floor(tilePos); 6 color.bg = floor(tilePos_low * 256.0 + 0.5)/255.0; 7 color.r = (tilePos_high.x + tilePos_high.y * 16)/255.0; 8 color.a = (mipmapLevel + textureId * 16)/255.0; 9 10 float calcTextureMipmapLevel(float2 uv) { 11 float2 dtdx = dFdx(uv); 12 float2 dtdy = dFdy(uv); 13 float2 dtex = dtdx*dtdx + dtdy*dtdy; 14 float minDelta = max(dtex.x,dtex.y); 15 float miplevel = max(0.5 * log2(minDelta), 0.0); 16 return miplevel; 17 } 17 Anders Scheel Nielsen

  27. TD-texture 18 Anders Scheel Nielsen

  28. TD-texture Texture usage: • 5 texture types • 4096 x 4096 • Usage: 80 MB 18 Anders Scheel Nielsen

  29. TD-texture Texture usage: • 5 texture types • 4096 x 4096 • Usage: 80 MB 18 Anders Scheel Nielsen

  30. TD-texture Texture usage: • 5 texture types • 4096 x 4096 • Usage: 80 MB My fragment shader: 1 color = tex2D(tdTexture, vertexIn.uv * coordScale); 2 color.w = tex2Dbias(tdTexture, vertexIn.uv, mipBias + resolutionBias).w; 18 Anders Scheel Nielsen

  31. Tilbagelæsning Tilbagelæsning fra grafikkort til systemhukommelse 19 Anders Scheel Nielsen

  32. Which tiles to load first? • Screen area prioritized • Based on error metric: •Mip map level 20 Anders Scheel Nielsen

  33. Which tiles to discard? • First In First Out • Least Frequently Used • Least Recently Used • Weighted Least Recently Used 21 Anders Scheel Nielsen

  34. Updating the Indirection Map 22 Anders Scheel Nielsen

  35. Updating the Indirection Map 23 Anders Scheel Nielsen

  36. Rendering 24 Anders Scheel Nielsen

  37. Rendering 25 Anders Scheel Nielsen

  38. Visual Results Screenshots 26 Anders Scheel Nielsen

  39. Resultater Resultater 27 Resultater Anders Scheel Nielsen

  40. Diskussion Diskussion 28 Diskussion Anders Scheel Nielsen

  41. Resultater: Tilbagelæsning 29 Anders Scheel Nielsen

  42. Resultater: Tilbagelæsning 30 Anders Scheel Nielsen

  43. Resultater: Tilbagelæsning 31 Anders Scheel Nielsen

  44. Resultater: tilbagelæsning + CPU 32 Anders Scheel Nielsen

  45. Resultater: HDD read 33 Anders Scheel Nielsen

  46. Resultater: Hvilke tiles skal indlæses? 34 Anders Scheel Nielsen

  47. Resultater: Hvilke tiles skal kasseres? 35 Anders Scheel Nielsen

  48. The demo Virtual Textures: 36 Anders Scheel Nielsen

  49. The demo Virtual Textures: • Efficient handling of giant textures: Demo: 128k x 128k, theoretical: 2M x 2M (16 TB) 36 Anders Scheel Nielsen

  50. The demo Virtual Textures: • Efficient handling of giant textures: Demo: 128k x 128k, theoretical: 2M x 2M (16 TB) • Texture usage for a 20 GB texture: 17 MB 36 Anders Scheel Nielsen

  51. The demo Virtual Textures: • Efficient handling of giant textures: Demo: 128k x 128k, theoretical: 2M x 2M (16 TB) • Texture usage for a 20 GB texture: 17 MB • Frame rate: 150-200 FPS (8800GT) 36 Anders Scheel Nielsen

  52. Demo time 37 Anders Scheel Nielsen

  53. Future work Prediction of visible tiles • Camera vector • A priori map Virtuel Terrain • Height map as a Virtual Texture Other uses than games • Browsing pictures • Google Earth’ish applications • Streaming Casual Games with Instant Game Play 38 Anders Scheel Nielsen

  54. Contributions Contributions • Calculating visible tiles at greater precision with 2 lines of code • Simple, but effective tile prediction method • New strategies for prioritizing tiles • Faster methods for critical tasks in the VT-system 39 Anders Scheel Nielsen

  55. 40 Konklusion Anders Scheel Nielsen

  56. Thank you! Andreas Bærentzen , DTU Carsten Kjær , Dalux Daniel Povlsen , Aptocore Martin Mittring , CryTek GmbH Sean Barrett Per Rasmussen Hardware provided by HwT.dk Anders.Scheel@gmail.com 40 Konklusion Anders Scheel Nielsen

  57. Media 41 Anders Scheel Nielsen

  58. Media Seek time is a killer: 10 tiles @ 256 x 256 = 650KB 41 Anders Scheel Nielsen

  59. Reading tiles from media 42 Anders Scheel Nielsen

  60. Reading tiles from media • Maximizing throughput MPixels/s: • Compression = more MPixels/s • Texture Layout on media: minimizing seek time 42 Anders Scheel Nielsen

  61. Reading tiles from media • Maximizing throughput MPixels/s: • Compression = more MPixels/s • Texture Layout on media: minimizing seek time 42 Anders Scheel Nielsen

  62. Reading tiles from media • Maximizing throughput MPixels/s: • Compression = more MPixels/s • Texture Layout on media: minimizing seek time 42 Anders Scheel Nielsen

  63. Reading tiles from media • Maximizing throughput MPixels/s: • Compression = more MPixels/s • Texture Layout on media: minimizing seek time • Invalidated by the future: SSD harddrives? 42 Anders Scheel Nielsen

  64. Diskussion 1 Ulemper ved metoden: Transparente objekter • Et ekstra prepass Antal unikke teksturer • Pakke flere teksturer i ét VT • 8 bit tile-position Kvalitetstab pga. manglende tekstur • Højere teksturkomprimering • Fjern visuel pops 43 Anders Scheel Nielsen

Recommend

So how do we make pictures like this? textures local illuminates reflection transparency It

So how do we make pictures like this? textures local illuminates reflection transparency It

CSE6335.03 Topics in Virtual Reality Monday March 23, 2009 So how do we make pictures like this? textures local illuminates reflection transparency It is very difficult There exist techniques to do this Photon Mapping - basically solve

463 views • 15 slides
Week 9 -Wednesday What did we talk about last time? Textures Volume textures Cube

Week 9 -Wednesday What did we talk about last time? Textures Volume textures Cube

Week 9 -Wednesday What did we talk about last time? Textures Volume textures Cube maps Texture caching and compression Procedural texturing Texture animation Material mapping Alpha mapping Bump mapping refers

668 views • 42 slides
Screenspace Effects Introduction General idea: Render all data necessary into textures Render

Screenspace Effects Introduction General idea: Render all data necessary into textures Render

Screenspace Effects Introduction General idea: Render all data necessary into textures Render all data necessary into textures Process textures to calculate final image A hi Achievable Effects: bl Eff t Glow/Bloom Depth of field

1.2k views • 35 slides
Procedural Texturing By Madis Janno What do I mean by Procedural Texturing? Two possible

Procedural Texturing By Madis Janno What do I mean by Procedural Texturing? Two possible

Procedural Texturing By Madis Janno What do I mean by Procedural Texturing? Two possible things: Procedurally generating textures Procedurally applying textures Todays focus is: Applying existing textures in a way that creates new textures

1.33k views • 69 slides
Outline Texture Synthesis What is Texture? How to Synthesize? Graphcut Textures

Outline Texture Synthesis What is Texture? How to Synthesize? Graphcut Textures

Graphcut Textures: Image and Video Synthesis using Graph Cuts (Kwatra, et al) presented by Adeel Bhutta Outline Texture Synthesis What is Texture? How to Synthesize? Graphcut Textures Main Idea, Contribution Patch

588 views • 20 slides
Texture What is texture? Easy to recognize, hard to define Deterministic textures

Texture What is texture? Easy to recognize, hard to define Deterministic textures

Texture What is texture? Easy to recognize, hard to define Deterministic textures (thing-like) Stochastic textures (stuff-like) Tasks Discrimination / Segmentation Classification Texture synthesis

555 views • 34 slides
Computer Graphics - Texturing - Philipp Slusallek Texture Textures modify the input for

Computer Graphics - Texturing - Philipp Slusallek Texture Textures modify the input for

Computer Graphics - Texturing - Philipp Slusallek Texture Textures modify the input for shading computations Either via (painted) images textures or procedural functions Example texture maps for Reflectance, normals, shadow

854 views • 69 slides
3: textures 1. Quest for Visual Realism Need for fine details in color variation! 1 Motivations

3: textures 1. Quest for Visual Realism Need for fine details in color variation! 1 Motivations

3: textures 1. Quest for Visual Realism Need for fine details in color variation! 1 Motivations 2. Limit the number of polygons Problem: Everything cannot be modeled at the scale of geometry! Micro-polygons would be needed! 2 Textures

674 views • 50 slides
Final exam effects Final exam effects Lighting Neon lights Textures / refelction

Final exam effects Final exam effects Lighting Neon lights Textures / refelction

Announcement Lots of CS Scholarship opportunities Textures I Deadline: April 15, 2008. Final exam effects Final exam effects Lighting Neon lights Textures / refelction Strawberry Snapple bottle Water surface CD

283 views • 13 slides
1D: Midpoint Displacement 2D: Diamond-Square Particle Systems Particle System Examples

1D: Midpoint Displacement 2D: Diamond-Square Particle Systems Particle System Examples

University of British Columbia Procedural Textures Procedural Modeling CPSC 314 Computer Graphics textures, geometry generate image on the fly, instead of Jan-Apr 2016 loading from disk nonprocedural: explicitly stored in

290 views • 3 slides
Textures III, Procedural Approaches Week 10, Mon Mar 19

Textures III, Procedural Approaches Week 10, Mon Mar 19

University of British Columbia CPSC 314 Computer Graphics Jan-Apr 2007 Tamara Munzner Textures III, Procedural Approaches Week 10, Mon Mar 19 http://www.ugrad.cs.ubc.ca/~cs314/Vjan2007 Reading for Last Time and Today FCG Chap 11 Texture

609 views • 49 slides
Final Exam effects Ground rules Textures II Teams of 2/3 GRAD students: responsible

Final Exam effects Ground rules Textures II Teams of 2/3 GRAD students: responsible

Final Exam effects Ground rules Textures II Teams of 2/3 GRAD students: responsible for research Team: responsible for implementation and documentation Procedural Textures Implement in GLSL and RenderMan (for teams of 3)

308 views • 12 slides
OpenGL 3.x Part 2: Textures and Objects Ingo Radax, Gnther Voglsam Institute of Computer

OpenGL 3.x Part 2: Textures and Objects Ingo Radax, Gnther Voglsam Institute of Computer

OpenGL 3.x Part 2: Textures and Objects Ingo Radax, Gnther Voglsam Institute of Computer Graphics and Algorithms Vienna University of Technology Topics for today OpenGL 3.x Part 1 - Revisited Textures Framebuffer Objects Vertexbuffer

1.39k views • 69 slides
Lecture 07: Buffers and Textures CSE 40166 Computer Graphics Peter Bui University of Notre Dame,

Lecture 07: Buffers and Textures CSE 40166 Computer Graphics Peter Bui University of Notre Dame,

Lecture 07: Buffers and Textures CSE 40166 Computer Graphics Peter Bui University of Notre Dame, IN, USA October 26, 2010 OpenGL Pipeline Todays Focus Pixel Buffers : read and write image data to and from OpenGL buffers. Textures :

520 views • 20 slides
FOR VIRTUAL MATERIAL DESIGN Adib Akl 1,2 , Charles Yaacoub 2 , Marc Donias 1 , Jean-Pierre Da Costa

FOR VIRTUAL MATERIAL DESIGN Adib Akl 1,2 , Charles Yaacoub 2 , Marc Donias 1 , Jean-Pierre Da Costa

30/10/2014 IEEE International Conference on Image Processing STRUCTURE TENSOR BASED SYNTHESIS OF DIRECTIONAL TEXTURES FOR VIRTUAL MATERIAL DESIGN Adib Akl 1,2 , Charles Yaacoub 2 , Marc Donias 1 , Jean-Pierre Da Costa 1 , Christian Germain 1 1

459 views • 15 slides
Surfaces How to carry to surface? Texture Synthesis: Surfaces and RD from Wei & Levoy = +

Surfaces How to carry to surface? Texture Synthesis: Surfaces and RD from Wei & Levoy = +

Surfaces How to carry to surface? Texture Synthesis: Surfaces and RD from Wei & Levoy = + Textures Textures Images surface given as mesh synthesis into textures synthesis onto vertices (fine enough) CS 176 Winter 2011 CS

1.24k views • 4 slides
Shape from Texture Texture Discrimination 1 Texture Texture Synthesis Goal of texture

Shape from Texture Texture Discrimination 1 Texture Texture Synthesis Goal of texture

Texture Modeling Texture What is texture? Easy to recognize, hard to define Deterministic/regular textures (thing-like) Stochastic textures (stuff-like) Tasks What is texture? Discrimination / Segmentation An

312 views • 29 slides
Virtual Machines Uses for Virtual Machines There are several uses for virtual machines:

Virtual Machines Uses for Virtual Machines There are several uses for virtual machines:

Virtual Machines Uses for Virtual Machines There are several uses for virtual machines: Virtual machine technology, often just called virtualization , makes one computer behave as several Running several operating systems simultaneously on

254 views • 10 slides
Textures, Procedural Approaches, Sampling Week 4, Thu Jun 2

Textures, Procedural Approaches, Sampling Week 4, Thu Jun 2

University of British Columbia CPSC 314 Computer Graphics May-June 2005 Tamara Munzner Textures, Procedural Approaches, Sampling Week 4, Thu Jun 2 http://www.ugrad.cs.ubc.ca/~cs314/Vmay2005 Review: Picking Methods manual ray intersection

1.44k views • 114 slides
Slides built from Carter Chapter 10 Animating Sprites (textures) Images from wikipedia.org

Slides built from Carter Chapter 10 Animating Sprites (textures) Images from wikipedia.org

Slides built from Carter Chapter 10 Animating Sprites (textures) Images from wikipedia.org Animating Sprites (textures) Images from wikipedia.org Lets Add to Our XELibrary Going to add a CelAnimationManager class Want to pass in a sheet

447 views • 24 slides
Final exam effects Textures I Final exam effects Final exam effects Lighting Grads

Final exam effects Textures I Final exam effects Final exam effects Lighting Grads

Final exam effects Textures I Final exam effects Final exam effects Lighting Grads Light saber Research and implementation plan Stage lighting Textures Teams Coffee froth Implementation Donuts Coke Can

224 views • 10 slides
Final Exam effects Ground rules Textures II Teams of 2 GRAD students: responsible for

Final Exam effects Ground rules Textures II Teams of 2 GRAD students: responsible for

Final Exam effects Ground rules Textures II Teams of 2 GRAD students: responsible for research Team: responsible for implementation and Procedural Textures documentation Implement in Cg or RenderMan Final exam effects Final

327 views • 11 slides
Concept This season we will be working with a mixture of textures and introducing foliage for

Concept This season we will be working with a mixture of textures and introducing foliage for

Concept This season we will be working with a mixture of textures and introducing foliage for colour and shape. Moving away from formal appearance into dense, chaotic, jungle vibe. Opportunity to trial different planting styles such as double

393 views • 6 slides
The J c Dependence on Oxygen Doping in Polycrystalline Forms of Bi-2212 with Various Textures M O

The J c Dependence on Oxygen Doping in Polycrystalline Forms of Bi-2212 with Various Textures M O

The J c Dependence on Oxygen Doping in Polycrystalline Forms of Bi-2212 with Various Textures M O Rikel a , A Hobl a , J Ehrenberg a , J Bock a , S Elschner b , A Dellicour c, d, e , D Chateigner c , B Vertruyen d , J-F Fagnard d , P.Vanderbemden

378 views • 27 slides

More recommend