interactive light transport with virtual point lights
play

Interactive Light Transport with Virtual Point Lights Benjamin - PowerPoint PPT Presentation

Apr 28, 2023 •50 likes •1.33k views

Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Interactive Light Transport with Virtual Point Lights Benjamin

  1. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Path Integral Formulation Make the light transport problem an integration one Inject the rendering eq. into the measurement eq. and expand it: � L e ( x k → x k − 1 ) G ( x 0 ↔ x 1 ) W ( j ) � ∞ � I j = e ( x 1 → x 0 ) k =1 M k +1 � ( � k − 1 i =1 f s ( x i +1 → x i → x i − 1 ) G ( x i ↔ x i +1 )) dA ( x 0 ) ... dA ( x k ) The path integral formulation � f ( j ) ( x ) d µ ( x ) I j = Ω Ω is the set of all finite length paths, µ its natural measure and f ( j ) obtained with the expansion. 12/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  2. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion A Short Pause Before the Remainder! OK, a short summary! Monte-Carlo rendering is: Sample a path x with density p ( x ); Evaluate f ( j ) ( x ) p ( x ) ; Accumulate. 13/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  3. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion A Short Pause Before the Remainder! OK, a short summary! Monte-Carlo rendering is: Sample a path x with density p ( x ); Evaluate f ( j ) ( x ) p ( x ) ; Accumulate. Most Monte-Carlo rendering methods → propose new ways to generate paths x . Basically, this Ph.D. presents new Monte-Carlo rendering techniques. 13/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  4. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Short Overview of Path Integration Core algorithm: path tracing [Kaj86] We generate a light path backward from the camera for each camera sensor (i.e. for each pixel) 14/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  5. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Short Overview of Path Integration Core algorithm: path tracing [Kaj86] We generate a light path backward from the camera for each camera sensor (i.e. for each pixel) Many, many similar techniques Bidirectional path tracing [VG94, LW93]; Light tracing [DLW93]. 14/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  6. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Path Tracing 15/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  7. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Path Tracing 15/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  8. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Path Tracing 15/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  9. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Path Tracing 15/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  10. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Path Tracing 15/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  11. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Problems with these ”Pure” Path Tracing methods No computation coherency Per-pixel computations are independent; No factorization. 16/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  12. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Problems with these ”Pure” Path Tracing methods No computation coherency Per-pixel computations are independent; No factorization. We must design efficient techniques Most of them propose to use biased estimators: Photon Maps [Jen01, Jen96, Jen97]; Radiance / Irradiance Caches [WRC88, War94, Kˇ 05]; And . . . 16/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  13. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Problems with these ”Pure” Path Tracing methods No computation coherency Per-pixel computations are independent; No factorization. Instant Radiosity [Kel97] → Replaces complete paths by ”Virtual Point Lights” 16/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  14. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Instant Radiosity Principles Splits each path x = { x 0 , x 1 , . . . , x n } into three parts: x c = { x 0 , x 1 } is the camera sub-path; x v is a geometric Virtual Point Light (VPL); x s is the remainder of the path connected to a light source. x s x v x 0 x 1 x c 17/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  15. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Instant Radiosity Principles For all sensors (i.e. pixels), use the same ( x v , x s ) light paths; Two-pass algorithm: Propagation of light paths from the light sources (sampling); Accumulation of VPL contributions (gathering). Do not forget: a VPL is a light path, not only a point! x s x v x 0 x 1 x c 17/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  16. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Particle Propagation 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  17. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Particle Propagation 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  18. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Particle Propagation 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  19. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Particle Propagation 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  20. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Particle Propagation 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  21. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Particle Propagation 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  22. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Incoming Radiance Field Integration 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  23. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Incoming Radiance Field Integration 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  24. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Incoming Radiance Field Integration 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  25. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Incoming Radiance Field Integration 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  26. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion The Two Steps of Instant Radiosity Incoming Radiance Field Integration 18/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  27. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Advantages and Drawbacks of Instant Radiosity Advantages Simple → the incoming radiance field is replaced by a set of points; Fast → can be easily implemented with coherent ray tracing or rasterization. 19/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  28. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Advantages and Drawbacks of Instant Radiosity Advantages Simple → the incoming radiance field is replaced by a set of points; Fast → can be easily implemented with coherent ray tracing or rasterization. Drawbacks Variance problems → how must the VPLs be located? Does not handle all lighting phenomena → caustics . . . 19/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  29. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Summary Introduction 1 Formalizing the Problem 2 Sampling VPLs: Metropolis Instant Radiosity 3 Accumulating VPL contributions 4 Coherent Metropolis Light Transport 5 Conclusion 6 20/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  30. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Goal of Metropolis Instant Radiosity (MIR) Properties of VPLs is fundamental We must find VPLs which illuminate parts of the scene seen by the camera! 21/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  31. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Goal of Metropolis Instant Radiosity (MIR) Solution: Combine the robutness of Metropolis Light Transport and the efficiency of Instant Radiosity Principle of MIR Use the path sequence of Metropolis Light Transport to sample VPLs (”MLT part”) ; For each path, store the second point as a VPL; Accumulate all VPL contributions (”IR part”) . With this sampler, all VPLs will bring the same amount of power to the camera 21/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  32. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Metropolis Light Transport [VG97] Principle (a short version) Consider the whole camera integrand f ( c ) ; Sample N paths with a density proportional to f ( c ) ; Count for each pixel j , the number N j of paths which get into it; Ω f ( c ) ( x ) d µ ( x ), compute the per-pixel � With N j , N , and histogram of f ( c ) ; We have the intensity of each pixel! 22/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  33. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Metropolis Light Transport [VG97] Numerical schemes behind it Ω f ( c ) ( x ) d µ ( x ) � Compute → Use a standard bidirectional path tracer; Sample N paths with a density proportional to f ( c ) → Use a Metropolis-Hastings algorithm. 22/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  34. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Metropolis Light Transport [VG97] Metropolis-Hastings Goal: given function f , sequentially sample random variables X i with a density proportional to f ; X i +1 and X i are correlated by a mutation. The density of X i is not exactly f , but with good properties (”ergodicity”), we can use all X i : as if their densities were f as if they were independent 22/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  35. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MLT - Initial Path ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� 23/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  36. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MLT - Candidate ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� 24/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  37. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MLT - Candidate accepted → Count its contribution ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� ��� 25/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  38. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Compute the power received by the camera With a bidirectional path tracer (or any other technique) � Ω f ( c ) ( x ) d µ ( x ) received by the camera. compute the power P c = 26/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  39. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Sample ”path VPLs” The core idea of the method MLT algorithm provides complete paths { x 0 , x 1 , x v , x s } ; Remove points x 0 and x 1 and consider ( x v , x s ) as a ”path VPL”. x s x v x 0 x 1 x c 27/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  40. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Sample ”path VPLs” The core idea of the method MLT algorithm provides complete paths { x 0 , x 1 , x v , x s } ; Remove points x 0 and x 1 and consider ( x v , x s ) as a ”path VPL”. x s Path VPL x v x 0 x 1 x c 27/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  41. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Sample ”path VPLs” The core idea of the method MLT algorithm provides complete paths { x 0 , x 1 , x v , x s } ; Remove points x 0 and x 1 and consider ( x v , x s ) as a ”path VPL”. We do not know the outgoing radiance functions of the VPLs; But, we can prove that these VPLs bring the same amount of power to the camera 27/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  42. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Cluster ”path VPLs” into ”geometric VPLs” Cluster path VPLs with the same VPL location into one geometric VPL When applying mutations, VPL locations may remain unchanged: The candidate is rejected and the path is duplicated; Only the sub-path x c = { x 0 , x 1 } is mutated; Only the sub-path x s is mutated. 28/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  43. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Cluster ”path VPLs” into ”geometric VPLs” Cluster path VPLs with the same VPL location into one geometric VPL When applying mutations, VPL locations may remain unchanged: The candidate is rejected and the path is duplicated; Only the sub-path x c = { x 0 , x 1 } is mutated; Only the sub-path x s is mutated. x s Before x v x 0 x 1 x c 28/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  44. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Cluster ”path VPLs” into ”geometric VPLs” Cluster path VPLs with the same VPL location into one geometric VPL When applying mutations, VPL locations may remain unchanged: The candidate is rejected and the path is duplicated; Only the sub-path x c = { x 0 , x 1 } is mutated; Only the sub-path x s is mutated. x s Mutation x v x 0 x 1 x c 28/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  45. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Cluster ”path VPLs” into ”geometric VPLs” Cluster path VPLs with the same VPL location into one geometric VPL When applying mutations, VPL locations may remain unchanged: The candidate is rejected and the path is duplicated; Only the sub-path x c = { x 0 , x 1 } is mutated; Only the sub-path x s is mutated. x s After x v x 0 x 1 x c 28/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  46. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Cluster ”path VPLs” into ”geometric VPLs” Cluster path VPLs with the same VPL location into one geometric VPL When applying mutations, VPL locations may remain unchanged: The candidate is rejected and the path is duplicated; Only the sub-path x c = { x 0 , x 1 } is mutated; Only the sub-path x s is mutated. 2 path VPLs into 1 geometric VPL x v x 0 x 1 x c 28/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  47. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Accumulate the VPL contributions Set of m geometric VPLs x v i They bring a fixed amount of power to the camera equal to P i = k i · P c / n ; n is the total number of path VPLs ; k i is the number of path VPLs connected to x v i . 29/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  48. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Accumulate the VPL contributions Set of m geometric VPLs x v i They bring a fixed amount of power to the camera equal to P i = k i · P c / n ; n is the total number of path VPLs ; k i is the number of path VPLs connected to x v i . We do not know the ”VPL power” Suppose that the power of the VPL is equal to 1; Compute the intensity of every pixel; Evaluate the total power P ′ i ; Scale all pixel intensities by P i / P ′ i . 29/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  49. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Decrease the VPL correlation Classical Issue with Metropolis-Hastings Example: If a VPL is on a wall, there is a high probability that the next one will be on the wall too. 30/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  50. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Decrease the VPL correlation Classical Issue with Metropolis-Hastings Example: If a VPL is on a wall, there is a high probability that the next one will be on the wall too. Increase Variance! 30/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  51. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion MIR - Decrease the VPL correlation Classical Issue with Metropolis-Hastings Example: If a VPL is on a wall, there is a high probability that the next one will be on the wall too. Increase Variance! Replace Metropolis-Hastings by Multiple-Try Metropolis-Hastings Idea (simplified explanation): generate many candidates at once and try to keep the best one; Does not really change the conception of the algorithm; Details in the Ph.D. thesis. 30/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  52. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Results - MH vs MTMH - Same Computation Times MH MTMH Figure: Exploration of left/right contributions (256 VPLs) 31/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  53. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Results and Comparisons Different tests were made Test scenes With directly-lit scenes; With many light sources; With difficult visibility layouts. 32/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  54. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Results and Comparisons Different tests were made Other algorithms Standard Instant Radiosity [Kel97]; Power Sampling Technique [WBS03]; Bidirectional Instant Radiosity. 32/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  55. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Results - Simple Scenes - 256 VPLs - Same Computation Times STD - 0.02% BIR - 0.007% Reference (standard) Power Sampling - 0.008% MIR - 0.009% 33/59 Figure: Tests with Shirley’s Scene 10. Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  56. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Results - Difficult Visibility - 1024 VPLs - Same Computation Times Standard / Power Sampling Bidirectional MIR Figure: Indirect illumination stress tests. 34/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  57. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Results - Difficult Visibility - 1024 VPLs - Same Computation Times Standard / Power Sampling Bidirectional MIR Figure: Indirect illumination stress tests. 35/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  58. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Advantages Thanks to MLT → Robust and fast sampling strategies; Thanks to Instant Radiosity → Fast and efficient gathering techniques: → We can use IGI; → We can use rasterization techniques . . . Non-intrusive algorithm → Can be used in any pre-existing renderer already using VPLs and Path Tracing. 36/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  59. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Drawbacks and Future Work Does not handle flickering problems during animations Nothing is made to ensure temporal coherency → if one sample changes, the whole sequence is modified; Solution: Reuse the previous samples with a sequential sampler (see [GDH06]). 37/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  60. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Drawbacks and Future Work And glossy and specular reflections ?! What happens if a part of the scene is seen through a highly glossy or a specular reflection ? Solution - Already implemented in yaCORT: → Instead, find the second diffuse surface to deposit the VPL with probability P ; → While gathering, compute a camera sub-path which has a length with the same probability. 37/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  61. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Drawbacks and Future Work And Caustics ?! Does not easily handle caustics. 37/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  62. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Summary Introduction 1 Formalizing the Problem 2 Sampling VPLs: Metropolis Instant Radiosity 3 Accumulating VPL contributions 4 Coherent Metropolis Light Transport 5 Conclusion 6 38/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  63. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Non-interleaved Deferred Shading of Interleaved Sample Patterns Goal We want to accumulate the contributions of a VPL set. 39/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  64. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Non-interleaved Deferred Shading of Interleaved Sample Patterns Goal We want to accumulate the contributions of a VPL set. Issues Many light sources == Large fillrate; Many light sources == Many rasterization steps. 39/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  65. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Non-interleaved Deferred Shading of Interleaved Sample Patterns Goal We want to accumulate the contributions of a VPL set. Issues Many light sources == Large fillrate; Many light sources == Many rasterization steps. Strategy: combine two techniques Deferred Shading → geometry rasterized once; Interleaved Sampling → decreases fill rate and maintains good image quality. 39/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  66. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Deferred Shading [DWS + 88, ST90] Principles The per-pixel geometric information is stored in a Geometric Buffer (G-buffer) (Normals, positions and colors) The G-buffer is then read to perform any lighting computation. It greatly simplifies the rendering pipeline and it also prevents the geometry from being reprojected each time a shading pass is performed. 40/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  67. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Interleaved Sampling [KH01] Instead of evaluating all VPL contributions for all pixels, we use separate subsets of VPLs for every neighbor pixel. (a) Standard Sampling (b) Interleaved Sampling 41/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights Already used in ray tracing → ”Instant Global Illumination”

  68. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Interleaved Sampling [KH01] Instead of evaluating all VPL contributions for all pixels, we use separate subsets of VPLs for every neighbor pixel. 41/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights Already used in ray tracing → ”Instant Global Illumination”

  69. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Overview of the Algorithm Creation Splitting Shading Gathering Discontinuity Filtering Blending 42/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  70. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Overview of the Algorithm Creation Splitting Shading Gathering Discontinuity Filtering Blending Conservative extension of deferred shading: all algorithms using deferred shading may also be used with our system. 42/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  71. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Core of the Algorithm: G-buffer Splitting Principle G-buffer G split into n × m smaller tiled sub-buffers G i , j Texel ( x , y ) from G goes to texel ( x / n , y / m ) of sub-buffer G i , j with i = x mod n and j = y mod m . 43/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  72. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Core of the Algorithm: G-buffer Splitting Principle G-buffer G split into n × m smaller tiled sub-buffers G i , j Texel ( x , y ) from G goes to texel ( x / n , y / m ) of sub-buffer G i , j with i = x mod n and j = y mod m . Fast Solution - Two-pass splitting Small blocks are split; Split blocks are translated. Results: fast A 1024 × 1024 192 bit G-buffer is split in 7 ms on a 6800GT; 43/59 20 ms with a one-pass splitting. Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  73. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Core of the Algorithm: Filtering Coherency of the pixels Discontinuity buffer; Box blur on continuous zones of the screen. 44/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  74. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Core of the Algorithm: Filtering Coherency of the pixels Discontinuity buffer; Box blur on continuous zones of the screen. +X +X P P Figure: Box Blur 44/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  75. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Core of the Algorithm: Filtering Coherency of the pixels Discontinuity buffer; Box blur on continuous zones of the screen. Interleaved Sub-sampling Figure: Quality 44/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  76. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Results - 500 sources - 1024 × 768 - IS 8 × 6 Fully interactive applications No visibility for secondary light sources; Fast! 69 f/s 36 f/s ( × 31) 64 f/s 29 f/s ( × 25) 45/59 58 f/s 29 f/s ( × 26) 57 f/s 29 f/s ( × 30) Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  77. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Results - Physically Based Rendering - 1280 × 1024 - IS 2 × 2 Physically based rendering Visibility for secondary light sources 46/59 0.7 s - 14 f/s ( × 3 . 4) 4.0 s - 2.5 f/s ( × 1 . 5) Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  78. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Conclusion To sum up . . . Generic extension of deferred shading; Trade-off between quality and speed. 47/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  79. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Summary Introduction 1 Formalizing the Problem 2 Sampling VPLs: Metropolis Instant Radiosity 3 Accumulating VPL contributions 4 Coherent Metropolis Light Transport 5 Conclusion 6 48/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  80. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Issues with Virtual Point Lights VPL based techniques Fast; Simple; Elegant. But: Do not handle all lighting phenomena; Use the same VPL family for all pixels. 49/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  81. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Issues with Virtual Point Lights VPL based techniques Fast; Simple; Elegant. But: Do not handle all lighting phenomena; Use the same VPL family for all pixels. Alternative approach Instead of making Instant Radiosity more robust, make Metropolis Light Transport more coherent and faster. 49/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  82. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Advantages and Drawbacks of Metropolis Light Transport Advantages Conceptually super simple; Very robust → it samples the density we want; Handles all kinds of lighting phenomena. 50/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

  83. Presentation Introduction Formalizing the Problem Sampling VPLs: Metropolis Instant Radiosity Accumulating VPL contributions Coherent Metropolis Light Transport Conclusion Advantages and Drawbacks of Metropolis Light Transport Advantages Conceptually super simple; Very robust → it samples the density we want; Handles all kinds of lighting phenomena. Drawbacks Pretty difficult to implement; Slow! → does not use efficient techniques like rasterization or coherent ray tracing. 50/59 Benjamin Segovia Interactive Light Transport with Virtual Point Lights

Recommend

Li Lightin ting in Virt rtual W l World rld Rongkai Guo Lights in the Real World Sun

Li Lightin ting in Virt rtual W l World rld Rongkai Guo Lights in the Real World Sun

Li Lightin ting in Virt rtual W l World rld Rongkai Guo Lights in the Real World Sun Lamp Blinds Flashlight And all of the Virtual Lights we CREATED! Lighting Concepts Three-Point Lighting Basics Key Light

188 views • 7 slides
Virtual Spherical Lights for Many-Light Rendering of Glossy Scenes Milo Jaroslav Bruce

Virtual Spherical Lights for Many-Light Rendering of Glossy Scenes Milo Jaroslav Bruce

Virtual Spherical Lights for Many-Light Rendering of Glossy Scenes Milo Jaroslav Bruce Kavita Haan Kivnek * Walter Bala Cornell University * Charles University in Prague Global Illumination Effects Soft shadows Color bleeding

805 views • 43 slides
Music, Water Lights Music, Water Lights An interactive means to express the physical effects of

Music, Water Lights Music, Water Lights An interactive means to express the physical effects of

Music, Water Lights Music, Water Lights An interactive means to express the physical effects of sound on light through water Ondulation by Thomas McIntosh http://www.ondulation.net/index.html Ondulation by Thomas McIntosh

346 views • 9 slides
Computer Graphics - Light Transport - Philipp Slusallek LIGHT 2 What is Light ?

Computer Graphics - Light Transport - Philipp Slusallek LIGHT 2 What is Light ?

Computer Graphics - Light Transport - Philipp Slusallek LIGHT 2 What is Light ? Electro-magnetic wave propagating at speed of light 3 What is Light ? [Wikipedia] 4 What is Light ? Ray Linear propagation Geometrical optics

546 views • 38 slides
Northern Lights A European CO 2 transport and storage network Open source access to transport

Northern Lights A European CO 2 transport and storage network Open source access to transport

Northern Lights A European CO 2 transport and storage network Open source access to transport and storage service Knut Bakke Presentation at TCCS 18 th June 2019 Content What is Northern Lights? What is open source?

527 views • 10 slides
Learning Light Transport the Reinforced Way Ken Dahm and Alexander Keller Light Transport

Learning Light Transport the Reinforced Way Ken Dahm and Alexander Keller Light Transport

Learning Light Transport the Reinforced Way Ken Dahm and Alexander Keller Light Transport Simulation How to do importance sampling compute functionals of a Fredholm integral equation of the 2nd kind L ( x , ) = L e ( x , )+ + ( x

917 views • 42 slides
0 The first problem is of course speed: light transport is generally slow, transport in volumes

0 The first problem is of course speed: light transport is generally slow, transport in volumes

In this concluding part of the course, I will discuss some open problems in volumetric light transport. 0 The first problem is of course speed: light transport is generally slow, transport in volumes even slower. Especially in large

617 views • 7 slides
Lights Out! Emilia Brinckhaus The Game What it is: 2/20

Lights Out! Emilia Brinckhaus The Game What it is: 2/20

Math 45 Linear Algebra Project 1/20 Lights Out! Emilia Brinckhaus The Game What it is: 2/20 Lights Out is an electronic puzzle-type game that is made up of a 5 5 board of buttons that can light up.

586 views • 20 slides
Computer Graphics - Light Transport - Hendrik Lensch Computer Graphics WS07/08 Light

Computer Graphics - Light Transport - Hendrik Lensch Computer Graphics WS07/08 Light

Computer Graphics - Light Transport - Hendrik Lensch Computer Graphics WS07/08 Light Transport Overview So far simple shading Today Physics behind ray tracing Physical light quantities Perception of light

616 views • 40 slides
Java 3D Lighting Java 3D supports the following types of light sources Ambient

Java 3D Lighting Java 3D supports the following types of light sources Ambient

Java 3D Lighting Java 3D supports the following types of light sources Ambient Directional Point Spot Java 3D also supports mechanisms for defining the volumes which lights can affect General Light Methods void

252 views • 11 slides
ADAPTIVE MATRIX COMPLETION FOR FAST VISIBILITY COMPUTATIONS WITH MANY LIGHTS RENDERING Sunrise

ADAPTIVE MATRIX COMPLETION FOR FAST VISIBILITY COMPUTATIONS WITH MANY LIGHTS RENDERING Sunrise

ADAPTIVE MATRIX COMPLETION FOR FAST VISIBILITY COMPUTATIONS WITH MANY LIGHTS RENDERING Sunrise Wang and Nicolas Holzschuch 1 Many-Lights Problem Direct lighting problem Large numbers of point lights Instant Radiosity (Keller

309 views • 29 slides
Lights Twist Miles Padgett FRS Kelvin Chair of Natural Philosophy ! Light beams carry a

Lights Twist Miles Padgett FRS Kelvin Chair of Natural Philosophy ! Light beams carry a

Lights Twist Miles Padgett FRS Kelvin Chair of Natural Philosophy ! Light beams carry a Linear Momentum Light carries a linear momentum Force exerted = Power/c Laser pointer exerts 10 -11 N Strong enough to move cells and

669 views • 17 slides
Lights Lights Pr oduct ion & Consumpt ion TEAM USS ENTERPR TEAM USS ENTERPR 1.2

Lights Lights Pr oduct ion & Consumpt ion TEAM USS ENTERPR TEAM USS ENTERPR 1.2

Lights Lights Pr oduct ion & Consumpt ion TEAM USS ENTERPR TEAM USS ENTERPR 1.2 1.2billion billion People do not waste light 2 TEAM USS ENTERPR TEAM USS ENTERPR [Source]: World Economic Forum 6.5 6.5 billion billion Contribute

242 views • 12 slides
Lecture 6 - Light Transport Welcome! , = (, ) ,

Lecture 6 - Light Transport Welcome! , = (, ) ,

INFOMAGR Advanced Graphics Jacco Bikker - November 2017 - February 2018 Lecture 6 - Light Transport Welcome! , = (, ) , + , , ,

1.04k views • 52 slides
Lecture 6 - Light Transport Welcome! , = (, ) ,

Lecture 6 - Light Transport Welcome! , = (, ) ,

INFOMAGR Advanced Graphics Jacco Bikker - November 2016 - February 2017 Lecture 6 - Light Transport Welcome! , = (, ) , + , , ,

490 views • 48 slides
Eco Schools Presentation to Governors We are focusing on Litter Transport School Grounds

Eco Schools Presentation to Governors We are focusing on Litter Transport School Grounds

APPENDIX 1 Eco Schools Presentation to Governors We are focusing on Litter Transport School Grounds Monitoring Energy Remember mber to: o: Turn off the lights Turn off the computer Turn off the IWB Open the blinds for natural light.

383 views • 9 slides
Street Light Improvements North Ridglea Neighborhood Street Lights IH 30 Camp Bowie, Bryant

Street Light Improvements North Ridglea Neighborhood Street Lights IH 30 Camp Bowie, Bryant

Public Meeting for 2018 Bond Program Street Light Improvements North Ridglea Neighborhood Street Lights IH 30 Camp Bowie, Bryant Irvin, Lackland Limits CPN: 101871 Project Manager: Shweta Rao, P.E, PMP Office Phone: 817-392-8022 Mobile:

416 views • 14 slides
CSE 681 Distributed Ray Tracing Shadows Assumption: The light source is a point

CSE 681 Distributed Ray Tracing Shadows Assumption: The light source is a point

CSE 681 Distributed Ray Tracing Shadows Assumption: The light source is a point Realistic: Soft shadows Point Light Source Area Light Source Reflections Assumption: The surface is a perfect mirror, so the only reflection on a

557 views • 39 slides
Public Transport Priority at Traffic Lights Laurent BREHERET - SODIT SODIT - Beijing - Octobre

Public Transport Priority at Traffic Lights Laurent BREHERET - SODIT SODIT - Beijing - Octobre

Public Transport Priority at Traffic Lights Laurent BREHERET - SODIT SODIT - Beijing - Octobre 2007 1 General concepts for PT priority A PT priority system aims at coordinating a set of actions, each of them favoring Public Transport while

272 views • 16 slides
LIGHTING 1 OUTLINE Review Factors affecting light Review Types of lights

LIGHTING 1 OUTLINE Review Factors affecting light Review Types of lights

LIGHTING 1 OUTLINE Review Factors affecting light Review Types of lights Materials Lighting Computations Implementing Lighting Gouraud Shading Phong Shading Blinn-Phong Shading Combining Light

681 views • 23 slides
Computer Graphics - Light Transport - Philipp Slusallek & Arsne Prard-Gayot Overview

Computer Graphics - Light Transport - Philipp Slusallek & Arsne Prard-Gayot Overview

Computer Graphics - Light Transport - Philipp Slusallek & Arsne Prard-Gayot Overview So far Nuts and bolts of ray tracing Today Light Physics behind ray tracing Physical light quantities Perception of light

735 views • 47 slides
Scalable Virtual Ray Lights Rendering for Participating Media Nicolas Vibert Adrien Gruson

Scalable Virtual Ray Lights Rendering for Participating Media Nicolas Vibert Adrien Gruson

Scalable Virtual Ray Lights Rendering for Participating Media Nicolas Vibert Adrien Gruson Heine Stokholm Troels Mortensen Wojciech Jarosz Toshiya Hachisuka Derek Nowrouzezahrai McGill University Luxion VIA University College

767 views • 48 slides
The northern lights (aurora borealis) The northern lights (aurora borealis) The northern lights

The northern lights (aurora borealis) The northern lights (aurora borealis) The northern lights

The northern lights (aurora borealis) The northern lights (aurora borealis) The northern lights are named after the roman goddess of dawn aurora And the Greek name for the north wind Did you know That Jupiter has lights to ? Where they

291 views • 8 slides
Fast Complete Visibility for Point Robots with Lights Costas Busch Louisiana State University

Fast Complete Visibility for Point Robots with Lights Costas Busch Louisiana State University

Fast Complete Visibility for Point Robots with Lights Costas Busch Louisiana State University Joint work with R. Vaidyanathan, G. Sharma, J. Trahan, S. Rai MAC 2016 1 Autonomous robots Look-Compute-Move cycles in the Euclidean plane 2

1.02k views • 64 slides

More recommend