bayesian learning for
play

Bayesian Learning for Guided Direct Illumination Sampling Vvoda , - PowerPoint PPT Presentation

Apr 23, 2023 •14 likes •594 views

1 Bayesian Learning for Guided Direct Illumination Sampling Vvoda , Kondapaneni, Kivnek - Bayesian online regression for adaptive illumination sampling 2 Guiding needs radiance approximations How to learn them reliably ? Our

  1. 1 Bayesian Learning for Guided Direct Illumination Sampling Vévoda , Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  2. 2 • Guiding needs radiance approximations • How to learn them reliably ? • Our proposition: (Online, Bayesian) Machine learning [ Vorba et al. 2014, V évoda et al. 2018 ] Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  3. 3 Take home message Machine Learning | Bayesian modeling = Excellent framework for guided/adaptive Monte Carlo Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  4. Bayesian online regression for adaptive direct illumination sampling Petr V évoda, Ivo Kondapaneni, and Jaroslav Křivánek Chaos Czech a.s. Charles University, Prague

  5. 5 Direct + indirect illumination

  6. 6 Direct + indirect illumination

  7. Non-adaptive sampling 7 Direct illumination only

  8. Non-adaptive sampling Adaptive sampling Adaptive sampling 8 [Donikian et al. 2006] [Donikian et al. 2006] Direct illumination only Direct illumination only

  9. Non-adaptive sampling Adaptive sampling Adaptive sampling 9 [Donikian et al. 2006] [Donikian et al. 2006] Direct illumination only Direct illumination only

  10. Non-adaptive sampling Adaptive sampling Ours 10 [Donikian et al. 2006] (Bayesian learning) Direct illumination only

  11. Non-adaptive sampling Adaptive sampling Ours 11 [Donikian et al. 2006] (Bayesian learning) 510x faster Direct illumination only

  12. Non-adaptive sampling Adaptive sampling Ours 12 [Donikian et al. 2006] (Bayesian learning) 510x faster Robust Direct illumination only

  13. 13 Previous work Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  14. 14 Adaptive sampling • General Monte Carlo – Vegas algorithm • [ Lepage 1980 ] – Population MC • [ Capp é et al. 2004, ... ] • Rendering – Image sampling • [ Mitchell 1987, ... ] – Indirect illumination (path guiding) • [ Dutre and Willems 1995 , Jensen 1995 , Lafortune et al. 1995, ... ] • [ Vorba et al. 2014, Muller et al. 2017 ] – Direct illumination • [ Shirley et al. 1996 , Donikian et al. 2006, Wang et al. 2009 ] Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  15. Bayesian methods in rendering • Filtering – NonLocal Bayes [ Boughida and Boubekeur 2017 ] • Global illumination – Bayesian Monte Carlo [ Brouilat et al. 2009, Marques et al. 2013 ] – Path guiding [ Vorba et al. 2014 ] Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling 15

  16. 16 Background Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  17. 17 Direct illumination problem Less important Occluded Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  18. 18 Non-adaptive, un-occluded light sampling P Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  19. 19 Adaptive light sampling [ Donikian et al. 2006 ] screen space Ad-hoc combination P P + Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  20. 20 Problem summary Light contribution bounds MC estimates Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  21. 21 Our approach Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  22. 22 Contributions • What distribution should we learn? • Learning the distribution through Bayesian inference Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  23. 23 Optimal light sampling distribution mean 2 + variance 𝑄 𝑀 ∝ 𝑄(𝑀) ∝ mean MC estimates Prob 𝑀 1 𝑀 2 𝑀 3 Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  24. 24 Direct illumination only

  25. 25 Mean only (Previous) Mean + Variance (Ours) Direct illumination only

  26. 26 Contributions • Optimal sampling distribution • Learning the distribution through Bayesian inference Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  27. 27 Naive adaptive light sampling outlier MC estimates P 𝑀 1 𝑀 2 𝑀 3 Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  28. 28 Bayesian adaptive light sampling outlier MC estimates P Model x Prior 𝑀 1 𝑀 2 𝑀 3 Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  29. 29 Scene subdivided in regions Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  30. 30 Light-region statistics MC estimates 𝑒 region 𝑆 𝑒 Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  31. 31 Regression data model Light-region data Parameters: 𝑙, ℎ - normal distr. parameters MC estimates 𝑞 0 - probability of occlusion 𝑂(est. | 𝑙 𝑒 2 , ℎ 𝑒 4 ) 1 − 𝑞 0 × 𝑞 0 × 𝜀 est. 𝑒 Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  32. 32 Conjugate prior 𝐪𝐩𝐭𝐮𝐟𝐬𝐣𝐩𝐬 ∝ likelihood × 𝐪𝐬𝐣𝐩𝐬 Same functional form Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  33. 33 Our (conjugate) priors 𝑞 0 ~ Beta 𝑞 0 … 𝑙, ℎ ~ Normal inverse gamma 𝑙, ℎ 𝜈 0 , … ) Hyperparameters Light contrib. estimate Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  34. 34 Algorithmic summary • During each Next event estimation (in a region) – Compute data distributions for each light (mean, variance). – Build sampling PMF over lights – Choose lights form the PMF & samples on lights at random – Update light-region stats Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  35. 35 Scalability – Light clustering Technical detail – not essential for our take-home message Cluster contribution bounds MC estimate Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  36. 36 Results Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  37. 37 Tests Direct only Direct + indirect Simple occlusion Complex occlusion Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  38. 38 Direct illumination only

  39. Wang Ours Donikian 39 Robust 510x faster Wang RMSE time [min] Direct illumination only

  40. 40 Tests Direct only Direct + indirect  Simple occlusion Complex occlusion Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  41. 41 Direct + indirect illumination

  42. Wang Wang 42 6.7x faster 6.7x faster Ours Ours Direct + indirect illumination

  43. 43 Tests Direct only Direct + indirect   Simple occlusion Complex occlusion Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  44. 44 Direct illumination only

  45. 45 Wang Ours Donikian 9.3x faster Wang RMSE time [min] Direct illumination only

  46. 46 Wang Ours Donikian Robust Direct illumination only

  47. 47 Tests Direct only Direct + indirect   Simple occlusion  Complex occlusion Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  48. 48 Direct + indirect illumination

  49. 49 Ours Ours Wang Wang 4.3x faster 4.3x faster Direct + indirect illumination

  50. 50 Ours Wang Direct + indirect illumination

  51. 51 Tests Direct only Direct + indirect   Simple occlusion   Complex occlusion • Grid resolution Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  52. 52 Direct illumination only

  53. 53 Ours (64) No regression Wang 3.6x faster 𝑒 2 , ℎ 𝑙 1 − 𝑞 0 × 𝑂 est. 𝑒 4 𝑞 0 × 𝜀 est. Direct illumination only

  54. 54 Tests Direct only Direct + indirect   Simple occlusion   Complex occlusion • Grid resolution  • Temporal coherence Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  55. Ours Wang 55 55 Direct illumination only

  56. 56 Contribution • Bayesian framework for robust adaptivity/guiding • Optimal sampling distribution • Algorithm for direct illumination – Unbiased, adaptive, robust – Easy to integrate Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

  57. 57 Acknowledgments • Ludvík Koutný (a.k.a. rawalanche) • Funding – Charles University: GAUK 1172416, SVV-2017-260452 – Czech Science Foundation: 16-18964S, 19-07626S. Vévoda, Kondapaneni, Křivánek - Bayesian online regression for adaptive illumination sampling

Recommend

Bayesian Learning 1 Outline MLE, MAP vs. Bayesian Learning Bayesian Linear Regression

Bayesian Learning 1 Outline MLE, MAP vs. Bayesian Learning Bayesian Linear Regression

Bayesian Learning 1 Outline MLE, MAP vs. Bayesian Learning Bayesian Linear Regression Bayesian Gaussian Mixture Models Non-parametric Bayes 2 Take Away ... 1. Maximum Likelihood Estimate (MLE) = arg max p ( D| )

609 views • 27 slides
Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian

Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian

Outline Intro to RL and Bayesian Learning History of Bayesian RL Model-based Bayesian RL Prior knowledge, policy optimization, discussion, Bayesian approaches for other RL variants Model-free Bayesian RL Gaussian

1.23k views • 63 slides
CS440/ECE448 Lecture 15: Bayesian Inference and Bayesian Learning Slides by Svetlana Lazebnik,

CS440/ECE448 Lecture 15: Bayesian Inference and Bayesian Learning Slides by Svetlana Lazebnik,

CS440/ECE448 Lecture 15: Bayesian Inference and Bayesian Learning Slides by Svetlana Lazebnik, 10/2016 Modified by Mark Hasegawa-Johnson, 3/2019 Bayesian Inference and Bayesian Learning Bayes Rule Bayesian Inference Misdiagnosis

829 views • 38 slides
Learning Objectives At the end of the class you should be able to: derive Bayesian learning from

Learning Objectives At the end of the class you should be able to: derive Bayesian learning from

Learning Objectives At the end of the class you should be able to: derive Bayesian learning from first principles explain how the Beta and Dirichlet distributions are used for Bayesian learning. D. Poole and A. Mackworth 2019 c Artificial

272 views • 16 slides
Adversarial Approaches to Bayesian Learning and Bayesian Approaches to Adversarial Robustness

Adversarial Approaches to Bayesian Learning and Bayesian Approaches to Adversarial Robustness

Adversarial Approaches to Bayesian Learning and Bayesian Approaches to Adversarial Robustness Ian Goodfellow, OpenAI Research Scientist NIPS 2016 Workshop on Bayesian Deep Learning Barcelona, 2016-12-10 Speculation on Three Topics Can we

769 views • 21 slides
Beyond Uniform Priors in Bayesian Network Structure Learning (for Discrete Bayesian Networks)

Beyond Uniform Priors in Bayesian Network Structure Learning (for Discrete Bayesian Networks)

Beyond Uniform Priors in Bayesian Network Structure Learning (for Discrete Bayesian Networks) Marco Scutari scutari@stats.ox.ac.uk Department of Statistics University of Oxford April 5, 2017 Bayesian Network Structure Learning Learning a BN

536 views • 26 slides
Bayesian learning (with a recap of Bayesian Networks) Applied artificial intelligence (EDA132)

Bayesian learning (with a recap of Bayesian Networks) Applied artificial intelligence (EDA132)

Bayesian learning (with a recap of Bayesian Networks) Applied artificial intelligence (EDA132) Lecture 05 2016-02-02 Elin A. Topp Material based on course book, chapters 14.1-3, 20, and on Tom M. Mitchell, Machine Learning, McGraw-Hill,

557 views • 28 slides
Overview Bayesian Methods for Parameter Estimation Introduction to Bayesian Statistics: Learning

Overview Bayesian Methods for Parameter Estimation Introduction to Bayesian Statistics: Learning

Overview Bayesian Methods for Parameter Estimation Introduction to Bayesian Statistics: Learning a Probability Learning the mean of a Gaussian Chris Williams Readings: Bishop 2.1 (Beta), 2.2 (Dirichlet), 2.3.6 School of Informatics,

177 views • 5 slides
Should all Machine Learning be Bayesian? Should all Bayesian models be non-parametric? Zoubin

Should all Machine Learning be Bayesian? Should all Bayesian models be non-parametric? Zoubin

Should all Machine Learning be Bayesian? Should all Bayesian models be non-parametric? Zoubin Ghahramani Department of Engineering University of Cambridge, UK zoubin@eng.cam.ac.uk http://learning.eng.cam.ac.uk/zoubin/ BARK 2008 Some

456 views • 26 slides
Learning: A Bayesian solution Dmitry P. Vetrov Research professor at HSE, Head of Bayesian

Learning: A Bayesian solution Dmitry P. Vetrov Research professor at HSE, Head of Bayesian

Open Problems in Deep Learning: A Bayesian solution Dmitry P. Vetrov Research professor at HSE, Head of Bayesian methods research group http://bayesgroup.ru Idea of the talk 2 Deep Learning Revolution in machine learning Deep neural

452 views • 26 slides
CSCE 478/878 Lecture 6: Bayesian Learning MAP learners 1. Provide practical learning

CSCE 478/878 Lecture 6: Bayesian Learning MAP learners 1. Provide practical learning

Bayesian Methods Not all hypotheses are created equal (even if they are all Outline consistent with the training data) Might have reasons (domain information) to favor some Bayes Theorem hypotheses over others a priori Bayesian methods work

201 views • 6 slides
Probabilistic Graphical Models Lecture 5 Bayesian Learning of Bayesian Networks CS/CNS/EE

Probabilistic Graphical Models Lecture 5 Bayesian Learning of Bayesian Networks CS/CNS/EE

Probabilistic Graphical Models Lecture 5 Bayesian Learning of Bayesian Networks CS/CNS/EE 155 Andreas Krause Announcements Recitations: Every Tuesday 4-5:30 in 243 Annenberg Homework 1 out. Due in class Wed Oct 21 Project proposals due

521 views • 41 slides
2016-02-10 5.2 Learning Bayesian networks: Learning phase: General idea Representing and

2016-02-10 5.2 Learning Bayesian networks: Learning phase: General idea Representing and

2016-02-10 5.2 Learning Bayesian networks: Learning phase: General idea Representing and storing the knowledge See Witten et al. 2011. The network we want to learn has to have a node for every feature that we have, resp. want to be Bayesian

58 views • 4 slides
Function Space Priors in Bayesian Deep Learning Roger Grosse Motivation Today Bayesian deep

Function Space Priors in Bayesian Deep Learning Roger Grosse Motivation Today Bayesian deep

Function Space Priors in Bayesian Deep Learning Roger Grosse Motivation Today Bayesian deep learning is most often tested on regularization (Bayesian Occams Razor, description length regularization) smoothing the predictions

420 views • 25 slides
AND MACHINE LEARNING CHAPTER 8: GRAPHICAL MODELS Bayesian Networks Directed Acyclic Graph (DAG)

AND MACHINE LEARNING CHAPTER 8: GRAPHICAL MODELS Bayesian Networks Directed Acyclic Graph (DAG)

PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 8: GRAPHICAL MODELS Bayesian Networks Directed Acyclic Graph (DAG) Bayesian Networks General Factorization Bayesian Curve Fitting (1) Polynomial Bayesian Curve Fitting (2) Plate Bayesian

846 views • 71 slides
Foundations of AI Why learning works 1 6 . Statistical Machine Learning Bayesian Learning and

Foundations of AI Why learning works 1 6 . Statistical Machine Learning Bayesian Learning and

Contents Statistical learning Foundations of AI Why learning works 1 6 . Statistical Machine Learning Bayesian Learning and Why Learning Works W olfram Burgard, Bernhard Nebel, and Andreas Karw ath 10/ 1 10/ 2 Statistical Learning

305 views • 5 slides
Bayesian Learning Based on Machine Learning, T. Mitchell, McGRAW Hill, 1997, ch. 6

Bayesian Learning Based on Machine Learning, T. Mitchell, McGRAW Hill, 1997, ch. 6

0. Bayesian Learning Based on Machine Learning, T. Mitchell, McGRAW Hill, 1997, ch. 6 Acknowledgement: The present slides are an adaptation of slides drawn by T. Mitchell 1. Two Roles for the Bayesian Methods in Learning 1. Provides

709 views • 54 slides
Bayesian Learning Based on Machine Learning, T. Mitchell, McGRAW Hill, 1997, ch. 6

Bayesian Learning Based on Machine Learning, T. Mitchell, McGRAW Hill, 1997, ch. 6

0. Bayesian Learning Based on Machine Learning, T. Mitchell, McGRAW Hill, 1997, ch. 6 Acknowledgement: The present slides are an adaptation of slides drawn by T. Mitchell 1. Two Roles for the Bayesian Methods in Learning 1. Provides

1.15k views • 71 slides
Bayesian Reinforcement Learning: A Survey Mohammad Ghavamzadeh, Shie Mannor, Joelle Pineau,

Bayesian Reinforcement Learning: A Survey Mohammad Ghavamzadeh, Shie Mannor, Joelle Pineau,

Bayesian Reinforcement Learning: A Survey Mohammad Ghavamzadeh, Shie Mannor, Joelle Pineau, Aviv Tamar Presented by Jacob Nogas ft. Animesh Garg (cameo) Bayesian RL: What - Leverage Bayesian Information in RL problem - Dynamics -

771 views • 52 slides
Graphical Models and Bayesian Networks Required reading: Ghahramani, section 2, Learning

Graphical Models and Bayesian Networks Required reading: Ghahramani, section 2, Learning

Graphical Models and Bayesian Networks Required reading: Ghahramani, section 2, Learning Dynamic Bayesian Networks (just 3.5 pages :-) Optional reading: Mitchell, chapter 6.11 Bayesian Belief Networks Machine Learning 10-701

548 views • 11 slides
5.2 Learning Bayesian networks: General idea See Witten et al. 2011. Bayesian (belief) networks

5.2 Learning Bayesian networks: General idea See Witten et al. 2011. Bayesian (belief) networks

5.2 Learning Bayesian networks: General idea See Witten et al. 2011. Bayesian (belief) networks aim at representing probability distributions of features and how to combine them to make predictions about the likelihood that a particular

622 views • 22 slides
Naive Bayesian Learning in Social Networks Jerry Anunrojwong (Harvard) joint with Nat Sothanaphan

Naive Bayesian Learning in Social Networks Jerry Anunrojwong (Harvard) joint with Nat Sothanaphan

Naive Bayesian Learning in Social Networks Jerry Anunrojwong (Harvard) joint with Nat Sothanaphan (MIT) EC18 Social Learning state of the world unknown to the agents Rule: can only talk to your neighbors Prior works: Bayesian Learning

730 views • 33 slides
Optimal Algorithms for Learning Bayesian Optimal Algorithms for Learning Bayesian Network

Optimal Algorithms for Learning Bayesian Optimal Algorithms for Learning Bayesian Network

Optimal Algorithms for Learning Bayesian Optimal Algorithms for Learning Bayesian Network Structures: Network Structures: Introduction and Heuristic Search Introduction and Heuristic Search Changhe Yuan UAI 2015 Tutorial Sunday, July 12 th ,

858 views • 56 slides
Overview Bayesian Model Selection Bayesian Learning of CPTs Dealing with Multiple Models Chris

Overview Bayesian Model Selection Bayesian Learning of CPTs Dealing with Multiple Models Chris

Overview Bayesian Model Selection Bayesian Learning of CPTs Dealing with Multiple Models Chris Williams Other Scores for Model Comparison Searching over Belief Network structures School of Informatics, University of Edinburgh Readings:

234 views • 6 slides

More recommend