h
play

H - PowerPoint PPT Presentation

Aug 06, 2023 •397 likes •997 views

Symposium What Neuroimaging Can Tell Us? From Correlation to Causation and Cognitive Ontologies, OHBM 2016 June 27, 2016 H

  1. Symposium “What Neuroimaging Can Tell Us? From Correlation to Causation and Cognitive Ontologies”, OHBM 2016 June 27, 2016 H       ? Sebastian Weichwald MPI for Intelligent Systems sweichwald.de/ohbm2016 � www.neural.engineering

  2. Motivation

  3. Voxel not used Voxel weight for person.n.01 -4 +4 Decoding model OFA OFA FFA FFA sup. sup. RH LH anterior anterior Encoding model EBA EBA Thanks to Alexander Huth, Gallant lab, UC Berkeley 2

  4. Voxel not used Voxel weight for person.n.01 -4 +4 Decoding model OFA OFA √ √ FFA FFA relevance sup. sup. RH LH anterior anterior √ √ Encoding model EBA EBA Thanks to Alexander Huth, Gallant lab, UC Berkeley 2

  5. Voxel not used Voxel weight for person.n.01 -4 +4 Decoding model OFA OFA √ √ FFA FFA relevance sup. sup. RH LH anterior anterior √ √ Encoding model EBA EBA Thanks to Alexander Huth, Gallant lab, UC Berkeley 2

  6. Encoding models 3

  7. Encoding models GLM difference in means ⋯ 3

  8. Encoding models GLM difference in means ⋯ “Associated with experimental condition?” 3

  9. Reichenbach’s Common Cause Principle Reichenbach, 1956 4

  10. Reichenbach’s Common Cause Principle stimulus voxel associated Reichenbach, 1956 4

  11. Reichenbach’s Common Cause Principle stimulus voxel Reichenbach, 1956 4

  12. Reichenbach’s Common Cause Principle h stimulus voxel Reichenbach, 1956 4

  13. Reichenbach’s Common Cause Principle h stimulus voxel stimulus voxel Reichenbach, 1956 4

  14. Reichenbach’s Common Cause Principle h stimulus voxel stimulus voxel stimulus voxel Reichenbach, 1956 4

  15. Reichenbach’s Common Cause Principle h stimulus voxel stimulus voxel stimulus voxel Reichenbach, 1956 4

  16. Causal interpretation chart Weichwald et al., NeuroImage , 2015 5

  17. Causal interpretation chart Voxel relevant? Encoding Causal interpretation √ × Stimulus-based Weichwald et al., NeuroImage , 2015 5

  18. Causal interpretation chart Voxel relevant? Encoding Causal interpretation √ effect of S × Stimulus-based Weichwald et al., NeuroImage , 2015 5

  19. Causal interpretation chart Voxel relevant? Encoding Causal interpretation √ effect of S × no effect of S Stimulus-based Weichwald et al., NeuroImage , 2015 5

  20. Decoding models 6

  21. Decoding models 6

  22. Decoding models “Does removal impair decoding performance?” 6

  23. Decoding models “Does removal impair decoding performance?” “Associated after taking all other variables into account?” 6

  24. Causal interpretation chart Voxel relevant? Encoding Causal interpretation √ effect of S × no effect of S Stimulus-based Weichwald et al., NeuroImage , 2015 7

  25. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ Stimulus-based × Weichwald et al., NeuroImage , 2015 7

  26. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ Non-effects may appear relevant: effect of S × no effect of S stimulus √ voxel A Stimulus-based × voxel B Weichwald et al., NeuroImage , 2015 7

  27. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ Stimulus-based × Weichwald et al., NeuroImage , 2015 7

  28. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × Weichwald et al., NeuroImage , 2015 7

  29. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ Effects may be missed: inconclusive Stimulus-based × stimulus voxel A voxel B Weichwald et al., NeuroImage , 2015 7

  30. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × Weichwald et al., NeuroImage , 2015 7

  31. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × inconclusive Weichwald et al., NeuroImage , 2015 7

  32. Are decoding models useful?

  33. Combine encoding and decoding models & 8

  34. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × inconclusive Weichwald et al., NeuroImage , 2015 9

  35. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × inconclusive √ √ √ × √ × × × Weichwald et al., NeuroImage , 2015 9

  36. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ Encoding plus decoding allows to identify indirect effects: inconclusive Stimulus-based × inconclusive √ √ stimulus voxel A voxel B √ × √ × × × Weichwald et al., NeuroImage , 2015 9

  37. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × inconclusive √ √ √ × √ × × × Weichwald et al., NeuroImage , 2015 9

  38. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × inconclusive √ √ √ × indirect effect of S √ × × × Weichwald et al., NeuroImage , 2015 9

  39. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ Encoding clarifies role of voxels relevant in decoding: effect of S × no effect of S stimulus √ voxel A inconclusive Stimulus-based × inconclusive √ √ √ × indirect effect of S √ voxel B × × × Weichwald et al., NeuroImage , 2015 9

  40. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × inconclusive √ √ √ × indirect effect of S √ × × × Weichwald et al., NeuroImage , 2015 9

  41. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × inconclusive √ √ effect of S √ × indirect effect of S √ × provides context × × Weichwald et al., NeuroImage , 2015 9

  42. Causal interpretation chart Voxel relevant? Encoding Decoding Causal interpretation √ effect of S × no effect of S √ inconclusive Stimulus-based × inconclusive √ √ effect of S √ × indirect effect of S √ × provides context × × no effect of S Weichwald et al., NeuroImage , 2015 9

  43. Wrap-up

  44. Wrap-up ▸ Simple causal interpretation chart 10

  45. Wrap-up ▸ Simple causal interpretation chart (also response-based paradigms) 10

  46. Wrap-up ▸ Simple causal interpretation chart (also response-based paradigms) Relevant in encoding/correlated? × / √ (e. g. GLM) 10

  47. Wrap-up ▸ Simple causal interpretation chart (also response-based paradigms) Relevant in encoding/correlated? × / √ (e. g. GLM) Relevant in decoding/partially correlated? × / √ (e. g. classifier) 10

  48. Wrap-up ▸ Simple causal interpretation chart (also response-based paradigms) Relevant in encoding/correlated? × / √ (e. g. GLM) Relevant in decoding/partially correlated? × / √ (e. g. classifier) ↝ Read off causal interpretation 10

  49. Wrap-up ▸ Simple causal interpretation chart (also response-based paradigms) Relevant in encoding/correlated? × / √ (e. g. GLM) Relevant in decoding/partially correlated? × / √ (e. g. classifier) ↝ Read off causal interpretation (Weichwald et al., NeuroImage , 2015) 10

  50. Wrap-up ▸ Simple causal interpretation chart (also response-based paradigms) Relevant in encoding/correlated? × / √ (e. g. GLM) Relevant in decoding/partially correlated? × / √ (e. g. classifier) ↝ Read off causal interpretation (Weichwald et al., NeuroImage , 2015) Extensions 10

  51. Wrap-up ▸ Simple causal interpretation chart (also response-based paradigms) Relevant in encoding/correlated? × / √ (e. g. GLM) Relevant in decoding/partially correlated? × / √ (e. g. classifier) ↝ Read off causal interpretation (Weichwald et al., NeuroImage , 2015) Extensions ▸ Stimulus-based causal inference 10

  52. Wrap-up ▸ Simple causal interpretation chart (also response-based paradigms) Relevant in encoding/correlated? × / √ (e. g. GLM) Relevant in decoding/partially correlated? × / √ (e. g. classifier) ↝ Read off causal interpretation (Weichwald et al., NeuroImage , 2015) Extensions ▸ Stimulus-based causal inference ↝ Cause-effect relationships between neural processes 10

Recommend

More recommend