Building Immersive NVIDIA SHIELD Android TV Games GTC 2016 | Luc Beaulieu (CTO) & JP Doiron (Technology Director)
Today’s Menu • Immersive experience • What went right • Challenges • What's next
Immersive experience
Sounds
Tactile
Immersive experience Sounds (history) Vibrating controllers/seats Lights TV Series, movies https://en.wikipedia.org/wiki/Ambilight
Philips Hue lights
Syfy show • Sharknado 1, 2, 3 • 12 Monkeys • The Expanse
DEMO Requirements: • 2 hue Go • 2 hue Bloom • 1 hue light strip • 1 hue bridge • 1 internet router • SHIELD TV • 2 controllers • Power bar • RJ45 cable • HDMI Cable • 12 Monkeys
Backup plan
https://www.youtube.com/watch?v=1Y3MQrcekrk
What went right
Performance
OpenGL ES 3
Tegra Graphics Debugger • Recompile shader live • Debug draw call • GPU Performance bottleneck • Live capture of a single frame
Loading Time Loading time (sec) 35 30 25 20 15 10 5 0 PS4 Wii U Xbox One PS3 1 Apple TV Shield TV Splash to menu Main to level 1 Level 1 to level 2 level 2 to menu Menu to level 3 Total (1) PS3 uses 2x downscaled textures
NVIDIA Great Support • Shipping of devices • Rapid feedback • Helping hand with Google Play issues
Challenges
Dramatization Texture compression volta.ca
Dramatization Flipped UV volta.ca
Shaders • Texture compression • Difference between DirectX and OpenGL • Variable precision (high, medium, low) When in doubt, default to high precision then work you way down
Game Size • APK 100 megs • Expansion files 2GB
Light latency 2015 version: Brightness 40-55ms Brightness + color 80-95ms Brightness + color + on 120-125ms Informations: meethue.com
Design
What’s Next?
Canvas: The Enterprise Media Server Solution For Game Engines Tuesday, 04/05 2:30 PM Room 212B
Shield TV 2.0 • Seamless mobile and TV ecosystem • Bi-directional interaction with shows • Built-in 4K depth camera
Shield AR
Light Fields http://www.psfk.com/
Questions? Luc Beaulieu luc@frimastudio.com JP Doiron jpdoiron@frimastudio.com
Recommend
More recommend
