Improving Patient Care NVIDIA Using EchoPixel's GTC 2017 Interactive Virtual Reality Technology Janet Goldenstein Lead Developer, EchoPixel, Inc. NVIDIA GTC - 2017
Medical Imaging Millions of medical images acquired each year Enormous amount of information is contained in medical images Years of training required to understand medical images 2 NVIDIA GTC - 2017
Surgical Planning in Pediatric Cardiology Information contained in 3D medical image data is not fully utilized for surgical planning 3 NVIDIA GTC - 2017
Trauma Decision in the ER CT Scans to help with Trauma Decisions Image Analysis takes too long 4 NVIDIA GTC - 2017
Information is not accessible Information contained in medical images is not accessible by the entire healthcare team 5 NVIDIA GTC - 2017
Radiology - Surgery Gap Radiologists understand the Surgeons must act on information the information 6 NVIDIA GTC - 2017
Visualize Anatomy Instead of Images Stereoscopic Visualization Apply advanced stereoscopic rendering to medical image data Medical Image + Next Generation Displays An immersive, virtual holographic experience + Anatomy High Performance Computing A high performance Nvidia GPU computer system with expandability and reliability 7 NVIDIA GTC - 2017
Why 3D Visualization and Interaction Dual “What " and “Where " Multisensory Routes What Where • Based on Memory • Sensory input based (motion) • Pattern recognition • Spatial relationships of objects 3D visualization and interaction completes perception 8 NVIDIA GTC - 2017
VR/AR Head Mounted Displays Limitations Doctors do not like to wear Isolating from environment & colleagues Can create dizziness Can become more obstructive than useful Very easy for registration to fail Challenges with “blacks” (additive blending) Virtual & Augmented HMD’s have limitations for medical imaging 9 NVIDIA GTC - 2017
Holographic Displays Limitations Small viewing area Limited color & contrast resolution Challenges with “blacks” Limited interaction Holographic Displays have limitations for medical imaging 10 NVIDIA GTC - 2017
True 3D Solution True 3D software Visualize patient specific anatomy Reach in and directly grasp, interact, and size key clinical features. Share 3D patient data to any other clinician Diagnosis & Surgical Planning Tools FDA 510K cleared / CE Mark True 3D enables physicians to see and interact with medical images the way they would with real physical objects. 11 NVIDIA GTC - 2017
True 3D Solution Show demo video here 12 NVIDIA GTC - 2017
True 3D: Pediatric Cardiology Dr. Saunders, Texas A&M – “It’s changed the way I think about the heart .” True 3D has now assisted multiple surgeries and has changed workflow 13 NVIDIA GTC - 2017
True 3D: Neurology Dr. Kaminsky, Lahey Clinic – Cannot measure tortuous vessels accurately without True 3D. 14 NVIDIA GTC - 2017
True 3D: Medical Devices • Reduction of number of devices/ implant (2.7 ~1) • Improves surgical planning and patient engagement • Interpretation time 1-2 mins vs. 30-40 mins Ken Merdan, BSC “When you are looking at something complex — and anatomy is complex and hard to understand —it’s easier to grasp in a short time frame.” Dr. Fred St Goar, Mitra Clip – Devices may improve but I can’t deliver their value unless I see the structure I am treating 15 NVIDIA GTC - 2017
Conclusion Information contained in medical images can be accessed by the entire healthcare team Improvement in clinical efficacy and workflow has had a significant positive impact on patient care Virtual Reality in healthcare is no longer in the future – it is happening now! 16 NVIDIA GTC - 2017
Contact EchoPixel, Inc. janet@echopixeltech.com +1 (844) 273-7766 17 NVIDIA GTC - 2017
Recommend
More recommend