healthcare education using the Microsoft HoloLens Emma Collins - PowerPoint PPT Presentation

Using mixed reality in healthcare education using the Microsoft HoloLens Emma Collins Emma Collins Dr Liz Ditzel Principal Lecturer Principal Lecturer Professor School of Nursing School of Nursing School of Nursing

The Project • Early Adopter with Pearson Immersive Learning • HoloHuman • HoloPatient

The technology • Mixed reality – Blends the virtual world with the real world – The HoloLens is considered to be a MR device

The Study • OPREC ethics approval 2018-790 • HoloPatient – BN509 students (N=68) met Jerry, a 27 year old mountain biker who had a large infected laceration on his back. He had just received penicillin and a tetanus injection. However, students were not briefed about his condition. • HoloHuman – BN507 students (N=19) revised a body system

HoloHuman

HoloHuman - Quant Item Year 1 BN507 mean (N=19) It was easy to locate the body system I wished to review 4.16 It was easy to locate the body structures I wished to review 4.05 I thought the images looked real 4.11 The information associated with identified structures were helpful 3.16 It was easy to use the headset 4.32 The headset was comfortable to use 3.84 I felt I needed more technological support to use the technology 1.32 I enjoyed using this technology to learn assessment skills 4.53 I think that this technology should be used in all nursing courses 4.21 I felt that my learning was enhanced by using the HoloLens technology 4.11 Scale: 1 = strongly disagree, 2 = disagree, 3 = neither disagree nor agree, 4 = agree, 5 = strongly agree.

HoloHuman - Qual “This supported my studying of the systems” “It was good to see more lifelike body structures” “It provided a visual way of learning” “I could actually see what I had been taught” “It was easy and made the experience realistic” “It gave me a better perspective of the body systems” “I have a visual picture, helps with visualising in exams”

HoloPatient

2018 Research • Meet Jerry – no handover or briefing – Clip 1: a man dressed in a hospital gown, appearing very agitated. – Clip 2: the same man, much ‘sicker’ – Clip 3: a very ill man.

Student Activity • For each clip students in groups were asked to: – record as many observations as possible – Write down possible nursing diagnoses – Decide on nursing actions

Clip 1: Student observations uncomfortable solid build coughing laboured breathing cuts or wound on body irregular heart rate white male itchy skin heart rate 88 B/P 124/84 0 2 4 6 8 10 12 14 16 18

Clip 1: Nursing diagnosis meningitis shingles respiratory disease purpura anaphalxysis sepsis infection 0 2 4 6 8 10 12 14 16

Clip 1: Nursing actions 9 8 7 6 5 4 3 2 1 0

Clip 3: Student observations blue lips eyes closed more redder spots loss of consciousness temperature 38.4 pulse 140 0 5 10 15 20

Clip 3: Nursing diagnosis 3.5 3 2.5 2 1.5 1 0.5 0 anaphalactic sepsis infected allergic reaction respiratory dehydration fever reaction shoulder wound arrest

Clip 3: Nursing actions maintain airway anaphalaxis prepare for ventilation administer I/V antibiotics call doctor urgently 0 5 10 15

HoloPatient - Quant Item Year 1 BN509 Year 2 BN605 mean mean (N=68) N=23) It was easy to pick up clues about the condition of the patient 4.43 4.7 It was easy to process the information gained from the patient cues 4.18 3.91 It was easy to describe the patient situation 4.35 4.48 The patient appeared to be very real 4.15 4.22 I felt confident about assessing the patient condition from the cues 4.03 4.30 It was easy to use the headset 4.42 3.78 The headset was comfortable to use 4.03 3.48 I felt I needed more technical support to use the technology 2.38 2.91 I felt I needed more support from the teacher when using the technology 1.94 2.30 I experienced motion sickness / disorientation from using the headset 1.53 2.35 I enjoyed using this technology to learn assessment skills 4.71 4.74 I think that this technology should be used in all nursing courses 4.47 4.57 I felt that my learning was enhanced by using the HoloLens technology 4.44 4.61 Scale: 1 = strongly disagree, 2 = disagree, 3 = neither disagree nor agree, 4 = agree, 5 = strongly agree.

Qualitative results • Q6 Do you feel that your learning experience was enhanced using the HoloLens? – “ It is easier to see the symptoms rather than be told them” – “See the actual patient and not having to ‘act’ – real time” – “It was interesting to assess a patient without feeling the pressure” – “A highly adaptable tool that gives cues not easily replicated in practice labs, giving a more realistic assessment” – “I felt I learnt more being in the situation and it was fun learning so made it more interesting” – “Allowed me to apply skills I had learnt and put them into practice – I learn by doing” – “Being able to see physical signs/symptoms is far more beneficial than explaining them”

• Q7= What’s the best thing about learning using the HoloLens technology? – “That you can see the patient and symptoms. It makes it more real” – “It was very real, cool to see the patient in our own eyes” – “This visual and auditory perspective allows a lot of cues to develop a nursing assessment and planning” – “Observing the progressing of a situation in a client without the panic and stress of a real situation” – “You can learn to observe patients and medical conditions in a stress free and learning environment” – “It feels so real. The patient looks like they are right there” – “It looked very life like. The skin looked very real was easy to see the cues from physical appearance” – “Awesome to see OP using emerging technology to assist learning”

2019 Research • Year 1 – HoloPatient (Jerry) – HoloHuman • Year 2 – HoloPatient (Asthma and Trauma)

Conclusion • Students enjoy the experience • Students learning seems to be enhanced • Research is ongoing

Thank you Emma Collins Principal Lecturer, School of Nursing, Otago Polytechnic, Dunedin, New Zealand Emma.collins@op.ac.nz