Evaluation of a Display for Airborne Separation in Safety-critical - PowerPoint PPT Presentation

Evaluation of a Display for Airborne Separation in Safety-critical Situations Marcus ARENIUS Human and Organisational Engineering & Systemic Design Heinrich-Plett-Str. 40, D-34132 University of Kassel Arenius et al, ICRAT 2014, 28.05.2014

Airborne separation • Above spec. FL: Airborne - Separation � Pilots conduct separation (without ATC assistance) � Find optimale flight route (Schneider, 2014) (Schneider, 2014) Arenius et al, ICRAT 2014, 28.05.2014

Perspective of the airline– Implications? • Effect of additional task on exisiting “task ecology“? • Avanced Training and Qualification Programm (ATQP) � „fly the aircraft first“ (CRM-Training) � Prepare pilots for new demands in task coordination (Training Curriculum) � Maintaining adequate Situation Awareness in challenging situations? Arenius et al, ICRAT 2014, 28.05.2014

1. Aim. Arenius et al, ICRAT 2014, 28.05.2014

Aim of Study Discern effect of the ATC-display on Situational Awareness in Safety-critical situations in Safety-critical situations � Simulator study with ATC-Display � Using Measurements of visual attention; Expert ratings (and others) Arenius et al, ICRAT 2014, 28.05.2014

2. Theory. Arenius et al, ICRAT 2014, 28.05.2014

Situational Awareness „the perception of the elements in the environment within a volume of time and space, the comprehension of their meaning and the projection of their status in the near future. (Endsley & Garland, 2001, p. 5) (Wickens, 2002) Arenius et al, ICRAT 2014, 28.05.2014

Spatial Awareness • Tasks necessary for flying the aircraft • Six important variables � Rollers / Rolling � Pitch Steering � Yawing � Flight level � Lateral deviations from flight route Positioning in time & space � Position on flight route Arenius et al, ICRAT 2014, 28.05.2014

Systems Awareness • Different technical systems and displays � Mainly monitoring Awareness of System System paramenters Routine Unexpected situations � Risk : Loss of Control Arenius et al, ICRAT 2014, 28.05.2014

Task Awareness A – Aviating Priority N – Navigating N – Navigating Flexibility C – Communications S – Systems Management Arenius et al, ICRAT 2014, 28.05.2014

Measuring SA Process Indices Behaviour and Performance Indices Direct Indices Interface Assessment System Decisions Decisions Performance Performance Processes System Awareness Eye-Tracking Evasion option Ratings (ad. fr. Endsley & Garland, 2001, p. xi) Arenius et al, ICRAT 2014, 28.05.2014

3. The ATC display. Arenius et al, ICRAT 2014, 28.05.2014

Requirements & Functioning • Defined warning volume around the aircraft (preventive): • Vector-based conflict detection: • Minimize devitions of flight route: (Schneider, 2014) (Schneider, 2014) Arenius et al, ICRAT 2014, 28.05.2014

Implementation • Iterative development based on pilot feedback • Fitted to “look-and-feel” Boeing 737 (radar) • Radar-based view (horizontal sep.) • Elevation profile (vertical sep.) • Display of conflict / avoidance options (Schneider, 2014) Arenius et al, ICRAT 2014, 28.05.2014

Layout (Schneider, 2014) Arenius et al, ICRAT 2014, 28.05.2014

4. Scenario & Participants. Arenius et al, ICRAT 2014, 28.05.2014

Scenario & Participants. • Flight Athens - Heraklion • 10 commerical pilots • Flight Szenario (3 min) • Boeing 737-800 simulator • Rated by Check-Pilot • Eye-tracking (PF) Arenius et al, ICRAT 2014, 28.05.2014

Scenario Traffic Warning Single Engine Failure Arenius et al, ICRAT 2014, 28.05.2014

AirCrt137 HDG 130 ° FL360 Arenius et al, ICRAT 2014, 28.05.2014 19

5. Results. Arenius et al, ICRAT 2014, 28.05.2014

Noticing of the Engine Failure Delay in noticing the Engine Failure P11 P10 P9 ipant P8 Particip P7 P6 P5 P4 P3 P1 0 5 10 15 Delay in [sec] Arenius et al, ICRAT 2014, 28.05.2014

Results Significant Correlations ( α = 0,05; n = 10), two-tailed t-Test: • Variable A Variable B Correlation coeff. Fixation Duration ATC-Display Performance Rating -0,75 Noticing Engine Failure Performance Rating -0,65 • Non-significant Correlations: Variable A Variable B Correlation coeff. ET strategy Performance rating -0,17 Arenius et al, ICRAT 2014, 28.05.2014

Fixation Duration (Cumulative) • Comparison P4 (high rating) - P8 (low rating): Arenius et al, ICRAT 2014, 28.05.2014

Discussion • Detrimental Effect on Situational Awareness − High delays in noticing EF associated with decreases in performance ranking (Systems Awareness) − High fixation times on ATC-display associated with decreases in performance ranking (Systems Awareness) − „Bank Angle“-Warnings (>30 ° ; „out-of-the-loop“) • Positioning ATC-Display − Vicinity of PFD,E/WD und NAV − Issue: Blending/Overlapping of tasks � Further research Arenius et al, ICRAT 2014, 28.05.2014

6. The big picture. (VA) Arenius et al, ICRAT 2014, 28.05.2014

What are they doing? Gaze strategies & Coping Psychological coping mechanisms (Sträter, 2005) Different strategies - Fixation ATC-display (P 8) - Triangulation (ET/expert ratings) - Goal Elaboration (P 4 PFD) ->Fixation - Visual inspection - > Define human tasks/functions - […] Arenius et al, ICRAT 2014, 28.05.2014

What are they doing? Global NMDS Representation Correlations of AoI • • Distance preserving Distance preserving original ordinal scale • Reflecting visual focus over time period � Disregards dynamics of behavior! Arenius et al, ICRAT 2014, 28.05.2014

Zooming in: ET-Dynamics, Coping and Functions F1/S1 F2/S2 F3/S3 Functions & coping strategies: strategies: • Best time? • Best player? Aggregated evaluation � Fit Strat. <-> Techn. � HMI-Function allocation Indentified functions & coping strategies Arenius et al, ICRAT 2014, 28.05.2014

Which factors should be evaluated? (HRA & HF) Performance Shaping Factor Quantity Feedback techn. system 45 Distraction Feedback on activity level 44 Irregularities Technic Adaptive Cognitive System Work experience on job 22 nical system Action Task Task Outcome Outcome Cooperation Cooperation 9 9 Cognitive Couplings Cognitive Processing Loop 7 Stress Experience-driven, Time-pressure 5 Task type and demand iterative determination of goals and actions Authority 5 Resilience Contextual Conditions (Psf-> mod. HEP) • Queries in event databases for specific scenarios • Translate psf into multifactorial designs Arenius et al, ICRAT 2014, 28.05.2014

Further steps • Integration of ET-data • Analysis of Dynamics (Aviation, Medicine, Control rooms, …) • Associated coping strategies ->Functions • Linking to HRA data − Database (~500 events, ~100 aviation) Database (~500 events, ~100 aviation) − Coping strategies − Demands, Coping Strategies & Psf − Design of (complex) HF studies Arenius et al, ICRAT 2014, 28.05.2014

Contact information Marcus Arenius arenius@ifa.uni-kassel.de Arenius et al, ICRAT 2014, 28.05.2014

Literature − Endsley, M. R., & Garland, D. J. (Eds.). (2001). Situation Awareness Analysis and Measurement . Atlanta, GA: CRC Press. − Schneider, M. (2014). Entwicklung eines Zusatzinformationssystems für Piloten und dessen Untersuchung hinsichtlich Auswirkungen auf das Verhalten von Piloten in kritischen Flugsituationen [Development and Evaluation of a Display for Airborne Separation] (Master Thesis). Evaluation of a Display for Airborne Separation] (Master Thesis). University of Kassel, Department of Human and Organisational Engineering & Systemic Design, Kassel. − Sträter, O. (2005). Cognition and safety: an integrated approach to systems design and assessment. Aldershot: Ashgate Publishing, Ltd. − Wickens, C. D. (2002). Situation Awareness and Workload in Aviation. Current Directions in Psychological Science , 11 (4), 128–133. Arenius et al, ICRAT 2014, 28.05.2014