The Effect of Increasing Levels of Automation in Demand-Capacity Balancing processes on Human Actors and their Roles and Responsibilities A Gaming Assessment Rosana Casar Second SESAR Innovation Days Braunschweig, 27 – 29NOV 2012 Assessment of degree of automation on human roles Assessment of degree of automation on human roles
Consortium Martijn Koolloos, David Escribano Martijn Koolloos, David Escribano Reiner Suikat, Meike Jipp Reiner Suikat, Meike Jipp Alan Groskreutz, Raquel Garcia Alan Groskreutz, Raquel Garcia Rolf Zon, Tanja Bos Rolf Zon, Tanja Bos Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 1 1
Outline Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 2
Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 3
General Objective Impact of automation on the new roles and responsibilities Assessment of the behaviour of ATM human roles in a highly automated environment Impact of automation on the interaction between human actors Airspace Organization Tools that support and the ATM actors’ Management duties Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 4
Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 5
Approach Gaming Roles & Responsibilities 2020 Role Name (Ex: AOC) General Responsabilities You are in charge of the maintenement of Trajectories and they give their consent before any demand adjustment. You will adapt their intentions and trajectories according to their strategies and possible imbalances in the network Personal Game Mission Your mission is to provide your preferred trajectories according to the different lobes orientations to the Sub- Regional Manager. Your trajectories preference are dependant on the rules of your company. Personal Game Goal 1 Your priotities are: the quality service to passenger is your first priority but the cost of your operation (extra flight time and extra fuel consumption) is also important. Every time that you are requested to provide your new trajectories you can use a what-if tool that will give you some information which help you to take decisions. Main interactions Available Tools with Trajectories predictor/What-if tool Sub-Regional/Air Space Manager SWIM AOCs Paper-based Platform-based Roles & Responsibilities 2035, 2050 GAME: CDM PROCESSES: ONE to ONE vs. ALL TOGETHER GAME: CDM PROCESSES: ONE to ONE vs. ALL TOGETHER GAME: CDM PROCESSES: ONE to ONE vs. ALL TOGETHER GAME: TIMING OF THE PROCESS GAME: TIMING OF THE PROCESS GAME: TIMING OF THE PROCESS Mission Mission Typology Typology Exercise Exercise Low Cost Low Cost Low Cost Director Director Airline Airline Airline Subregional/AMC Subregional/AMC Commercial Commercial Commercial Manager Manager Airline #1 Airline #1 Airline #1 VGA dimension, VGA lobes VGA lobes location, timing slot, orientation orientation two possible lobes Commercial Commercial Commercial Military Military Military Military Military Subregional Subregional Airline #2 Airline #2 Airline #2 Exercise Exercise Exercise Airspace Manager Airspace Manager orientations Manager Manager Director Director Director User User User Scenario Civil Civil Exercise Exercise A A Publication in the Publication in the Airspace Manager Airspace Manager Director Director Low Cost Low Cost NOP NOP Airline Airline Subregional/AMC Subregional/AMC B B Manager Manager Core Area Core Area Commercial Commercial Airline Airline Day before Day before Day D Day D operation operation Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 6
Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 7
What is Gaming? More than pure entertainment Low-cost human in the loop activity Simulate decision making processes Experts are ‘around a table’ playing different roles as they were living real processes Assessment of degree of automation on human roles 1 st SESAR Innovation Days, Toulouse, 29/11 – 01/12/2011 8
Paper-Based & Platform-Based Gaming • Relatively easy and low-cost (use of basic office material) • First assessment • Support the platform-based games Paper-Based • Use of a platform (more realistic context) • Close link with different levels of automation Platform- • Complete assessment Based Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 10
Gaming session activities Paper-Based Preparation Play Analysis Platform-Based Preparation Play Analysis TIME Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 11
Platform-based Gaming CHILL • Collaborative Human-In-The-Loop Laboratory • Used in Airspace Organization and Management Gaming (DCB) • Different categories of actors work together • Suite of interoperable modelling services and components Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 12
Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 13
Paper-Based and Platform-Based Gaming Objectives • Suitability of the assumed LoA • Pre-selection of solutions to be assessed • Preliminary analysis of the impact of automation on Paper-Based human roles • Complete assessment of the impact of automation on human roles • Impact on teamwork Platform- • Needs of possible future support tools Based Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 14
Metrics Acceptance Impact of Trust Confidence Automation on Human Roles Situation Workload Awareness Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/2012 15
Collection and analysis methods Qualitative Results (mainly): • Over the shoulder observations • Questionnaires • Debriefings • System Data Collection (only platform-based) Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 16
Scenario – Demand and Capacity Imbalance Local Traffic Refine/Build Reference Traffic Demand Manager Network Manager Detect Airspace Demand and Capacity Imbalance Airport Select/Refine a demand and capacity imbalance CDM/ASM Assess the impact of the solution at network level Airspace Negative User impact Start UDPP process on SBTs Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 17
Games performance - Runs Runs in 2020 time frame (Baseline) Runs in 2035 time frame Runs in 2050 time frame Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 18
Objective The assessment’s approach Gaming Technique Gaming Sessions Results Conclusions and Research Lines Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 19
Paper-based Gaming Results Suitability of Levels of Automation • 2050 2020 and 2035 Interaction between roles • Decreases with higher levels of automation Substitution of human tasks • Positively assessed • Human performance improves with increasing LoA Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 20
Paper-based Gaming Results Level of frustration • 2050, 2020 2035 Situational Awareness • Two of them considered high level of SA with higher LoA • One of them with low SA with the 2050 scenario Other results • Flexibility, better managed by the humans Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 21
Platform-based Gaming Results LoA and Trust • LoA proposed were accepted • Level of trust is maintained Situational Awareness • Sufficient with the traffic density and the LoA shown • Some proposals to improve it Teamwork • System more helpful when increasing LoA • The interactions decreases but not missed Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 22
Platform-based Gaming Results Workload • acceptable LTM NM Needs for additional tools • Chat was appropriate • Tool to visualize different solution scenarios Assessment of degree of automation on human roles 2 nd SESAR Innovation Days, Braunschweig, 27 – 29/11/201 23
Recommend
More recommend
