Metrics and Performance Metrics and Performance Management Management W. Post W. Post Wednesday, 20 July 2005 Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar 6th USA/Europe ATM R&D Seminar - - Baltimore, MD Baltimore, MD 1 1
General objective General objective � create and reinforce create and reinforce working and personal working and personal � relationships between leading experts and between leading experts and relationships researchers in the ATM R&D community, researchers in the ATM R&D community, share available results and and reach consensus reach consensus share available results on major issues. Since the goal of these . Since the goal of these on major issues seminars is to “ “create and reinforce create and reinforce” ”, an , an seminars is to emphasis in the selection process will be on emphasis in the selection process will be on identifying and tracking continuity and tracking continuity and identifying and progress from previous seminars. from previous seminars. progress Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 2
Track scope Track scope � "ATM performance assessment, modeling "ATM performance assessment, modeling � and analysis techniques, gate- -to to- -gate (en gate (en- - and analysis techniques, gate route to en- -route) capacity issues, demand route) capacity issues, demand route to en forecasting, demand management; this also forecasting, demand management; this also includes wider ATM business related includes wider ATM business related issues." issues." Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 3
Layered Performance Layered Performance Management in ATM Management in ATM ATM Community Expectations Aviation & Society KPAs Level 1 Static aggregates KPAs ATM systems Level 2 RASP ATM core services Level 3 KPAs RTSP sub-functions, KPAs Level 4 RNP, RCP, … subsystems & enablers Technologies and methods KPAs Dynamics Level 5 SARPS, … = Impact relationship Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 4
Key Performance Areas Key Performance Areas KPA 01 Access and Equity Note1: KPA 02 Capacity Mostly applicable to upper 2 to 3 layers. KPA 03 Cost Effectiveness Different KPAs could KPA 04 Efficiency be applicable to lower layers KPA 05 Environment KPA 06 Flexibility KPA 07 Global Interoperability KPA 08 Participation by the ATM community KPA 09 Predictability KPA 10 Safety KPA 11 Security Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 5
Coverage of track papers Coverage of track papers Level Level 1 1 2 2 3 3 4 4 5 5 KPA 01 Access and Equity KPA 01 Access and Equity KPA 02 Capacity KPA 02 Capacity KPA 03 Cost Effectiveness KPA 03 Cost Effectiveness KPA 04 Efficiency KPA 04 Efficiency KPA 05 Environment KPA 05 Environment KPA 06 Flexibility KPA 06 Flexibility KPA 07 Global Interoperability KPA 07 Global Interoperability KPA 08 ATM community Participation KPA 08 ATM community Participation KPA 09 Predictability KPA 09 Predictability KPA 10 Safety KPA 10 Safety KPA 11 Security KPA 11 Security Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 6
Observations Observations � Common set of Common set of KPIs KPIs for reporting at ATM system for reporting at ATM system � level (2) is still missing. level (2) is still missing. � Causality between the studied performance at Causality between the studied performance at � lower level and desired change at system level is lower level and desired change at system level is usually implicit. usually implicit. rd order Are we focussing on the 1 st st , 2 , 2 nd nd , or 3 , or 3 rd � Are we focussing on the 1 order � effects? effects? � Studies are often specialised to a particular local Studies are often specialised to a particular local � problem. problem. � Data availability still often an issue. Data availability still often an issue. � Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 7
Conclusions Conclusions � Main focus of papers Main focus of papers in track in track is on few is on few � performance areas: performance areas: � Capacity, Efficiency, Cost effectiveness, � Capacity, Efficiency, Cost effectiveness, Environment, Safety (papers from SAF track not Environment, Safety (papers from SAF track not counted). counted). � Some other areas are addressed in more detail � Some other areas are addressed in more detail in other tracks (e.g. safety, environment). in other tracks (e.g. safety, environment). � Value of ATM interesting 'new' topic. Value of ATM interesting 'new' topic. � Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 8
Conclusions Conclusions � Need for a commonly applied ATM performance Need for a commonly applied ATM performance � framework is high. framework is high. � R&D, � R&D, � Daily performance assessment, � Daily performance assessment, � Target setting. � Target setting. � Standardise metrics definitions. Standardise metrics definitions. � � How to deal with trade How to deal with trade- -offs at all levels? offs at all levels? � � Need to Need to build common understanding of current of current build common understanding � and future (desired) ATM performance. and future (desired) ATM performance. Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 9
Further details Further details � Paper summaries can be found in Paper summaries can be found in � subsequent slides of this presentation but subsequent slides of this presentation but are not presented. are not presented. � Some slides with definitions from ICAO ATM Some slides with definitions from ICAO ATM � Performance Manual work are provided but Performance Manual work are provided but not presented. not presented. Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 10
Questions? Questions? Wednesday, 20 July 2005 Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar 6th USA/Europe ATM R&D Seminar - - Baltimore, MD Baltimore, MD 11 11
Session 1 Session 1 � Economic Contribution and Productivity of ATM Economic Contribution and Productivity of ATM - - � Dr. Paula Leal de Matos – – Eurocontrol Eurocontrol . Dr. Paula Leal de Matos . � KPA 03 � KPA 03 – – level 1. level 1. � Amongst first studies to address ATM Added value Amongst first studies to address ATM Added value � � � Difficulty to collect required economic data. Difficulty to collect required economic data. � North America and Europe: 22 billion US$, North America and Europe: 22 billion US$, � 230.000 jobs. 230.000 jobs. � Productivity comparable to other technologically Productivity comparable to other technologically � advanced sectors. advanced sectors. � True value of ATM may need to be further clarified True value of ATM may need to be further clarified � Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 12
Session 1 Session 1 � Extent and Impact of Future NAS Capacity Extent and Impact of Future NAS Capacity � Shortfalls in the United States: A Socio- - Shortfalls in the United States: A Socio Economic Demand Study - - Shahab Economic Demand Study Shahab Hasan Hasan – – LMI/David Ballard – – GRA, Inc. GRA, Inc. LMI/David Ballard � KPA 03 � KPA 03 – – level 1. level 1. � FAA Long term forecast & Capacity FAA Long term forecast & Capacity � constraints from 2012. constraints from 2012. � Lack of capacity would cost from 6.5 (2015) Lack of capacity would cost from 6.5 (2015) � to 19.5 billion US$. Cumulative between 90 to 19.5 billion US$. Cumulative between 90 and 230 billion US$ for period 2015- -2025. 2025. and 230 billion US$ for period 2015 Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 13
Session 2 Session 2 � Flight Efficiency Studies in Europe and the Flight Efficiency Studies in Europe and the � United States - United States - Tarja Kettunen Tarja Kettunen – – ISA Software/Dave ISA Software/Dave Knorr Knorr – – FAA FAA � KPA 04 � KPA 04 – – Level Level 2. 2. � Indicator: Indicator: Excess distance / direct distance. Excess distance / direct distance. � � Radar data versus great circle route. � Radar data versus great circle route. � Inefficiency:10%, distance and city � Inefficiency:10%, distance and city- -pair pair dependant. Extra Cost 1 billion € € /year. /year. dependant. Extra Cost 1 billion � Causes: Route structure, TMA Ops, Mil. Areas. � Causes: Route structure, TMA Ops, Mil. Areas. 70% TMA, 30% en route. Same for US en EU. � 70% TMA, 30% en route. Same for US en EU. � � Mature Indicator. Need to include vertical profile � Mature Indicator. Need to include vertical profile Wednesday, 20 July 2005 6th USA/Europe ATM R&D Seminar - Baltimore, MD 14
Recommend
More recommend
