IE 507, Human-Centered Design Seminar Human Factors (and Human Factors-Related) Research (and Development) Dr. Kenneth Funk Mr. Sami Al-AbdRabbuh Mr. Steven Hattrup School of Mechanical, Industrial, and Manufacturing Engineering Friday 25 May 2018 1
Human Factors and Aviation Safety Primary Causes of Aircraft Accidents Hull Loss Accidents – Worldwide Commercial Jet Fleet – 1994 Through 2005 Flight Crew 55% Airplane 17% Weather 13% Misc./Other 7% Airport/ATC 5% Maintenance 3% 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% Source: Boeing Commercial Airplanes 2
Cockpit Task Management (CTM) Research Lockheed L1011 CTM: Process by which pilots selectively attend to multiple, concurrent flight tasks to safely and effectively complete a flight. Boeing 777 3
Determining the Significance of CTM: Accident Analysis CTM Error Taxonomy ● Task Initiation: early / late / incorrect / lacking ● Task Prioritization: incorrect ● Task Termination: early / late / incorrect / lacking ● Method: ● Reviewed 324 National Transportation Safety Board (NTSB) Aircraft Accident Reports ● (1960 – 1989) Developed pre-impact timelines, classified CTM errors ● Findings: 80 CTM errors in 76 (23%) of the accidents ● % CTM % of All CTM CTM Error # Accidents Accidents # CTM Errors Errors Task Initiation 35 46 35 44 Task Prioritization 24 32 24 30 Task Termination 21 28 21 26 Chou, C.D., D. Madhavan, and K.H. Funk (1996). Studies of Cockpit Task Management Errors, International Journal of Aviation Psychology , Vol. 6, No. 4, pp. 307-320. 4
Improving CTM: Training Experiment Interaction Plot Can task prioritization be trained? ● APE Mnemonic: Assess, Prioritize, Execute ● e Simulator Experiment Prescriptive t ● a R Licensed pilot participants ● r o Independent variable: training (Descriptive, Descriptive r ● r E Prescriptive, None/Control) n o Dependent Variables ● i t Control a Task Prioritization Error Rate – z i Prospective Memory Recall t – i r o Flight – training / no training – flight i ● r P ANOVA of results ● ● . f 1 – r e P – y 0.9 – r o Control m – 0.8 e M – e 0.7 v Descriptive i t c 0.6 e p Prescriptive s Bishara, S. and K. Funk (2002). Training Pilots to Prioritize Tasks, o 0.5 r Proceedings of the Human Factors and Ergonomics Society P Pre Training Post Training 46th Annual Meeting , Baltimore, MD, September 30-October 4, 2002, pp. 96-100. 5
Flight Simulator Studies of Task Prioritization Factors 6
Operating Room Distractions and Interruptions Research in collaboration with OHSU Department of Surgery Simulated laparoscopic cholecystectomy ● 18 OHSU 2 nd & 3 rd year surgical residents ● Independent Variable: Distracted vs non- ● distracted Dependent Variables: ● Damage to organs ● Collateral blood loss ● Remembering to announce closure ● Total and cauterizing times ● Results: 8 out of 18 committed errors when ● distracted versus 1 out of 18 when not distracted Distractions/Interruptions # Errors Visual movement 0 ● Ringing cell phone 1 ● Question about “crashing” patient 4 ● Side conversation 3 ● Question about choice of profession 2 ● Dropped metal tray 0 ● Feuerbacher, R.L.,Funk II, K.H., Spight, D.H., Diggs, B.S., Hunter, J.G. (2012). Realistic distractions and interruptions impair simulated surgical performance by novice surgeons, Archives of Surgery , http://archsurg.jamanetwork.com/article.aspx?articleid=1216543. 7
Flight Deck Automation Issues Research: Literature Review, Surveys, Accident/Incident Analyses, Meta-Analysis Top 10: 1. Automation may demand attention. 2. Automation behavior may be unexpected and unexplained. 3. Pilots may be overconfident in automation. 4. Behavior of automation may not be apparent. 5. Failure assessment may be difficult. 6. Mode transitions may be uncommanded. 7. Mode awareness may be lacking. 8. Mode selection may be incorrect. 9. Situation awareness may be reduced. 10. Understanding of automation may be inadequate. L1011 vs. B777 Funk, K., B. Lyall, J. Wilson, R. Vint, M. Niemczyk, C. Suroteguh, and G. Owen (1999). Flight Deck Automation Issues, International Journal of Aviation Psychology , Vol. 9, No. 2, pp. 109-123. 8
Experiments & Trade Studies to Inform Targeting Device UI Specifications Laser Target Locator Module (LTLM): TRIGR LTLM: MARK VIIE Small Tactical Optical Rifle Mounted OSU Emulators: (STORM) Micro-Laser Rangefinder Targeting Device STORM (not available) (on forward rail of M4 carbine) 9
Medical Device R&D: Healthcare Toolkit, West African Infectious Diseases Diagnosis Aid
Requirements Development for a Resilient Emergency Management System in a Local Jurisdiction Sami Al-AbdRabbuh 25 May 2018
Outline • What is the need? • Conventional approaches to meeting the need? • Why are conventional approaches inadequate? • What is the science that might help meet the need? • Why is that inadequate by itself? • What can Human factors approach contribute to this? • Objective and research question
What is the need? • What is the need for a human-centered design in Emergency Management (EM)? – Emergency management systems often include time critical and cognitively demanding tasks that humans perform on machines, computers, and other systems.
What is the role of an emergency manager? • The role of a local emergency manager entails: 1. Managing resources before, during, and after a major emergency or disaster. 2. Conducting activities related to the critical components of emergency management. 3. Coordinating with all partners in the emergency management process https://emilms.fema.gov/IS0230d/FEM0104040text.htm
• What is the need? For an emergency management person or entity to accomplish its tasks, there must be an understanding of what are the information requirements and decisions criteria that informs EM activities, EM systems design, and EM decisions.
Conventional approaches to meeting the need • Homeland Security Exercise and Evaluation Program (HSEEP) Produces After-Action Reports/Improvement Plans (AAR/IP). • Why are conventional approaches inadequate? – It does not explicitly call out the requirements generation phase. – Rarely drives a deep understanding of what should emergency managers do in a local interagency level – Does not always help in driving needed change
What is the science that might help meet the need? • Comprehensive emergency management theory • Task Analysis tools • Balanced Scorecards
Emergency Management Theory • Comprehensive Emergency Management – Phases – Planning P Process • Comprehensive functional emergency management (CFEM) framework.
Source: FEMA
http://www.nfrmp.us/state/about.cfm
What tasks should an emergency manager focus on? UTL All-Hazards Taxonomy of National Preparedness Tasks (Universal all-Hazards Taxonomy) 11
Task Analysis Methods They are used to determine and describe the physical description of an activity performed within complex systems. Cognitive Tasks Analysis methods describe the cognitive processes used by agents. Task Analysis tools help in understanding the requirements for successful completion of these tasks. (Stanton,1960)
How to analyze tasks and generate requirements APPLIED COGNITIVE TASK ANALYSIS (ACTA) GOAL DIRECTED COGNITIVE TASK ANALYSIS (GDTA) Knowledge Audit Task Simulation Diagram Interview Information Goals Decisions requirements Cognitive Demand Table Prasanna, Yang, and King (2009) 14
How to analyze tasks and generate requirements of an EM system Goal Directed Information Analysis (GDIA) Context Discovery Scenario Building à Identifying Physical Tasks Goal Hierarchy validation à Obtain Goals (Cognitive Demands) Identify Decisions being made & information to make Prepare Goal-Decision-Information Diagrams Validate obtained records such decisions Obtain Information Requirements of specific EM roles in a specific type of hazard Prasanna, Yang, and King (2009) 15
Context Discovery Scenario Building à Identifying Physical Tasks Goal Hierarchy validation à Obtain Goals (Cognitive Demands) Prepare Goal-Decision- Identify Decisions being made & Validate obtained records information to make such decisions Information Diagrams Obtain Information Requirements of specific EM roles in a specific type of hazard Prasanna, Yang, and King (2009) 16
Balanced Scorecards (BSC) • BSCs in Business • BSCs for natural disaster management Financial perspective Donors’ perspective Customer perspective Target beneficiaries perspective Internal business perspective Internal business perspective Innovation and learning perspective Innovation and learning perspective Moe, T. L., Gehbauer, F., Senitz, S., & Mueller, M. (2007, 11) 17
Recommend
More recommend