Validated Assessment Model for Pilot Selection Benjamin Tan Senior Consultant | Org. Psychologist
Agenda Why use How can Types of Who will be these About us we use our solutions successful? assessment insights? models?
About us
What makes us unique? Who are we? 2002 World leader in psychometric innovations We focus on: What ▪ Creating client centric solutions ▪ Better user experience ▪ Enabling better talent decisions do we offer? ▪ Delivering clear use cases ▪ Innovation & science Robust People Talent psychometrics analytics advisory 2018
cut-e in numbers Over 400 30 million More than 300 Candidates assessments from more carried out each year than 90 employees worldwide integrations with HRMS 2.000 countries 35 client references Online assessment available in 40 More than 70 offices worldwide languages online assessment tools
cut-e solutions deliver The science behind Process efficiencies Best in class UX Quality of hire your success 42% cut-e solutions are designed against Reduced 98% interviews by guidelines by key 40% professional bodies more profit including: generated completion rate by high scorers than low scorers More … More … More …
Our aviation clients A snapshot … and many more!
Types of solutions
+1 perfect prediction Structured +0.65 Cognitive interviews ability tests +0.58 and unstructured interviews +0.46 Integrity tests +0.36 Assessment +0.35 Biographical centres data +0.10 Years of education Graphology +0.00 and astrology 0 random chance Schmidt, Oh & Shaffer (2016)
Selection context Realistic Job Preview Pre-application assessment Personality questionnaire, Situational Judgement Online assessments Questionnaire, aptitude assessments Selection Video interview One or two way video interviews Assessment centre Individual & group exercises, interviews Technical evaluation Assessment of technical skills
How can we identify pilots … ▪ who will be successful in the future … … when we have so many to hire and train … in a timely and cost -efficient manner?
Online Test Modules Considerations for online tests ▪ No special input devices ▪ No sound ▪ Self-explanatory ▪ Forgery-proof
What tools will tell us who will be successful?
What do we need to measure in pilots? Pilot-specific Role fit Org. fit Aptitude Behaviour assessment Across the following roles ▪ Captain ▪ First Officer ▪ Cadet/Trainee Pilot ▪ Aptitudes critical at early stages – predicts training success ▪ Behaviour becomes more critical than aptitude for more experienced pilots (Captains)
The measures – cut-e pilot suite The ability to… shift back and forth between two or more activities or sources of information (such as speech, sounds, touch, or time sharing other sources) spatial orientation know your location in relation to the environment or to know where other objects are in relation to you quickly and accurately compare similarities and differences among sets of letters, numbers, objects, pictures, perceptual speed or patterns which may be presented at the same time or one after the other control precision quickly and repeatedly adjust the controls of a machine or a vehicle to exact positions speed of closure quickly make sense of, combine, and organize information into meaningful patterns oral expression communicate information and ideas in speaking so others will understand category flexibility generate or use different sets of rules for combining or grouping things in different ways arrange things or actions in a certain order or pattern according to a specific rule or set of rules (e.g., information ordering patterns of numbers, letters, words, pictures, mathematical operations) combine pieces of information to form general rules or conclusions (includes finding a relationship among inductive reasoning seemingly unrelated events) number facility add, subtract, multiply, or divide quickly and correctly selective attention concentrate on a task over a period of time without being distracted deductive reasoning apply general rules to specific problems to produce answers that make sense
Cognitive assessments
Pilot-specific abilities tests
Example: multitasking … measures the ability to perform several tasks simultaneously
Behavioural Research Stress resistance F-JAS - Goeters et al. (1997) Co-operation Communication Decision making Teamwork Leadership TEM - Maurino (2005) Situational awareness Stress management Identify risk Manage error Communication skills Co-operation CRM - Flin (2010) Assertiveness Leadership Self discipline Self-critical attitude Stress management Self organisation IATA (2012) Professional aspiration level
Pilot NOTECH model What is required? Competency Cadet First Officer Captain Safety orientation ✓ ✓ ✓ Decision-making ✓ ✓ ✓ operational Customer & commercial orientation ✓ ✓ ✓ Planning & organising ✓ Teamwork ✓ ✓ ✓ interactive Communication style ✓ ✓ ✓ Managing the crew ✓ Resilience ✓ ✓ ✓ motivational Motivation ✓ ✓ ✓ Self-development ✓ ✓ ✓
Predicting simulator performance Combination of tests assessing complex control, multi-tasking, spatial ▪ orientation and situational judgement … Handling Management Application Knowledge of procedures Decision Situational making Awareness Communication Procedures … reduces fail rate in SIM by 12%
How can we use our insights?
cut-e recommended pilot process We make Candidates tell predictions This allows us us about their about their to be smarter preferred work future about how we style behaviour from interview them this
Pilot Report - Inputs shapes – 18 aspects of preferred work style squares – capacity to resist aspects of the situation that may cause unsafe behaviour
Cognitive assessments
Detailed Profile excellent limited Area poor good NOTECHS fair Safety Orientation prioritises safety; takes responsibility for safety; follows rules and regulations; enforces rule following where necessary; acts as a role model for safety; speaks up when notices a potential safety issue or error Decision-Making operational quickly draws accurate conclusions; takes into account relevant information when making decisions; accurately anticipates the outcome of situations; adapts decision-making in changing circumstances; identifies risks Customer & Commercial Orientation recognises the importance of customer satisfaction as a business goal; understands the link between own behaviour and business performance; thinks in terms of revenue and cost; behaves positively towards customers The analysis of the response pattern does not show any irregular or unusual aspects. Thus, data Data quality quality is sound and the interpretation of the results is reliable and accurate. Sample report
Detailed Profile Strong Dealing with emotions First Officer Selma Sample is even-tempered and confident. She is resilient even in the case of failure and remains calm under pressure. At times she considers how she is perceived by others, but is hardly affected by this. Thus, she can focus attention on the tasks and duties of a First Officer. This means that First Officer Selma Sample is likely assess situations accurately and also when under pressure. Her decision-making is likely to be based on relevant information only. At this stage it seems that there are no major issues affecting First Officer Selma Sample’s health and well-being on the long run. Risk Organising work and self First Officer Selma Sample responds to sudden change in a spontaneous and intuitive manner and feels constrained by exact planning. She sees the big picture rather than the details and is distracted easily. Moreover, she is quick to question rules and regulations. Moreover, colleagues might perceive her as unreliable and undisciplined. This means that First Officer Selma Sample is likely to struggle with adhering to rules and regulations and to have difficulty maintaining attention during routine tasks. Her colleagues can rely on her only to a limited extent and this may impair their planning and lead to interpersonal conflict. Sample report
Why assess using these instruments?
Why? Ability tests ▪ Predict flying performance during training and the actual flight NOTECHS ▪ Predict training and job performance ▪ Are important for preventing accidents (CRM, TEM) ▪ Can be trained only to a limited extent, therefore need to be assessed before hire Assessing ability and NOTECHS at an early stage in the selection process ▪ Increases pass rates in AC and simulator ▪ Makes the process timely and cost-efficient
Make better talent decisions! go www.cut-e.com
Recommend
More recommend
