Sharing of the IQA and EQA experience Pierre Dalmas Director, QA 1 - PowerPoint PPT Presentation

Sharing of the IQA and EQA experience Pierre Dalmas Director, QA 1 st July 2015 Operational Programme II – Cohesion Policy 2007-2013 Empowering People for More Jobs and a Better Quality of Life Project part-financed by the European Union European Social Fund (ESF) Co-financing rate: 85% EU Funds; 15% National Funds Investing in your future

Contents of Presentation • General comments • The milestones • Organisational set-up and EQA awareness • Self-evaluation process • The scoping visit, in between and the main visit • Concluding comments, opportunities, challenges • Discussion, question and answer

Acronyms • IQA : Internal Quality Assurance (10 standards) • SED : Self evaluation document aka IQA Report • EQA : External QA Assessment of the institution

General Comments Preparing for the EQA - a 4 step process • Understanding and interpreting the IQA Standard • Compiling the SED • Hosting the EQA • Analysing and addressing the findings

General Comments • The EQA process is an opportunity for the Institution to transfer tacit and explicit knowledge within the organisation. • Comparing the EQA process to the ‘SECI ’ model ( Ikujro Nonaka - A Process Theory of the Knowledge Based Organisation), the EQA process has four distinct phases. Step Behaviour Process 1 Understanding and S ocialisation - Consolidation of tacit interpreting the IQA knowledge Standard 2 Compiling the SED E xternalisation – Transfer of tacit knowledge to explicit knowledge 3 The EQA assessment C ombination – Transfer of explicit knowledge between institution and peer assessment team 4 Analysing and addressing I nternalisation - Transfer of explicit knowledge the findings to tacit (organisational) knowledge. • At the end of the each step, quality improvement takes place.

The Milestones November 2014 • Release of National QA Framework including IQA standards. December 2014 • Received official notification of EQA visit. • Information meetings with Senior Management. • Appointment of EQA Facilitator • Approval of action plan. January 2015 • 1 day EQA awareness sessions with Programme Coordinators (Malta and Gozo) • Dissemination of EQA information to lecturing staff and students February 2015 • Mapping of IQA standard with College quality management system processes • Briefing of core EQA team and identification of roles and responsibilities

The Milestones March / April 2015 • Meetings with internal stakeholders • Identification of gaps, areas for improvement • Submission of draft IQA Self-Assessment Report to Peer Assessment Team • EQA Scoping Visit (15 – 17 th April 2015) May 2015 • Remedial action • Submission of final IQA Self-Assessment Report to Peer Assessment Team • Submission of policies, procedures, regulations and other evidence to PAT • EQA Main assessment (4 th – 8 th May 2015) June 2015 • Receipt of draft EQA External Quality Audit report • Acceptance letter of EQA report

Organisational set-up and EQA awareness • Nomination of Institutional Facilitator • Setting-up of a core team • Identification of stakeholders • Dissemination of information to all stakeholders • Reporting back to senior management • Liaison with / requests for clarification from NCFHE

Self-evaluation process Mapping IQA standards with Institutions processes

Self-evaluation process IQA - interpreting and understanding the standard IQA 1 : Mission, Vission, Strategy, Quality Polciy, Policy, Regulations, Roles and Responsibilities IQA 2 : Institutional Probity IQA 3 & 10 : Programme Design, Development, Approval and Review IQA 4 : Student Centred Learning, Teaching, Learning and Assessment IQA 5 : Student Admission to Student Exit IQA 6 : FT and PT Teaching Staff, Recruitment, Induction, Appraisal, CPD IQA 8 : Information, Anlaysis, Improvement (PDCA) IQA 9 : Public Information, Prospectus.

Self-evaluation process Identifying the Institution’s processes (Part1 )

Self-evaluation process Mapping IQA standards with Institutions processes

Self-evaluation process Identifying the Institution’s processes (Part 2)

Self-evaluation process Mapping IQA standards with Institutions processes

Compiling the IQA report. Documenting of the Institution’s processes.

Compiling the IQA report. Documenting of the Institution’s processes.

Identifying and addressing gaps and weaknesses Identifying strengths Corrective action plan

The scoping and the main EQA Audit visit Scoping Visit 2 days, 2 peer assessors • Opening meeting with Senior Management • Meeting with Registrar, Curriculum and QA • Visits to two satellite institutes (lectures and students) • Meeting with Institute Directors • Closing meeting with senior management

The scoping and the main EQA Audit visit The EQA Main Visit : Types of Meetings / Interviews • Peer Team meetings – Private meetings (1 st and last day) – Clarification meetings (with Institute Facilitator) – End of day meetings

The scoping and the main EQA Audit visit The EQA Main Visit : Main Statistics Duration : 5 full days EQA Peer Assessment Team • EQA Team Leader • EQA International Expert • NCFHe Representative • Student Assessor x 2 • NCFHE Observer

The scoping and the main EQA Audit visit The EQA Main Visit : A total of 26 meetings (+ joker meeting) were planned. Interviews held with : • Senior Management (opening meeting) • Institute Directors • Registrar • Student Support services • Students, Student Body representatives, alumni • Programme Coordinators, Lecturers • External stakeholders (employers, unions etc) • Human Resources • Financial Controller • Chief Administration Officer • Library and Learning Resource Centre Closing meeting held with Senior Management

Concluding Reflections • CPD building exercise • Promotes quality within the Institution • Tests internal communication • Requires internal collaboration • Challenges the ‘sate of denial’ • Tests feedback mechanisms (students, lecturers, employers) • Gives an official voice to staff , students and employers • Process, scope and benefits are not to be underestimated !! • Need to work hard on IQA SED !! • The EQA provides an unprecedented assessment of the institution • Establishes an enhanced relationship and network with NCFHE

Benefits to the Institution • An external, independent comprehensive review of the internal processes. • Provides for people feedback. • An independent, professional report that maps a 2 – 3 year path for the institution’s improvement plan.

Challenges and opportunities • Updates of IQA standard to allow for more focus on – Internal communication – Assessment of WBL – Quality Management System review – User friendliness of IQA document • Selection of Peer Review Teams • ‘Norming’ of reports

Discussion, questions and answers

Thank You Operational Programme II – Cohesion Policy 2007-2013 Empowering People for More Jobs and a Better Quality of Life Project part-financed by the European Union European Social Fund (ESF) Co-financing rate: 85% EU Funds; 15% National Funds Investing in your future