Joint external evaluation Dr Nirmal Kandel, MBBS, MA (Anthropology), MPH, EMBA Team Lead – JEE Thailand 26 – 30 June, 2017 Bangkok, Thailand
IHR monitoring and evaluation framework (IHR – MEF) IHR Revie IHR IHR M&E w WHA Com (2005) 58 Framework mitte e The IHR (2005) WHA61.2 is JEE Tool is The first JEE IHR Review is adopted by adopted. WHO developed mission is the 58 th World Committee makes develops a conducted Combining the recommendations Health framework for GHSA Action Assembly annual reporting packages and the (WHA) to the WHA IHR Capacities 2005 2015 2016 2008 2014 2 2 Joint External Evaluation
IHR monitoring and evaluation framework (IHR – MEF) • Transparency Annual Reporting • Mutual accountability IHR MEF After Action • Trust building Review • Appreciation of Country plannin public health benefits g Exercises • Dialogue • Sustainability Joint External Evaluation 3 Joint External Evaluation
Process improvement approach Use of information to IHR/preparedness develop action plan for health security and costing Using IHR Monitoring and Evaluation Framework Health systems Support to National review - Priority capacities cycle and - Priority countries budget planning 4 Joint External Evaluation
The JEE tool: overview In February 2016, the WHO developed the joint external evaluation (JEE) tool. The JEE tool consists of 19 technical areas. The JEE tool assesses country capacity under the International Health Regulations (2005) to prevent, detect and rapidly respond to public health threats whether occurring naturally or due to deliberate or accidental events. The JEE tool can be used for internal self-evaluation or external evaluation. Since February 2016, all external evaluations are being done using the JEE tool. 5 Joint External Evaluation
JEE tool: core elements The JEE tool is a data gathering instrument designed to evaluate IHR capacities for health security across all relevant sectors at the national level. The 19 technical areas of the tool are arranged according to the following core elements: • Preventing and reducing the likelihood of outbreaks and other public health hazards and events defined by the IHR (2005) is essential. • Detecting threats early to save lives. • Rapid and effective response requires multisectoral, national and international coordination and communication. 6 Joint External Evaluation
JEE tool: outcomes This tool specifically helps to: • determine the baseline capacity, including gaps and needs; • inform the development of implementations plans; • measure progress on work implemented across the IHR core capacities; and • highlight gaps and needs for current and prospective donors and partners, as well as to inform country level planning and priority setting. 7 Joint External Evaluation
JEE process: a different kind of evaluation Voluntary external evaluation – openness and transparency 1. 2. Peer-to-peer review is a fully collaborative process, with joint development of scores and priority actions; it is not an audit or an inspection 3. Multisectoral includes agriculture, wildlife, security, and others, both within the host country and on the external team 4. Field visits support and inform technical area discussions 5. Integrates and supports findings from other assessments 6. Focus is on the development of priority actions 7. Final report presented to host country within two weeks of completion of the mission 8. Broad donor and international support is on a common platform 8 Joint External Evaluation
JEE process final report Focus on “end user” needs, i.e. establishing baseline and next steps to 1. strengthen capacity in each technical area. These include: • Scores • Strengths • Areas which need strengthening • Top three (maximum five) priority actions for each technical area. 2. The final report is typically provided to the host country for review within two weeks of completion of the mission. 3. Evaluation results are openly available and posted online. 9 Joint External Evaluation
Experiences from JEE mission Member States/countries, international organizations, and donors/partners have considered the external evaluation process a success (for example, Pakistan at the WHA 2016 encouraged all Member States to conduct the JEE mission, based on their experience). The evaluation process has also been a learning experience for those who have participated in the JEE missions. Forty-seven countries have already completed external JEEs as of now. It is standard JEE practice to have all evaluation reports publicly available on the WHO website as of now 26 reports are already online and remaining are in process 10 Joint External Evaluation
JEE Missions (June 2017) COMPLETED - 47 IN PIPELINE - 27 Afghanistan, Albania, Armenia, Bahrain, Bangladesh, Belgium, Belize, Benin, Cote d'Ivoire, Cambodia, Ghana, Guinea, Eritrea, Ethiopia, Finland, Jordan, Kenya, Kuwait, Kyrgyzstan, Lao People's Democratic Republic, Latvia, Lebanon, Liberia, Maldives, Mauritania, Mongolia Morocco, Mozambique, Myanmar, Namibia, Nigeria, Oman, Pakistan, Qatar, Saudi Arabia, Senegal, Sierra Leone, Slovenia, Somalia, Sri Lanka, Sudan, Tunisia, Turkmenistan, United Republic of Tanzania and Zanzibar , United Arab Emirates, United States of America, Viet Nam Australia, Bhutan, Cameroon, Canada, Chad, Comoros, Djibouti, Indonesia, Iraq, Japan,, Lesotho, Libya, Madagascar, Malaysia, Mali, New Zealand,, Federated States of Micronesia , Republic of Korea, Singapore, South Africa, Switzerland, Liechtenstein, Thailand, The Gambia, Togo, Uganda, Zambia 11 Joint External Evaluation
Examples of impact of external assessment “The National Center .. AMR reference laboratory “ This is the first time we are meeting together and has since 2014 been certified by the international we realized the concept of working together for the CEASAR program AMR External Quality people of Balochistan and we commit to support and Assessment program” work together with provincial health office ” “Passive monitoring in animals is in place for over ” The country formed a permanent cross-cutting 80 notifiable diseases and in humans for 52 ministerial council to put policies, plans, and diseases (including zoonotic diseases)” processes in place to comply with the International Health Regulations ” “Further enhancement of co -operation between the health and veterinary services could be pursued ” The vaccination coverage for the first dose of the through formalized procedures and designated MMR vaccine in the country for children aged 2 responsibilities to support the sustainability, even if years is above 92%. ” good informal exchange of information exists” 12 Joint External Evaluation
The role of evaluations Country: Partner Interaction 13 Joint External Evaluation
Tools, Guides and Templates (Supporting Materials) Joint External Evaluation Implementation Guide Joint External Evaluation Tool and Process Overview Joint External Evaluation Reporting Template JEE Roster Database Self-Evaluation Toolkit Standard Operating Procedures for JEE Roster of Experts Online Team Orientation Course Team Lead Training Course Standard JEE opening presentation, technical areas presentation and country health system overview templates Performance Evaluation of JEE and Checklists. Accessible On: http://www.who.int/ihr/procedures/implementation/en/ 14 Joint External Evaluation
THANK YOU
Recommend
More recommend
