The Role of the Examination The Role of the Examination Board - PowerPoint PPT Presentation

The Role of the Examination The Role of the Examination Board Board International Examinations in International Examinations in Occupational Hygiene Occupational Hygiene

Terry McDonald Terry McDonald Chief Examiner Chief Examiner Faculty of Occupational Faculty of Occupational Hygiene Hygiene

Functions of an Examination Functions of an Examination Board Board Creation of syllabi Creation of syllabi Collecting and verifying examination Collecting and verifying examination questions questions Creation of examination papers Creation of examination papers Marking of examination papers Marking of examination papers Candidate and tutoring performance Candidate and tutoring performance analysis analysis Appeals and complaints Appeals and complaints

Creation of a Syllabus Creation of a Syllabus Collaborating Subject Course Organisations Specialists Providers Stakeholders Syllabus Creation Syllabus Verification Syllabus and Review Template

Creation of a Syllabus Creation of a Syllabus Based upon input from Based upon input from – Professional bodies Professional bodies – – Collaborating organisations Collaborating organisations – – Subject specialists Subject specialists – – Course providers Course providers – – Other stakeholders Other stakeholders –

Creation of a Syllabus Creation of a Syllabus Specification and organisation of content Specification and organisation of content Required level of detail Required level of detail Learning outcomes Learning outcomes Guidance on the balance of teaching time Guidance on the balance of teaching time Review Review

Examination Questions Examination Questions Question Allocation to Writers Subject Area Questions Existing Rewritten Initial Check Questions for Suitability Question Verification Questions Bank Reviewed Coded and Allocation to on a Two Year added to Syllabus Section Cycle Bank

Source of Questions Source of Questions Subject specialists Subject specialists Professional occupational hygienists Professional occupational hygienists Course providers Course providers Tutors Tutors Existing question banks Existing question banks

Initial Question Review Initial Question Review Allocation to general subject area Allocation to general subject area Initial check for suitability Initial check for suitability Rewriting Rewriting Verification by subject specialist Verification by subject specialist

Addition to the Question Bank Addition to the Question Bank Allocation to section and subsection of Allocation to section and subsection of syllabus syllabus Coding of questions Coding of questions

Question Banks Question Banks On- -going review of questions used in going review of questions used in On examinations examinations Full review of all questions at least every Full review of all questions at least every two years two years Reviews relating changes in practice Reviews relating changes in practice

Examination Papers Examination Papers Syllabus Template Question Bank Examination Paper Initial Check by Marking Schedule Chief Examiner Delivery of Final Check by Examination International Reviewer

Examination Papers Examination Papers A template is used to select questions A template is used to select questions from the question bank from the question bank Balance of questions should reflect the Balance of questions should reflect the syllabus syllabus Draft paper reviewed by: Draft paper reviewed by: – Chief Examiner Chief Examiner – – International Examinations Reviewer International Examinations Reviewer –

Marking Marking Examination Marking Script Schedule Answer Examination Paper Results List Frequency Marker Data Final Result Practical Results Assembled Data Final Result Candidate Certificate Verified Advised Issued

Marking of Examination Papers Marking of Examination Papers Marking schedule used by examination Marking schedule used by examination marker marker Border- -line marks automatically remarked line marks automatically remarked Border by Chief Examiner by Chief Examiner Percentage of other scripts remarked as Percentage of other scripts remarked as per QA procedures per QA procedures

Marking of Examination Papers Marking of Examination Papers Answer frequency data used as part of the Answer frequency data used as part of the question verification procedure question verification procedure Appeals and queries relating to questions Appeals and queries relating to questions moderated by Chief Examiner moderated by Chief Examiner

QA Analysis QA Analysis Examination Questions Linked Syllabus Paper To Syllabus Candidate Balance Evaluated Performance Answer Frequency Evaluated Question Data Analysis Report to Other Relevant Course Provider Question Information Verification Question Modification

QA Analysis QA Analysis Questions re- -allocated back to syllabus to allocated back to syllabus to Questions re check balance check balance Answer frequency data used to identify Answer frequency data used to identify problem questions problem questions Group data provided to course provider to Group data provided to course provider to help to identify areas of weakness in help to identify areas of weakness in course provision course provision

Appeals Procedure Appeals Procedure Course Provider Candidate Balance of Paper Specific Question Question Verification QA Data Response

Appeals Procedure Appeals Procedure Chief Examiner and / or Faculty Registrar Chief Examiner and / or Faculty Registrar deal with appeals relating to: deal with appeals relating to: – Specific questions Specific questions – – Balance of examination paper Balance of examination paper – QA data and expert advice are used to QA data and expert advice are used to adjudicate on appeals adjudicate on appeals