Other Roles Test Proctor • Assist test administrator with test administration and classroom management, work under their supervision • May administer accommodations • May be a volunteer Special Populations Coordinator • Assists the Test Monitor in identifying and documenting all testing accommodations needed for students • Trains test administrators to administer accommodations • Monitors testing for the correct and secure implementation of accommodations • Coordinates alternate assessments (if applicable to school) Technology Coordinator • Assists the Test Monitor in preparing administrator and student devices for secure testing according to vendor directions • Troubleshoots any technology problems that may arise 24
Before Testing
Key Before Testing Tasks OSSE LEA School • • • Issue testing security Identify authorized Establish and submit to standards personnel LEA the school test plan • • • Train on testing security Collect and submit Receive test materials standards school test plans to OSSE • Inventory test materials • • Issue testing security Distribute testing • Distribute test materials and integrity notification security and integrity • Review all test manuals statement to LEAs notification • Conduct test • Attend Training • Review and approve administration and school test plans security training • • Establish standards for Develop and maintain test monitoring Test Security Files • Prepare technology to create secure environment • Notify students and families of testing 26
Test Security and Integrity Notification Statement • Notification must be distributed to all authorized personnel involved in Statewide testing prior to access of secure test materials or administration. • Notification statement includes a list of requirements and responsibilities for all authorized personnel. • Signatures and submission to OSSE are not required. • Notification statement has been posted to OSSE’s website here: http://osse.dc.gov/service/test-security-and- incident-forms 27
Test Security Training OSSE is responsible for developing training for test integrity and security. Attendance at OSSE Test Security Training is required for all Non Public School Coordinators. • Non Public Coordinators training responsibilities include: – Train test monitors and all authorized personnel at LEA/school in State, LEA, and school policy and procedures – Training must include: • Distribution of Testing Integrity and Security Notification Statement to all authorized personnel • Review of School Test Plan • Review of Test Security Guidelines • Review of Test Administration Procedures • Review of vendor-supplied testing manual(s) 28
Test Security Training (continued) Who requires training? – Test Monitors – Test Administrators – Test Proctors – Authorized Personnel How should training be documented? – The following may be placed in the school’s Test Security File: • Training Materials • Sign-In Sheets • Statewide Testing Integrity and Security Notification • Statement Distribution Roster (signatures not required) 29
Reviewing Guidelines and Resources All Test Coordinators and Test Administrators are responsible for reviewing and implementing the guidance in the vendor- supplied assessment administration manuals – PARCC Test Coordinator and Administrator Manuals – MSAA Test Administration Manual 30
School Test Security Plan
School Test Security Plan OSSE requires each school to provide the following information in a school test plan: – Names and contact information for test coordinators and key personnel – Assessments associated with the school plan* – Secure Materials Management – Reporting Irregularities – Irregularities Investigations – Prohibited Actions – Logistics – Assurances – PearsonAccessNext Test Sessions and Test Administrators – A list of authorized personnel – A detailed testing schedule * Each school may have up to three test security plans, one for each assessment (PARCC/DC Science, MSAA, and ACCESS for ELLs 2.0). If the school decides to submit one plan for all assessments the plan will be due 15 business days prior to the earliest assessment. 32
School Test Plan: OSSE Approvals/Feedback The school plan serves as your official communication with OSSE on your plan for administering districtwide assessments and, OSSE monitors will visit schools during testing and assess the accuracy of your plan. School plans must be submitted to OSSE for final approval at least 15 business days prior to the first day of testing . OSSE reviews and approves all school plans and provides technical assistance to schools whose plans need improvement prior to and during testing. 33
School Test Security Plan (cont.) Characteristics of a strong Characteristics of a weak school test security plan school test security plan • S uccinct • D ifficult to follow • C lear • I ncomplete • O rganized • N ot thoughtfully prepared • T houghtful • G eneric Responses • T horough 34
TEST SECURITY PLAN WALKTHROUGH https://octo.quickbase.com/db/bmiq8feda 35
Non Public Test Coordinator Homepage • Links to important test security documents • Instructions on how to access test plans • Click ”New Test Plan” to add a new test plan 36
Support Documents • 2018 School Test Security Plan Instructions • 2018 Test Security File Documents • 2018 TS Training Attendance (Optional) 37
Assessments and Start and End Dates School test security plans include PARCC, DC Science, MSAA and ACCESS for ELLs 2.0. Schools should select all of the tests the plan is designed to cover. Schools are encouraged to submit separate plans for each assessmentsuite. Once the assessment(s) are selected, the application will ask for start and end dates for each assessment. The start day entered will be used to calculate the test plan due date. 38
General Information • Select the Non Public School from the School Name Field • Double Click the “Related LEA” spaces to select the LEA(s) your test plan will need to have approved 39
General Information • Enter all LEA and School user information for the assessment selected 40
Secure Materials Management • Complete all answers in this section • Toggle of the yellow “ i ” throughout the plan to see example responses or helpful hints. 41
Reporting Irregularities • Complete all answers in this section • In the fields that allow you to select more than one choice, make sure to check all that apply 42
Irregularities Investigations Make sure to complete all answers in this section 43
Prohibited Actions Only select ”yes” if your school has additional prohibited actions. 44
Logistics • Make sure to include name and title • Answer these questions thoughtfully and thoroughly 45
Assurances New for 2017-2018 test administration, assurances are updated so that LEAs must provide an assurance that all trainings will occur before the first day of testing. This is a change from 2016-2017 that required all assurances to be completed before submission of the test security plan. 46
PearsonAccessNext Before submitting a test security plan, test sessions and test administrators must be added to the PearsonAccessNext system. Only check this box if all student tests have been assigned to a test session and a test administrator. 47
Authorized Personnel and Test Schedule • Click on hyperlinks to download file formats for each attachment • Edits, Amended , or Additional attachments can be added in attachments 2-6 of each file 48
After School Plan Submission Once a school test security plan is approved, portions of the plan will be locked. The “After School Plan Submission” and “Authorized Personnel and Test Schedule” sections will remain active and allow test coordinators to communicate with OSSE about minor deviations in their plan. Please not for train please select “Training” for the status so OSSE does not review the exemplar. 49
Notify Students and Families Students Families • Prepare students to participate in • School/LEA must provide families the PARCC/DC Science or with a letter regarding the dates MSAA/DC Science Alternate and purpose of the statewide assessments • Provide opportunities for practice • Copies of letters sent home must • Explain purpose and dates of be kept on file for the test testing monitor’s review • Encourage positive attitudes about • A template with English and other testing translated versions of the letter • Ensure accommodations are will be available on the OSSE identified website for school use https://osse.dc.gov/publication/assessments-parent-letter- template 50
During Testing
Key During Testing Tasks OSSE LEA School • • • Support test integrity Support test monitors Maintain hard copy • coordinators and test Monitor assessment school security file • monitors administration at school Follow school test plan • • Monitor assessment sites Administer assessment • administration at school Document handling of sites secure materials on chain of custody form • Follow the test directions • Actively monitor and manage test environment • Report irregularities, incidents and/or breaches of security 52
Maintaining a Test Security File • School test security files must contain: • School test plan(s) • Documentation of any changes to or deviations from school test plan(s), including records of make-up test groups • Training attendance sheet • Copies of all incident forms • Documentation of all irregularities • Documentation of recommendations for invalidated student scores • Chain-of-custody documentation: receipt and return of secure test materials • Test administration concerns/notes • Signed test security affidavits • Parent notification letter and accommodations notification letter • School test security hard copy files must be kept on file for four years 53
Reporting Test Irregularities/Incidents • Document minor deviations from the testing plan in the School Security File • Submit incident reports via: – OSSE website or phone at (202) 304-3269 • Non Public Test Coordinators, Any authorized personnel, all others • All forms are posted online here: http://osse.dc.gov/service/test- security-and-incident-forms 54
When to Submit an Incident Report The following should be documented with an incident report: – Student becomes ill or injured and cannot complete a testing session they have already started – Student or staff member is in possession of a cell phone/unauthorized device or uses said device in an active testing environment – Students and/or staff take actions that could constitute as cheating/coaching – Students and/or staff are in possession of materials that could constitute as cheating – Secure testing materials are lost of left unsupervised – Student does not receive the appropriate accommodations – All students must leave the testing environment due to an emergency or drill – A technical issue causes students to not complete an active testing session before the close of a school day The following do not need to be documented with an incident report: – Technical issues that cause minor delays in test timing for a student or group of students – Assigning a student a different device during testing – Student behavior that does not disrupt a test session or interfere with that student, or other students, completing the test session (e.g., one student is relocated but able to complete testing) – Substituting test administrators and/or proctors 55
Test Administration Monitoring • OSSE and Non Public Test Coordinators are responsible for monitoring test administration • Statewide Assessment Auditor General Observation Checklist • The Statewide Assessment Auditor General Observation Checklist will be posted on OSSE’s website here: http://osse.dc.gov/service/test-security-and-incident-forms 56
Non Public Test Security Reporting • During testing, Non Public Coordinators are responsible for: – Investigating, documenting, and reporting to OSSE any findings and recommendations for remediation of a failure of the test security plan or other test integrity/security protocol 57
Test Environment and Prohibited Actions
Non-Permissible Bulletin and Wall Displays • Wall displays with tested content or test taking strategies must be removed/covered in testing room, hallways, stairwells, bathrooms, etc. throughout testing. • Displays must be covered prior to the first day of testing and remain covered for the duration of active statewide assessments. 60
Room Setup Recommendations for Testing Environment: – Seat students in every other seat – Arrange monitors back-to-back – Seat students back-to-back – Seat students in a semi-circle – Seat students in widely spaced rows or in every other row Special Considerations – Test students in a one-on-one setting in the following circumstances: • If the student requires the human scribe accommodation on any assessment • Complete the speaking unit of ACCESS for ELLs 2.0 61
Closeout Procedures and Materials After Tests • Test administrators must follow the closeout protocol detailed in the TAM for each student. TAs are to read the script and/or provide the student the closeout instructions handout. – TAs are not permitted to tell/ask students to check their work. – Sample approved statement: “Are you finished and ready to close out your test ?” • Test administrators may dismiss students or students may sit quietly or read books/complete activities not related to the assessed subject. – Examples : Crossword puzzle after math; Sudoku puzzle after ELA • Test materials must be collected by the test administrator or proctor prior to the student receiving any other materials. 62
Cell Phones and Prohibited Electronics • Cell phones may not be used in the testing environment by students or test administrators. • During the administration of paper based tests, no cell phones may be in the testing environment at any point during testing. • During the administration of computer-based tests, school test monitors and school technology coordinators may use cell phones for technical support • If a student or students’ testing device(s) experiences technical problems that prevent the student(s) from normal continuation of testing, the test administrator must alert the test monitor and technology coordinator. • All technical problems and delays which significantly impact the administration of the assessment must be reported and documented by the test monitor as an incident through the incident reporting protocol. 63
Use of Calculators and Devices • Grade-level appropriate calculators will be available on the test platform on calculator sections of mathematics units for computer based tests. • Students may use hand-held, grade appropriate calculators on calculator sections of assessments. • No calculators are allowed on non-calculator sections, except when specified by a student’s IEP. • Test administrators must confirm that calculator memories have been cleared. • Prohibited calculating devices: – Calculators with College Algebra System (CAS) features; – Tablets, laptops or personal digital assistants (PDAs) or phone-based calculators, except those that are being used as devices for computer-based testing; and – Calculators and electronic devices with “QWERTY” keyboards, except where expressly mandated by an IEP or Section 504 plan. 64
Support Materials Individual statewide assessments may permit additional support materials, which will be specified in the testing manual if permitted. In the event that additional support materials are permitted: • Additional support materials must be located in a pre-determined location in the testing room; • All guidance and instructions regarding additional support materials must be followed; and • If schools allow students to bring their own permissible/specific support materials, they must be given to the school test monitor or test administrator prior to testing to ensure that the tools are appropriate for testing (e.g., tools do not have any writing or pre-stored information on them). 65
Prohibited Materials English Language Arts/Literacy Mathematics • Dictionaries or thesauruses • Mathematical formulas and conversion tables other than the • Bilingual, word-to-word grade-specific, vendor-supplied dictionaries, without material definitions, phrases, • Mathematics Reference Sheets sentences, or pictures, are an allowable other than the grade-specific, accommodation for English vendor-supplied material. Learner (EL) students) • Any resources that define, explain, • Any unauthorized resource or or illustrate mathematical reference material that defines, terminology or concepts or explains, or illustrates ELA otherwise provides unauthorized terminology or concepts or assistance during testing; otherwise provides unauthorized • Non approved or unauthorized assistance during testing. calculators 66
Test Integrity and Accommodations • It is a violation of test integrity if a student does not receive their appropriate testing accommodations or if a student receives an accommodation they are not entitled to. • Students need to be familiar and comfortable with all necessary accommodation(s) BEFORE the assessment – practice tests and tutorials are a resource. • Any unique/non-standard accommodations not included in the manuals for an assessment must be approved by OSSE prior to their use on statewide tests. • An emergency accommodations form will be available online for temporary accommodations in the event of student injury (e.g. a scribe for a student with a broken wrist). 67
Exceptional Circumstances • Absences/Makeups – Makeup testing should be included in the schedule in the School Test Plan. – Schools may schedule makeup tests across grades/subjects in the same room, but timing should be the same. – Students are not allowed to return to a testing session which they have exited after starting (except if approved by OSSE). • Homebound students – Homebound students must participate in testing. – Test monitor works with test integrity coordinator and notify OSSE in the School Test Plan. • Testing at alternative sites – All eligible public school students must participate in testing. – Test monitor works with test integrity coordinator and OSSE. 68
Exceptional Circumstances • Homeschool students – Homeschool students in public education must participate in testing. – Test monitor works with LEA on participation and notifies OSSE in School Test Plan. • Significant medical emergencies – May apply for Medical Exemption with support from physician. – School may apply to OSSE for an exemption using the Medical Exemption Form. • Weather, Natural Disaster, Fire Alarm or School-wide Emergency – If there is a school-wide emergency requiring evacuation, follow the LEA/school-wide emergency protocol. – Student safety first, then document and submit an incident report to OSSE. 69
Non-Public Placements LEAs must ensure that all eligible students enrolled at their LEA, including students in non-public settings participate in statewide assessments. Non-publics are considered a school/campus under the purview of the LEA. Non-public requirements: • Compliance with Testing Integrity Act of 2013, Amendment of 2015, Test Security Guidelines and vendor manuals • Creation and submission to LEA of enrollment School Test Plan for students at that site 70
Authorized Personnel and Prohibited Actions Under the Testing Integrity Act of 2013, all authorized personnel are prohibited from: – Test Fraud: Academic Coaching – Cheating – Test Tampering Failure to comply with the prohibitions are considered violations of test security. 72
TI Act Violations: Test Fraud/Coaching Reviewing, reading, or looking at test items or student responses before, during, or after administering the Statewide assessment, unless specifically permitted in the test administrator’s manual • There should be no interaction with the content on any secure assessment by an authorized personnel. • Authorized personnel should not look at or review any test content or student responses (including on scratch paper). Assisting students in any way with answers to test questions using verbal or nonverbal cues before, during, or after administering the assessments • Examples may include: – Answering test or content-specific questions from students – Interacting in any way with student responses, including on scratch paper – Providing verbal or nonverbal cues to indicate performance (e.g., “good job,” “check your work,” shaking head) 73
TI Act Violations: Cheating • Allowing any form of cheating • Failing to actively supervise students at all times during test sessions • Allowing students to view or practice secure test items before or after the scheduled testing time • Using or allowing students use of unapproved electronics or cell phone during the administration of a Statewide assessment • Allowing students to use notes, references, or other aids, unless the test administrator’s manual or an approved accommodation specifically allows 74
TI Act Violations: Test Tampering • Altering student responses in any manner • Photocopying, or in any way reproducing , or disclosing secure test items or other materials related to Statewide assessments • Altering the test procedures stated in the formal instructions accompanying the Statewide assessments • Having in one’s personal possession secure test materials except during the scheduled testing dates and times • Making or having in one’s possession answer keys before the administration of the Statewide assessment; except that it shall not be prohibited to have an answer key for a Statewide assessment that has already been administered and released by OSSE 75
TI Act Violations: Test Tampering (cont.) • Leaving secure test materials in a non-secure location or unattended by authorized personnel • Making a false certification on any Statewide assessment forms established and required by OSSE • Being present in the test environment or handling the test materials for one’s own child or family member • Failing to count all test booklets and answer documents before allowing any pupil to leave the testing room and/or to ensure that all pupils have properly logged off the computer system • Failing to observe the test material chain of custody procedures as outlined in the school test security plan. 76
Exceptions to Violations in TI Act Failure to comply with the prohibitions will not be considered a violation if an action is: – Necessary to provide for an accommodations explicitly identified in an IEP, 504 Plan, or EL Plan; or – Limited to supporting students to stay on task and focused. Supporting students to stay on task and focused includes: – Announcements to entire testing group of time remaining on test – Announcements to entire testing group reminding students to stay on task – Announcements to entire testing group reminding students to abide by school and/or LEA rules and/or processes – Verbally, but with minimal disruption to other students, waking up a student who has fallen asleep while testing – Verbally, but with minimal disruption to other students, addressing an individual student’s disruptive behavior 77
Additional Test Administrator Guidance In addition to the guidance in the Testing Integrity Act, the assessment administration manuals clearly specify what can and cannot be said during secure testing. Test administrators are expected to follow the scripts provided in the assessment administration manuals. Test administrators and proctors may provide support to students with logging in. Technology coordinators may address technology issues such as computers freezing, batteries dying, student getting kicked off the platform. – Note: This does not include guidance on how to use the accessibility features on the platform. Practice with the platform functionalities must be completed prior to testing. 78
After Testing
Key After Testing Tasks OSSE LEA School • • • Collect affidavits Sign affidavits Package and return or • • Verify data Collect and submit dispose of secure test affidavits (from test materials as per vendor monitors and test instructions • integrity coordinators) to Document any missing OSSE within 15 days of materials and remaining the end of testing incidents • • File and execute LEA plan Sign and submit affidavits of action in response to (from Non Public test any significant incidents monitors only) to LEA test deemed by OSSE as integrity coordinator needing follow up within 10 days of end of response testing • Document any remaining incidents 80
Affidavits • Within 10 days after the conclusion of testing, Non Public Test Coordinators and Test Administrators must: – Submit signed affidavits to all LEA Test Coordinators • Within 15 days after the conclusion of testing, LEAs must: – File with OSSE the signed affidavits 81
Test Integrity Investigations • OSSE reviews every allegation of test security violation to determine the appropriate course of action. • OSSE reviews test security protocols and data to ensure the tests were administered with fidelity. • OSSE establishes standards for the investigation of any alleged violation of a law, regulation, or policy relating to testing security. • LEAs are also required to investigate allegations of test security violations and/or provide additional information to OSSE regarding allegations. • New for 2016-17, LEAs have the opportunity to lead test integrity investigations of their OSSE Identified schools. 82
Sanctions for Violations If an LEA, school, and/or individual knowingly and willingly violates the Testing Integrity Act, they may incur the following sanctions: LEA/School: • Payment of expenses incurred as a result of the violation; • Administrative fine; and/or • Invalidation of test scores Individual: • Denial, suspension, revocation or cancellation of, or restrictions on issuance or renewal of OSSE-issued license for a minimum of one year; • Payment of expenses incurred as a result of the violation; and/or • Administrative fine 83
Questions?
ACCESS for ELLs 2.0 2017-18 Test Administration
ACCESS for ELLs 2.0 Objectives LEA Test Coordinators will be able to: • identify ACCESS for ELLs 2.0 testing dates, administrative roles, and testing platform • describe ACCESS for ELLs 2.0 test administration procedures 86
ACCESS for ELLs 2.0Assessment ACCESS for ELLs 2.0 is a secure large-scale English language proficiency assessment administered to Kindergarten through 12th grade students who have been identified as English Learners. It is given annually in WIDA Consortium member states to monitor students’ progress in acquiring academic English. WIDA English Language Development Standards Domains Listening Speaking Reading Writing 87
Who Can Administer ACCESS • Test Administrators (TAs)- are responsible for administering the Test to students • Test Coordinators (TCs)- are responsible for managing the administration of the ACCESS for ELLs 2.0 Assessment • TAs and TCs are responsible for reviewing the District of Columbia’s ACCESS for ELLs Checklist located on www.WIDA.us 88
Test Coordinator Tasks Before Test Administration • Log in to your WIDA account and agree to the Non-Disclosure and User Agreement • Log in to WIDA AMS and agree to test security terms • Watch all tutorials located in the Preparing dropdown menu in the ACCESS for ELLs 2.0 Training course • Review the District and School Test Coordinator Manual • Add new students to WIDA AMS and assign them test sessions • Watch all tutorials located in the Testing dropdown menu in the ACCESS for ELLs 2.0 Training course 89
Test Coordinator Tasks During Test Administration • Coordinate ordering additional test materials if warranted • Monitor student progress in WIDA AMS • Securely store all test materials 90
Test Coordinator Tasks After Test Administration • View the After Testing tutorial located in the Afterward dropdown menu in the ACCESS for ELLS 2.0 Training course • Prepare any test materials to be returned to DRC 91
Test Administrator Tasks Before Test Administration • Log in to your WIDA account and agree to the Non-Disclosure and User Agreement • Log in to WIDA AMS and agree to test security terms • Download and print the Test Administration Manual to become familiar with policies and procedures • Print any additional materials needed to administer the test • Watch any tutorials located in the TEsting dropdown menu in the ACCESS for ELLs 2.0 Training course 92
Test Administrator Tasks • Take the Online Administration Quiz – Log in to www.WIDA.us – View the training modules for each test being administered – TAs must score an 80% or higher on each quiz – Training certificates will be updated as a record of completion 93
Test Administrator Tasks Click the training tile for the test you will be administering. You can only administer tests for trainings you have completed. 94
Test Administrator Tasks During Test Administration • Monitor and supervise students during the testing session • Distribute test tickets to students when they are ready to begin testing • Follow directions provided in the manuals and scripts • Collect and account for all test materials and return them to the TC 95
Test Administrator Tasks After Test Administration • View the After Testing tutorial from the Afterward dropdown menu in the ACCESS for ELLs 2.0 Training course • Work with the TC to ensure all testing materials have been collected and returned 96
Questions?
Alternate Assessments 2017-18 Test Administration
Alternate Assessment Objectives LEA Test Coordinators will be able to: • identify MSAA testing dates, administrative roles, and testing platform • describe MSAA test administration procedures 99
Multi-State Alternate Assessment The Multi-State Alternate Assessment (MSAA) was developed to ensure that all students with significant cognitive disabilities are able to participate in an assessment that measures what they know and can do in relation to grade-level State Content Standards Participation Criteria Criteria Descriptors A disability or multiple disabilities that The student has a significant cognitive disability significantly impact intellectual functioning and adaptive behavior Goals and instruction listed in the IEP for the The student in learning content linked to grade- student are linked to the enrolled grade-level level content standards content standards The student requires extensive, direct (a) extensive, repeated, individualized individualized instruction and substantial instruction and support supports to achieve measureable gains in a (b) substantially adapted materials and grade-and age-appropriate curriculum individualized methods 100
Who Can Administer the MSAA • Test Administrators (TAs)- are responsible for administering the Test to students • Test Coordinators (TCs)- are responsible for managing the administration of the MSAA test Who can perform actions in the MSAA Online Assessment System? 101
Test Coordinator Tasks Before Test Administration • Complete the MSAA test administration training for TCs – focuses on information in the Test Administration Manual (TAM) – helps safeguard testing integrity – TCs are not required to take the final quiz – www.msaaassessment.org Module Module Title Module 1 MSAA Overview Module 2 Test Design and Experience Module 3 Completing the Student Information Module 4 Create Users and Orgs Module 5 Student Response Check and the Early Stopping Rule Module 6 Navigating the MSAA Online Assessment System 102
Recommend
More recommend
