ELTPA Assessment Tool for Placement in ELT Programs presented by: - PowerPoint PPT Presentation

ELTPA Assessment Tool for Placement in ELT Programs presented by: Centre for Education and Training

Centre for Education & Training Test Development CLBA Placement CLBLA Literacy CLBPT Streamlined CLB-OSA Online Self-assessment ELTPA (6-10) Placement

Background National launch of high-level proficiency ELT programs Need for assessment of client proficiency as a predictor of success, benchmarked-based, workforce-context language training Funding available through the ELT Initiative TCET contracted to develop placement tools for ELT in November 2004 Initially proposed in response to needs of ELT providers in Peel/Halton (Ontario) CIC request to develop as tool for national placement of ELT learners TCET contracted by ELT to develop placement tool for ELT programs

Key Strategies consistency in application of development methodology consideration for stakeholder issues ongoing consultation with experts in the field rigorous validation process

Development Team Test developer – Kasia Dziwak Task writers (4) Consultants/reviewers: test development – Gail Stewart workplace training – Judith Bond CLB validity experts (4) Advisory Group Measurement Expert

ELTPA Test Development and Validation Research CLB 2000 and test development literature ELT program surveys Development of Test expert review Specifications revisions Development of Tasks expert review and revisions validity study and revisions Field Test analysis of results and revisions Pilot ELTPA (6-10) – 350 candidates ELTPA (9-10) – 140 candidates Statistical Analysis, expert analysis Operational Forms consultation on operational forms

Successes statistical analysis of ELTPA pilot data confirms the validity of the speaking, listening, reading and writing sub-tests, and reveals reliability results commensurate with or exceeding standards for low-stakes tools positive feedback from pilot subjects and their instructors

Expert’s View Gail Stewart, Developer of CLBA/CLBPT: ELTPA design and development reflects consistent application of best practices, due consideration for stakeholder issues and a thoughtful balance among requirements for reliability, validity, ease of administration, and efficiency of scoring.

User’s View “Our Mohawk College ELT students were involved in the pilot testing of the ELT assessment tool in the fall of 2005. We were very pleased with the results! The pilot results were very much in-line with our own evaluations of the students' benchmark levels, which was excellent to know. We feel that the assessment tool has great reliability and validity. The students' too, were pleased with their experience in piloting the test. They felt it was a fair assessment of their skills and quite straightforward.” ELT Instructor at Mohawk College, Hamilton

ELTPA Instrument referenced to CLB 2000 designed for placement in ELT programs workforce-oriented tasks and ELTPA (6-10) themes four language skills and four scores time-efficient, easy to use and reliable administered by a trained assessor Funding : CIC, ELT Initiative

ELTPA (6-10) Overview proficiency across: Bm 6- through Bm 10+ for assessment of clients with prior CLB scores at Bm 6 or higher includes a screener administered and scored by a trained assessor

ELTPA (6-10) Speaking and Listening Speaking Listening 20 min, assessor facilitated 15 min, interview Task 1: Task 1 and 2: follow a phone message introduce oneself and describe/narrate an experience Task 2: Task 3: listen to a semi-formal presentation conduct an analysis Task 3: Task 4: listen to an informal conversation deliver a presentation Task 5: Task 4: follow a formal discussion participate in a discussion

ELTPA (6-10) Reading and Writing Reading Writing 45 minutes 60 min; multiple choice Task 1: Task 1: write a memo/report read an instructional email Task 2: Task 2: write a formal letter read a company policy excerpt Task 3: read and compare ideas in two opinion passages

Recommended Uses for ELTPA Instruments determine client proficiency level for placement in an ELT program provide instructors and service providers with accurate information on the clients’ proficiency facilitate program planning and development provide candidates with a better understanding of their higher-level workforce-context language skills