21 st Century Instructional Assessments: Moving from Paper to Online - PowerPoint PPT Presentation

Conference 2018 Conference 2018 21 st Century Instructional Assessments: Moving from Paper to Online WELCOME!

Presenters Judy Shandler Nancy Morello   Senior Business Analyst Supervisor, Instructional Assessment & Exams  Performance Development System Coordinator  Learning and Teaching Centre  Instructional Assessment Online Project Lead  Instructor Conference 2018

Paper-Paper Everywhere!

A Longitudinal Project (actually 2 Projects) 2015 Student Evaluation of Teaching (SET) - System Selection Project  Purpose :  Recommend an enterprise-level software system for online SET to better support teaching and learning at BCIT Conference 2018

SET System Selection Project  Approach :  Establish a working group including: ITS, Registrar, Business Analyst, Learner Services  Consult with internal and external stakeholders  Students  Instructors  Managers  Administrators  Bargaining Units  Other Canadian post-secondary Institutions  Vendors Conference 2018

SET Student Evaluation of Teaching  Feedback :  Excessive number of existing SET business processes  Eight (8) systems requiring data processing for surveys Conference 2018

SET Student Evaluation of Teaching  Feedback :  Concerns about content of questionnaire  Program/course feedback and formative student feedback  Best practices for nonstandard courses  Improving response quality and response rates  Clarity about how the process is supposed to work  Short, well-designed questionnaires with targeted questions.  Support for online evaluation  Wi-Fi can be an issue when doing evaluations on a mobile device Conference 2018

Overall Feedback. . . Not much has changed since 2013 Conference 2018

Recommendation  eXplorance Blue  Hosted in Montreal  Highly secure  Easy to use  Increases accessibility & flexibility  Improve business processes & confidentiality  10 Canadian Institutions using Blue Conference 2018

Considerations and Possible Issues  Internal versus External hosting  Privacy Policies  Sponsorship  Political sensitivity  Bargaining units  Value of surveys  Sending the correct message Conference 2018

Conference 2018

Let’s Talk About

Instructional Assessment Online (IAO) Why?  Expected  Strong commitment to Learning and Teaching for students and instructors  Clear understanding of the evaluation system and process  Ease of administrating Conference 2018

IAO Project Team  Sponsor(s)  Executive Sponsor  Business Sponsor  Project Manager (Vendor)  Project Lead  System Administrator  Data Administrator  Marketing  Web Design Conference 2018

IAO Project Goals  Phase out paper base surveys  Reduce admin tasks  Improved survey access for faculty, management and supporting staff  Improved survey deployment to students  Secured central access to reports  Ability for faculty to select from question banks  Improving quality of surveys Conference 2018

IAO Project Deliverables  Phased implementation of eXplorance Blue  Training  Requirements doc.  Communication plan (incl. MarCom, SA, Faculty, Management, etc.)  Install and integrated with BCIT’s single sign on (SSO) Conference 2018

Survey Design and Questions  Assessment Model Conference 2018

Survey Design and Questions  13 Core Questions  12 Likert scale questions  1 comment/feedback question  Extensive Question Bank Questions  5 additional Likert scale questions  2 additional comment/feedback questions  Either from question bank  Or customized by instructor  Important!  Getting agreement (standard questions & question bank)  Instructors & Bargaining Units Conference 2018

Communication Plan  Emails to:  Instructors  Program Heads  Program Assistants  Associate Deans  Deans  Main Message:  Highly secure  Easy to use  Increases accessibility and flexibility  Improves business processes and confidentiality Conference 2018

STOP!!! Conference 2018

Security - PIA Conference 2018

Communication Plan (cont’d . . .)  Website  Overview  About IAO  Survey Questions  Instructor Toolkit  Student Toolkit  FAQ  Contact us Conference 2018

Communication Plan Includes:  Meeting with all Schools and Departments:  Instructors  Program Heads  Program Assistants  Associate Deans  Deans  Student Association (SA)  Email  Main Message  Autonomous  Highly secure  Easy to use  Increases accessibility and flexibility  Improves business processes and confidentiality Conference 2018

Features  Reports  Instructors  Associate Deans  Customize Administration for Instructors  Change survey dates  Opt out  Monitor response rates  Increase Engagement  Instructors can verify their courses and enrollments maintaining student anonymity Conference 2018

Phases  Part-Time Studies  Distance Ed  Full-Time Course  Labs and Clinical Conference 2018

Nancy Morello Judy Shandler nancy_morello@bcit.ca judy_shandler@bcit.ca 2 Conference 2018