Creating Dashboards of Direct and Creating Dashboards of Direct and Creating Dashboards of Direct and Creating Dashboards of Direct and Indirect SLOs Measures in R Indirect SLOs Measures in R Indirect SLOs Measures in R Indirect SLOs Measures in R Dr. Chris Boosalis, Dr. Oddmund Myhre, and Binod Pokhrel, MS ECE
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Introduction • Development of an assessment system within a College of Education • Delivering the assessment system campus wide • Using dashboards to assist in closing the loop • Server architecture, maintenance, security, and costs
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu OUTCOMES How to retain meaning of assessment measures at multiple levels of the organization? How to track the effects programmatic and curricular changes? How do we close the loop at regular intervals – not just at accreditation time? How to use free and open source tools to manage assessment data?
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu University/College Mission University Learning Outcomes Accreditation Requirements Program Learning Outcomes Course Learning Outcomes Multiple Measures of Student Learning
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Making Meaning of Multiple Measures Technological Skills Collaborative Ethical Skills Practice Subject Pedagogical Matter Skills Knowledge Data Driven Multicultural Decision Competence Making Goal: Subject Working with Leaders in Matter English Competence Learners Learning
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Multiple Measures of Learning Outcomes: • Employer Surveys CLOSING • Student Surveys • Performance Assessments THE LOOP • Tests • Clinical Evaluations • Direct Assessments
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Example Measures of Professional Competency Learning Outcome: Leaders in Measures of Measures of Learning Reflective Professional Practices Engagement
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu PROFESSIONAL COMPETENCY: Subject-matter Evaluations Clinical Evaluations Course Assignments Technology Mastery Ethical Practice
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu REFLECTIVE LEADERS Assessment Data-driven Decision Making Intellectual Engagement Lifelong Learning
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu PROFESSIONALS ENGAGED Collaboration Leadership Innovation Advocacy
STATIC BAR CHARTS
Improved Assessment within a College Aligning Direct and Indirect Assessments to Student Learning Outcomes
Table 1 Hypothetical Alignment of Fictitious Program Standards to an SLO SLO Elementary Secondary Ed Specialist Nursing Social Work Psychologist Wide Wide -Wide Wide Providing Differentiating Differentiating Differentiating Culturally Culturally Culturally essential instruction for instruction for instruction for responsive responsive responsive services to English learners English learners English learners health care for services for therapy for language- diverse diverse diverse minority linguistic linguistic linguistic communities groups groups groups - - Improved College- Assessment Assessment Assessment Assessment Improved College Improved College Improved College Table 2 Hypothetical Alignment of Fictitious Program Standards and Fictitious Direct and Indirect Measures SLO Program Program Standard Direct Measure* Indirect Measure* Teaching Performance Differentiating instruction for Student Exit Survey, Elementary Assessment, Rubric Element English learners Question 13 10 Teaching Performance Differentiating instruction for Student Exit Survey, Secondary Assessment, Rubric Element English learners Question 13 10 SLO 1: Providing Teaching Performance essential services Differentiating instruction for Student Exit Survey, Ed Specialist Assessment, Rubric Element to language- English learners Question 13 10 minority Culturally responsive health communities Clinical Assessment, Rubric Program Exit Survey, Nursing care for diverse linguistic Element 12 Question 22 groups Culturally responsive services Clinical Assessment, Rubric Clinical Exit Survey, Social Work for diverse linguistic groups Element 13 Question 23 Culturally responsive therapy Field Experience Assessment, Field Experience Survey, Psychologist for diverse linguistic groups Rubric Element 14 Question 24
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Scaling up to University-wide Assessment Aligning Direct and Indirect Assessments to Student Learning Outcomes
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu HYPOTHETICAL ALIGNMENT OF FICTITIOUS PROGRAM ASSESSMENTS TO AN SLO ACROSS MAJORS
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Shiny Server
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu / System System System System Ubuntu 14.04 LTS 64 bit OS Binod Pokhrel – binod.pokhrel@csus.edu All updates installed Ubuntu Package for R, Rbase Curl and CRAN Repository All dependencies Shiny GoogleVis
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu / Operational and maintenance cost Operational and maintenance cost Operational and maintenance cost Operational and maintenance cost Binod Pokhrel – binod.pokhrel@csus.edu Internal Server Skilled IT – Minimal running cost Minimal Hardware requirement External Support - $ 200 - $1500 / Year for the server side (Ubuntu) https://www.ubuntu.com/support/plans-and-pricing Vendor -E.g. Digital Ocean (Monthly recurring cost) http://deanattali.com/2015/05/09/setup-rstudio-shiny-server-digital-ocean/#sign-up
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu / Deployment and Server security Deployment and Server security Deployment and Server security Deployment and Server security Binod Pokhrel – binod.pokhrel@csus.edu - Physically Transfer - Shared Disk - SFTP Security – Firewall Proper Authentication Regular Log checks
Fusion Registry and R
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Fusion Registry – Chris and Matt Nelson (UK)
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu Slice and Dice
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu SDMX Data – 23,000 Records Parsed
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Chris Boosalis – chris.boosalis@csus.edu / Oddmund Myhre – omyhre@csustan.edu
Recommend
More recommend
