Library y Services D Data: Assessing Impact o t on Stu tudent t - PowerPoint PPT Presentation

Library y Services D Data: Assessing Impact o t on Stu tudent t Success in a a Data-Informed ed C Colleg ege Presente ted b by B Bob H Holzmann, M M.B.A., Systems & & Dig igit ital l Technologies L Lib ibraria ian November 9, 2018 Oklahoma Association of College and Research Libraries

Library Services Data: Assessing Impact o t on Stu tudent t Success Team m member ers: Adam am B Bren ennan an, Aman anda R a Ross, Josh B Barnes es, B Bob ob H Hol olzman ann ( (lead ader er), Step ephan anie Ingold (librar ary m manag agem emen ent l liai aison on), P Paula S a Set ettoo oon ( (Dean an)

The Li Library Services Assessment t Plan • Executive Summary • Background Details • 7 parts: Methods & Data Info • Conclusion • Bibliography

Library Ser Servic ices es Assess ssessment Plan • Library Services Impact Upon Student Success: Method and Data • Recommendations • Implementation

Backg kground: “ “In the B Beginning” • No Existing Formal Library Assessment Plan • Assessment? What is Library Assessment? • Reasons to assess library services? • Why Count, Measure, and Report?

Our S Str trategic P ic Plan: G Goals ls, O , Obje ject ctiv ives • College and Library Strategic Plans Goals & Objectives • TCC Goal: Performance Based Culture • TCC Objective: Institutional Effectiveness Plan • Library Objective: Create a formal services evaluation plan • Library Objective: Tie data to operations, activities, programs , etc.

Data: W Why W We e Count, M t, Mea easure, R Report • A “Data-informed” Organization • Evidence-based Performance, Evaluation • Qualitative versus (or plus) Quantitative • Justify, Improve, Add Library Services • Workload measures: Staffing, Hours, Output • Bragging Rights !

Asses essment Plan M Methods, Da Data Routine Data Electronic Focus Resources Groups Collection Surveys Assessment Impact on Other Student Department Services Success

Routine Da e Data / / Library Annu nnual R Report • Library Computer Lab: use by log-ins • Print and online: usage & holdings • College-wide Totals: not by campus • Technical Services: workload output • Provide counters: all library entrances

Acq cquir ire & & Use e Data: F Focu cus G Groups • Qualitative assessment method: Hard & Soft Data • Couple with customer service mapping technique • Limit number of issues, participants • Explore specific areas of satisfaction/dissatisfaction • Combine: library surveys with focus groups • Collect Data: Analyze, Interpret, Report, Decide

Acq cquir ire & & Use e Data: S Surveys • Qualitative or quantitative methods • TCC’s college-wide surveys • Conduct: limited library-only surveys • Create: Internal library survey instrument • Combine: library surveys with focus groups • Collect Data: Analyze, Interpret, Report, Decide

Acq cquir ire & & Use e Data: E E-Resou ources ces S Stats ts • Bi-annual Usage Reports revised • Online Articles, E-Books, E-Videos, E-Reference • Usage/Cost Data for analysis, selection, planning • Cost Analysis: Print vs. E-Resources • Usage, Holdings data for IPEDS and ACRL • Access data logs: Statistical impact on student success

Colle lect ctio ion A Asses essment • Custom Reports to Evaluate Collections • Interlibrary Loan (ILL) requests analysis • Missing and Lost items • Electronic Resources versus Print • Online Resources for New Academic Programs • Open Access Collections and OER

Ot Other er D Departm tmen ents ts’ Services ces within t the L Library • Services in the library provided by other departments • Effect students' use and perception of the library • Future assessment of such services

The T e Top op M Mea easure: S : Stu tudent S Succe ccess • Academic Achievement: GPA • Persistence: 3 years to completion • Completion = Graduation or Transfer • Degree and Certificate Programs So, what impact do library services have upon student success?

Li Library S Ser ervic ices I Impact on on Stu tudent S Succ ccess • Historically, assessment of library effect on academic success was impossible to measure and quantify • How to achieve quantitative evaluation using hard data and make the connection? • Recent published studies about statistical methods to correlate library use and student success • Embark on a journey into new assessment territory that few others (and no community colleges) have explored

Li Library S Ser ervic ices I Impact on on Stu tudent S Succ ccess • Soria, Fransen, and Nackerund’s & other studies demonstrating library impact on student success • Methods for obtaining our data are in place • Investigate possible correlation and impact: • Multivariate statistical analyses • Longitudinal studies • Creative improvements to methodology • Longer-term predictive studies

Li Library S Ser ervic ices I Impact on on Stu tudent S Succ ccess • Approval from TCC’s Institutional Review Board (IRB) • Strengthening TCC Partnerships: 1. Institutional Research & Assessment (IR&A) 2. Information Technology Infrastructure Services (ITIS) 3. Academic Departments & College Leadership • Statistical methods couple Library users’ data with student information, academic data, other services • Balanced mix of quantitative and qualitative

Data: Impac pact on n Stud udent S t Suc uccess • Points of Service (POS): Contact via systems or staff • Library academic services that impact student success • Data Points defined for library services • Systems Enhancements and Planning

Data: Servi vices f for Stud udent S t Suc uccess ss Computers Use Circulation Reserves Interlibrary Electronic Loan Resources Study Reference Rooms Desk

Data: Servi vices f for Stud udent S t Suc uccess ss Computers Library Computers Used Use Circulation Reserves • Successful Logins • Computer Hostname Interlibrary Electronic • Grouped by Campus Library Loan Resources • Provided each Semester Study Reference Rooms Desk • I.T. gets files from archived logs

Data: Servi vices f for Stud udent S t Suc uccess ss Computers Use Circulating Collections Circulation Reserves • Check-outs and Renewals • Worldshare Mgmt System Interlibrary Electronic Loan Resources • WMS Reports/Analytics • Provided from WMS database Study Reference Rooms Desk

Data: Servi vices f for Stud udent S t Suc uccess ss Computers Use Course Reserves Use Circulation Reserves • Check-outs and Renewals • Worldshare Mgmt System Interlibrary Electronic Loan Resources • WMS Reports/Analytics • Reported by Semester Study Reference Rooms Desk

Data: Servi vices f for Stud udent S t Suc uccess ss Computers InterLibrary Loan Use • OCLC Tipasa ILL Circulation Reserves • Data Export to Excel Interlibrary Electronic • Borrowing: Closed, Supplied Loan Resources • Enhancement Summer 2018 Study Reference Rooms Desk • Reports last 400 transactions

Data: Servi vices f for Stud udent S t Suc uccess ss Computers Electronic Resources Use Use • EZproxy Custom SPU logging Circulation Reserves • SPU log rolls-over monthly Interlibrary Electronic • ALL Authentication Required Loan Resources • Subscription e-Resources Study Reference Rooms Desk • SPU logs copied, converted

Data: Servi vices f for Stud udent S t Suc uccess ss Study Rooms Use Computers Use • Think Tanks, Library Classrooms Circulation Reserves • All students TCC IDs in a group Interlibrary Electronic • Springshare LibApps Loan Resources • TCC ID required field added Study • LibWizard Survey Report export Rooms

Data: Servi vices f for Stud udent S t Suc uccess ss Library Instruction Research Online Chat Consultations and Email Collaborative Faculty Spaces Consultations Librarian Mobile Liaison Texting

Data: Servi vices f for Stud udent S t Suc uccess ss Library Instruction Library Instruction • Librarian as the Instructor Research Online Chat Consultations and Email • Library Instruction in any classroom • Faculty, Course Number, Section Collaborative Faculty Spaces Consultations • TCC ID in data for Course & Section • Librarians enter data in LibInsight Librarian Mobile Liaison texting • LibInsights database export

Data: Servi vices f for Stud udent S t Suc uccess ss Library Research Consultations Instruction Research • Librarian provides direct service Online Chat Consultations and Email • Appointment or “walk in” • TCC ID may be entered by Librarian Collaborative Faculty Spaces Consultations • Librarians enter data in LibInsight Librarian Mobile • LibInsights Database Export Liaison texting

Data: Servi vices f for Stud udent S t Suc uccess ss Library Online Chat and Email Instruction Research Online Chat • Chat form has TCC ID field Consultations and Email • LibAnswers stats transcripts export Collaborative Faculty • Email questions, our AskUs Service Spaces Consultations • Email form includes the TCC ID Librarian Mobile • LibAnswers stats tickets export Liaison texting