8/6/2009 Opening Discussion Agenda Using NSSE and CLA � Opening discussion/foundations 1. How familiar are you with NSSE? in Concert � NSSE+ CLA administration 2. What are the benefits and opportunities options created by combining NSSE and CLA data? created by combining NSSE and CLA data? � Using NSSE+ CLA data � Closing discussion 3. What obstacles stand in the way? CIC/CLA Consortium Summer Meeting 4. What are you hoping to learn from this session? August 3, 2009 2 Foundations of Student What Do We Need to Know? Engagement “All learning and development What constitutes quality in Quality of effort (Pace) undergraduate education? requires an investment of time Student involvement (Astin) How might we measure and effort by the student. and effort by the student.” quality? q y S Social and academic integration i l d d i i t ti What types of evidence of (Tinto) quality would be helpful in guiding improvement Good practices in undergraduate Pace, C. R. (1984). efforts? education (Chickering & Gamson) Measuring the quality of college student experiences. Learning and development model (Pascarella) 1
8/6/2009 Path Model for Assessing Change Design Goal Key Challenges in Student Learning (Pascarella) Interactions 1. How do we interpret with Agents of Structural/ Organizational Socialization the relationship � Maximize matching of CLA CLA Characteristics between engagement of Institutions and NSSE results at the scores and measured student level Learning and g Cognitive learning outcomes? � Affords appropriate analyses Development NSSE of the relationship between CLA performance and 2. How do we use these student engagement Institutional in our work? Student Environment Background/ Precollege Traits Quality of Student Effort 8 9 Two NSSE Administration NSSE Administration NSSE-CLA Options Options Data Collection Timeline � Standard Administration Standard NSSE Local NSSE Precollege First year Soph. year Junior year Senior year Administration Administration � For institutions planning to administer NSSE in 2010 CLA administered first (fall). CLA administered first (fall). CLA administered first (fall). CLA d i i t d fi t (f ll) Participants identified by Participants identified for local First-year institution and included in spring NSSE administration (paper) in � Local Administration NSSE sample (oversample may spring. NSSE CLA be necessary). � For 2007, 2008 or 2009 NSSE participants not CLA NSSE NSSE administered first (spring). participating in 2010 Local NSSE administration NSSE respondents identified by Student I D Senior (paper) in spring as part of CLA institution using NSSE interface administration. and invited for CLA. Student I D BCSSE 10 11 2
8/6/2009 Standard NSSE Standard Administration: Local NSSE Administration: Administration: Details Special Considerations Details Sample Sizes (FY+ Sr) and Fees � Identify first-year CLA participants for inclusion � Institution administers paper survey in NSSE sample (oversample fee may apply) � Surveys returned to NSSE for scanning and Undergrad Paper Web+ Web-only Sampling Enrollment Sample Size Sample Size Sample Size Fee � Monitor senior NSSE administration (using data file preparation < 4,000 450 1,800 Census $3,375 NSSE W b t NSSE Web tool) to identify CLA invitees l) t id tif CLA i it 4,000-7,999 600 2,400 Census $4,500 � Participation fee of $500 8,000-12,000 800 3,200 Census $6,000 � Promotion is vital: invitation does not ensure � $3.00 per survey shipped (nonrefundable) > 12,000 1,000 4,000 Census $7,500 participation $300 Participation fee also applies Oversampling Fees (per student) Web-only $1.50 Paper (NSSE-administered) $7.50 Paper (institution-administered) $2.00 13 14 15 Local Administration: BCSSE Option Making Sense of Results Special Considerations Institution must… � Administer the Beginning College Survey of � Now that you have NSSE data Student Engagement as a census during � Handle all logistics for survey administration orientation or before classes start matched with CLA data, what � Follow administration protocol for survey p y do you do with it? do you do with it? � A � Assess precollege engagement e p e ollege eng gement invitation and administration, in accordance � Assess expectations for engagement during with IRB requirements college � Implement special procedures to enter student � Link to first-year CLA and NSSE results IDs on NSSE surveys, to enable linking with CLA results � For information and registration information, go to www.bcsse.iub.edu 16 17 18 3
8/6/2009 Sample Assessment Topics: Sample Study Topics: Sample Study Topics: First-Year Students Seniors Seniors (continued) � Examine the relationship between baseline � Examine the relationship between student � Adjusting for precollege achievement scores CLA performance and first-year engagement activities & experiences and CLA performance (SAT/ACT), do seniors who have engaged in deeper ways of learning (analysis, synthesis, � Are CLA high performers predisposed to high � Do students with high levels of senior-year integration, reflection) score better on CLA engagement? engagement? engagement perform better on CLA tasks? engagement perform better on CLA tasks? tests? � Identify students with � What is the relationship between CLA � Do students learn more when they write more? performance/engagement mismatch: performance and involvement in capstone experiences, research with faculty, etc.? High Low Engagement Engagement High CLA Low CLA 19 20 21 Sample Study Topics: Contact Us What about other data? First-Year Students w/ BCSSE � Examine the relationship between precollege � Course records www.nsse.iub.edu attributes and first-year engagement � Writing portfolio 812-856-5824 � Do students who were highly engaged in high assessments nsse@iub.edu school perform better on CLA tasks? h l f b tt CLA t k ? � Transfer students � Do students with high expectations for Bob Gonyea � Learning communities engagement in college perform better on CLA rgonyea@indiana.edu tasks? � Other student subpopulations 22 23 4
CIC-CLA Consortium: Using NSSE and CLA in Concert Options for Combining CLA and NSSE Administrations to Maximize Overlap at the Student Level Recent NSSE participants (2006, 2007, or Institutions already planning to 2008) not planning a regular NSSE participate in NSSE 2009 administration in 2009 NSSE administration type Standard Local Web (recommended to maximize NSSE Administration mode Paper sample); Web+ or Paper are also possible Administration process for entering students Administer BCSSE before first day of classes. Administer BCSSE before first day of classes (optional) CLA administered first (fall). CLA administered first (fall). Administration process Participants identified by institution and Participants identified for local NSSE administration for first-year students included in spring NSSE sample (oversample in spring. may be necessary). Administration process NSSE administered first (spring). NSSE Local NSSE administration (paper) in spring as part for seniors respondents identified by institution using of CLA administration. NSSE interface and invited for CLA. For information on costs, sample sizes, and other details, refer to the NSSE and BCSSE Web sites. Beginning College Survey of Student Engagement: www.bcsse.iub.edu National Survey of Student Engagement: www.nsse.iub.edu
Recommend
More recommend
