center fidelity survey
play

Center Fidelity Survey IUCRC Evaluators Meeting June 8, 2012 Denis - PowerPoint PPT Presentation

Industry/University Cooperative Research Centers Center Fidelity Survey IUCRC Evaluators Meeting June 8, 2012 Denis Gray, Lindsey McGowen, Olena Leonchuk & Sarah DeYoung North Carolina State University Background and Goal


  1. Industry/University Cooperative Research Centers Center Fidelity Survey IUCRC Evaluator’s Meeting June 8, 2012 Denis Gray, Lindsey McGowen, Olena Leonchuk & Sarah DeYoung North Carolina State University

  2. Background and Goal Industry/University Cooperative Research Centers • Background – IUCRCs have recently exhibited some heterogeneity on how consortially they operate – Questions have also come up about the extent to which IUCRCs represent “team science” (e.g., multidisciplinary, team -based0 • Goals – Examine the extent to which IUCRCs exhibit fidelity to the consortial model – Examine the extent to which IUCRCs practice “team science” – Explore the relationships among these variables June 2012 IUCRC Evaluation Team 2

  3. Methodology Industry/University Cooperative Research Centers • Questionnaire – Completed by evaluator rating center practices and operations (e.g. meeting attendance) – N=48 • Merged with archival data – Structural data – Process/Outcome data June 2012 IUCRC Evaluation Team 3

  4. Which of the following best describes how this multi-site center operates: Industry/University Cooperative Research Centers Decision Making 14.9% 48.9% 36.2% Center-based mostly Center-based Site-based June 2012 IUCRC Evaluation Team 4

  5. Estimate the percentage of total IAB who physically attended this meeting: Industry/University Cooperative Research Centers Last Meeting 6.3% 4.2% 0-20% 20.8% 21-40% 45.8% 41-60% 61-80% 81-100% 22.9% June 2012 IUCRC Evaluation Team 5

  6. If face-to-face meeting, which of the following best describes the attendance at the meeting: Industry/University Cooperative Research Centers Last Meeting 14.6% Equal attendance across sites Host site dominant attendance 18.8% Other 66.7% June 2012 IUCRC Evaluation Team 6

  7. Which of the following new project decision-making procedures best describes how new research proposals are selected/approved at this center: Industry/University Cooperative Research Centers Project Selection 12.5% 12.5% 4.2% 70.8% Consortial Site-based Consortial Modified Member-based Member-based June 2012 IUCRC Evaluation Team 7

  8. Which of the following statements best describes how this center provides project results to their dues-paying IAB members: Industry/University Cooperative Research Centers Results Dissemination 2.1% 22.9% 75.0% Consortial Modified member-based Member-based June 2012 IUCRC Evaluation Team 8

  9. Please check the response that most accurately describes the estimated frequency of collaborative projects (project involving multiple PIs) within this center Industry/University Cooperative Research 2.1% Centers Single PI Multi-PI 0.0% 0% 2.4% 6.6% 7.3% 14.6% 1-20% 7.3% 14.6% 21-40% 43.8% 41-60% 19.5% 61-80% 48.8% 31.3% 81-100% 2.9% 4.8% 2.9% 4.8% 4.8% 31.0% 4.8% 41.2% 52.9% 54.8% June 2012 IUCRC Evaluation Team 9 Multi-disciplinary Multi-site

  10. Industry/University Cooperative Research Centers Predictive Analyses Preliminary Findings June 2012 IUCRC Evaluation Team 10

  11. Question? Industry/University Cooperative Research Centers • What are the consequences of operating at varying degrees of fidelity? – Does it have implications for structural outcomes? – Does it have implications for factors measured by the process/outcome questionnaire or fidelity questionnaire (e.g. multidisciplinarity)? June 2012 IUCRC Evaluation Team 11

  12. Methodology Industry/University Cooperative Research Centers • Creating Fidelity Scale – Dichotomize Q2 (decision making), 15 (project selection) &16 (results dissemination) • 1 = high fidelity • 0 – low fidelity – Sum across those variables so that the fidelity scale ranges from 0 to 3 • Predictive Analyses – Bivariate correlations, for now… June 2012 IUCRC Evaluation Team 12

  13. Significant Correlates with Fidelity* Industry/University Cooperative Research Centers 1 2 3 4 5 6 1. Fidelity 48 2. % Members Physically Attending 0.31* 48 3. % Projects Interested 0.30* 0.38* 43 4. % CD time spent teaching -0.35* -0.17 0.09 48 5. Members Added -0.32* -0.17 -0.63** -0.08 48 6. Members Dropped -0.33* -0.44** -0.45** 0.01 0.65** 48 Note: N reported along the diagonal; * p < .05, ** p < .01 *Caution: we evaluated about 50 bivariate correlations. June 2012 IUCRC Evaluation Team 13

Recommend


More recommend