Dashboard Review First Quarter of FY 2015 Joe Selby, MD, MPH - PowerPoint PPT Presentation

Dashboard Review First Quarter of FY 2015 Joe Selby, MD, MPH Executive Director Michele Orza, ScD Senior Advisor to the Executive Director

Presentation Overview • Evolution of our Board of Governors’ Dashboard from 2013 • Latest revisions • Overall organization and types of graphics • Noteworthy and Yellow-flagged items • Examples of background slides • Examples of metrics proposed for Committee dashboards

Discussion Questions • Are there metrics that should be revised or retired or moved to the Committee Dashboards? • Are there new or different metrics suggested by today’s presentation and discussion? If so, are they appropriate for the Board or one of the Committees ? • What further improvements should we consider so that our Dashboard and accompanying materials effectively convey the status of our work and progress toward our goals ?

Our End-of-CY 2013 Dashboard

Our End-of-FY 2014 Dashboard

Legend *Influencing Research* On Target Q2=Q2 2014 PCORI inspired the American Heart Association to pilot the Citizen Scientist Think Tank, Board of Governors Off Target NA Q3=Q3 2014 intended to foster patient engagement in the design of heart disease and stroke research FY2015 Dashboard – Q1 Needs Attention Q4=Q4 2014 Our Goals: Increase Information, Speed Implementation, and Influence Research (As of 12/31/2014) Q1=Q1 2015 NA=Not Applicable Funds Committed to Research – Budget=$640M Projects Awarded Percent of Projects Meeting All Milestones Targeted Pragmatic Broad 100 Q2 Q1 Q2 Q3 Q4 PCORnet Engagement 90 30 Percent Meeting All Q3 Number of Projects 80 Budget 70 Q4 60 20 Q1 50 40 Actual 30 10 20 10 NA 0 100 200 300 400 500 600 0 0 Research Engagement PPRNs CDRNs $ Millions Q1 Q2 Q3 Q4 Completion of Projects Journal Articles Published Uptake of Methodology Standards 30 30 Q2 7,000 Q2 35 Expected Q3 Q3 6,000 25 30 Actual Number of Projects Q4 Q4 5,000 20 25 20 Number of Articles Q1 Q1 4,000 20 15 3,000 15 10 10 2,000 10 5 1,000 5 0 0 0 0 0 0 Web Views Citations By Awardees About or By PCORI Q1 Q2 Q3 Q4 Expenditures – Total Budget=$362M Progress of PCORnet Q1 Q2 Q3 Q4 Version Obesity Research Phase II 2.0 of Cohort Budget PFA CDM Project Phase II Research Released Complete Awarded awarded Actual Other Q1 Budget Other Governance Aspirin Health =Target Q1 Q2 Q3 Actual policies Trial Systems =Actual approved Awarded Projects 0 50 100 150 200 250 Awarded $ Millions

Concerns with FY 2014 Dashboard and Revisions in FY 2015 Dashboard Concern with FY 2014 Dashboard Revision in FY 2015 Dashboard Cluttered – too many items Cut from 17 boxes to 9 Hard to read Remaining items enlarged Arrow graphics difficult to interpret Replaced with horizontal bar charts PCORnet arrow provided no information PCORnet timeline with key milestones • Many metrics not right level for Board Focused more on key Outputs and Goals • Others moved to Committee Dashboards

Legend *Influencing Research* On Target Q2=Q2 2014 PCORI inspired the American Heart Association to pilot the Citizen Scientist Think Tank, Board of Governors Off Target NA Q3=Q3 2014 intended to foster patient engagement in the design of heart disease and stroke research FY2015 Dashboard – Q1 Needs Attention Q4=Q4 2014 Our Goals: Increase Information, Speed Implementation, and Influence Research (As of 12/31/2014) Q1=Q1 2015 NA=Not Applicable Funds Committed to Research – Budget=$640M Projects Awarded Percent of Projects Meeting All Milestones Targeted Pragmatic Broad 100 Q2 Q1 Q2 Q3 Q4 PCORnet Engagement 90 30 Percent Meeting All Q3 Number of Projects 80 Budget 70 Q4 60 20 Q1 50 40 Actual 30 10 20 10 NA 0 100 200 300 400 500 600 0 0 Research Engagement PPRNs CDRNs $ Millions Q1 Q2 Q3 Q4 Completion of Projects Journal Articles Published Uptake of Methodology Standards 30 30 Q2 7,000 Q2 35 Expected Q3 Q3 6,000 25 30 Actual Number of Projects Q4 Q4 5,000 20 25 20 Number of Articles Q1 Q1 4,000 20 15 3,000 15 10 10 2,000 10 5 1,000 5 0 0 0 0 0 0 Web Views Citations By Awardees About or By PCORI Q1 Q2 Q3 Q4 Expenditures – Total Budget=$362M Progress of PCORnet Q1 Q2 Q3 Q4 Version Obesity Research Phase II 2.0 of Cohort Budget PFA CDM Project Phase II Research Released Complete Awarded awarded Actual Other Q1 Budget Other Governance Aspirin Health =Target Q1 Q2 Q3 Actual policies Trial Systems =Actual approved Awarded Projects 0 50 100 150 200 250 Awarded $ Millions

Legend *Influencing Research* On Target Q2=Q2 2014 PCORI inspired the American Heart Association to pilot the Citizen Scientist Think Tank, Board of Governors Off Target NA Q3=Q3 2014 intended to foster patient engagement in the design of heart disease and stroke research FY2015 Dashboard – Q1 Needs Attention Q4=Q4 2014 Our Goals: Increase Information, Speed Implementation, and Influence Research (As of 12/31/2014) Q1=Q1 2015 NA=Not Applicable Funds Committed to Research – Budget=$640M Projects Awarded Percent of Projects Meeting All Milestones Targeted Pragmatic Broad 100 Q2 Q1 Q2 Q3 Q4 PCORnet Engagement 90 30 Percent Meeting All Q3 Number of Projects 80 Budget 70 Q4 60 20 Q1 50 40 Actual 30 10 20 10 NA 0 100 200 300 400 500 600 0 0 Research Engagement PPRNs CDRNs $ Millions Q1 Q2 Q3 Q4 Completion of Projects Journal Articles Published Uptake of Methodology Standards 30 30 Q2 7,000 Q2 35 Expected Q3 Q3 6,000 25 30 Actual Number of Projects Q4 Q4 5,000 20 25 20 Number of Articles Q1 Q1 4,000 20 15 3,000 15 10 10 2,000 10 5 1,000 5 0 0 0 0 0 0 Web Views Citations By Awardees About or By PCORI Q1 Q2 Q3 Q4 Expenditures – Total Budget=$362M Progress of PCORnet Q1 Q2 Q3 Q4 Version Obesity Research Phase II 2.0 of Cohort Budget PFA CDM Project Phase II Research Released Complete Awarded awarded Actual Other Q1 Budget Other Governance Aspirin Health =Target Q1 Q2 Q3 Actual policies Trial Systems =Actual approved Awarded Projects 0 50 100 150 200 250 Awarded $ Millions

Legend *Influencing Research* On Target Q2=Q2 2014 PCORI inspired the American Heart Association to pilot the Citizen Scientist Think Tank, Board of Governors Off Target NA Q3=Q3 2014 intended to foster patient engagement in the design of heart disease and stroke research FY2015 Dashboard – Q1 Needs Attention Q4=Q4 2014 Our Goals: Increase Information, Speed Implementation, and Influence Research (As of 12/31/2014) Q1=Q1 2015 NA=Not Applicable Funds Committed to Research – Budget=$640M Projects Awarded Percent of Projects Meeting All Milestones Targeted Pragmatic Broad 100 Q2 Q1 Q2 Q3 Q4 PCORnet Engagement 90 30 Percent Meeting All Q3 Number of Projects 80 Budget 70 Q4 60 20 Q1 50 40 Actual 30 10 20 10 NA 0 100 200 300 400 500 600 0 0 Research Engagement PPRNs CDRNs $ Millions Q1 Q2 Q3 Q4 Completion of Projects Journal Articles Published Uptake of Methodology Standards 30 30 Q2 7,000 Q2 35 Expected Q3 Q3 6,000 25 30 Actual Number of Projects Q4 Q4 5,000 20 25 20 Number of Articles Q1 Q1 4,000 20 15 3,000 15 10 10 2,000 10 5 1,000 5 0 0 0 0 0 0 Web Views Citations By Awardees About or By PCORI Q1 Q2 Q3 Q4 Expenditures – Total Budget=$362M Progress of PCORnet Q1 Q2 Q3 Q4 Version Obesity Research Phase II 2.0 of Cohort Budget PFA CDM Project Phase II Research Released Complete Awarded awarded Actual Other Q1 Budget Other Governance Aspirin Health =Target Q1 Q2 Q3 Actual policies Trial Systems =Actual approved Awarded Projects 0 50 100 150 200 250 Awarded $ Millions

*Influencing Research* Early Signs of PCORI inspired the American Heart Association to pilot the Citizen Scientist Think Tank, intended to foster patient engagement in the design of heart disease and stroke research Influence on Research “ As PCORI has evolved, the notion of patient engagement has changed dramatically, and the American Heart Association (AHA) has sought more ways we can make the patient the focal point.”* The AHA was an early adopter of PCORI’s efforts to get people and organizations to focus on patient-centeredness. For example, they developed the Citizen Scientist Think Tank (CSTT) Pilot • A Community of patient and caregiver volunteers from AHA with availability and training to help design research studies for heart disease and stroke • The pilot involved 30 volunteers, was successful, and AHA’s goal now is to obtain funding and scale up to 300+ • The AHA explained that, although they are a patient advocacy organization, most of the research they fund is designed by clinicians and researchers, and the CSTT is intended to ensure that patients have a voice and the appropriate resources to engage in the research process *Marko Mijic, Government Relations Manager, American Heart Association

Funds Committed Q1 Q2 Q3 Q4 Budget by Type of Project and Fiscal Year Actual 350 0 100 200 300 400 500 600 $ Millions 58 300 Pragmatic PFAs 50 Targeted PFAs 250 Broad PFAs PCORnet 200 Pilot Projects 196 $Millions 150 244 100 50 96 25 31 9 0 1 FY 2012 FY 2013 FY 2014 FY 2015 Q1