PRESENT: Pragmatic engineering of themes from large volume text to improve healthcare http://www.present.org.uk/ CPES – Cancer Patient Experience Survey - Freetext comments Dr Carol Rivas, Sydney Anstee Dr Daria Tkacz, Dr Don Cruickshank
What is CPES? • Cancer Patient Experience Survey • The English Cancer Patient Experience Survey (CPES) is commissioned by NHS England and administered on their behalf by an external survey provider organisation (Quality Health). • The survey provides insights into the care experienced by cancer patients across England who were treated as day cases or inpatients. Further details, including access to the latest report can be found at: • https://www.quality-health.co.uk/surveys/national-cancer-patient- experience-survey 2
Current process of freetext from CPES 59 Tick box questions & 3 freetext comment boxes in the survey 75,000 freetext comments per year (approx.)
A new and timely process needed Rapid process 75,000 Accurate representation of patients views freetext comments Visual summary (approx.) Useable in Service Improvement Representative of Patients views and Usable for HCPs
Development of the Dashboard • Literature review • Discrete choice experiment survey • Concept mapping workshops with patients • Individual interviews with patients • TEXT ENGINEERING – sensitivity developments • PRESENT dashboard ready for Proof of Concept testing……..
Thematic summary – Dashboard
• We used freetext comments from 2013 CPES Wales to populate the Dashboard Representative of Patients views and Usable for HCPs
Structured Walkthrough with Health Care Professionals (HCPs) DASHBOARD – proof of concept 2 hours (max) video/ audio-recorded interviews in usual work place Objective: find defects and errors from the users’ point of view In order to: improve the quality and effectiveness of a product Structured Walkthrough Interview aims: • Is the dashboard Usable? (standard usability principles, Nielson’s Heuristic Evaluation) • Can role relevant tasks be accomplished? (based on Goal Directed Design, Alan Cooper) • Implementability of the dashboard? (Normalisation, impact, evaluation, Carl May) • Diffusion of Innovation: self-assess where they & organisations fit on innovator-adopter scales
WALKTHROUGH INTERVIEW PARTICIPANTS Professional roles we Locations Gender Total planned to recruit from: Completed London, Leeds and 1 male Lead GPs 3 Southampton 2 female Ward managers; Nurse director London 1 female 2 London 1 male Associate directors, lead clinicians, Southampton and Leeds 2 male 2 Members of the Trust Board Lead commissioners in CCGs Southampton 1 male 1 Lead members of multidisciplinary Southampton, London and 2 female 3 treatment teams (MDT) Leeds 1 male Other – Data Analyst in NHS Southampton; London 1 male 2 Improvement (A&E); Patient 1 female Experience Leads 1 N= 13 6 HCPs agreed to participate, were London, Leeds and 0 booked, but later cancelled: Southampton All Nurse directors and managers Walkthroughs conducted: 23 rd March - 21st April 2017 (15 planned, 13 completed)
Positives Challenges and Opportunities Usability Overall Intuitive - Simple Infographic – easier to interpret ‘easy on the eye’ Navigation – add some tools Themes/comments good Severity: Not market-ready yet Goals Needs are easy to identify Timely data Justifications for Text sensitivity improvements Export/ report function Successes (morale and sharing) Implementation Value and purpose Could freetext from other sources be Likely support of use (Ind included &Org) Who will fund and support Possible new initiatives Should be open to all & not heavily protected Other Tensions between Performance Targets and Patient Experience “Could revolutionise”; “be phenomenal”; Overall “replace all the others”…. If Changes can be made
ANY QUESTIONS? For further contact - Carol Rivas: c.a.rivas@soton.ac.uk http://www.present.org.uk/
Funding acknowledgement This presentation summarises independent research funded by the National Institute for Health Research (Health Services and Delivery Research, 14/156/15 - PRESENT: Patient Reported Experience Survey Engineering of Natural Text: developing practical automated analysis and dashboard representations of cancer survey freetext answers). The views expressed herein are those of the author(s) and not necessarily those of the NHS, the National Institute for Health Research or the Department of Health. Nor does it necessarily represent the views of any of the collaborators whose logos are used herein. http://dashboard.present.org.uk/ds_final/index.html http://present.org.uk/
The team Dr Carol Rivas , University of Southampton Dr Daria Tkacz, University of Southampton Dr Don Cruickshank, University of Southampton Sydney Anstee, University of Southampton Dr Richard Wagland, University of Southampton Dr Mike Bracher, University of Southampton Professor Carl May, University of Southampton Dr Richard Giordano, University of Southampton Professor Dame Jessica Corner, University of Nottingham David Simpson Professor Theresa Wiseman, University of Southampton Dr Adam Glaser, University of Leeds Dr Georgios Lyratzopoulos, University of Cambridge Jennie Whitford, Macmillan Cancer Support Hanna Hine, Macmillan Cancer Support Dr Shelley Dolan, Clinical Director, London Cancer Alliance Lesley Turner, patient advisor 13 and our other collaborators, advisory group members and patients
Recommend
More recommend
