Youth Music Evaluation, Learning and Impact Dr Douglas Lonie Research and Evaluation Manager, Youth Music
Being Evidence Based Need Practice How do we Why do we do do what we what we do? do? How do we do What It better and difference support better does what we practice Development do make? in the sector? Impact
CES Outcomes Approach Overall Aim Intended Outcomes Activities and Outputs
Embedding Evaluation: a case study • YM employs evaluation team • Systems and processes reviewed 2008 • Consistent outcomes framework established • Internal and external training begins 2010 • Research and reporting starts to indicate impact • Grants and research team merge 2012
What we do • Outcomes/Evaluation focused application systems • Nvivo used to code and analyse all data • Statistical summaries of profile statistics • Diversity of portfolio • Regional allocation (Index of Multiple Deprivation)
What can we claim? • Be realistic and confident in the extent of your own impact • Be honest, frame negative results as learning • Don’t report statistics independently (always require interpretation) • Use evidence in a complementary way
How much can we realistically do? • Do you value evaluation as an organisation? – Who is responsible for it? • When should I commission an ‘expert’? – Importance of objectivity? – Done with or done to? – Action research and improvement • Cash – starved consultants • Language and power
Evaluation Builder http://network.youth music.org.uk/scales/e valuation-scales
• Three c’s • Commitment (to projects and to learning) • Concentration (and task completion) • Control (over different aspects of their lives)
• All genre and multi-genre • Pop/rock most popular • Country not very popular • 1/3 Western Classical • Growth of hip-hop ‘therapy’
Youth Music Network
3a. Thinking about your outcome indicators and sources of evidence in relation to this goal area please provide an update on the last 12 months and the extent to which you have achieved your intended outcomes. (500 words) Goal: • To have improved the social and personal skills of CYP in CC through participation in high quality music-making activities Indicators: • confidence, self esteem, more involvement from young people Our programme this year has had a number of regular workshops that have been run as music clubs focusing as much on the social side/group interaction as the music making.. In the sessions that have run for some time such as [title], we have young people that have been coming anything from a few months up to 5 years. This brought a really good dynamic to group this year, especially as new members came along, an encouraging and supporting process takes place, instantly making those sessions a safe, non threatening environment to be in. During our observations the tutors run the sessions that makes time and space for friendships to develop and clearly show negative behaviour to each other is not acceptable in the sessions. The young people are happy to come up with ideas for songs that are being written by the group, often these will be quite personal feelings or situations that they have been in, again there is a freedom of being able to do this without feeling stupid or embarrassed.
1. Please describe your progress towards achieving your project’s intended outcomes (No Word Limit ) Generic outcome 1 – To improve the quality and standards of music delivery for young people Indicator: Using participant's feedback and young music leaders views we will explore the quality of our music offered to children and young people. • Evidence 1: Attached is a video showing some of the young people from this particular workshop performing with instruments and one of our music mentors, who has attended our provision for a number of years as an MC, explaining the process of a lot of young people learning instruments to facilitate more live performances and expressing his thanks to another music mentor who has helped to develop lots of young people in the area of playing an instrument. This shows that the young people are not only recognising the development of their skills in themselves and in their peers but also that their views are listened to and will have an effect on our music offer.
Ross’s Story http://youtu.be/PpSUFse8WzU
Thanks for listening! Contact Me douglas.lonie@youthmusic.org.uk Charity Website youthmusic.org.uk Online Community youthmusic.org.uk/network
Recommend
More recommend
