The completed evaluation will deliver to the key responsibilities as set out in the evaluator brief. The approach will yield both quantitative and qualitative data, will provide an overview of the context in which Snappy Operas took place and an analysis of the extent to which its aims were delivered. Specifically, we will:
Design a suite of evaluation tools which include both quantitative and qualitative measurements;
Road test the tools with a sample of staff and artists to ensure that they are fit for purpose, are not too onerous and measure what it is we are seeking to measure
Using the evaluation tools, carry out a comprehensive evaluation of Snappy Operas. The evaluation will be augmented by semi structured interviews with key project participants and stakeholders.
Produce an evaluation report. Included within this will be a flexible evaluation framework which can be adapted to satisfy the requirements of a range of projects.
At the end of the evaluation period, we will deliver an Evaluation Summit for project delivery staff. This will include a basic introduction to evaluation practice and an opportunity for staff to familiarise themselves with the range of evaluation tools produced.
As mentioned above, our approach will deliver an evaluation whose basic structure can be adapted for other projects. However, in order to add texture and depth it will also be informed by the learning which emerges from five in depth semi structured interviews which we will carry out over the course of the evaluation.
Semi structured interviews will be important methods which will yield the following qualitative data:
An exploration of the extent to which programme aims were met;
An analysis of the effectiveness of the project processes in supporting delivery of the project aims and outcomes;
Views of which elements of the project worked particularly well and which worked less well;
An analysis of critical success factors which led to positive outcomes;
A discussion of any unexpected outcomes which the project has yielded;
Reflections on the efficacy of the partnership in delivering the project;
Views of ways in which positive developments can be sustained;
A discussion of the organisational and / or individual learning which has emerged from engagement in the project.