Evaluation

Evaluation Approach

The evaluation strategy to be used in the CyberGaTE project is a further development of an innovative strategy that has been used successfully in national development projects over the last few years, in particular:

• The JISC project ‘Taking Work-Based Learning Forward in Scotland using the Work-Based Learning Toolkit’ .
• The JISC Digital Literacy Project from the University of Greenwich – ‘Digital Literacies in Transition’ .
• The HEA funded project ‘The Cyber Security Knowledge Exchange’ .

The main features of the strategy are:

• A focus towards questions with an emphasis on impact and future development.
• The use of concept mapping as a device for both data capture and communication.
• An iterative process which runs throughout the main project (and potentially beyond as it can then be ‘adopted’ by the project team).
• The evaluation outcomes and outputs are easy to access and communicate, and are available to the project team for further development after the cessation of project funding.

Focus Questions

Concept map 1, above, summarises the main focus questions which drive the evaluation. These questions are used in an iterative process with all the stakeholder groups.

Iterative Process

The maps produced in the evaluation will be updated regularly and after all key stages in the project timeline. Data collection to support the statements in the maps will require regular interviews with the project team and other stakeholders as well as the review of project outputs. The maps will also be used in workshops to allow the exchange of opinions and data between stakeholders.

Outcomes and Outputs

In the final report, five concept maps will be produced – one to summarise the main headline points emerging from the evaluation and then an individual map on each of the four main areas – outcomes, impact, issues and resolutions, and embedding/sustainability. At the end of the project, all the maps will be available to the project team in both original and presentation formats to allow for any future development and dissemination.