Revising Methodologies and linking criteria with Part 1: Stakeholder involvement in the process ENQA Seminar for Recently Reviewed Agencies The Hague, 12-13 October 2017 Helka Kekäläinen, Head of Unit, FINEEC
Guidelines from FINHEEC the predecessor in HE evaluations (2013) Independence, enhancement-led approach, transparency, intensive cooperation with stakeholders, students as central actors, internationality If a 3. cycle of audits will be executed, the content should be renewed. The renewal is necessary to ensure the impact of the audits. 13.10.2017 2
Assignment from the Higher Education Evaluation Committee of FINEEC (Nov 2015) The Planning Group of the 3rd cycle of external evaluation of HE should take into account the new ESG 2015 prepare the evaluation areas, criteria, and process formulate the guidelines for the preparation draw up the guidelines for the selection of experts design the follow up procedure suggest the reporting system. 13.10.2017 3
Planning Group 2016 Chair, professor Jouni Välijärvi, University of Jyväskylä Quality manager Hannele Keränen, University of Applied Sciences Lapland Rector Turo Kilpeläinen, University of Applied Sciences Kajaani Student, Anna Mäkipää, University of Applied Sciences Turku Vice-dean Mirja Ruohoniemi, University of Helsinki Innovation director Petri Räsänen, Council of Tampere region Head of HEI unit Helka Kekäläinen FINEEC Secretary, counsellor of evaluation Mafi Saarilammi, FINEEC 13.10.2017 4
Stakeholder meetings 2016 Meeting with the MoEC 14 October National seminar 25 October ENQA and EUA feedback in November Planning group meetings January- March Workshop with Rector s conference Arene 17 March Workshop with students 11 April Planning group meetings Peda-Forum 17 August Workshop with Evaluation Committee 22 September Planning group meetings October- December April- July- September June Council meeting 12 May Workshop with Rector s conference UNIFI 26 May. University quality network 9 June University of Applied Sciences quality network 13 June Planning group meetings 5
Workshops with Rectors Conferences What kind of evaluation areas would inspire institutions to develope their operations? Me-we-us. Anything missing? Discussion of benchmarking as a part of the selfevaluation. Pros and cons? Some suggestions from rectors: Renewal needed, impact in all functions, from processes to results, freedom of thought in societal interaction etc. 11.5.2014 6
Workshop with Student representatives Learning cafe: What kind of evaluation areas would you like to see in the new evaluation model of HEIs? Student centered learning should be a focus in the new model, what would that require from the model? What promotes students motivation in learning? The role of local student unions in the production of the selfevaluation report? Other issues? Results: During the site-visit students will be heard in the format of a workshop instead of formal interviews. FINEEC will cover the travel and accomodation expences to the national seminar for one representative from each student union (40 persons). 11.5.2014 7
Quality Network meetings Discussion on the shift from quality assurance system focus to enhancement and impact focus and student-centredness. What kind of evaluation areas would inspire institutions to develope their operations? Discussion on benchmarking as part of the preparation for external evaluation. Challenges? Opportunities? Human resource development, how important? Anything missing? Some suggestions from quality managers: Quality assurance of research has to be there!!!, minimum criteria for benchmarking needs to be clear etc. 11.5.2014 8
Workshop in Peda-Forum Learning cafe: 1. Bechmarking: Who? How? Why? 2. The programme samples: what constitutes good enough and excellence? How to encourage students to take an active role in learning and how to assess that? 3. Staff development for teachers: Needs? How? 4. Impact and renewal capacity of HEIs: How? Regional development? Creative and innovative atmosphere? Suprising result: QA of research again! Other: Impact and renewal are difficult to define, benchmarking already accepted as compulsory part of the self-evaluation. 11.5.2014 9
Meeting with the Ministry of Education and Culture Fine-tuning the terminology Strong support for the benchmarking/ bench-learning Suggestion to include topical themes periodically Digitalisation to improve the usability of the data 13.10.2017 10
National seminar in Finlandia House 170 participants: HEI representatives, students, external stakeholders The current version of the New Audit Model was offered for discussion Working groups in 5 themes: Criteria, Instructions for the self-evaluation, Benchlearning, Student-centred learning process, HEI promoting impact Me-we-us into pyramid shape 2. 3. 4. 5. 6. Main result for FINEEC: no strong opposition, participants were able to operate with the new model 11
Meeting with ENQA and EUA representatives in Brussels Aim was to have a external European view (in Finnish) on a model that has been developed nationally External experts were able to see the connections with the new Audit Model and the ESG 13.10.2017 12
The new audit model enhances societal impact Operational culture promoting impact and innovation Student-centred approach Examples of successful development work HIGHER EDUCATION INSTITUTION
Areas of evaluation I HEI creates competence The planning of education The implementation of education The enhancement of education II HEI promotes impact and renewal Managing societal interaction and impact Impactful research, development and innovation activities and artistic activities Promoting impact through the operational culture III HEI enhances quality and well-being Using the quality system in strategic management Using the quality system in the development of staff competence Functionality and development of the quality system Example(s) of successful development activities in all 3 areas 13.10.2017 14
Digital Platform 13.10.2017 15
Lessons Learned in Stakeholder involvement Act early on the invitation in order to reach the desired audience Plan the realization of the workshop/ meeting carefully: aims, advance material, engagement methodology, chairs and secretaries, collection of information and input from the stakeholders, dissemination of the results in the event and afterwards, aftercare? Write short memos of every event (this presentation is based on them) More is more, be available It was the duty of the QA agency to look after ESG. 13.10.2017 16
Thank you for your attention!