EPOS - Innovative Education towards the Needs of the Organic Sector Evaluation of EPOS educational activities by participants: e-learning & Intensive Study Programme ( Summer course ) Dr. Renata Kazimierczak & Dr. Dominika Średnicka-Tober Warsaw University of Life Sciences
Testing educational materials and methods: A. E-learning Time: May - July 2015 Place/tool: e-learning platform (Moodle) Number of participants: 45 Profile of participants: BSc, MSc, PhD students Activity: Lectures on the e-learning platform (introductory information about organic food and farming; preparation for the summer course) Coordinator of the task: Uni Kassel
Testing educational materials and methods: B. Intensive Study Programme (Summer course) Time: 25 VII - 7 VIII 2015 (14 days) Place: Warsaw & Górzno Number of participants: 45 Profile of participants: BSc, MSc, PhD students Lecturers: 15 lecturers (representatives of each university participating in the project).
EPOS Intensive Study Programme - participants Students Lecturers Poland 9 4 Czech Republic 6 2 Spain 6 2 Italy 8 2 Germany 4 2 Finland 5 2 Estonia 7 1 All 45 15
EPOS Intensive Study Programme study trip to Górzno
Evaluation of the Intensive Study Programme ( summer course ) by participating students
Please rate the following statements regarding general aspects of the summer school: 70,0 60,0 50,0 40,0 30,0 20,0 10,0 0,0 The summer school broadened my knowledge and skills regarding the subject of the course [%] 0,0 0,0 13,2 57,9 28,9 strongly disagree disagree unsure agree strongly agree 86,8 %
Please rate the following statements regarding general aspects of the summer school: 60,0 Attending this summer school was worthwhile [%] 55,3 50,0 40,0 44,7 30,0 20,0 10,0 0,0 0,0 0,0 0,0 strongly disagree disagree unsure agree strongly agree 100 %
Please rate the following statements regarding general aspects of the summer school: 50,0 The size of the group was appropriate for a summer school [%] 47,4 40,0 30,0 20,0 23,7 28,9 10,0 0,0 0,0 0,0 strongly disagree disagree unsure agree strongly agree
Please rate the following statements regarding general aspects of the summer school: 50,0 40,0 30,0 20,0 10,0 0,0 The summer school provides plenty of opportunities for building networks that might help further my career [%] 0,0 13,2 18,4 39,5 28,9 strongly disagree disagree unsure agree strongly agree
Please rate the following statements regarding general aspects of the summer school: 60,0 50,0 40,0 30,0 20,0 10,0 0,0 This summer school provides plenty of opportunities to talk to senior researchers [%] 2,6 10,5 15,8 52,6 18,4 strongly disagree disagree unsure agree strongly agree
Please rate the following statements regarding aspects of the lectures: [%] The lectures in general addressed my knowledge level on the subjects The quality of the lectures was good The lecturers knowledge on the subjects was good strongly disagree disagree unsure agree strongly agree 2.6 2.6 21.1 71.1 2.6 0.0 7.9 26.3 55.3 10.5 0.0 0.0 23.7 47.4 28.9
Please rate the following statements regarding aspects of group work assignments: [%] strongly disagree disagree unsure agree strongly agree The group work assignments in general addressed my knowledge level on the subject The knowledge of the group work assignments instructors on the subjects was good The balance between lectures and group work was optimal The group work assignments and lectures complemented one another 0.0 0.0 21.1 71.1 7.9 2.7 0.0 18.9 75.7 2.7 5.3 10.5 31.6 44.7 7.9 2.6 0.0 26.3 65.8 5.3
Please rate the following statements regarding aspects of online module: 70,0 60,0 50,0 The online module addressed my knowledge level on the subject [%] 60,5 40,0 30,0 28,9 20,0 10,0 0,0 2,6 2,6 strongly disagree disagree unsure agree strongly agree 5,3
Please rate the following statements regarding aspects of online module: 60,0 50,0 40,0 30,0 20,0 10,0 0,0 The organisation of the online module was good [%] 2,6 15,8 15,8 52,6 13,2 strongly disagree disagree unsure agree strongly agree
Please rate the following statements regarding aspects of online module: 60,0 50,0 40,0 30,0 20,0 10,0 0,0 The summer school and online module complemented one another [%] 2,6 5,3 31,6 50,0 10,5 strongly disagree disagree unsure agree strongly agree
Which lectures would you recommend [number of responses] Environmental Integration of Agriculture Marketing and economics Weed management Food quality Organic food and human health Ecosystem services Bioactive compounds in organic food Nutrient supply and cycling in organic horticulture C storage in organic farming Environmental aspects Domestic and organic food History of organic farming Innovative technologies in agriculture Plant breeding 1 1 2 2 2 2 3 4 4 5 5 5 8 10 0 2 4 6 8 10 12
Which lectures would you rather not recommend [number of responses] Nutrient supply and cycling in organic horticulture (too difficult) History of organic farming (to many names) 4 4 C storage in organic farming Slow Food & Fair Trade (could have been shorter) Gasses emission Crop protection 2 2 3 3 Food quality Marketing and economics 1 1 0 1 2 3 4 5
Were there any topics missing that you expected to hear about? [number of responses] Food processing and hygienic condition 5 More discussion time 3 Yields in organic farming how to increase it, economy features Certification process Logistic and distribution of organic products GMOs 2 2 2 2 Plant diseases and treatment Legislation Brands connected with food production Permaculture, intercropping, biodiversity More discuss about projects in the organic sector Information about the difference between organic and General information about best brands producing organic food 1 1 1 1 1 1 1 0 1 2 3 4 5 6
the overall organization of the summer school? the time table of the summer school (e.g. scheduled breaks, starting and finishing times)? the information via email before the summer school? How satisfied were you with... strongly disagree disagree unsure agree strongly agree 2.6 2.6 28.9 60.5 5.3 29.7 27.0 21.6 16.2 5.4 0.0 2.8 22.2 66.7 8.3 the information during the summer school? 2.8 2.8 25.0 58.3 11.1 the ad hoc dealing on our side with unexpected difficulties you experienced? 6.1 3.0 27.3 51.5 12.1 the size of the group in general? 0.0 8.3 19.4 66.7 5.6 the leisure activities? 21.6 8.1 18.9 45.9 5.4 the summer school location 1? (landscape park) 0.0 2.8 11.1 36.1 50.0 the summer school location 2? (Warsaw) 5.9 2.9 14.7 41.2 35.3 the lecture halls and study facilities in the landscape park? the lecture halls and study facilities in Warsaw? 3.1 9.4 25.0 34.4 28.1 2.9 17.1 25.7 34.3 20.0 the accommodation in Warsaw? 0.0 2.9 5.7 48.6 42.9 the catering in the landscape park? 2.9 2.9 8.6 51.4 34.3 the catering in Warsaw? 5.6 25.0 8.3 27.8 33.3
Further notes, criticizm, feedback and important suggestions regarding course organization number of responses To intensive schedule and to often changed very tiring 14 More free time would be recommended 12 Good organization, fantastic atmosphere, do it again! 7 No satisfactory food in the Landscape Park - should be more organic 6 Students English language skills should be checked before the course 4 Make lecture more interactive, more time for questions and discussion 3 In general the experience was wonderful 3 To much group work 2
Further notes, criticizm, feedback and important suggestions regarding course organization number of responses Recommendation to use more videos during all lectures 1 Too short time to prepare the presentation from Friday 31st to Monday 3 rd 1 Group was too big 1 Internet access was limited 1 Too many lectures about agriculture 1 Limited touristic information (about Poland, Warsaw) 1 We should have visited more dynamic organic farms 1 Most of the professors talked about their topics relating the contents to their own countries instead of the whole EU. 1
Evaluation of the summer course by TEACHERS
Identification of the Participant and general information Was this your first summer course financed by the Erasmus+ or Lifelong Learning Programmes? Please indicate how many times you have participated in summer courses financed by Erasmus+ or Lifelong Learning Programmes since 2010 0 71,4 28,6 yes no 2-5 6-10 >10 100
What were your main motivations for taking part in this summer course? To improve my foreign language skills 42,9 To increase my future employment and career opportunities 14,3 To meet new people To increase the quality and quantity of student and staff mobility to and from my sending institution To share my own knowledge and skills with students 28,6 71,4 85,7 To experiment and develop new learning practices and teaching methods To create spin-off effects like curriculum development, development of joint courses or modules, academic networks, research collaboration etc. To build up cooperation with the labour market 14,3 42,9 42,9 To reinforce the cooperation with a partner institution 28,6 To build up new contacts/expand my professional network 57,1 To increase my job satisfaction To gain practical skills relevant for my current job and professional development 42,9 42,9 To increase knowledge of social, linguistic and/or cultural matters To develop my own competences in my field and increase the relevance of my teaching To acquire knowledge and specific know-how from good practice abroad 57,1 57,1 71,4 0,0 10,0 20,0 30,0 40,0 50,0 60,0 70,0 80,0 90,0
Did your participation in the summer course include the following elements? Monitoring of Erasmus+ projects 28,6 Cultural activities 14,3 Planning of future Erasmus+ co-operation 0,0 Participation in tests/exams 57,1 Joint events and seminars 14,3 Promotion and/or follow-up/monitoring of Erasmus+ activities 0,0 Own research activities 14,3 Problem-based learning/case studies 28,6 Distance teaching/online courses 71,4 Research supervision of students 28,6 Tutorials/seminars/workshops 85,7 Job-shadowing 0,0 Lectures 100,0 0,0 20,0 40,0 60,0 80,0 100,0 120,0
Personal and professional development: thanks to this summer course: I have learned from good practices abroad strongly disagree rather disagree neither agree nor disagree rather agree strongly agree 0.0 0.0 14.3 42.9 28.6 I have experimented and developed new learning practices or teaching methods 0.0 0.0 28.6 42.9 14.3 I have gained sector-specific or practical skills relevant for my current job and professional development 0.0 0.0 0.0 57.1 28.6 I have enhanced my organisational/ management/leadership skills 0.0 0.0 28.6 42.9 14.3 I have reinforced or extended my professional network or built up new contacts 14.3 0.0 0.0 28.6 71.4 I have reinforced the cooperation with the partner institution/organisation 0.0 0.0 0.0 14.3 71.4 I have built cooperation with players in the labour market 0.0 0.0 42.9 14.3 14.3 I have built cooperation with players in civil society 0.0 14.3 28.6 14.3 0.0 I have improved my foreign language skills 0.0 0.0 14.3 42.9 28.6 I have increased my social, linguistic and/or cultural competences 0.0 14.3 0.0 42.9 42.9 I have improved my competences in the use of Information and Communication Technology tools (e.g. computer, internet, virtual collaboration platforms, software, ICT devices, etc.) 0.0 0.0 14.3 71.4 14.3 I have increased my job satisfaction 0.0 0.0 14.3 14.3 57.1 I have enhanced my employment and career opportunities 0.0 0.0 28.6 28.6 28.6
Furthermore, during my participation in the summer course... strongly disagree rather disagree neither agree nor disagree rather agree strongly agree I have shared my own knowledge and skills with students and/or other persons I contributed to create spin-off effects like curriculum development, development of joint courses or modules, academic networks, research collaboration, etc. I contributed to increasing the quality and quantity of student or staff mobility to and from my sending institution 0.0 0.0 0.0 0.0 85.7 0.0 0.0 0.0 0.0 85.7 0.0 0.0 0.0 0.0 57.1 Other 0.0 0.0 0.0 0.0 0.0
My teaching period had the following impact on the host institution & the students of the Has enhanced the motivation of non-mobile students to study/do a traineeship abroad host institution: strongly disagree rather disagree neither agree nor disagree rather agree strongly agree 0.0 0.0 42.9 28.6 28.6 Has allowed non-mobile students to get a perspective from abroad ("internationalisation at home") Has allowed students to develop their entrepreneurial mind-set and to understand enterprises Will lead to the use of new teaching methods/approaches at the partner institution Has led to the use of new teaching methods/approaches at the partner institution 0.0 0.0 0.0 42.9 57.1 0.0 0.0 28.6 42.9 28.6 0.0 0.0 28.6 57.1 14.3 0.0 0.0 28.6 42.9 28.6 Will lead to the introduction of new teaching subject(s) 0.0 14.3 42.9 28.6 14.3 Has led to the introduction of new teaching subject(s) 0.0 0.0 57.1 14.3 14.3 Will lead to the introduction of changes in the organisation/management of the partner institution Has led to the introduction of changes in the organisation/management of the partner institution 0.0 0.0 71.4 14.3 0.0 0.0 0.0 57.1 28.6 0.0 Other 0.0 0.0 0.0 0.0 0.0
My participation in the course had the following impact on my sending institution/enterprise strongly disagree rather disagree neither agree nor disagree rather agree strongly agree Will lead to the use of new teaching/training methods/ approaches/ good practices at my sending institution 0.0 0.0 28.6 42.9 28.6 Has led to the use of new teaching/training methods/ approaches/ good practices at my sending institution Will lead to new/increased cooperation with the partner institution/ organisation(s) Has led to new/increased cooperation with the partner institution/ organisation(s) 0.0 14.3 14.3 42.9 28.6 0.0 0.0 14.3 28.6 57.1 0.0 0.0 0.0 14.3 71.4 Will lead to internationalisation of my sending institution 0.0 14.3 14.3 28.6 42.9 Has led to internationalisation of my sending institution 0.0 14.3 0.0 28.6 57.1 Will lead to stronger involvement of my institution/enterprise in curriculum development Has led to stronger involvement of my institution/enterprise in curriculum development Will lead to the introduction of changes in the organisation/management of my sending institution/enterprise Has led to the introduction of changes in the organisation/management of my sending institution/enterprise 0.0 0.0 28.6 42.9 28.6 0.0 0.0 57.1 14.3 28.6 0.0 0.0 71.4 0.0 28.6 0.0 0.0 57.1 14.3 28.6 Other 0.0 0.0 0.0 0.0 0.0
EVALUATION OF THE E-LEARNING PROJECT PHASE
Please rate the following statements regarding aspects of the e-learning project phase: strongly disagree rather disagree neither agree nor disagree rather agree strongly agree The e-learning course addressed students knowledge level on the subjects 0.0 0.0 0.0 33.3 66.7 The organisation of the e-learning was good 0.0 0.0 0.0 50.0 50.0 The Moodle programme was a good tool to be used for such an activity The summer school and e-learning complemented one another 0.0 0.0 0.0 16.7 83.3 0.0 0.0 0.0 16.7 83.3
How satisfied were you with different aspects of the summer course Please rate the following statements regarding general aspects of the summer school: strongly disagree rather disagree neither agree nor disagree rather agree strongly agree Attending this summer school was worthwhile The size of the group of students was appropriate for a summer school 0.0 0.0 0.0 16.7 83.3 33.3 0.0 0.0 33.3 33.3
How satisfied were you with: not at all not quite a little very extremely this summer course experience in general? the overall organization of the summer school? the time table of the summer school (e.g. scheduled breaks, starting and finishing times)? the information via email before the summer school? the information during the summer school? the ad hoc dealing on our side with unexpected difficulties you experienced? the size of the group in general? the summer school location 1? (landscape park) the summer school location 2? (Warsaw) the lecture halls and study facilities in the landscape park? the lecture halls and study facilities in Warsaw? the accommodation in the landscape park? the accommodation in Warsaw? the catering in the landscape park? 0.0 0.0 0.0 50.0 50.0 0.0 0.0 16.7 50.0 33.3 0.0 16.7 33.3 16.7 50.0 0.0 0.0 33.3 33.3 33.3 0.0 0.0 50.0 16.7 33.3 0.0 0.0 16.7 50.0 33.3 33.3 0.0 16.7 33.3 16.7 0.0 0.0 0.0 16.7 50.0 0.0 0.0 0.0 33.3 50.0 16.7 0.0 0.0 33.3 16.7 0.0 16.7 0.0 33.3 33.3 0.0 0.0 0.0 33.3 33.3 0.0 0.0 0.0 50.0 33.3 0.0 0.0 16.7 16.7 33.3
Would you recommend this experience to a colleague? 0% YES NO 100%
How do you plan to share your experience from the course? With a written report 16.7 At staff meeting(s) 100.0 At conference(s) 50.0 At workshop(s) with colleagues 100.0 In the media 0.0 Other 0.0 Not foreseen at all 16.7
Further notes, criticism, feedback and improvement suggestions E-learning tools are very powerful, in most cases they are only used marginally due to limited time for becoming experts of the tools The programme should be less packed Give more space for serious group work language skills must be checked before the acceptance of participation Landscape park was adequate for accommodation, not really ideal for working That kind of courses should be maintained whenever possible in order to broaden the students' view, especially for those who do not have the privilege of OA (OF) courses in their home university.
Additional extensive Feedback of a Best aspects Finish teacher Truly interdisciplinary and multinational group of teachers and students The course (group works, presentations) helped to build up confidence Facilities at the campus in Warsaw were very good Cultural programme in Warsaw was diverse Some excellent lectures and other activities The course was overall a great experience and served the aim of bringing together bright youngsters. There was clearly good caring attitude from the organisers
Additional extensive Feedback of a Finish teacher Aspects in need of improvement: evaluation Evaluation strategy lacked timely preparation - this part of the course should be worked out together and well in advance and put down in writing: what are the objectives of the course, how to evaluate best each of these, what is the expected level of performance etc. just as an example, if we have such a multidisciplinary course with many topics to learn and diverse group of student specialties, then it might be reasonable to offer an option to answer to a certain % of the exam questions of own choice (and all questions for an extra point) this is commonly practiced in Finland. The exam was not designed well (too late, too many questions, digital version not tested, no instructions in advance)
Additional extensive Feedback of a Finish teacher Aspects in need of improvement: evaluation clear deadlines, instructions, technical aspects, and shared responsibilities need to be put down in writing peer proof-reading of all questions (if even one of us cannot understand a question or answer, then we cannot expect students to do so) worth thinking of other evaluation tools except the multiple-choice exam
Additional extensive Feedback of a Finish teacher Aspects in need of improvement: group work, workshops it would be valuable, for the project overall and individual partners, to work on such major teaching events together and have written materials (objectives of each assignment, instructions, evaluation criteria, approaches) - useful also for later use by the partners.
Additional extensive Feedback of a Finish teacher Assignments thoughts for future There were three small group assignments (all in the first week). It might be worth developing one group project (assignment) that lasts through the whole course and requires students to link all the course topics into one holistic product. It can, of course, consist on several parts and stages (sub-deliverables presented and reviewed by all). It will build up continuation through the whole course and will help the students to see how all the course topics fit together (into Organic Chain) (as was mentioned in the students feedback). We have excellent experience of such approaches in our summer schools.
Additional extensive Feedback of a Finish teacher Changing lectures to peer-learning Speaking of innovation (which is what this project is about), I thought that for some topics, changing from a lecture-form of delivery to a more engaging one might work well. Such are those that are based (almost) entirely on facts (e.g. alternative food movements). One can split the topic into blocks (e.g. separate movements), instruct student groups to learn about one of the blocks using the slides, literature, online sources) and then teach other groups about this block. The teacher-expert is needed, of course, for correcting mistakes in understandings and guiding.
Additional extensive Feedback of a Finish teacher Question sessions during lectures we could ask every teacher to plan 5-10 min of the lecture time specifically for questions, either in a free manner in the end of the lecture or as a more structured activity.
Additional extensive Feedback of a General organisation Finish teacher Events were frequently delayed this is not a good message to students (& affects the general discipline) Programme too full (too intensive)
Additional extensive Feedback of a Technical aspects Finish teacher Blinds on the windows needed - We should monitor such technical problems & solve them during the course