Evaluation Report University of Prishtina Faculty of Mechanical Engineering Academic Programs Traffic and Transport (Bsc and Msc) Reaccreditation Expert committee: Herbert FELLNER, Peter STURM May 27 th 2014 1 Task Evaluation of the Academic Programs Traffic and Transport (Bsc and Msc) of the Faculty of Mechanical Engineering (FME) at the University of Prishtina for the Kosovo Accreditation Agency (KAA) with the aim of re accreditation of the Bsc and Msc programmes. 2 Members of the Expert Committee Pursuant to official paper regarding Scientific Activity and Higher Education as well as the Ordinance on Measures and Criteria for the Evaluation of Quality and Efficiency of Higher Education Institutions, the National Council for Higher Education of Kosovo appointed an Expert Committee (EC) in charge of quality and efficiency evaluation of the University of Pristhina, Faculty of Mechanical Engineering as follows: Prof. DI. Dr. Herbert Fellner, professor at the University of Applied Sciences FH JOANNEUM Alte Poststrasse 149, A 8020 Graz, Austria Tel. No.: +43 316 5453 8431, fax: +43 316 5453 8401 E mail: herbert.fellner@fh joanneum.at AUniv. Prof. DI. Dr. Peter Sturm, professor at Graz University of Technology Inffeldgasse 21a, A 8010 Graz, Austria Tel. No.: +43 316 873 30200, fax: +43 316 873 20202 E mail: sturm@tugraz.at Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 1
3 Preparation Documents The provided documents included: Self Evaluation Report (SER) regarding the study programmes for re accreditation of Traffic and Transport with the profiles Road Traffic (Bsc), Railway Traffic (Bsc) and Road traffic (Msc), Prof. Dr. Musli Bajraktari, University of Prishtina, Faculty of Mechanical Engineering, Prishtina 2014 Final Evaluation report of the Academic Programmes Traffic and Transport (Bsc and Msc), Faculty of Mechanical Engineering from expert committee, June 25 th 2011 Final Evaluation report of the Academic Program for Accreditation Study Programme Road Traffic (Msc), Faculty of Mechanical Engineering from expert committee, August 28 th 2012 4 Site visit During the site visit on 24 th of April 2014 there were meetings with the faculty management, responsible persons of the study program, students and teaching staff. There was also a visit to computer labs, library and laboratories. Mag. B. Muja and Mr Fisnik Gashi from the KAA assisted the site visit. Before the protocol was made, the documents which provide the basis for the evaluation procedure had been delivered to and studied in detail by the members of the EC. The on site meeting was scheduled as followed: April 23 rd 2014 Pre meeting Prishtina TIME AGENDA 20.00 Working dinner for the experts with Ms Furtuna Mehmeti and Mr. Fisnik Gashi April 24th University of Prishtina, Faculty of Mechanical Engineering, Prishtina TIME AGENDA 09.00 11.00 Meeting with the management of the institution and the responsible persons of the study programs 11.00 12.30 Visit to facilities 12.30 14.15 Lunch and discussion of EC and KAA 14.15 15.15 Meeting with teaching staff 15.15 17.00 Meeting with the students 17.00 17.15 EC and KAA consultation 17.15 17.30 Closing meeting with the management of the Institution Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 2
April 25 th 2014 Post meeting Prishtina TIME AGENDA 8:30 12.30 Meeting of the experts in the Hotel Baci, wrap up and draft of preliminary results of the site visit 5 Additional material received after site visit Based on the site visit additional material was requested by the EC concerning clarification: Presentation of the dean during the meeting of the management (ppt file) Improved description of the following subjects in the Msc program: Traffic design, Operational research, Simulations in traffic, Techniques in traffic, Traffic safety II, Theory of vehicle movement. Clarification of concept of courses for foreign languages, especially focus on description of the ECTS calculation in relation to the activity undertaken within this lesson, e.g. English I: projects/presentation, contacts with teacher/consultations, time spent in evaluation; French I: practice in field. The following answers were delivered by the Faculty of Mechanical Engineering: Answer to the Report (AR) of Commission for Academic Program Traffic and Transport ; Faculty of Mechanical Engineering, Prof. Dr. Musli Bajraktari, Prishtina, dated May 5 th 2014, e mail received May 6 th 2014 Response from FME concerning the draft evaluation report, received per e mail on May 21 st 2014 This report is based on the above mentioned papers. 6 Bachelor Program Traffic and Transport (Bsc) The Academic Program Traffic and Transport consists currently of the profiles Road traffic (Bsc) and Railway traffic (Bsc). The structure of the chapter follows the guidelines for experts (Academic Programs) from KAA. The questions raised in this guideline are printed in the following chapters in italics. 6.1 Academic programs and student management Question: Does the academic program correspond to the institution s mission statement and principles of operation? The academic program corresponds with the mission statement of the faculty. Question: Are the programs quality, range and academic aims appropriate to the academic degree? Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 3
In general a Bsc program shall aim at providing a solid base for the proposed scientific area, i.e. Traffic and Transport. Having this solid foundation would allow a further deepening of knowledge within appropriate Msc programs. The current Bsc program is well established already over a couple of years. In opinion of EC a slight shift into the direction of broadening of the basic knowledge within the Bsc program is required. The current situation of having two profiles (road and railway) seems not to be appropriate for the general layout of the BSc program Traffic and Transport. Due to the fact that the whole curricula differs between the road and the rail profile only in 3 subjects a separation into the two profiles is not justified. In addition such a separation reduces the possibilities for the students for finding an appropriate workplace, i.e. a quite specific Bsc might be restricted in applying for a job in the general field of traffic and transport. Separations should be made on the level of a Msc program. Question: Is the program based on an overarching didactic concept that has been adequately communicated to and adopted by the teaching staff? The overarching didactic concept defined by FME as lecturing and teaching exercises, supported by seminars seems to be appropriate. This concept seems to be clear to the staff. The exercises are done within groups of students. Question: Does the academic degree correspond to international standards? Generally spoken yes, but there are some deficits which should not appear in a Bsc in the framework of a FME. This concerns general knowledge about: Applied thermodynamics Basics in chemistry Material science Economics and project management The implementation of foreign languages is given, however the extent seems not to be sufficient in order to ensure general knowledge and language application at a sufficient level. Referring to the document Response from FME of the draft evaluation report, a lesson concerning material science will now be implemented in the 2 nd semester of the Bsc. Referring to the document Response from FME of the draft evaluation report, the foreign language courses include in addition to 2 hours lectures one hour for exercises in small groups. This is not reflected in the description of the subjects English, German and French Language I (page 26 ff of the SER) and has to be adjusted. Question: Does the structure of the program give sufficient opportunity for independent study, reflection and analysis? (e.g. what is the proportion of independent study time compared to online/distance teaching and classroom units?) Based on the Hours of Study and the ECTS written in the SER sufficient opportunity should be given. Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 4
The resources provided for the students (e.g. computers, working places) should be increased. The digitalization of the library, including access to e journals is very important and we recommend finalizing these works as soon as possible. In any way there is a remarkable improvement compared to the site visits undertaken in the years before. Question: Is the allocation of ECTS appropriate and justified? The workload for the students is defined in the SER. However a detailed insight into the various calculation tables shows deficits in the calculation of the workload. In addition it is not clear whether the numbers given in the ECTS calculation tables reflects reality. Especially the definition of time spent for contacts with teacher/consultations seems to be unrealistic high and not be manageable for the teaching staff for some subjects. Compared to international level the ECTS credits reflect less hours in classroom, although the basis value of 25 h per 1 ECTS is similar. Question: Is the workload required for the academic program manageable for students? Based on the Hours of Study and the ECTS written in the SER the program seems to be manageable for the students. Question: Are the teaching methods and content of teaching units sufficient for the successful achievement of the programs goals and outcomes (competences and qualifications, knowledge and skills)? The teaching methods are in general appropriate. Group sizes with max. 30 students per group in exercises would be appropriate, however for complex topics like mathematics, mechanics, foreign languages, etc. smaller group sizes supported by tutorial units would be proposed. Referring to the document Response from FME of the draft evaluation report, for laboratory exercises groups with 15 students are implemented. Question: Is the overlap of academic content between the various parts of the curriculum comprehensible and transparent? The different lessons are well linked and integrated. The curriculum is transparent and comprehensible. On bases of the existing curriculum a split into two profiles is not justified. Question: How do the admission criteria and admission procedures measure up to international standards? There is no pre selection of new students beyond the requirement of having the appropriate high school grade (Matura). SER shows the total number of students per academic year which is remarkable high (~200 in the 1 st year, ~150 in the 2 nd year) in relation to the number of graduated students (30 40 per year). In order to optimize resources appropriate admission procedures like pre exams might be helpful. We recommend the limitation of the students to the available resources like lecture rooms, computers, laboratories and staff. Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 5
Question: Is the ratio of academic/artistic staff to students appropriate? Following the AR the ratio of teaching staff to students is 1:22 at the FME (about 1275 students and 55 people teaching), which seems to be appropriate. It is incomprehensible that there are 480 students in Traffic and Transport Bsc, almost 38% of the students of FME, which is just one of the 12 actual study programs. 6.1.1 Staff Question: Does the institution have an adequate proportion of permanent staff and appropriate proportions of permanent and external staff? Following the SER there is nearly no staff from outside the academic world teaching. We still recommend including external practical knowledge in the lessons and exercises from industry, authorities and private business. Question: Does the academic staff demonstrate proven ability at a high academic and didactic level and are their qualifications appropriate to the positions they hold within the institution according to the basic criteria? Many CVs show long expertise in teaching in the field of traffic and transport. Following the recommendations given in the previous Evaluation Reports staff took part in several specific training courses in this field. We recommend continuing this way to improve the knowledge. 6.1.2 Research and International Cooperation Question: Is the teaching staff involved in research activities inside or outside the institution, and do these research activities feed back into teaching/course contents? Following the SER FME is active in international research programs and in cooperation with European universities. We recommend the continuation of these activities. Question: Are the extent and the quality of international cooperation in research and teaching adequate? The ambition of some persons from the teaching staff to implement international cooperation in research and teaching seems to be very high and successful. Such an initiative is fully supported by the EC. Question: Are students involved in research and cooperation projects? Following the SER students are included in student research projects, mainly seminar works. 6.1.3 Finances and Infrastructure/Space and Equipment Question: Does the institution have an adequate budget plan? The FME is part of the University of Prishtina and has an annual budget plan within the University. Question: Does the institution have adequate buildings and specialized infrastructure for the requirements of the program? Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 6
We recognize the engagement in redesigning and upgrading class rooms and recommend continuing this way especially with invest in IT equipment, presentation technology and laboratories like workshop facilities for practical exercises. Some of the labs would need more basic equipment in order to come closer to international standards. 6.1.4 Quality management Question: Are the institution s programs assessed regularly within the context of internal evaluation processes? There is an evaluation process of the lectures at the University of Prishtina. This process covers all courses. According to the information provided during the site visit, the results of these evaluations are presented only to the faculty members but not to the students (except those students sitting in the appropriate committee). 6.2 Recommendations Bsc The current Bsc programme is well established and runs now already for a couple of years. After this successful implementation period a careful adjustment to current needs and international standards is proposed. This concerns the following items: Implementation of additional subjects (1) Basic knowledge: a. Basics in Applied Thermodynamics (ideal gas law, real gases, combustion, etc.) b. Basics in Chemistry c. Material science Referring to the document Response from FME of the draft evaluation report, the course material science will be implemented in the 2 nd semester as compulsory lesson. (2) Basics in Economics (business studies, accounting, cost reporting, etc.) as compulsory lesson and project management Referring to the document Response from FME of the draft evaluation report, an appropriate lesson will be implemented in the next accreditation period as compulsory subject. (3) Foreign languages a. Exercises/project presentations in the course with 2 hours p. week in classes within the given 5 ECTS credits seems to be implemented, however the course descriptions given in the SER do not contain hours for exercises. Adjustment of the course description is required. Referring to the document Response from FME of the draft evaluation report, the foreign language courses include in addition to 2 hours lectures one hour for exercises in small groups. This is not reflected in the description of the subjects English, German and French Language I (page 26 ff of the SER) and has to be adjusted. Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 7
b. Additional units currently classified as elective (3 rd semester) should be compulsory (4) Subject Informatics and programming : It has to be question whether the inclusion of extended knowledge concerning MS office like macro writing in Excel or data base management in MS Access as well as standard programming languages like C++ should be superior to quite complex programming tools like JAVA. Referring to the document Response from FME of the draft evaluation report, the content of the lecture has now been adjusted to the remarks mentioned above. (5) There is one elective subject dealing with traffic and the environment. This course deals with tail pipe emission only. An extension to air quality (dispersion), noise and water is recommended. However, the whole subjects or parts of it could be moved to the Msc program. Referring to the document Response from FME of the draft evaluation report, the content of the lecture has now been adjusted to the remarks mentioned above and moved to the Msc program. Didactic concept Smaller units in exercises and labs are proposed (about 15 students per group). Referring to the document Response from FME of the draft evaluation report, for laboratory exercises groups with 15 students and for theoretical exercises 30 students are implemented. Reevaluation of the ECTS points per subject The general handling of the calculation of the workload for students seems to be quite generous. A more strict calculation according to international standards would most probably reduce the current ECTS credits per subject and enable to implement about one additional subject per semester. This would give more flexibility in the design of the curriculum, e.g. improving the basic knowledge in the Bsc program. Referring to the document Response from FME of the draft evaluation report, it is an urgent task that persons in charge and teachers of subjects will make corrections in the ECTS credits for their subjects. Different profiles A differentiation in the two profiles Bsc road traffic and Bsc railway trafic is not justified and should be omitted. Referring to the document Response from FME of the draft evaluation report, the Bsc. is for Traffic and Transport which consist of road, railway, air and water traffic. Infrastructure Further extension of workplaces with PC would be beneficial. Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 8
An introduction of a basic lab concerning measurement technique (meteorology in general) with measurement equipment, data acquisition, data processing is proposed. The topics of this lab could be e.g. traffic counting (optical, radar, etc.), GPS (active), noise, pollution (air) etc., but it should always cover the whole range starting from design of the measurement, performance of the measurement and appropriate data processing Financing An increase in budget for more site visits and exchange with industry is proposed. Quality assurance In addition to the current update of the content of the existing lessons the curriculum of the Bsc program should be checked and adjusted on regularly basis. A compilation of the results of the student evaluations for teaching and courses need to be documented also in the SER and to be published to the students. A compilation of the results of the questionnaires for academic staff, administration and supporting staff need to be published in the SER. 7 Academic Program Road traffic (Msc) This chapter contains the topic Academic Program and Student Management for the Master course. The structure of the chapter follows the guidelines for experts (Academic Programs) from KAA. The questions raised in this guideline are printed in the following chapters in italics. 7.1 Results Academic Program Road Traffic (Msc) The Academic Program covers currently Road traffic. 7.1.1 Academic programs and student management Question: Does the academic program correspond to the institution s mission statement and principles of operation? The academic program corresponds with the mission statement of the faculty. Question: Are the programs quality, range and academic aims appropriate to the academic degree? In general a Msc program shall aim at enlarging and deepening the knowledge for the proposed study area, in this case Road traffic. The current Msc program is now running in its first cycle after first accreditation (currently 4 th semester). Two focal areas can be found within the curriculum, one is dealing with traffic design and management and another somewhat smaller one with traffic safety. Both areas offer a state of the art education in traffic engineering. Question: Is the program based on an overarching didactic concept that has been adequately communicated to and adopted by the teaching staff? Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 9
The overarching didactic concept was defined by FME as lecturing and teaching exercises, supported by seminars. This concept seems to be appropriate and clear to the staff. Question: Does the academic degree correspond to international standards? Generally spoken yes, however a stronger involvement of English as a working language would be beneficial, e.g. the master work written in English language. Question: Does the structure of the program give sufficient opportunity for independent study, reflection and analysis? (e.g. what is the proportion of independent study time compared to online/distance teaching and classroom units?) Based on the Hours of Study and the ECTS written in the SER sufficient opportunity should be given. The resources provided for the students (e.g. computers, working places) should be increased. Question: Is the allocation of ECTS appropriate and justified? This question has to be answered similar to the Bsc program evaluation. The FME defined the workload for the students. However a detailed insight into the various calculation tables shows deficits in the calculation of the workload. In addition it is not clear whether the numbers given in the ECTS calculation tables reflects reality. Due to the lower number of students in the Msc program the contacts with teacher/consultations seems to be more realistic. Question: Is the workload required for the academic program manageable for students? Based on the Hours of Study and the ECTS written in the SER the program seems to be manageable for the students. Question: Are the teaching methods and content of teaching units sufficient for the successful achievement of the programs goals and outcomes (competences and qualifications, knowledge and skills)? The teaching methods are in general appropriate. Question: Is the overlap of academic content between the various parts of the curriculum comprehensible and transparent? The different lessons are well linked and integrated. The curriculum is transparent and comprehensible. Some lessons from the Bsc curriculum would fit better to the Msc program (e.g. Traffic and Environment, Mechanization of Loading and Unloading, etc.). Question: Is the ratio of academic/artistic staff to students appropriate? Following the SER there is a strongly reduced number of students within the Msc program compared to the Bsc program. According to this low number of students the ratio of academic staff and students seems to be appropriate. 7.1.2 Staff See Bsc program. Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 10
7.1.3 Research and International Cooperation See Bsc program. 7.1.4 Finances and Infrastructure/Space and Equipment See Bsc program. 7.1.5 Quality management See Bsc program. 7.2 Recommendations Msc The curriculum for an accredited Msc program in Road Traffic exists now for two years. Based on the current experience some adjustments are proposed: Subjects in Road Traffic (1) Moving some subjects from the Bsc program into the Msc curriculum. This could concern lessons like Traffic and Environment, Mechanization of Loading and Unloading, ect. Referring to the document Response from FME of the draft evaluation report, the both lessons mentioned above have been moved from the Bsc to the Msc. (2) Technology related subjects dealing with vehicle technology (power train, drive train, vehicle safety, etc.) are missing and could be a valuable addendum. Referring to the document Response from FME of the draft evaluation report, the content of the lecture Vehicle Movement has been adjusted accordingly. (3) There is one elective subject dealing with traffic and the environment. This course deals with tail pipe emission only. An extension to air quality (dispersion), noise and water is recommended. Referring to the document Response from FME of the draft evaluation report, the content of the lecture has now been adjusted to the remark mentioned above and moved to the Msc program. Didactic concept (1) Introduction of English as a working language in at least a few of the courses and writing the diploma work in English language. (2) Implementation of external lecturers from industry/administration and private business in order to increase the practical relevance of the subjects. Re evaluation of the ECTS points per subject Similar to the Bsc program the general handling of the calculation of the workload for students seems to be quite generous. A more strict calculation according to international standards would most probably reduce the current ECTS credits per subject and enable the implementation of additional subjects in the Msc program. Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 11
Referring to the document Response from FME of the draft evaluation report, it is an urgent task that persons in charge and teachers of subjects will make corrections in the ECTS credits for their subjects. Infrastructure Similar to the Bsc program a further extension of workplaces with PC would be beneficial. Financing More financial support for software, site visits, international student exchange, etc. would be required. 8 Final assessment The findings during studying the documents and impressions from the site visit as well as from the documents received after the visit can be concluded as follows: Compared to the evaluation procedures and site visits attended the years ago there is a positive trend to be observed. Many improvements have been achieved. The motivation of the management, the teaching staff and the students seems to be high. The study program at Bsc level is established, that one at Msc level undergoes its first cycle. Hence it is a good opportunity to further improve the Bsc program and to adjust the Msc course. Bachelor program We recommend the re accreditation of the Academic Program Traffic and Transport (Bsc) following the modifications and recommendations mentioned under chapter 6.2, with special focus on: Improvement in subjects and introduction of a compulsory lecture in Applied Thermodynamics and Basics in Chemistry Re evaluation of ECTS to international standards Omitting the split into two profiles Master program We recommend the re accreditation of the Academic Program Road Traffic under the provisions mentioned in chapter 7.2, with special focus on: Didactic concept (English as working language) Re evaluation of ECTS to international standards Improvement in subjects In addition we would propose on the long term the establishment of a Master profile in Railway Traffic and renaming the Master to Traffic and Transport with the profiles Road traffic and Railway traffic. Evaluation Report Faculty of Mechanical Engineering, May 27 th 2014 12