Lessons learnt case study (II)
|
|
- Derek Hawkins
- 5 years ago
- Views:
Transcription
1 Lessons learnt case study (II) Developing a Composite Indicator of Scientific and Technological Research Excellence 12 th JRC Annual Training on Composite Indicators & Multicriteria Decision Analysis (COIN 2014) daniel.vertesy@jrc.ec.europa.eu European Commission Joint Research Centre Econometrics and Applied Statistics Unit Composite Indicators Research Group (JRC-COIN) Lessons Learnt Case Study II: Reserach Excellence 1 Lessons Learnt Case Study II: Reserach Excellence 2 OVERVIEW [STEP #] Background and Motivation Conceptual framework [1] Defining and Measuring Research Excellence [1-4] Normalization, Weighting and Aggregation [5-6] Uncertainty analysis [7] Validation [8] Section 1 BACKGROUND AND MOTIVATION * Work carried out with Sjoerd Hardeman, Vincent van Roy, Michaela Saisana Lessons Learnt Case Study II: Reserach Excellence 3 Lessons Learnt Case Study II: Reserach Excellence 4
2 Background and Motivation The broader context Why assess national research systems? Descriptive account: research in contemporary society Normative account: policy interest in accountability and competitiveness Explanatory account: the new economics of research Why focus on excellence? Political interest by European Commission (DG RTD) JRC Research project aimed at exploring national research systems: What characterizes national research systems and how and to what extent do countries differ? Mapping country performance through [Composite] Indicators What determines the efficiency of national research systems? Applying a non-parametric production frontier analysis Create Composite Indicators only when appropriate! Lessons Learnt Case Study II: Reserach Excellence 5 Lessons Learnt Case Study II: Reserach Excellence 6 History of iterations Section 2 REFINING THE CONCEPTUAL FRAMEWORK Feasibility Study (Barré et al., 2011): Conclusion: Out of the 22 indicators deemed feasible to collect by the Barré et al Report, could statistically fit an alternative framework to measure public and business research excellence and collaborations Presentation of Initial aggregation methodology, Expert Workshop (Ispra, Oct 2012) Conclusions: More focused conceptual and theoretical foundation; (i.e., Research innovation; Research inputs research outputs; Research interactions research outputs) Presentation of updated framework and results; Discussions with policy users (2013) Conclusions: further fine-tune some variables; issue of time scope; geographical coverage Final Report (Sep 2013) Lessons Learnt Case Study II: Reserach Excellence 7 Lessons Learnt Case Study II: Reserach Excellence 8
3 National Research Systems /1 National Research Systems /2 Components Research assets (actors) Structural capabilities (sectorial and disciplinary composition) Relationships Research interactions Attributes Different type of actors: universities, industry, government Different dimensions to interactions: geographical, cognitive, and institutional Goal orientation Research excellence Lessons Learnt Case Study II: Reserach Excellence 9 Lessons Learnt Case Study II: Reserach Excellence 10 Definition of Research Excellence The better the definition = the better the measurement knowledge producing activities whose outputs are considered of high-end quality (Tijssen, 2003) 1. Output oriented 2. focus on the quality rather than the quantity 3. focus on top-end rather than average Section 3 DEFINING AND MEASURING RESEARCH EXCELLENCE Lessons Learnt Case Study II: Reserach Excellence 11 Lessons Learnt Case Study II: Reserach Excellence 12
4 Defining Research & Excellence Issues of Measurement /1 [S&T] Research (OECD, 2002) = creative work undertaken on a systematic basis in order to increase the stock of knowledge, including knowledge of man, culture and society, and the use of this stock of knowledge to devise new applications Research Excellence (our definition, based on Tijssen, 2003) = the high quality outcome of research 1. Output oriented 2. focus on the quality rather than the quantity 3. focus on top-end rather than average Science and Technology: different ways of evaluation (peers vs. market) Main quality issues of indicators: Extent: scale and scope of the data; type of activities covered How many countries? 27 EU member states + comparator countries At least two time points Reliability: systematic collection of data, consistency over time; i.e., Did definitions change over time? Validity: how well does the data correspond to the phenomenon to be measured? Measures research (as defined); a measure of output; focus on quality rather than quantity; not average but top-end quality Lessons Learnt Case Study II: Reserach Excellence 13 Lessons Learnt Case Study II: Reserach Excellence Issues of Measurement /2 Does the data represent research? IGNORE DATA Some examples Number of publications per public sector researchers? Does the data represent high-end quality aspects of research? Does the data represent research outputs? Does the data represent research inputs (or process) whose outputs are not yet covered by a strong indicator? Specialization in publications in the fields of the Grand Societal Challenges? Share of foreigners in doctoral programmes? => IGNORE these indicators INCLUDE AS STRONG INDICATOR INCLUDE AS ADDITIONAL WEAK INDICATOR Lessons Learnt Case Study II: Reserach Excellence 15 Lessons Learnt Case Study II: Reserach Excellence 16
5 Indicators of research excellence /1 Indicators of research excellence /2 The top-end quality output of scientific research: Excellence of main actors of the research system: Highly cited publications (i.e., top 10%) [HICIT] Extent (+), reliability (+), and validity (+) Highly cited researchers Extent (-), reliability (+), and validity (+) (data not available) Nobel Prizes & Fields Medals Extent (-), reliability (-), and validity (+) Top 500 research organizations (Leiden ranking) Extent (+), reliability (+), and validity (+/-) ERC research grants Extent (+/-), reliability (+), and validity (+/-) Lessons Learnt Case Study II: Reserach Excellence 17 Lessons Learnt Case Study II: Reserach Excellence 18 Indicators of research excellence /3 Never underestimate the choices to make! High-quality technological outcomes of research activities: PCT patent applications Extent (+), reliability (+), and validity (+/-) Triadic patent families (TPF) Extent (-), reliability (+), and validity (+/-) Patent quality indicators (OECD) Extent (-), reliability (+), and validity (+/-) Contractual research Extent (-), reliability (-), and validity (-) PCT/mln pop JP-08 JP-10 JP-09 JP-07 JP-05 JP-06 JP-04 JP-03 JP-02 JP-01 JP TPF/mln pop Decide on the relevant indicators Consider alternative ways to measure, collect relevant data Consider alternative specification i.e., meaning of different numerators / denominators Consider implications meaning, statistical behaviour Long iterative process!!! Lessons Learnt Case Study II: Reserach Excellence 19 Lessons Learnt Case Study II: Reserach Excellence 20
6 How to Best Specify the Indicators? Scale-normalization An example: Universities and Public research organizations (PRO) Aim: simple, possibly uniform solution; high correlation To decide: Source = Leiden ranking vs. ARWU, etc.; SCIMAGO vs. Content = Universities + PRO, how to harmonize? Numerator: Which measure of excellence? How to aggregate from institution score to country scores? What threshold to choose? Denominator: Staff, Population, R&D, etc.? Correlation between Research Excellence indicators and potential normalizing factors Indicator Country group GDP Population GERD Other: HICIT EU Total All Countries Publications TOPINST EU All Countries PCT EU-27 All Countries Number of Researchers ERC EU All Countries Lessons Learnt Case Study II: Reserach Excellence 21 Lessons Learnt Case Study II: Reserach Excellence 22 Indicators selected Code Name Definition Sources HICIT Highly cited Field-normalised count of the 10 % most highly Science Metrix publications per total cited publications divided by total publications (Scopus) publications with an author from that country (years reliable data available: ) PCTPAT PCT Patent Patent applications filed under PCT by inventors OECD applications per country of residence (fractional counting) in all million inhabitants IPC classes per million inhabitants (years reliable data available: ) TOPINST Top universities and Number of top 250 world scientific universities SciMago Institute public research and top 50 public research organisations in a Ranking (Scopus) institutes per total country divided by total R & D expenditures R & D expenditure (years available: , ) ERC ERC grants received per public R & D expenditure Value of ERC grants received by country of host organisation, equally spread over project duration divided by public R & D expenditures (years available: ) ERC, CORDIS DG-RTD Issues of time coverage Aimed for coherence (in order to be able to test other indicators) Constraints: Low overlap Lags due to citation-window for highly cited publications Demand for up-to-date indicators Years Indicator HICIT x x x x x x x x x TOPINST????? PCT (x) (x) (x) (x) (x) (x) x x x x x ERC (x) x x x HICIT x x x x x x x x x TOPINST????? PCT (x) (x) (x) (x) (x) (x) x x x x x Solution chosen: 2 time points selected: 2005 and 2008 for 3-indicators framework covering 41 countries; and 2007 and 2008 for 4 indicator framework covering ERA countries; but labeled as 2005 and 2010 to bear in mind the lag. Lessons Learnt Case Study II: Reserach Excellence 23 Lessons Learnt Case Study II: Reserach Excellence 24
7 0 0 0 Description of Data Section 4 NORMALIZATION, WEIGHTING AND AGGREGATION Indicators: Years considered: HICIT (Number of highly cited Publications per total publications) TOPINST (No. of Top 250 universities and Top 50 research institutes per GERD) PCTPAT (Number of PCT Patent Applications per mln. population) ERC (Value of ERC project grants, per public R & D expenditure) 2003 & & & & 2010 Nr. of Observations Missing a ( %) 0 % 0 % 0 % 17 % Min Max Mean Standard Deviation Skewness Kurtosis Country-year combination Outliers to be treated! Lessons Learnt Case Study II: Reserach Excellence 25 Lessons Learnt Case Study II: Reserach Excellence 26 Variable scores / 1 Variable scores / 2 HICIT ( 2010 ) TOPINST ( 2010 ) HICIT TOPINST PCTPAT ( 2010 ) ERC ( 2010 ) PCTPAT ERC Lessons Learnt Case Study II: Reserach Excellence 27 Outliers to be treated! Lessons Learnt Case Study II: Reserach Excellence 28
8 29 30 Log-transforming ERC Correlation Outliers treated Descriptives N Missing (%) Min Max Mean StDev skewness kurtosis skew>2& kurt>3.5 N. Outliers ERC LnERC % 17% ERC - LOG-TRANSFORMED HICIT TOPINST PCTPAT ERC a HICIT 1 *** *** *** *** TOPINST *** 1 *** *** *** PCTPAT *** *** 1 *** *** ERC a *** *** *** 1 *** NB: *** = significant at 1 %; 40 countries (and EU27 weighted average) at 2 time points combined; a) correlation scores after outlier treatment Cluster analysis Cluster 1 n = 5 countries Cluster 2 n = 14 countries List of countries CH, DK, IL, NL, SE AT, BE, CZ, DE, FI, FR, GR, IT, JP, KR, NO, SK, UK, US Cluster 3 n = 21 countries BG, BR, CN, CY, EE, ES, HR, HU, IE, IN, IS, LT, LU, LV, MT, PL, PT, RO, RU, SI, TR Entire dataset n = 40 countries -4.0 ERC List of indicators Benchmark country with highest score per variable Highly cited publications CH BE IS CH PCT patents SE FI IE SE Top institutes CH BE BG CH Lessons Learnt Case Study II: Reserach Excellence 29 Lessons Learnt Case Study II: Reserach Excellence Aggregation Arithmetic vs. geometric? Geometric reflects excellence = countries need to be good in all aspects Section 5 UNCERTAINTY ANALYSIS Lessons Learnt Case Study II: Reserach Excellence 31 Lessons Learnt Case Study II: Reserach Excellence 32
9 Uncertainty Analysis Steps and considerations Uncertainty in the weights for the variables Reference Alternative HICIT 25 % [15 %-35 %] TOPINST 25 % [15 %-35 %] PCTPAT 25 % [15 %-35 %] ERC 25 % [15 %-35 %] 2. Uncertainty in the aggregation formula Reference Alternative geometric average arithmetic average Lessons Learnt Case Study II: Reserach Excellence 33 Uncertainty Results RE Index "2005" RE Index "2010" Rank Interval Rank Interval Switzerland 1 [1, 1] 1 [1, 1] Netherlands 2 [3, 3] 2 [2, 4] Israel 3 [2, 2] 5 [2, 3] Denmark 4 [4, 5] 3 [4, 5] Sweden 5 [4, 5] 4 [3, 5] Finland 6 [6, 8] 6 [6, 8] Germany 7 [7, 10] 7 [7, 9] Belgium 8 [6, 9] 8 [6, 8] United Kingdom 9 [7, 9] 9 [7, 9] EU [10, 14] 13 [10, 16] France 11 [11, 15] 12 [12, 15] Austria 12 [11, 13] 11 [10, 13] Italy 13 [12, 18] 14 [14, 17] Greece 14 [14, 18] 18 [16, 19] Spain 15 [15, 20] 17 [15, 19] Norway 16 [11, 19] 10 [10, 13] Ireland 17 [17, 20] 16 [13, 19] Hungary 18 [14, 20] 19 [16, 23] Cyprus 19 [7, 21] 21 [12, 25] Iceland 20 [10, 24] 15 [11, 20] Czech Republic 21 [18, 25] 20 [18, 26] Slovenia 22 [20, 24] 22 [21, 26] Portugal 23 [22, 26] 23 [21, 26] Bulgaria 24 [21, 27] 25 [21, 28] Luxembourg 25 [21, 27] 27 [20, 28] Poland 26 [26, 30] 26 [26, 31] Estonia 27 [24, 28] 24 [23, 27] Slovakia 28 [24, 29] 29 [22, 28] Malta 29 [26, 29] 30 [20, 29] Romania 30 [29, 34] 28 [30, 33] Lithuania 31 [30, 32] 31 [29, 31] Turkey 32 [30, 34] 32 [30, 32] Latvia 33 [30, 33] 34 [34, 34] Croatia 34 [31, 34] 33 [32, 33] 34 Lessons Learnt Case Study II: Reserach Excellence Comparing Research Excellence Scores with indicators of Innovation and Competitiveness CH CH CH Section 6 VALIDATION BG RO TR LT LV PL SK HR GR HU MT ES IT CZ PT NO CY EE SI EU27 FR IE NL AT IS LU BE UK FI DE DK SE TR GR RO BG PL SK HR IT LT ES HU CY CZ PT SI LV AT EU27 FR BE IL IS EE DE NO IE LU MT DK NL FI UK SE GR ROSK HR HU BG CY SIPT IT PL MT LTR LV CZ ES EE EU27 IS IE IL FR LU BE DK AT NO NL SE DEFI UK IUS Summary Innovation Index, 2010 IUS Source: European Commission, IUS 2011; Corr = INSEAD Global Innovation Index 2012 GII Source: INSEAD, 2012; Corr = WEFORUM Global Competitiveness Index 2012 GCI Source: World Economic Forum, 2012; Corr = Lessons Learnt Case Study II: Reserach Excellence 35 Lessons Learnt Case Study II: Reserach Excellence 36
10 37 38 Further exploring correlations Correlations, no causal relations! LU GR PT LV IT PL DE ES HU DK NO CH IS BE FR SE AT IE EU27 GR ES HU BG CY CZ PT SI EE PL SK RO MT TR LT LVHR UK CZ IL FI IT SE FR DK FI DE BE UK AT IS CH NL IE GDP/capita, USD PPP k=2005, 2008 GDP: World Bank WDI; Corr.=0.448 NO LU Interpretation, cautionary remarks, recommendations Use the proposed composite indicator as an input to the broader debate on measuring and monitoring research activities at the country level; a necessary but also preliminary step to inform research policymakers. results conditional upon the conceptual choices made (and sometimes were forced to make due to our ignorance) and the data that we used (and sometimes were restricted in using due to a lack in available alternatives) Next steps: necessity of collecting and using alternative data and methods for the analysis Policy recommendations: Focus more on establishing research excellence embodied by people Improve either scientific or technological research excellence PISA Overall average scores, 2000 PISA scores source: OECD; Corr = Lessons Learnt Case Study II: Reserach Excellence 37 Lessons Learnt Case Study II: Reserach Excellence 38
PROGRESS TOWARDS THE LISBON OBJECTIVES IN EDUCATION AND TRAINING
COMMISSION OF THE EUROPEAN COMMUNITIES Commission staff working document PROGRESS TOWARDS THE LISBON OBJECTIVES IN EDUCATION AND TRAINING Indicators and benchmarks 2008 This publication is based on document
More informationThe European Higher Education Area in 2012:
PRESS BRIEFING The European Higher Education Area in 2012: Bologna Process Implementation Report EURYDI CE CONTEXT The Bologna Process Implementation Report is the result of a joint effort by Eurostat,
More informationEQE Candidate Support Project (CSP) Frequently Asked Questions - National Offices
EQE Candidate Support Project (CSP) Frequently Asked Questions - National Offices What is the EQE Candidate Support Project (CSP)? What is the distribution of Professional Representatives within EPC member
More informationMay To print or download your own copies of this document visit Name Date Eurovision Numeracy Assignment
1. An estimated one hundred and twenty five million people across the world watch the Eurovision Song Contest every year. Write this number in figures. 2. Complete the table below. 2004 2005 2006 2007
More informationSOCRATES PROGRAMME GUIDELINES FOR APPLICANTS
SOCRATES PROGRAMME GUIDELINES FOR APPLICANTS The present document contains a description of the financial support available under all parts of the Community action programme in the field of education,
More informationIntroduction Research Teaching Cooperation Faculties. University of Oulu
University of Oulu Founded in 1958 faculties 1 000 students 2900 employees Total funding EUR 22 million Among the largest universities in Finland with an exceptionally wide scientific base Three universities
More informationDepartment of Education and Skills. Memorandum
Department of Education and Skills Memorandum Irish Students Performance in PISA 2012 1. Background 1.1. What is PISA? The Programme for International Student Assessment (PISA) is a project of the Organisation
More informationUNIVERSITY AUTONOMY IN EUROPE II
UNIVERSITY AUTONOMY IN EUROPE II THE SCORECARD By Thomas Estermann, Terhi Nokkala & Monika Steinel Copyright 2011 European University Association All rights reserved. This information may be freely used
More informationChallenges for Higher Education in Europe: Socio-economic and Political Transformations
Challenges for Higher Education in Europe: Socio-economic and Political Transformations Steinhardt Institute NYU 15 June, 2017 Peter Maassen US governance of higher education EU governance of higher
More informationTwenty years of TIMSS in England. NFER Education Briefings. What is TIMSS?
NFER Education Briefings Twenty years of TIMSS in England What is TIMSS? The Trends in International Mathematics and Science Study (TIMSS) is a worldwide research project run by the IEA 1. It takes place
More informationScience and Technology Indicators. R&D statistics
2014 Science and Technology Indicators R&D statistics Science and Technology Indicators R&D statistics 2014 Published by NIFU Nordic Institute for Studies in Innovation, Research and Education Address
More informationNational Academies STEM Workforce Summit
National Academies STEM Workforce Summit September 21-22, 2015 Irwin Kirsch Director, Center for Global Assessment PIAAC and Policy Research ETS Policy Research using PIAAC data America s Skills Challenge:
More informationOverall student visa trends June 2017
Overall student visa trends June 2017 Acronyms Acronyms FSV First-time student visas The number of visas issued to students for the first time. Visas for dependants and Section 61 applicants are excluded
More informationPIRLS. International Achievement in the Processes of Reading Comprehension Results from PIRLS 2001 in 35 Countries
Ina V.S. Mullis Michael O. Martin Eugenio J. Gonzalez PIRLS International Achievement in the Processes of Reading Comprehension Results from PIRLS 2001 in 35 Countries International Study Center International
More informationThe development of national qualifications frameworks in Europe
European Centre for the Development of Vocational Training WORKING PAPER No 8 The development of national qualifications frameworks in Europe Luxembourg: Publications Office of the European Union, 2010
More informationEducating for innovationdriven
New Delhi, 9 May 2012 Educating for innovationdriven societies! Stéphan Vincent-Lancrin Senior Analyst & Project Leader OECD Skills and education for innovation «21st Century Skills»! Education and training
More informationTeaching Practices and Social Capital
D I S C U S S I O N P A P E R S E R I E S IZA DP No. 6052 Teaching Practices and Social Capital Yann Algan Pierre Cahuc Andrei Shleifer October 2011 Forschungsinstitut zur Zukunft der Arbeit Institute
More informationThe Survey of Adult Skills (PIAAC) provides a picture of adults proficiency in three key information-processing skills:
SPAIN Key issues The gap between the skills proficiency of the youngest and oldest adults in Spain is the second largest in the survey. About one in four adults in Spain scores at the lowest levels in
More informationImpact of Educational Reforms to International Cooperation CASE: Finland
Impact of Educational Reforms to International Cooperation CASE: Finland February 11, 2016 10 th Seminar on Cooperation between Russian and Finnish Institutions of Higher Education Tiina Vihma-Purovaara
More informationSummary and policy recommendations
Skills Beyond School Synthesis Report OECD 2014 Summary and policy recommendations The hidden world of professional education and training Post-secondary vocational education and training plays an under-recognised
More informationSECTION 2 APPENDICES 2A, 2B & 2C. Bachelor of Dental Surgery
Cardiff University College of Biomedical and Life Sciences School of Dentistry Entry 2017 SECTION 2 APPENDICES 2A, 2B & 2C Bachelor of Dental Surgery Admissions Policy for Undergraduate Courses Entry 2017
More informationDEVELOPMENT AID AT A GLANCE
DEVELOPMENT AID AT A GLANCE STATISTICS BY REGION 2. AFRICA 217 edition 2.1. ODA TO AFRICA - SUMMARY 2.1.1. Top 1 ODA receipts by recipient USD million, net disbursements in 21 2.1.3. Trends in ODA 1 Ethiopia
More informationehealth Governance Initiative: Joint Action JA-EHGov & Thematic Network SEHGovIA DELIVERABLE Version: 2.4 Date:
ehealth Governance Initiative: Joint Action JA-EHGov & Thematic Network SEHGovIA DELIVERABLE JA D4.1.1 Strategy & Policy Alignment Documents I WP4 (JA) - Policy Development and Strategy Alignment Version:
More informationThe recognition, evaluation and accreditation of European Postgraduate Programmes.
1 The recognition, evaluation and accreditation of European Postgraduate Programmes. Sue Lawrence and Nol Reverda Introduction The validation of awards and courses within higher education has traditionally,
More informationThe development of ECVET in Europe
European Centre for the Development of Vocational Training WORKING PAPER No 14 The development of ECVET in Europe (2011) Luxembourg: Publications Office of the European Union, 2012 The development of
More informationWelcome to. ECML/PKDD 2004 Community meeting
Welcome to ECML/PKDD 2004 Community meeting A brief report from the program chairs Jean-Francois Boulicaut, INSA-Lyon, France Floriana Esposito, University of Bari, Italy Fosca Giannotti, ISTI-CNR, Pisa,
More informationNational Pre Analysis Report. Republic of MACEDONIA. Goce Delcev University Stip
National Pre Analysis Report Republic of MACEDONIA Goce Delcev University Stip The European Commission support for the production of this publication does not constitute an endorsement of the contents
More informationDISCUSSION PAPER. In 2006 the population of Iceland was 308 thousand people and 62% live in the capital area.
Increasing Employment of Older Workers through Lifelong Learning Discussion Paper Jón Torfi Jónasson Institute of Social Science Research, University of Iceland Introduction This Peer Review is concerned
More informationTailoring i EW-MFA (Economy-Wide Material Flow Accounting/Analysis) information and indicators
Tailoring i EW-MFA (Economy-Wide Material Flow Accounting/Analysis) information and indicators to developing Asia: increasing research capacity and stimulating policy demand for resource productivity Chika
More informationA comparative study on cost-sharing in higher education Using the case study approach to contribute to evidence-based policy
A comparative study on cost-sharing in higher education Using the case study approach to contribute to evidence-based policy Tuition fees between sacred cow and cash cow Conference of Vlaams Verbond van
More informationTIMSS Highlights from the Primary Grades
TIMSS International Study Center June 1997 BOSTON COLLEGE TIMSS Highlights from the Primary Grades THIRD INTERNATIONAL MATHEMATICS AND SCIENCE STUDY Most Recent Publications International comparative results
More informationStudents with Disabilities, Learning Difficulties and Disadvantages STATISTICS AND INDICATORS
Students with Disabilities, Learning Difficulties and Disadvantages STATISTICS AND INDICATORS CENTRE FOR EDUCATIONAL RESEARCH AND INNOVATION Students with Disabilities, Learning Difficulties and Disadvantages
More informationCALL FOR PARTICIPANTS
CALL FOR PARTICIPANTS TRAINING OF TRAINERS FOR EUROPEAN ERASMUS+: YOUTH IN ACTION PROJECTS 2017/18 CALL FOR PARTICIPANTS YOU HAVE...already gained experience as a trainer within the field of Non-Formal
More informationFinanciación de las instituciones europeas de educación superior. Funding of European higher education institutions. Resumen
Financiación de las instituciones europeas de educación superior Funding of European higher education institutions 1 Thomas Estermann Head of Unit Governance, Autonomy and Funding European University Association
More informationEUROPEAN-ACCREDITED ENGINEERING MASTER DEGREE PROGRAMME.
Ingénieur d excellence de l, spécialité Génie mécanique (production automatisée ) Engineering master degr ee in Mechanical engineering Brussels, 17th of march 2017 Ingénieur d excellence de l, spécialité
More informationUniversities as Laboratories for Societal Multilingualism: Insights from Implementation
Universities as Laboratories for Societal Multilingualism: Insights from Implementation Dr. Thomas Vogel Europa-Universität Viadrina vogel@europa-uni.de The Agenda 1. Language policy issues 2. The global
More informationThe development of ECVET in Europe
European Centre for the Development of Vocational Training WORKING PAPER No 10 The development of ECVET in Europe Luxembourg: Publications Office of the European Union, 2010 The development of ECVET in
More information15-year-olds enrolled full-time in educational institutions;
CHAPTER 4 SAMPLE DESIGN TARGET POPULATION AND OVERVIEW OF THE SAMPLING DESIGN The desired base PISA target population in each country consisted of 15-year-old students attending educational institutions
More informationIAB INTERNATIONAL AUTHORISATION BOARD Doc. IAB-WGA
GROUP A EDUCATION, TRAINING AND QUALIFICATION MINUTES OF THE MEETING HELD ON 28 AUGUST 2006 IN QUÉBEC CANADA 1. Welcome and Apologies Christian AHRENS opened the meeting welcoming everyone. Apologies had
More informationResearch training and national innovation systems in Australia, Finland and the United States
Research training and national innovation systems in Australia, Finland and the United States A policy and systems study supported by 30 case studies of research students in the fields of geospatial science,
More informationNorth American Studies (MA)
North American Studies (MA) Master Discover the world at Leiden University Type Language City Master English Leiden Taking an integrated approach to the study of the United States, the MA North American
More informationNA/2006/17 Annexe-1 Lifelong Learning Programme for Community Action in the Field of Lifelong Learning (Lifelong Learning Programme LLP)
Lifelong Learning Programme for Community Action in the Field of Lifelong Learning (Lifelong Learning Programme LLP) Guide for Applicants 2007-2013 1 First level (page 1) NA/2006/17 A What the LLP offers
More informationDocument number: 2013/ Programs Committee 6/2014 (July) Agenda Item 42.0 Bachelor of Engineering with Honours in Software Engineering
Document number: 2013/0006139 Programs Committee 6/2014 (July) Agenda Item 42.0 Bachelor of Engineering with Honours in Software Engineering Program Learning Outcomes Threshold Learning Outcomes for Engineering
More informationEducational system gaps in Romania. Roberta Mihaela Stanef *, Alina Magdalena Manole
Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Scien ce s 93 ( 2013 ) 794 798 3rd World Conference on Learning, Teaching and Educational Leadership (WCLTA-2012)
More informationThe Rise of Populism. December 8-10, 2017
The Rise of Populism December 8-10, 2017 The Rise of Populism LIST OF PARTICIPATING SCHOOL Byron College B Arsakeio Tositseio Lykeio Ekalis A Tositseio Arsakeio Lykeio Ekalis QSI Tbilisi Ionios School
More informationHIGHER EDUCATION IN POLAND
http://en.uw.edu.pl HIGHER EDUCATION IN POLAND 132 public Higher Education Institutions (HEIs) 1.4 million students every year receive their education in Poland 65 800 long-term international students
More informationMODERNISATION OF HIGHER EDUCATION PROGRAMMES IN THE FRAMEWORK OF BOLOGNA: ECTS AND THE TUNING APPROACH
EUROPEAN CREDIT TRANSFER AND ACCUMULATION SYSTEM (ECTS): Priorities and challenges for Lithuanian Higher Education Vilnius 27 April 2011 MODERNISATION OF HIGHER EDUCATION PROGRAMMES IN THE FRAMEWORK OF
More informationESTONIA. spotlight on VET. Education and training in figures. spotlight on VET
Education and training in figures Upper secondary students (ISCED 11 level 3) enrolled in vocational and general % of all students in upper secondary education, 14 GERAL VOCATIONAL 1 8 26.6 29.6 6.3 2.6
More informationMaster in International Economics and Public Policy. Christoph Wirp MIEPP Program Manager
Master in International Economics and Public Policy Christoph Wirp MIEPP Program Manager Welcome! Content Content 1. Introduction 2. Structure 3. Exams 4. Important Dates 5. Newsletter 6. Links 1. Introduction
More informationTERTIARY EDUCATION BOOM IN EU COUNTRIES: KEY TO ENHANCING COMPETITIVENESS OR A WASTE OF RESOURCES?
Studia Ekonomiczne. Zeszyty Naukowe Uniwersytetu Ekonomicznego w Katowicach ISSN 2083-8611 Nr 271 2016 Uniwersytet Warszawski Wydział Nauk Ekonomicznych Katedra Makroekonomii i Teorii Handlu Zagranicznego
More informationEQF Pro 1 st Partner Meeting Lille, 28 March 2008, 9:30 16:30.
EQF Pro 1 st Partner Meeting Lille,, 9:30 16:30. Present: Michel Feutrie (MF); Danièle Pouliquen (DP), Maike Schansker (MS), Isabel Martins (IM), Joana Coutinho (JC), Doris Gomezlj (DG), Jean-Marie Dujardin
More informationStudy on the implementation and development of an ECVET system for apprenticeship
Study on the implementation and development of an ECVET system for apprenticeship Thomas Reglin Gabriele Fietz Forschungsinstitut Betriebliche Bildung (f-bb) ggmbh Nuremberg Isabelle Le Mouillour BIBB,
More informationHIGHLIGHTS OF FINDINGS FROM MAJOR INTERNATIONAL STUDY ON PEDAGOGY AND ICT USE IN SCHOOLS
HIGHLIGHTS OF FINDINGS FROM MAJOR INTERNATIONAL STUDY ON PEDAGOGY AND ICT USE IN SCHOOLS Hans Wagemaker Executive Director, IEA Nancy Law Director, CITE, University of Hong Kong SITES 2006 International
More information06-07 th September 2012, Constanta Romania th Sept 2012
Cerintele actuale pentru pregatirea specialistilor din industria alimentara din Europa si strategii pentru viitorul acestei cariere - rezultate ale proiectului european fp7 Track Fast Training Requirements
More informationExtending Place Value with Whole Numbers to 1,000,000
Grade 4 Mathematics, Quarter 1, Unit 1.1 Extending Place Value with Whole Numbers to 1,000,000 Overview Number of Instructional Days: 10 (1 day = 45 minutes) Content to Be Learned Recognize that a digit
More informationinternational PROJECTS MOSCOW
international PROJECTS MOSCOW Lomonosov Moscow State University, Faculty of Journalism INTERNATIONAL EXCHANGES Journalism & Communication Partners IHECS Lomonosov Moscow State University, Faculty of Journalism
More informationInvestment in e- journals, use and research outcomes
Investment in e- journals, use and research outcomes David Nicholas CIBER Research Limited, UK Ian Rowlands University of Leicester, UK Library Return on Investment seminar Universite de Lyon, 20-21 February
More informationMeasuring up: Canadian Results of the OECD PISA Study
Measuring up: Canadian Results of the OECD PISA Study The Performance of Canada s Youth in Science, Reading and Mathematics 2015 First Results for Canadians Aged 15 Measuring up: Canadian Results of the
More informationRethinking Library and Information Studies in Spain: Crossing the boundaries
Rethinking Library and Information Studies in Spain: Crossing the boundaries V IRGINIA O RTIZ- R EPISO U NIVERSIDAD C ARLOS III DE M ADRID D EPARTAMENTO DE B IBLIOTECONOMIA Y D OCUMENTACIÓN Barcelona,
More informationSelf Awareness, evaluation and motivation system Enhancing learning and integration and contrast ELS and NEET
Self Awareness, evaluation and motivation system Enhancing learning and integration and contrast ELS and NEET ERASMUS + 2014 Strategic Partnership Project SAVE project Self Awareness, evaluation and Motivation
More informationAnalysis of European Medical Schools Teaching Programs
44(1):26-31,2003 STUDENT CMJ Analysis of European Medical s Teaching Programs Tina Dušek, Tamara Bates Zagreb University of Medicine, Zagreb, Croatia Aim. To compare the teaching programs of European medical
More informationEU Education of Fluency Specialists
EU Education of Fluency Specialists C. Hylebos, Artevelde College, Gent, Belgium M. Leahy, Trinity College Dublin, Ireland Background Evolution in the field of SLT Broadening of SLT field More specialized
More informationModern Trends in Higher Education Funding. Tilea Doina Maria a, Vasile Bleotu b
Available online at www.sciencedirect.com ScienceDirect Procedia - Social and Behavioral Scien ce s 116 ( 2014 ) 2226 2230 Abstract 5 th World Conference on Educational Sciences - WCES 2013 Modern Trends
More information2001 MPhil in Information Science Teaching, from Department of Primary Education, University of Crete.
Athanasia K. Margetousaki Nikolaou Plastira 100, Vassilika Vouton GR 700 13 Heraklion, Crete Greece Phone. +302810391828 Fax: +30 2810 391583 e-mail amarge@iacm.forht.gr, amarge@edc.uoc.gr STUDIES 1995
More information03/07/15. Research-based welfare education. A policy brief
03/07/15 Research-based welfare education in the Nordics A policy brief For information on obtaining additional copies, permission to reprint or translate this work, and all other correspondence, please
More informationWELCOME WEBBASED E-LEARNING FOR SME AND CRAFTSMEN OF MODERN EUROPE
WELCOME WEBBASED E-LEARNING FOR SME AND CRAFTSMEN OF MODERN EUROPE Authors Helena Bijnens, EuroPACE ivzw, Belgium, Johannes De Gruyter, EuroPACE ivzw, Belgium, Ilse Op de Beeck, EuroPACE ivzw, Belgium,
More informationInformation needed to facilitate the clarity, transparency and understanding of mitigation contributions
Climate Change Expert Group Paper No.2017(1) Information needed to facilitate the clarity, transparency and understanding of mitigation contributions Sara Moarif (IEA) May 2017 Unclassified COM/ENV/EPOC/IEA/SLT(2017)1
More informationA TRAINING COURSE FUNDED UNDER THE TCP BUDGET OF THE YOUTH IN ACTION PROGRAMME FROM 2009 TO 2013 THE POWER OF 6 TESTIMONIES OF STRONG OUTCOMES
A TRAINING COURSE FUNDED UNDER THE TCP BUDGET OF THE YOUTH IN ACTION PROGRAMME FROM 2009 TO 2013 THE POWER OF 6 TESTIMONIES OF STRONG OUTCOMES 1 TRAINING COURSE: THE POWER OF NON FORMAL EDUCATION In 2009,
More informationFrom Empire to Twenty-First Century Britain: Economic and Political Development of Great Britain in the 19th and 20th Centuries 5HD391
Provisional list of courses for Exchange students Fall semester 2017: University of Economics, Prague Courses stated below are offered by particular departments and faculties at the University of Economics,
More informationCEF, oral assessment and autonomous learning in daily college practice
CEF, oral assessment and autonomous learning in daily college practice ULB Lut Baten K.U.Leuven An innovative web environment for online oral assessment of intercultural professional contexts 1 Demos The
More informationWE STRENGTHEN SCIENCE AND THE HUMANITIES IN AUSTRIA.
WE STRENGTHEN SCIENCE AND THE HUMANITIES IN AUSTRIA. Austrian Science Fund (FWF) University of Veterinary Medicine and University of Natural Resources and Life Sciences Vienna, April 16, 2015 Presenter
More informationImproving education in the Gulf
Improving education in the Gulf 39 Improving education in the Gulf Educational reform should focus on outcomes, not inputs. Michael Barber, Mona Mourshed, and Fenton Whelan Having largely achieved the
More informationOECD THEMATIC REVIEW OF TERTIARY EDUCATION GUIDELINES FOR COUNTRY PARTICIPATION IN THE REVIEW
OECD THEMATIC REVIEW OF TERTIARY EDUCATION GUIDELINES FOR COUNTRY PARTICIPATION IN THE REVIEW JUNE 2004 CONTENTS I BACKGROUND... 1 1. The thematic review... 1 1.1 The objectives of the OECD thematic review
More informationThe Economic Impact of International Students in Wales
November 2017 The Economic Impact of International Students in Wales Ursula Kelly & Iain McNicoll Viewforth Consulting Ltd Universities Wales Prifysgolion Cymru EXECUTIVE SUMMARY THE ECONOMIC IMPACT OF
More informationCouncil of the European Union Brussels, 4 November 2015 (OR. en)
Council of the European Union Brussels, 4 November 2015 (OR. en) 13631/15 NOTE From: To: General Secretariat of the Council JEUN 96 EDUC 285 SOC 633 EMPL 416 CULT 73 SAN 356 Permanent Representatives Committee/Council
More informationCalifornia Digital Libraries Discussion Group. Trends in digital libraries and scholarly communication among European Academic Research Libraries
California Digital Libraries Discussion Group Trends in digital libraries and scholarly communication among European Academic Research Libraries Valentina Comba InterLibrary Center (CIB) University of
More informationCHAPTER 3 CURRENT PERFORMANCE
CHAPTER 3 current 3-1 3. Current Performance The examination of the performance of the n education system begins with an analysis of how students have fared over time, and in comparison with other countries,
More informationInternational House VANCOUVER / WHISTLER WORK EXPERIENCE
International House VANCOUVER / WHISTLER WORK EXPERIENCE 2 3 work experience At IH Vancouver, we understand that language acquisition is only the first step in achieving your career goals. With this in
More informationD.10.7 Dissemination Conference - Conference Minutes
Project No. 540346-LLP-1-2013-1-GR-LEONARDO-LNW D.10.7 Dissemination Conference - Conference Minutes Effective Writers & Communicators Project September 2015 This project has been funded with support from
More informationCOMMISSION OF THE EUROPEAN COMMUNITIES
COMMISSION OF THE EUROPEAN COMMUNITIES Brussels, 29.05.1998 SEC(I 998) 909 final Commission Working document on bilateraland multilateral cooperation between the.1.\'lember States of the European Union
More informationEUROPEAN STUDY & CAREER FAIR
3 rd of April 2013 MANNHEIM, GERMANY EUROPEAN STUDY & CAREER FAIR EUROPEAN STUDENTS FORUM Partners: The EUROPEAN STUDY AND CAREER FAIR, which takes place in Mannheim, Germany on 3rd of April 2012, brings
More informationPUBLIC CASE REPORT Use of the GeoGebra software at upper secondary school
PUBLIC CASE REPORT Use of the GeoGebra software at upper secondary school Linked to the pedagogical activity: Use of the GeoGebra software at upper secondary school Written by: Philippe Leclère, Cyrille
More informationREGISTRATION OF THE EXPRESSIONS OF INTEREST
Republic of Moldova Ministry of Transport and Road Infrastructure STATE ROAD ADMINISTRATION ROAD SECTOR PROGRAM TECHNICAL SUPERVISION OF THE EXECUTION OF REHABILITATION WORKS ON R9 SOROCA-ARIONESTI REGISTRATION
More informationThe International Coach Federation (ICF) Global Consumer Awareness Study
www.pwc.com The International Coach Federation (ICF) Global Consumer Awareness Study Summary of the Main Regional Results and Variations Fort Worth, Texas Presentation Structure 2 Research Overview 3 Research
More informationREFLECTIONS ON THE PERFORMANCE OF THE MEXICAN EDUCATION SYSTEM
DIRECTORATE FOR EDUCATION REFLECTIONS ON THE PERFORMANCE OF THE MEXICAN EDUCATION SYSTEM DAVID HOPKINS 1, ELPIDA AHTARIDOU, PETER MATTHEWS, CHARLES POSNER AND DIANA TOLEDO FIGUEROA 2 LONDON CENTRE FOR
More informationLifelong Learning Programme. Implementation of the European Agenda for Adult Learning
Lifelong Learning Programme Implementation of the European Agenda for Adult Learning Peer learning activity on supporting adults into work by connecting European instruments EQF, ECVET and validation of
More information2 ND BASIC IRRS TRAINING COURSE
2 ND BASIC IRRS TRAINING COURSE INTERNATIONAL ATOMIC ENERGY AGENCY VIENNA, 6-9 OCTOBER 2014 INFORMATION BROCHURE 1 Basic IRRS Training (BIT) Table of Contents I. GENERAL INFORMATION... 2 II. AGENDA OF
More informationCOMMISSION OF THE EUROPEAN COMMUNITIES RECOMMENDATION OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL
EN EN EN COMMISSION OF THE EUROPEAN COMMUNITIES Brussels, 9.4.2008 COM(2008) 180 final 2008/0070 (COD) RECOMMENDATION OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL on the establishment of the European
More informationProbability and Statistics Curriculum Pacing Guide
Unit 1 Terms PS.SPMJ.3 PS.SPMJ.5 Plan and conduct a survey to answer a statistical question. Recognize how the plan addresses sampling technique, randomization, measurement of experimental error and methods
More informationCourses below are sorted by the column Field of study for your better orientation. The list is subject to change.
Provisional list of courses for Exchange students Spring semester 2017: University of Economics, Prague Courses stated below are offered by particular departments and faculties at the University of Economics,
More informationSteinbeis Transfer Institut - Management Education Network - Filderhauptstrasse Stuttgart - Germany Phone Fax + 49
Steinbeis Transfer Institut - Management Education Network - Filderhauptstrasse 142-70599 Stuttgart - Germany Phone + 49 711 451 001-33 - Fax + 49 711 451 001-45 www.uni-simt.de Strategic Management and
More informationLIFELONG LEARNING PROGRAMME ERASMUS Academic Network
SOCRATES THEMATIC NETWORK AQUACULTURE, FISHERIES AND AQUATIC RESOURCE MANAGEMENT 2008-11 LIFELONG LEARNING PROGRAMME ERASMUS Academic Network Minutes of the WP 1 Core Group Meeting (year 2) May 31 st June
More informationProgramme Specification
Programme Specification Title: Accounting and Finance Final Award: Master of Science (MSc) With Exit Awards at: Postgraduate Certificate (PG Cert) Postgraduate Diploma (PG Dip) Master of Science (MSc)
More informationMarie Skłodowska-Curie Actions (MSCA)
Education Marie Skłodowska-Curie Actions (MSCA) South Africa-European Union Space Dialogue Workshop on Scientific, Technical and Entrepreneurial Skills Development for the Space Sector 19 Nov. 2013 Pretoria
More informationNational and Regional performance and accountability: State of the Nation/Region Program Costa Rica.
National and Regional performance and accountability: State of the Nation/Region Program Costa Rica. Miguel Gutierrez Saxe. 1 The State of the Nation Report: a method to learn and think about a country.
More informationMath-U-See Correlation with the Common Core State Standards for Mathematical Content for Third Grade
Math-U-See Correlation with the Common Core State Standards for Mathematical Content for Third Grade The third grade standards primarily address multiplication and division, which are covered in Math-U-See
More informationHigher education is becoming a major driver of economic competitiveness
Executive Summary Higher education is becoming a major driver of economic competitiveness in an increasingly knowledge-driven global economy. The imperative for countries to improve employment skills calls
More informationAdvances in Aviation Management Education
Advances in Aviation Management Education by Dr. Dale Doreen, Director International Aviation MBA Program John Molson School of Business Concordia University 15 th Annual Canadian Aviation Safety Seminar
More informationIntroduction. Background. Social Work in Europe. Volume 5 Number 3
12 The Development of the MACESS Post-graduate Programme for the Social Professions in Europe: The Hogeschool Maastricht/ University of North London Experience Sue Lawrence and Nol Reverda The authors
More information