Reviewing the state of scientific research based on statistics on research and bibliometrics

Similar documents
Impact of Educational Reforms to International Cooperation CASE: Finland

Introduction Research Teaching Cooperation Faculties. University of Oulu

National Academies STEM Workforce Summit

Department of Education and Skills. Memorandum

Summary and policy recommendations

The European Higher Education Area in 2012:

Science and Technology Indicators. R&D statistics

Twenty years of TIMSS in England. NFER Education Briefings. What is TIMSS?

PROGRESS TOWARDS THE LISBON OBJECTIVES IN EDUCATION AND TRAINING

Open Science at Tritonia Academic Library, University of Vaasa, Finland

Overall student visa trends June 2017

Students with Disabilities, Learning Difficulties and Disadvantages STATISTICS AND INDICATORS

The Survey of Adult Skills (PIAAC) provides a picture of adults proficiency in three key information-processing skills:

DEVELOPMENT AID AT A GLANCE

Tuition fees: Experiences in Finland

May To print or download your own copies of this document visit Name Date Eurovision Numeracy Assignment

SOCRATES PROGRAMME GUIDELINES FOR APPLICANTS

Challenges for Higher Education in Europe: Socio-economic and Political Transformations

Welcome to. ECML/PKDD 2004 Community meeting

JAMK UNIVERSITY OF APPLIED SCIENCES

ehealth Governance Initiative: Joint Action JA-EHGov & Thematic Network SEHGovIA DELIVERABLE Version: 2.4 Date:

Tailoring i EW-MFA (Economy-Wide Material Flow Accounting/Analysis) information and indicators

Educating for innovationdriven

Rethinking Library and Information Studies in Spain: Crossing the boundaries

TIMSS Highlights from the Primary Grades

Teaching Practices and Social Capital

Summary results (year 1-3)

HIGHLIGHTS OF FINDINGS FROM MAJOR INTERNATIONAL STUDY ON PEDAGOGY AND ICT USE IN SCHOOLS

EXECUTIVE SUMMARY. TIMSS 1999 International Science Report

SECTION 2 APPENDICES 2A, 2B & 2C. Bachelor of Dental Surgery

The recognition, evaluation and accreditation of European Postgraduate Programmes.

international PROJECTS MOSCOW

The development of national qualifications frameworks in Europe

FACULTY OF PSYCHOLOGY

UNIVERSITY AUTONOMY IN EUROPE II

Self-archived version. Citation:

EUROPEAN UNIVERSITIES LOOKING FORWARD WITH CONFIDENCE PRAGUE DECLARATION 2009

EQE Candidate Support Project (CSP) Frequently Asked Questions - National Offices

National Pre Analysis Report. Republic of MACEDONIA. Goce Delcev University Stip

Universities as Laboratories for Societal Multilingualism: Insights from Implementation

HIGHER EDUCATION IN POLAND

MISSISSIPPI STATE UNIVERSITY SUG FACULTY SALARY DATA BY COLLEGE BY DISCIPLINE

A comparative study on cost-sharing in higher education Using the case study approach to contribute to evidence-based policy

PIRLS. International Achievement in the Processes of Reading Comprehension Results from PIRLS 2001 in 35 Countries

World University Rankings. Where s India?

Co-operation between Higher Education Institutions in Oulu. 30. September 2015 Jouko Paaso President, CEO

RELATIONS. I. Facts and Trends INTERNATIONAL. II. Profile of Graduates. Placement Report. IV. Recruiting Companies

IAB INTERNATIONAL AUTHORISATION BOARD Doc. IAB-WGA

MISSISSIPPI STATE UNIVERSITY SUG FACULTY SALARY DATA BY COLLEGE BY DISCIPLINE 12 month salaries converted to 9 month

Building Bridges Globally

The International Coach Federation (ICF) Global Consumer Awareness Study

Supplementary Report to the HEFCE Higher Education Workforce Framework

Training Programme for Doctoral Thesis Supervisors in University of Turku

ESTONIA. spotlight on VET. Education and training in figures. spotlight on VET

2. 20 % of available places are awarded to other foreign applicants.

Academic profession in Europe

STRA S TE TRA G TE Y G Y

The development of ECVET in Europe

Interview on Quality Education

Pharmaceutical Medicine as a Specialised Discipline of Medicine

A European inventory on validation of non-formal and informal learning

Evaluation Report Output 01: Best practices analysis and exhibition

Financiación de las instituciones europeas de educación superior. Funding of European higher education institutions. Resumen

Summary Report. ECVET Agent Exploration Study. Prepared by Meath Partnership February 2015

Master s Degree Programme in East Asian Studies

Advances in Aviation Management Education

Question 1 Does the concept of "part-time study" exist in your University and, if yes, how is it put into practice, is it possible in every Faculty?

EXECUTIVE SUMMARY. TIMSS 1999 International Mathematics Report

DISCUSSION PAPER. In 2006 the population of Iceland was 308 thousand people and 62% live in the capital area.

International House VANCOUVER / WHISTLER WORK EXPERIENCE

Study on the implementation and development of an ECVET system for apprenticeship

MODERNISATION OF HIGHER EDUCATION PROGRAMMES IN THE FRAMEWORK OF BOLOGNA: ECTS AND THE TUNING APPROACH

COMMISSION OF THE EUROPEAN COMMUNITIES RECOMMENDATION OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL

The development of ECVET in Europe

03/07/15. Research-based welfare education. A policy brief

Organising ROSE (The Relevance of Science Education) survey in Finland

Students representation in institutional governance Case: Finland

The Ohio State University Library System Improvement Request,

EUROPEAN STUDY & CAREER FAIR

The Rise of Populism. December 8-10, 2017

06-07 th September 2012, Constanta Romania th Sept 2012

University of Toronto

PROJECT PERIODIC REPORT

BalticSeaNow.info- Innovative participatory forum for the Baltic Sea.

Analysis of European Medical Schools Teaching Programs

Texas Healthcare & Bioscience Institute

GLOBAL INSTITUTIONAL PROFILES PROJECT Times Higher Education World University Rankings

WE STRENGTHEN SCIENCE AND THE HUMANITIES IN AUSTRIA.

DEPARTMENT OF SOCIAL SCIENCES

Eye Level Education. Program Orientation

The Junior Community in ALICE. Hans Beck for the ALICE collaboration 07/07/2017

SCOPUS An eye on global research. Ayesha Abed Library

How to Search for BSU Study Abroad Programs

UPPER SECONDARY CURRICULUM OPTIONS AND LABOR MARKET PERFORMANCE: EVIDENCE FROM A GRADUATES SURVEY IN GREECE

2015 Academic Program Review. School of Natural Resources University of Nebraska Lincoln

CEF, oral assessment and autonomous learning in daily college practice

Modern Trends in Higher Education Funding. Tilea Doina Maria a, Vasile Bleotu b

EUA Quality Culture: Implementing Bologna Reforms

The Netherlands. Jeroen Huisman. Introduction

A Finnish Academic Libraries Perspective on the Information Literacy Framework

Transcription:

Reviewing the state of scientific research based on statistics on research and bibliometrics 3 Nov, 2017 STI seminar in Tartu Estonian Research Council Anu Nuutinen Senior Science Adviser Academy of Finland 1

Academy of Finland in a nutshell Key public funding agency for scientific research, major player in science policy in Finland Strategic Research Council Funding budget 2017 Finnish Research Infrastructure Committee 437m to support scientific research to improve framework conditions for research 140 employees Four research councils Research Council for Biosciences and Environment Research Council for Culture and Society Research Council for Natural Sciences and Engineering Research Council for Health Part of the Academy of Finland s funds ( 70.7m in 2017) come from proceeds of Finland s national gaming company Veikkaus. 2 ACADEMY OF FINLAND 2017

The Academy of Finland s reviews of the state of scientific research in Finland Support Finnish universities and research institutes in their efforts to further develop their operations Serve to strengthen the knowledge base for policy-making The Academy has produced reviews regularly since late 1990s, at two-year intervals since 2012 Complementary analyses between the publication years Active collaboration with stakeholders Steering group with members representing the Ministry of Education and Culture, universities (rector), government research institutes (president), Academy Board; chaired by the President of the Academy of Finland Next review will be published in 2018, for more information please contact Science Adviser Otto Auranen (firstname.lastname@aka.fi) ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND

State of Scientific Research in Finland 2016 In focus: research personnel and funding (background data) publishing, scientific impact and copublications (incl. international comparison) separate section on impact of research beyond academia (special theme) www.aka.fi/tieteentila > EN Some data used in the review are available also in English via vipunen.fi, the education statistics portal run by the Finnish educational administration. Edited by Anu Nuutinen, Anssi Mälkki, Katri Huutoniemi ja Johanna Törnroos, Academy of Finland Bibliometric computing by Yrjö Leino, CSC IT Center for Science Ltd, Finland. 8 ACADEMY OF FINLAND 2017

Introduction: Data on research personnel (1/2) Discipline classification Difficult to place interdisciplinary and phenomenon-based research in a traditional classification of disciplines. Material based on an alternative classification not currently available. There is a great need for this! How to detect qualitative change? Measuring change is of great science policy interest. The research profiles of universities develop but the possible change in personnel statistics shows with a great delay (if at all due to the granularity of discipline classification). 5 ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND

Introduction: Data on research personnel (2/2) The comparison of input and output data by discipline The work contribution (FTEs) of teaching and research staff may be reported to a different discipline than competitive funding or publications. To some extent, the problem lies in the combination of different datasets. This also reflects multidisciplinarity and changes in science. The discipline for teaching and research staff and research expenditure is often determined by the administrative unit (e.g. a department) of the discipline. In some cases, the disciplines of the staff are determined by individual staff member. The discipline of a WoS publication is determined on the basis of the discipline of the publication channel. The smaller the unit of analysis, possibly bigger the problem. 6 ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND

The number of universities and the median value of tier IV position FTEs by discipline in 2012. The discipline s top 10 index in 2009 2012 is illustrated by colours. Pink clearly above world average, blue at the level of the world average in the discipline. Sources: University data collection by the Ministry of Education and Culture 2013; Thomson Reuters, Web-of-Science-based data (WoS), Bibliometric computing CSC, 2014. 7 ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND 2014

The distribution of professors between different academic disciplines, calculated in terms of full-time equivalents, is an indication of the long-term strategic choices made by Finnish universities. Proportion of tier IV position FTEs of disciplinary group by university, %, in 2015 Disciplinary group FTE total TUT LUT AALTO Hanken Oulu ÅAU UVA JYU UH UEF UTU UTA ULA ARTS Total Mathematics and statistics 74 9 0.1 20 11 3 2 14 21 3 14 3 100 Physics, geosciences, space science 135 8 2 12 9 3 14 28 15 9 1 100 Chemistry, chemical engineering 90 6 7 12 12 20 11 19 8 6 100 ICT and electrical engineering 226 20 5 22 16 5 3 9 6 4 5 6 100 Engineering, other fields 176 27 20 36 13 3 1 1 1 100 Business studies and economics 239 4 8 20 13 5 3 11 7 5 4 12 6 1 100 Ecology, environmental science, plant biology 96 1 8 2 12 50 13 13 100 Agricultural and forest sciences 69 84 16 100 Biomedicine, biosciences 179 2 9 5 2 38 16 18 9 100 Clinical medicine 221 16 0.2 27 18 25 14 100 Health sciences 88 13 1 28 10 20 8 20 100 Behavioral sciences 167 2 6 7 20 24 13 14 10 3 100 Social sciences, other fields 320 2 1 6 3 7 25 11 16 19 9 100 Linguistics 108 7 6 7 14 27 11 15 12 100 Art and literature research 136 22 1 2 9 13 1 2 4 7 38 100 Humanities, other fields 144 6 9 1 9 41 11 15 8 1 100 All fields 2 473 5 3 10 1 8 5 2 9 23 10 12 8 2 2 100 8 Source: Vipunen, Education Statistics Finland.

9

Introduction: Bibliometric data Publishing practices vary by discipline. - The publication numbers for different disciplines are not comparable in all respects. Statistical delay - Citations accumulate with a delay that varies greatly between disciplines. - Eg. publications in 2011 2014 describe the current state of research. Coverage: International citation databases do not cover the publications of all disciplines in the same way. - Scientific articles in research books or edited scientific books (monographs) typically not included. - The material is not as appropriate for a detailed examination of publication activities in the social sciences or the humanities (SSH) as in many other disciplines. The bibliometric results presented here are derived from the Web of Science prepared by CLARIVATE ANALYTICS, Inc. (Formerly the IP & Science business of Thomson Reuters ), Philadelphia, Pennsylvania, USA: Copyright CLARIVATE ANALYTICS 2016. All rights reserved. Results are taken with permission from the bibliometric analysis system provided by CSC IT Center for Science Ltd, Espoo, Finland. 10

Finland has a high number of scientific publications per capita Country Publications per 100,000 capita 2001 2004 2011 2014 Relative change 01/04 11/14 Proportion of publications in which the country s researchers have participated 2001 2004 2011 2014 Switzerland 875 1,452 1.7 1.7% 1.8% Denmark 658 1,196 1.8 0.9% 1.0% Sweden 762 1,091 1.4 1.8% 1.6% Norway 511 1,017 2.0 0.6% 0.8% Finland 662 969 1.5 0.9% 0.8% Netherlands 564 966 1.7 2.5% 2.4% Belgium 483 815 1.7 1.3% 1.3% Ireland 355 757 2.1 0.4% 0.5% United Kingdom 552 745 1.3 8.8% 7.1% Austria 443 742 1.7 1.0% 0.9% Germany 380 570 1.5 8.3% 6.8% USA 424 538 1.3 33.2% 25.3% France 353 490 1.4 5.9% 4.8% Note: Publication numbers are based on whole counting. Population data are from 2004 and 2014. Source: Clarivate Analytics, Web-of-Science-based data, bibliometric computing CSC Ltd, 2016; OECD Stat. Main Science and Technology Indicators. 11

How does Finland compare to other research-intensive countries in terms of publication output? Indicator: Number of publications per capita Finland has a high number of scientific publications per capita in comparison to many OECD countries. Finland s number of publications has increased 1.5-fold in the 2000s. Many comparison countries have shown a higher increase in the 2000s. Note: The figures only include publications in the Web of Science data. 12

Publication profile of Finland and 12 comparison countries in 2011 2014 Publication number (fract.) Proportion of country s publications, % Disciplinary group Finland FI NL BE IE GB AT NO FR SE CH DE DK US WORLD Mathematics and statistics 812 2.3 1.4 2.5 2.0 2.0 3.6 2.3 4.5 1.8 2.1 2.7 1.3 2.2 2.8 Physics, geosciences, space science 4,747 13.4 10.2 12.9 10.9 11.9 14.4 11.8 18.7 11.8 16.9 18 11.1 11.9 14.2 Chemistry, chemical engineering 2,366 6.7 4.6 6.8 6.7 5.3 6.4 4.6 8.4 6.1 7.7 9.0 5.5 5.3 9.1 ICT and electrical engineering 4,386 12.3 6.6 8.9 9.8 6.7 11.4 7.5 10.7 9.1 8.2 8.5 6.9 7.3 9.9 Engineering, other fields 2,598 7.3 5.8 7.4 7.9 6.6 7.9 9.9 8.4 8.6 7.0 8.4 7.2 7.1 11.3 Business studies and economics 1,214 3.4 3.0 2.3 2.2 2.9 2.3 3.1 1.8 2.4 2.1 2.1 2.5 2.3 2.1 Ecology, environmental science, plant biology 3,115 8.8 6.3 7.8 6.5 5.9 7.3 8.6 6.8 7.3 7.1 6.2 8.1 6.8 6.9 Agricultural and forest sciences 1,306 3.7 2.3 4.0 5.4 2.0 2.9 4.1 2.1 2.3 2.6 2.3 3.8 2.2 3.0 Biomedicine, biosciences 3,462 9.7 12.4 12.1 10.9 11.5 11.6 9.0 10.8 11.9 13.3 11.9 13.7 14.3 11.2 Clinical medicine 5,673 16.0 26.6 18.4 19.3 21.1 21.0 16.9 18.1 20.2 20.1 19.5 23.9 20.8 16.5 Health sciences 1,708 4.8 5.6 3.1 5.1 5.1 2.1 7.6 1.9 6.6 3.1 2.0 5.3 5.3 3.2 Behavioural sciences 1,168 3.3 4.9 3.7 3.5 4.1 1.9 3.5 1.3 2.5 2.2 2.6 1.6 4.2 2.6 Social sciences, other fields 1,268 3.6 4.5 3.5 4.3 6.2 2.5 5.7 1.3 4 2.4 2.0 3.8 4.1 2.7 Humanities 903 2.5 2.7 4.5 3.6 6 2.4 3.0 3.0 2.3 2.0 2.3 2.3 3.4 2.2 General scientific journals 801 2.3 3.0 2.1 1.8 2.8 2.4 2.3 2.3 3.2 3.2 2.5 2.9 3.0 2.3 All fields 35,529 100 100 100 100 100 100 100 100 100 100 100 100 100 100 The proportion of publications has been highlighted when it is 0.5 percentage points higher than in the world on average. Source: Clarivate Analytics, Web-of-Science-based data, bibliometric computing CSC Ltd, 2016.

Are there differences in Finland s publication profile compared to the comparison countries? Indicator: Publication profile based on disciplinary proportions of country s publications Note: Publication numbers cannot be compared across disciplines! - International citation databases do not cover the publications of all disciplines in the same way. Scientific articles in research books or edited scientific books (monographs) are not included. The material is not as appropriate for a detailed examination of publication activities in the social sciences or the humanities (SSH) as in many other disciplines. Comparing countries within the same discipline makes more sense. Finland: ICT and electrical engineering; Ecology, environmental science, plant biology; Business studies and economics - Greater proportion than in any comparison country Finland: Clinical medicine; Biomedicine, biosciences - Smaller proportion than in any comparison country (except Norway in biomed.) 14

The scientific impact of research in Finland is stable and above the world average, but competition has become stiffer Scientific impact based on top 10 index in selected OECD countries in 1991 2014 Selected OECD countries are countries with the top 10 index above the world average (index value > 1) in 2011 2014. Source: Clarivate Analytics, Web-of-Science-based data, bibliometric computing CSC Ltd, 2016. Selected OECD countries Top 10 index 1991 2001 1994 2004 Publication number (fract.) 2011 2014 2011 2014 Switzerland 1.27 1.37 1.50 71,727 USA 1.42 1.38 1.43 1,409,660 Netherlands 1.23 1.29 1.40 107,936 Denmark 1.10 1.32 1.39 43,419 UK 1.05 1.16 1.35 338,129 Australia 0.93 1.04 1.22 167,865 Belgium 0.92 1.06 1.21 57,370 Sweden 1.15 1.12 1.19 68,630 Canada 1.05 1.11 1.18 205,558 Luxembourg 0.32 0.71 1.17 2,313 Ireland 0.78 0.95 1.15 23,730 Norway 0.93 1.07 1.09 34,341 Germany 0.80 0.96 1.09 330,270 Austria 0.74 0.90 1.06 39,807 Finland 0.99 1.00 1.06 35,529 France 0.84 0.95 1.04 227,430 Iceland 0.97 1.04 1.03 2,207 Israel 0.93 0.99 1.03 42,019 New Zealand 0.85 0.88 1.02 26,054

Scientific impact based on top 10 index in selected OECD countries in 1991 2014 Selected OECD countries are countries with the top 10 index below the world average (index value < 1) in 2011 2014. Selected OECD countries 1991 1994 Top 10 index 2001 2004 Publication number (fract.) 2011 2014 2011 2014 Spain 0.59 0.81 0.95 184,460 Italy 0.73 0.83 0.94 212,462 Greece 0.48 0.76 0.90 38,295 South Korea 0.64 0.77 0.86 192,487 Portugal 0.59 0.80 0.80 43,643 Slovenia 0.55 0.56 0.79 12,274 Estonia 0.34 0.54 0.69 5,165 Japan 0.73 0.69 0.65 319,229 Hungary 0.43 0.59 0.60 19,575 Chile 0.41 0.60 0.57 18,441 Turkey 0.46 0.55 0.53 105,784 Mexico 0.45 0.45 0.46 40,693 Czech Republic 0.35 0.46 0.44 46,148 Poland 0.32 0.37 0.43 87,609 Slovakia 0.17 0.28 0.37 13,764 All OECD countries 1.11 1.09 1.14 4,574,023 Source: Clarivate Analytics, Web-of-Science-based data, bibliometric computing CSC Ltd, 2016. 16

What is the scientific impact of Finnish research and how has the impact developed compared to OECD countries? Indicator: Top 10 index The level of scientific research in Finland has remained stable. Finnish research performs above the world average. Although the level of Finnish research has climbed slightly over the past ten years, many OECD countries have outperformed and outpaced Finland. Compared with the results of the 2014 review, there have been only marginal changes in the state of scientific research in Finland. 17

Number of ERC grants per researcher FTEs in higher education and government sectors, and the top 10 index The figure includes countries with a minimum of 20 ERC grants in 2007 2015 18 Number of ERC grants in 2007 2015 per 10,000 researcher FTEs in higher education and government sectors 350 250 225 200 175 150 125 100 75 50 25 0 CZ HU AT IE SE FR BE GB PT IT GR FI ES 0,2 0.2 0.4 0,4 0.6 0,6 0,8 0.8 1,0 1.0 1.2 1,2 1.4 1,4 1.6 1,6 1.8 1,8 The ERC grants include Starting, Consolidator and Advanced Grants in 2007 2015. Researcher FTEs are from 2014, except for Israel and Switzerland from 2012. IL DE NO NL DK CH Top 10 index in 2011 2014 World average is 1. Sources: ERC funding statistics (https://erc.europa.eu/projects-and-results/statistics); OECD Stat, Main Science and Technology Indicators; Clarivate Analytics, Web-of-Science-based data, bibliometric computing CSC Ltd, 2016. Country codes AT Austria BE Belgium CH Switzerland CZ Czech Republic DE Germany DK Denmark ES Spain FI Finland FR France GB Great Britain GR Greece HU Hungary IE Ireland IL Israel IT Italy NL Netherlands NO Norway PT Portugal SE Sweden

The proportion of international co-publications has seen a visible increase in Finland Proportion of collaboration type, % 100% Domestic co-publications 75% Domestic publications by one organisation 50% 53% International co-publications 25% 27% 0%. Publication numbers are based on whole counting. Source: Clarivate Analytics, Web-of-Science-based data, bibliometric computing CSC Ltd, 2016.

How has research collaboration, especially international collaboration, developed in Finland? Indicator: International and domestic publications The number of international co-publications has increased five-fold in 1991 2014. The number of domestic co-publications and domestic publications by one organisation have seen a smaller increase. The proportion of international co-publications by Finnish researchers has seen a visible increase in recent years. - International co-publications accounted for more than 50% of all scientific publications produced in Finland in 2011 2014. - In the early 1990s, the corresponding figure was only 27%. 20

International co-publications more highly cited than domestic publications Scientific impact by collaboration type in Finland and in comparison countries in 2011 2014. Top 10 index World average is 1. 2,0 2.0 1,8 1.8 All publications 1,6 1.6 1,4 1.4 1,2 1.2 1,0 1.0 0,8 0.8 International copublications Domestic publications (incl. publications without any collaboration) 0,6 0.6 CH US NL DK GB BE SE IE NO DE AU FI FR The top 10 index for Belgium s domestic publications was 1.0 in 2011 2014. Source: Clarivate Analytics, Web-of-Science-based data, bibliometric computing CSC Ltd, 2016. 21

Scientific impact by collaboration type in Finland and in comparison countries in 2001 2004 and 2011 2014 Top 10 index World average is 1. 2,0 2.0 1,8 1.8 1,6 1.6 1,4 1.4 1,2 1.2 1,0 1.0 0,8 0.8 International copublications 2001 2004 International copublications 2011 2014 Domestic publications 2001 2004 0,6 0.6 CH US NL DK GB BE SE IE NO DE AU FI FR Domestic publications 2011 2014 The top 10 index for Belgium s domestic publications was 1.0 in 2011 2014. Source: Clarivate Analytics, Web-of-Science-based data, bibliometric computing CSC Ltd, 2016. 22

What is the scientific impact of publications representing different types of collaboration? Indicator: Top 10 index by collaboration type (international copublications vs domestic publications) International co-publications yield a higher top 10 index than domestic publications in Finland and in all comparison countries, even for the US and the UK. International co-publications have a greater scientific impact than domestic publications. The top 10 index of international co-publications has increased in all comparison countries in the 2000s. 23

Summary Bibliometric indicators are proxies based on which one can analyse eg. publication activity, scientific impact, and collaboration. Disciplinary differences in publishing and citation practices, and data coverage need to be taken into account. The results often pinpoint to directions worth looking at more closely with the help of other data and methods. Rarely, if ever, give clear-cut answers to why questions. Add a useful perspective to the analysis of scientific impact. Citation indicators alone do not provide a reliable picture of quality of research. - Pivotal role of peer review in research evaluation! 24 ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND

Methodological notes 25 ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND

Top 10 index as a citation indicator (1/2) Research with the greatest scientific impact can be analysed by examining the most highly cited publications. The top 10 index describes a country s/organisation s relative proportion of the 10% most cited publications in the world. The citation indicator is scaled so that the world average in each discipline is always one. Top 10 index > 1: The proportion of a country s publications that belong to the most highly cited 10% of publications in their field is greater than in the world on average. - World = publications covered in the citation database and included in the analysis. 26

Top 10 index as a citation indicator (2/2) Citations are accumulated with a delay that varies greatly between disciplines. The number of citations gained by publications is normalised. - Publications are compared to the international level within the same discipline, publication type (e.g. article, review article) and the same publication year. - Self-citations are excluded from the analysis. Publications are fractionalised according to discipline, country and organisation. - One publication can belong to more than one discipline (subject category). - Fractional counting leads to the most proper field normalisation. - E.g. a Finnish-Swedish publication results in 0.5 publication points for both countries. - If researchers from three Finnish universities have contributed to the publication, each organisation gains 1/3 x 0.5 publication points. 27

Collaboration types Domestic co-publication: all authors are affiliated with a Finnish organisation Domestic publication by one organisation: all authors work in the same organisation in Finland International co-publication: at least one of the authors is affiliated with a non-finnish organisation 28

Special themes in 2014 and 2016 Recruitment of professors (2014) - Questionnaire Research infrastructures (2014) - Questionnaire Broader impact of research in society (2016) - Data collected both by qualitative (focus group interviews) and quantitative methods (2 surveys). The State of Scientific Research in Finland 2014 Summary. Academy of Finland 2014. Edited by: Anu Nuutinen and Annamaija Lehvo, Academy of Finland Bibliometric computing by: Yrjö Leino, CSC IT Center for Science Ltd, Finland. The State of Scientific Research 2016. Academy of Finland 2016. (The report as a whole available in Finnish, the bibliometric analysis and the special theme available also in English.) Edited by: Anu Nuutinen, Anssi Mälkki, Katri Huutoniemi ja Johanna Törnroos, Academy of Finland Bibliometric computing by: Yrjö Leino, CSC IT Center for Science Ltd, Finland. ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND

The number of professors recruited by universities in 2010 2013, place of taking doctoral degree, number of non-finns by organisation and the total professor level FTEs. The 225 professors recruited by Aalto University include 54 assistant professors. Other universities did not report assistant professors. Tier IV positions in the university research career model include those of professor, Academy Professor, research professor and research director. Sources: Academy of Finland survey of professors 2013; University data collection by the Ministry of Education and Culture 2013. 30 ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND 2014

Abbreviations of the names of universities AALTO Aalto University HANKEN Hanken School of Economics UH University of Helsinki UEF University of Eastern Finland JYU University of Jyväskylä ULA University of Lapland LUT Lappeenranta University of Technology OULU University of Oulu ARTS University of the Arts Helsinki TUT Tampere University of Technology UTA University of Tampere UTU University of Turku UVA University of Vaasa ÅAU Åbo Akademi University 31 ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND 2014

Choices made by research organisations are put into practice in recruitment: active and open recruitment is essential Although thematic choices and research profiling are important, excessively narrow definitions of teaching and research areas should be avoided in the recruitment of professors. A professor s career can span decades, and quality and the ability for renewal are of greater value than a perfect fit with the current teaching and research needs. It is crucial that the researchers recruited are capable of developing their research and teaching throughout their career in collaboration with the local, national and international research communities. Recruitment processes need to be enhanced. New career systems, still partly under development, will allow for more flexible recruitment practices, and tenure-track career paths are internationally more attractive than the old system. The new opportunities should be actively exploited. As a rule, all professorships should be open to international application. Annual data collection on recruitment of teaching and research staff will be implemented by the Ministry of Education and Culture in 2018 32 ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND 2014

Research infrastructure survey Academy of Finland research infrastructure survey 2013 A summary report and a list of described research infrastructures (available in Excel format online) Academy of Finland 2014 (material available only in Finnish) 33 ACADEMY OF FINLAND STATE OF SCIENTIFIC RESEARCH IN FINLAND 2014

Special theme in 2016: Broader impact of research in society The review analyses the different types of impact arising from research and researchbased knowledge as well as the pathways through which impact is realized. Data and methods The impact was explored from the direction of research activities, focusing on four different research fields: ecology, evolutionary biology and ecophysiology history medical engineering and health technologies materials science and technology Together, these fields provide complementary views of the diverse ways in which academic research is linked and contributes to the rest of society. 34

A large survey and interview dataset was collected from the selected research fields Survey on the broader impacts of research on society (N=490) Questionnaire and summary of responses available in English at http://www.aka.fi/globalassets/30tiedepoliittinen-toiminta/tieteentila/tt_tutkimuksen_laajempi_vaikuttavuus110117_en.pdf Survey on the role of doctoral degree holders in society (N=566) Questionnaire and summary of responses available in English at http://www.aka.fi/globalassets/30tiedepoliittinen-toiminta/tieteentila/tt_tohtorit_rooli_yhteisk_10017_en.pdf Upcoming by the end of 2017: Törnroos Johanna (2017): The Role of Doctoral Degree Holders in Society. Academy of Finland, Helsinki. Data from both surveys have been opened in Finnish Social Science Data Archive, FSD (#FSD3159 and #FSD3160) Group interviews with researchers and research users (10 groups, 70 participants) Statistics of placement of doctoral degree holders in Finland (Source: Statistics Finland) 35

Roles of science in society The broader impact of research can be analysed in terms of the different roles science has in society. Scientific research is expected to contribute to society, for example, in the following issues: Human understanding and world view: Research-based knowledge and abilities build, sustain and develop individuals and societies understanding of the surrounding world and their part in it. Wealth and prosperity: Research-based knowledge and abilities open material prospects for sustaining and increasing the wellbeing of people and societies. Basis for decision-making: Research-based knowledge and abilities underpin societal decision-making, policies and problem-solving; they can also ease individuals choices. Practice development: Research-based knowledge and abilities generate, sustain and advance competencies and professional practices. 36

Contributions of research to society in four research fields. The area of the circle represents the proportion of respondents in each research field (%) who selected the given type of contribution. Economy and economic renewal Health and wellbeing Public services and institutions The environment and natural resources Human capacities and culture Improved business capability or competitiveness of individual companies Improved prospects for employment or expert work New business activity; attraction of investments Development or renewal of the economic environment; adaptive capacity of the economy Other impact on the economy and economic renewal Reduced morbidity or illness; improved physical or mental health Reduction of social problems; improved social welfare Improvement of healthcare Management or prevention of health-related risks Other impact on health and wellbeing Preparation of policy-making, legislation or other regulations Renewal of teaching curricula; educational planning Improvements related to other public services (e.g. public security, transportation, social services) Improved function of public institutions Other impact on public institutions and services Reduction of environmental stress; improved state of the environment Sustainable use of natural resources; protection of biodiversity Sustainability of the built environment, infrastructures or land use Management or prevention of environmental risks; improved ecological resilience Other impact on the environment and natural resources Strengthening civilisation, citizen participation or civil activity Protection of cultural diversity; improved cultural interaction or coexistence Development of environments supporting creativity, experimentation and learning Development of national or international community Other impact on human capacities and culture Source: Academy of Finland s survey on the broader impacts of research on society, 2016. 37

Main routes to impact Research impact can be considered by looking at the routes by which research-based knowledge and abilities are conveyed beyond academia. The main routes of impact can be viewed as follows: Transfer of research results: The results, inventions, methods or other outputs of research come into use beyond academia. There may be a lot of underpinning research and development in the background. Cooperation and interaction: Researchers work alongside and discuss and exchange knowledge with stakeholders beyond academia, such as business and industry, public authorities, education, civic organisations or professional practitioners. Proficient people: Research-based knowledge, expertise, vision and skills are conveyed by people who move and act beyond academia. 38

Doctoral degree holders placement in higher education and government research institutes, and other sectors in 2013. Employed doctoral degree holders who finished their degree in 2012 or earlier. Total (number) Medical sciences Pharmacy All fields of science Other fields in humanities ICT and electrical engineering Chemistry, chemical engineering Other fields in eng. and technology Arts and literature research Health sciences Other fields in social sciences Biological and environmental sciences Business sciences and economics Physics, geosciences, space science Behavioural sciences Agricultural sciences Mathematics, statistics Linguistics 5 217 315 21 945 1 014 1 845 1 185 1 332 618 615 1 566 1 989 1 203 1 680 1 401 876 366 561 0 0% % 25% % 50 50% % 7575% % 100 100% % Higher education and government research institutes Other sectors Source: Data collected by the Statistics Finland, Vipunen - Education Statistics Finland. 39

Recommendations concerning broader impact of research There is a mutually reinforcing relationship between top-level research, high-quality education and the broader impact of research. This must be taken into account in research and innovation policy. Science has both intrinsic value and significant societal impact. Universities and other research organisations must support, monitor and evaluate the broader impact of research in all its forms. The broader impact of research arises through multiple routes: through proficient people, cooperation and interaction, and through the transfer of research results. The various routes of impact and roles of science in society must be taken into account in the promotion of impact beyond academia. 40

Available at: http://www.aka.fi/en/research-and-science-policy/state-of-scientific-research/broader-impact-of-research-in-society/ 41

Thank you! More information Anu Nuutinen Senior Science Adviser Planning and Management Support Unit Academy of Finland firstname.lastname(at)aka.fi www.aka.fi/tieteentila > EN 42