Regional Innovation Impact Assessment Framework for universities: design and development of an evidence-based model Koen Jonkers, Robert Tijssen, Milena Slavcheva, Athina Karvounaraki, Xabier Goenaga Disclaimer: This presentation does not necessarily reflect the official opinion of the European Commission. The commission nor anyone acting on its behalf can be held responsible for the use made of material contained in it.
REPORT Performance based funding of universities Based on a comparative qualitative analysis of 35 national R&I systems. Fed into the H2020 PSF MLE on PBF
REPORT Lamy Report: European university label The EU could offer top-up institutional funding tied to modernization and innovation performance (Lamy et al, 2017)
Theoretical Framework Performance based funding of universities Ex ante research assessment Institutional research funding allocation None: historically based Use of education indicators only Ex Post Research Assessment Ex Post Innovation Assessment Funding allocation based on assessment Funding allocation based on assessment
Source: adapted from Technopolis Group (1999) Innovation Impact of Universities
INPUTS OUTPUTS IMPACTS Labour Supplies/equipment Services Students R&D institutions Social environment Knowledge creation Provision of leadership Knowledge infrastructure Social environment Human capital creation Transfer of existing know-how Increase capacity for development Regional creativity New business start-ups Productivity gains Business innovation Technological innovation Capital investment New business start-ups Direct and indirect spending impacts Source: adapted from Goldstein and Renault (2004)
OUTPUTS/IMPACTS OUTPUTS Indicator portfolio Indicator portfolio Provision of leadership Knowledge infrastructure Social environment Regional orientation, strategic development and knowledge infrastructure Knowledge creation Transfer of existing know-how Research, technological development, knowledge transfer and commercialisation Technological innovation Capital investment Human capital creation Source: adapted from Goldstein and Renault (2004) Entrepreneurship and support to enterprise development Education and human capital development Regional development level
OUTPUTS/IMPACTS Indicator portfolio Provision of leadership Knowledge infrastructure Social environment Regional orientation, strategic development and knowledge infrastructure Knowledge creation Tailor made RIA profile could feed into a university Transfer of existing know-how Technological innovation Research, technological development, knowledge transfer and commercialisation level case study: a "narrative with numbers" Capital investment Human capital creation Source: adapted from Goldstein and Renault (2004) Entrepreneurship and support to enterprise development Education and human capital development Regional development level
Examples use of U-Multi Rank in RIA Knowledge transfer indicators Income from private sources Co-publications with industrial partners Patents awarded Co-patents with industry Publications cited in patents Income from private sources Co-publications with industrial partners Patents awarded (size-normalised) Industry co-patents Spin-offs Income from continuous professional development Regional engagement indicators Student internships in the region BA theses with regional organisations MA theses with regional organisations Regional joint publications Income from regional sources BA graduates working in region Student internships in region Regional joint publications Income from regional sources MA graduates working in region Graduates employment in the region Strategic research partnerships in the region In red the KT indicators that appear in both RIA and UMR
Availability of indicators in the EU MS Education Knowledge Transfer Entrepreneurship Regional orientation Mostly yes Partially BE, DK, UK BE, HR, CZ, DK, FI, SE, MT, UK BE, BG, EE, FI, IT, NL, UK BE, DK, DE, FI, UK Mostly not BG, CZ, FI, MT, NL, SE DE, EE, SI, NL DK, PL, SI, SE HR, MT HR, EE, DE, HU, IT, PL, PT, RO, SK, SI, BG, SK, HU, IT, PT, RO SK, RO, MT, HU, DE, CZ, HR most others
The HEInnovate questionnaire is grouped in the following dimensions: Leadership and governance Organisational capacity: funding, people and incentives Entrepreneurial teaching and learning Preparing and supporting entrepreneurs Knowledge exchange and collaboration The internationalised institution Measuring impact There is thus a clear link to the four proposed RIA categories.
Case studies (1) "The university generated 25% of the funding of its R&D projects "University Alpha s technology transfer office through contracts with regional had a total turnover of 240 million euro in firms in 2010-2015 up from 20% 2016" in 2005-2010". 140 120 Vision & Strategy: The university s 100 most recent Strategic Plan 2016-2020 112 states: aims to 105 80 97 "University Alpha become plays a constructive a global innovation role leader by 2020, delivering world 90 class solutions and providing a 60 78 80 80 82 the development of greater innovation contribution policy in to region the economic growth 64 68 of 72 its region. Transferred knowledge as an engine 40 52 58 Alpha by actively for innovation collaborating and growth 45 50 with the local Research in the Department of 20 government, Engineering, amongst made it possible others to design with a respect to 3D compressor blade as a single 0 component. Blades designed using the 1999 designing a new policy for high tech clusters. Qualitative 2001 2003 " "In examples 2005the 2007 period 20092010-2015, 2011 2013 University 2015 2017 Alpha trained 40 industrial PhDs - 10 % of all graduated PhDs " of specific impact research results yielded fuel efficiency improvements of about 1% when deployed in aircraft engines manufactured by a worldwide known company. The efficiency improvements in engines have delivered significant savings in CO 2 emissions and in fuel costs. The demand for this new technology engines increased in recent years. The orders the company received during the assessment period are estimated to be worth more than 20 billion Euros at list prices. 120 Cumulative number of spin-off companies created with university investments occurrences 126
Case studies (2)
Case studies (2)
Case studies (2)
Case studies (2)
Innovation impact of universities: general considerations Performance systems may: Assess absolute innovation performance Performance relative to regional performance Improvement of performance (progress) Performance with respect to pre-determined objectives (contracts) Final design dependent on the framework through which it is implemented
Thanks Questions and inputs/feedback? You can find me at Koen.Jonkers@ec.europa.eu
University performance Indicator boxes Impact categories Regional orientation, strategic development and knowledge infrastructure Research, technological development, knowledge transfer and commercialisation Entrepreneurship and support to enterprise development Education and human capital development examples Profiling related to regional needs and specialisation R&D related income from private sector Student start ups / spin offs % of students involved in industrial traineeships context Regional development level e.g. Regional Innovation Scoreboard
Case Studies next steps 1 st workshop October 2 nd workshop November Policy Brief on Entrepreneurial Education High Quality case studies published on JRC RIO website Book project
REPORT Aalto University: case study Success story of an entrepreneurial university orchestrating its innovation ecosystem
The university as driver in setting up partnerships KU Leuven LRD Financial world GFF Leuven MindGate Science Parks Region Industry W. Fyen, presented at the EU JRC workshop on RI2A, September 24, 2018
LRD Financial Ecosystem Fund+ VIB Ventures Vesalius I, II, III Capricorn Healthtech Capricorn ICT Essenscia Innovation Fund Smile Invest Imec Xpand Financial world GFF KU Leuven LRD Leuven MindGate Science Parks Region Industry W. Fyen, presented at the EU JRC workshop on RI2A, September 24, 2018
KU Leuven LRD Financial world GFF Leuven MindGate Science Parks Region Industry W. Fyen, presented at the EU JRC workshop on RI2A, September 24, 2018
KU Leuven LRD Financial world GFF Leuven MindGate Science Parks Region Industry W. Fyen, presented at the EU JRC workshop on RI2A, September 24, 2018
Aalto student movement and Aalto Entrepreneurship Society Aalto University has fostered a local culture of entrepreneurship developed with the active top-down support to the strong bottom-up drive for innovation. Startup Sauna Design Factory Urban Mill Start-up driven innovation ecosystem and student-centric model 70-100 start-up companies crated annually within the Aalto ecosystem 1041 commissioned projects with companies 93 granted patents (2013-2017)
Project Based Learning at Aalborg University AAU's PBL model has long been characterized by problem-solving group work based on real-world projects, often performed in cooperation with the business world. Independent acquisition of skills and knowledge Interdisciplinary and team work Problem and result oriented Strong demand for AAU students in labour market STUDENTS 53 % of Master theses in cooperation with external organisations 67% of graduates collaborated with private/public organisations during study 62% of graduates have a job within 0-3 months after graduation
Higher education and regional retention at POLITO Quality of education is well rated by students (2017) Share of students satisfied with their degree course (any) Effectiveness of graduation for the job performed after graduation according to students 52% 9% 1% 38% Definitely yes More yes, than no More no, than yes Definitely not 35% 8% 57% Very Effective/Effective Effective Enough Not effective/ low effectiveness Retention of graduate students in the Turin area Students tend to choose PoliTo because employability rate it guarantees after graduation 70 % willing to work in the local region (2017) 86,4 % of employment after graduation (2018)
Knowledge transfer at the University of Bologna Founded in 1088, the University of Bologna is a comprehensive research university with very strong entrepreneurial activities. Seven industrial interdepartmental research centres (CIRI) Competence Centre Industry 4.0 IPR activities A reference point at national and regional level in university IPR and knowledge transfer University IPR regulation issued in 1996 a pioneer act for Italian universities Since 2015 wider span of KTO activities: - Patent filings almost doubled between 2014 and 2017
Indicator Box A: Education and human capital development Inputs Grants and scholarships for students from local/regional private sector Credit bearing courses established through a direct request or with the involvement from nonacademic local/regional organisations; Tailor-made academic programs in partnership with businesses Participation non-academic agents in curricula design Joint PhD Programmes and industry sponsorship of post graduate education Entrepreneurship teaching and learning; skills development Inter-sectorial mobility of teaching staff Labour outcomes and student satisfaction postgraduation Regional student retention Life-long learning and non-academic education Graduate tracking of salaried employment Results indicators and Impact indicators Entrepreneurship education: number of students enrolled in entrepreneurship courses as % of total students the number of students attending internship Number of faculty members taking a temporary position in a non-academic organisations; Number of employees from non-academic organisations taking temporary teaching and/or research positions at university Labour outcomes and postgraduate labour surveys that measure satisfaction with knowledge gained at university Student internships in the local region: out of the students who did an internship, the percentage where the internship was with a company or organisation located in the region BA theses with local/regional organisations: degree theses of bachelor graduates done in cooperation with organisations (industry, public, non-profit organisations) in the region MA theses with local/regional organisations: degree theses of master graduates done in cooperation with organisations (industry, public, non-profit organisations) in the region % academics teaching in courses required by local/regional firms; or income received from noncredit bearing teaching and associated activities for local/regional clients Graduate employment: percentage of graduates working in the region after graduation Wages of university graduates (3-5 years after graduation)
Box B: Research, technological development, knowledge transfer and commercialisation (with involvement of local or regional partners) Inputs Research activities Knowledge and technology transfer Consultancy and contract research Collaboration with regional private partners Inter-sectorial mobility of research/teaching staff Industry funded research positions Shared R&D facilities International staff Results indicators and Impact indicators R&D related income from local/regional private sector Resources generated from contract research and consultancy work local/regional industry Strategic research partnerships in the region Regional partnerships of the Tech Transfer Office Patent (applied/granted), licensing income from local/regional industry Regional joint research publications within local/regional industry Shared R&D facilities with local/regional industry Mobility of university staff to or from local business enterprises Research staff with a dual affiliation at local/regional business enterprise Industrial PhDs that involve local/regional industry; % of PhDs undertaken jointly with private actors or the number of postgraduate students directly sponsored by local/regional industry R&D prizes and innovation prizes awarded by local/regional industry Professorships or other university positions (partially) funded by local/regional industry Public private co-publications
Indicator Box C: Entrepreneurship and support to enterprise development (within the local region or with involvement of local or regional partners)) Inputs Industry liaison offices, knowledge and technology transfer offices; Business incubators, and accelerators Access to seed funding and venture capital Science park, technology park or innovation hub Other business-related infrastructure, facilities and services Results indicators and Impact indicators University spin-off and start-up companies (number of, employment generated, turnover) Student start-ups (number of, employment generated, turnover, private funding raised, nature of university support) Investments of industry or public sector partners
Indicator Box D: Regional orientation, strategic development and knowledge infrastructure (with involvement of local, regional, national or foreign partners) Inputs Profiling to reflect regional specialisation and objectives Involvement in regional innovation strategy setting Regional knowledge infrastructure; Capacity for regional socioeconomic development Results indicators and Impact indicators Income from regional sources: proportion of external research revenues apart from government or local authority core/recurrent grants that comes from local/regional sources (i.e. industry, private organisations, charities). Joint agenda setting with regional partners Profiling strategies (PR and marketing) related to regional needs and specialisations HRM and staff performance assessment related to regional needs and specialisations Formation of social ties and networks with local/regional stakeholders and partners Contributions to the creation of a local/regional entrepreneurial ecosystem Contribution to embedding the regional innovation system in international R&D networks (international co-publications; participation in international research projects; attraction of foreign staff) Contribution to the investment climate (attraction of private investments in the region e.g. by foreign or national firms)
Regional context indicators Inputs Results indicators and Impact indicators Framework conditions (human resources, attractive research systems, innovation friendly environment) Investments (finance and support; firm investments) Innovation activities (innovators, linkages and intellectual assets) Employment and sales impacts Percentage population aged 30-34 having completed tertiary education Percentage population aged 25-64 participating in lifelong learning International scientific co-publications per million population Scientific publications among the top-10% most cited publications worldwide as percentage of total scientific publications of the country R&D expenditure in the public sector as percentage of GDP R&D expenditure in the business sector as percentage of GDP Non-R&D SME innovation expenditures as percentage of total turnover SMEs introducing product or process innovations as percentage of SMEs SMEs introducing marketing or organisational innovations as percentage of SMEs etc