NATIONAL REPORT ON THE IMPLEMENTATION AND IMPACT OF ERASMUS+ IN NORWAY

a NATIONAL REPORT ON THE IMPLEMENTATION AND IMPACT OF ERASMUS+ IN NORWAY Inger C. Nordhagen Malin Dahle inger.nordhagen@ideas2evidence.com 1 March 1st 2017

Table of contents Table of contents... 1 Executive summary... 2 Overview of the Erasmus+ programme in Norway... 5 Methodology for the preparation of the National Report... 6 Role of actors... 6 Selection and priority of standard questions... 6 Data collection... 7 Answers to standard questions... 8 Effectiveness... 8 Efficiency... 20 Relevance... 24 Internal and external coherence and complementarity... 27 European added value and sustainability... 27 References... 29 Abbreviations, terms and explanations EACEA Education, Audiovisual and Culture Executive Agency EVS European Voluntary Service HEI Higher Education Institution KA1 Key Action 1: Learning mobility of individuals, including the Student Loan Guarantee Facility KA2 Key Action 2: Cooperation for innovation and the exchange of good practices KA3 Key Action 3: Support for policy reform NA National Agency NAU National Authority SIU Norwegian Centre for International Cooperation in Education (NA for education and training) Bufdir The Norwegian Directorate for Children, Youth and Family Affairs (NA for youth) 1

Executive summary The conclusions presented in this report are based on extensive empirical data collected through interviews with informants at the NAU and NA levels, as well as with participating organisations across fields and sectors, in addition to document analyses. Benefits of programme Participation in the Erasmus+ programme constitutes a cornerstone in Norwegian educational policy. The programme is essential for cooperation at all education levels and with relevant partners outside the education system. Erasmus+ also supports policy development in the field of education providing real added value through sharing best practices and by supporting initiatives that would not have been possible at individual national level without Erasmus+. Norway particularly emphasises Erasmus+ contributions to: Knowledge about Europe and the European dimension in education Increasing student and staff mobility Providing an arena for cooperation with the business sector Supporting various initiatives for innovation in the education sector Peer learning and sharing of good practice through the Open Method of Coordination (OMC) Supporting the Bologna process, and by this providing valuable input to creating a real European Higher Education Area The evidence from this evaluation report indicates positive effects from Erasmus+ and previous programmes at the level of individuals, participating organisations, and policy. At the individual level, participating organisations report improved key competences and skills for individuals that participate in mobility projects, in particular improved transversal skills, language and intercultural skills. In the youth field, the effect of mobility stays on marginalised youth in is particularly salient. At the level of participating organisations, improved teacher competence and quality through staff mobility are reported. Strategic Partnerships are considered unique opportunities to develop new methods and work on long term quality improvement. At the policy level, Erasmus+ is contributing to youth participation in local and regional politics. In the field of education and training, the programme is contributing to increased cross sectoral collaboration against dropout rates. Synergy effects and efficiency benefits The various key actions generate positive synergies, as they complement each other and allow projects to build on each other. An integrated programme has led to more collaboration across fields and sectors. Thematic synergy effects between sectors in the education and training fields facilitate administrative work and knowledge sharing, and collaboration on complex issues such as dropout rates. The streamlining of actions across sectors within the education and training field has improved the communicability of the programme, increasing the potential for impact, and has reduced the administrative burden on the NA. Erasmus+ has brought more legitimacy to the youth field. Simplified grants and unit costs have led to efficiency benefits at the level of the participating organisations. Reporting procedures have been simplified. 2

Elements to be maintained in the upcoming programme All three key actions (and their sub actions) are seen to have positive effects and are expected to be maintained in the upcoming programme. The Strategic Partnership actions are particularly welcomed and considered to have great potential impact. The policy level and NA level stress the importance of continuing to prioritise Strategic Partnerships in the upcoming programme, and to increase the funding for these actions. NA and policy informants emphasise the potential of the centralised actions, e.g. Knowledge Alliances. They welcome the continuation of the centralised actions in the upcoming programme, and propose increased funding for these actions. Suggestions for improvement Funding: Increase flexibility in the distribution of funds between decentralised actions, as funding for certain actions is inadequate. In Norway, there is a particular need for more funding for VET pupil mobility and Strategic Partnerships in higher education. Increase funding for centralised actions. Match the daily rates for participants in youth exchanges and in youth worker mobility. Boost the funding for dissemination activities in order to increase impact. Administration: Simplify and rationalise administrative processes across fields and sectors: Further streamlining of actions within education and training to reduce the administrative burden. Make language more user friendly. Simplify application forms and processes in order to increase access for target groups without a professionalised internationalisation apparatus, and further simplify reporting procedures. Simplify processes for learning agreements and institutional agreements in higher education. Improve technical solutions and further digitalisation, i.e. electronic agreements and signatures. Ensure continuity of ICT systems and improving the communication between the systems. Standardise grants for exchange students. Present sector and field specific programme guides. System of cooperation and division of tasks Increase guidance and flow of information about the centralised actions from the EACEA. Introduce a clearer mandate for the working groups, and a clearer division of tasks between the working groups, the NA and Programme committees, and the Commission. Structure of programme Extract the sports field from Erasmus+ in order to make the programme more coherent and its profile more distinct. Introduce smaller scale Strategic Partnerships within the VET and adult education sectors. Introduce mobility for upper secondary pupils. 3

To summarise, Norway s position is that the Erasmus+ programme generates considerable benefits and positive synergies within and across fields and sectors, and that the main structure of the programme therefore should be continued into the next programme period. There is a general view that Erasmus+ constitutes a more holistic and coherent approach to internationalisation of the education and youth fields than previous programmes. Still, the report uncovers areas for improvement, e.g. regarding the distribution of funds, administrative procedures and technical solutions. 4

Overview of the Erasmus+ programme in Norway Through the EEA Agreement, Norway is a programme country in Erasmus+ on par with full members of the EU. The responsibility of funding and implementing the decentralised actions is shared between two National Agencies. The Norwegian Centre for International Cooperation in Education (SIU) is in charge of the education and training and sports fields, with the Ministry of Education and Research and the Ministry of Culture as National Authorities, respectively. The Directorate for Children, Youth and Family Affairs (Bufdir) is National Agency for the youth field, while the Ministry of Children and Equality is the National Authority for this field. Figure 1: Organisation of Erasmus+ in Norway In 2015, SIU awarded a total of 16,4 million to Erasmus+ decentralised actions in the education and training field. Table 1 shows the number of projects awarded, the success rate, and amount awarded per key action and action. Table 1: Decentralised funding for the education and training field, Norway 2015 Key Action KA1 Learning Mobility of Individuals KA2 Cooperation for innovation and the exchange of good practices Action Type # Awarded Projects Success Rate Grant Amount Awarded (EUR) KA101 School education staff mobility (KA101) 33 78% 587 020 KA102 VET learner and staff mobility (KA102) 57 95% 3 494 468 KA103 Higher education student and staff mobility (KA103) 48 100% 6 101 950 KA104 Adult education staff mobility (KA104) 6 75% 83 070 KA107 Higher education student and staff mobility between Programme and Partner Countries (KA107) 18 67% 1 266 544 Sub-total Key Action 1 162 88% 11 533 052 KA201 Strategic Partnerships for school education (KA201) 2 50% 344 902 KA202 Strategic Partnerships for vocational education and training (KA202) 4 44% 1 041 009 KA203 Strategic Partnerships for higher education (KA203) 6 35% 1 564 972 KA204 Strategic Partnerships for adult education (KA204) 2 29% 504 388 KA219 Strategic Partnerships for Schools Only (KA219) 14 4% 1 400 101 Sub-total Key Action 2 28 41% 4 855 372 GRAND TOTAL 190 75% 16 388 424 Source: The Norwegian Centre for International Cooperation in Education (SIU). 5

In 2015, Bufdir awarded a total of 2,9 million to decentralised actions in the youth field. Table 2 shows the number of projects awarded, the success rate, and amount awarded per action and key action. Table 2: Decentralised funding for the youth field, Norway 2015 Key Action KA1 - Learning Mobility of Individuals KA2 - Cooperation for innovation and the exchange of good practices KA3 - Support for policy reform Action Type # Awarded Projects Success Rate Grant Amount Awarded (EUR) KA101 Youth mobility (KA105) 99 77% 2 447 780 Sub-total Key Action 1 99 77% 2 447 780 KA201 Strategic Partnerships for youth (KA205) 3 27% 295 920 Sub-total Key Action 2 3 27% 295 920 Dialogue between young people and policy makers (KA347) 4 36% 150 650 Sub-total Key Action 3 4 36% 150 650 GRAND TOTAL 106 70% 2 894 351 Source: The Norwegian Directorate for Children, Youth and Family Affairs (Bufdir). Methodology for the preparation of the National Report Role of actors The Norwegian Ministry of Education and Research first issued an open call for tender to prepare the National Report. As no offers were submitted, the Ministry assigned the task of preparing the national report to the National Agency for education and training (SIU), which further assigned the task to an independent consultant, ideas2evidence. The main idea behind bringing in an external evaluator was that an independent party would be better suited to collect data on the participating organisations view on the role of and cooperation with the National Agencies, which have the roles of both funder and controller of the organisations activities. The role of ideas2evidence has been to collect data on the evaluation questions through interviews and analysis of documents and statistics, and prepare and finalise the report. SIU s role as commissioning authority has been to provide ideas2evidence with reports and statistics, contribute as interviewees, and to review and comment on a draft of the final report. The Ministry of Education and Research, the Ministry of Children and Equality, and the Directorate for Children, Youth and Family Affairs have contributed through interviews and by reviewing the final draft of the report. Selection and priority of standard questions Because of the number and scope of the evaluation questions from the European Commission, SIU and the Ministry of Education and Research found it necessary to prioritise between and omit some questions. The selection of questions to be answered is based on two criteria; 1) relevance/usefulness to other programme countries: on which questions does Norway have particularly useful input, which can also benefit other programme countries?; and 2) relevance to Norwegian interests: which questions are particularly relevant to Norwegian interests? Based on these criteria, each question was ranked on a 3 point scale from high to low priority. All high priority questions were to be answered, medium priority questions could be answered, while low priority questions could be omitted. Six questions were ranked low priority and are therefore not answered in this report. These are questions 2, 9, 12, 14, 19 and 20. All high and medium priority questions have been answered. 6

Data collection The conclusions in this report are based on extensive empirical data collected through interviews in addition to document analysis. In order to get as comprehensive as possible an understanding of the views and opinions of the various stakeholders, we conducted interviews at three levels: the level of National Authority, the level of National Agency, and the level of participating organisations. At each level, we conducted a number of interviews to cover both fields and key actions. The table below gives an overview of the number of interviewees and interviews at each level, in each field, and total. We conducted a total of 43 interviews, with a total of 61 interviewees. Table 3: Number of interviews and interviewees per field, level and in total. National Authorities (group) National Agencies (group) Participating organisations Field Education and training Youth Total # interviews # interviewees # interviews # interviewees # interviews # interviewees 1 5 1 5 2 10 8 16 3 5 11 21 23 23 7 7 30 30 Total 32 44 11 17 43 61 Since the decentralised administration of Erasmus+ is divided between two National Agencies, we conducted group interviews at each agency. In order to cover both fields and all key actions, we carried out several group interviews at each agency. Similarly, we conducted group interviews at each of the two National Authorities, the Ministry of Education and Research and the Ministry of Children and Equality. As there are only centralised actions in the sports field, we have not included any specific data collection for this field. The uneven number of interviews in each field partially reflects the funding for education and training versus youth, and is partially a result of the goal of covering all fields, key actions and sectors, which made it necessary to conduct more interviews in the education and training field. Research institutes, although key stakeholders in the programme, are not represented in the study, as they do not participate in the programme. Similarly, the participation of SMEs in the programme is marginal. For this report, interviews have been conducted with two SMEs and one large enterprise. The table below details the distribution of interviews with participating organisations in each field and each sector. 7

Table 4: Number of interviews with participating organisations, per field, sector, type of organisation and actions represented. Field Type of organisation Number of Organisations Actions represented Education and training 23 Higher education 8 103,107, 203 Higher ed. Institution 7 Business/industry 1 VET 6 102,116, 202, sector skill alliance County administration* 2 Upper secondary school (vocational) 1 Higher ed. Institution 1 Business/industry 2 School education 6 101,201, 219 Municipality** 2 Lower secondary school 1 Upper secondary school (academic) 2 County administration* 1 Adult education 3 104, 204 Adult education centre 3 Youth 6 KA1 (EVS, Youth Exchanges, Youth Workers Mobility), KA2 and KA3 NGO 3 Foundation 1 County administration* 1 Municipality 1 *School owner, upper secondary level **School owner, early childhood education through lower secondary level Answers to standard questions Effectiveness (Question 1) To what extent have Erasmus+ and its predecessor programmes contributed to the realisation of the Erasmus+ specific objectives? Because of the scope of this question, the NAU for education and training has chosen to focus on results relating to objectives one and two; 1) the improvement of key competences and skills, and 2) fostering quality improvements at the level of educational organisations and in youth work. Outside of interim and final evaluations, the research on the effects of Erasmus+ and the previous programmes in Norway is in general limited. In two SIU reports on internationalisation in upper secondary, and primary and lower secondary, schools were surveyed on the perceived effects of internationalisation efforts. 1 These reports encompass all internationalisation programmes, and although EU programmes that now are included in Erasmus+ (e.g. Comenius and Leonardo) were the most utilised programmes, we cannot isolate the perceived effect of these programmes from the others. The effects reported in this section are therefore mostly based on the extensive number of interviews with various stakeholders that were conducted for this report, and compared with available data and international research when such is available. Informants believe Erasmus+ and its predecessor programmes contribute to the realization of objectives one and two in a number of ways. 1 SIU, 2011 and 2015. 8

Objective 1: Improving key competences and skills. In the field of education and training, in addition to improved language skills, the effect most frequently referred to is improved transversal skills for pupils, apprentices and students that participate in mobility projects. This was underscored by informants within both the higher education and the VET sectors. Within upper secondary study preparatory education, some informants observed similar effects after exchanges within Strategic Partnership projects. A number of informants report that pupils, apprentices and students improve their ability to think innovatively and independently, improve self efficacy, and the ability to adjust to changing circumstances. Various pupil surveys support this finding. 2 According to the Erasmus Impact Study, employers value these transversal skills higher than both specific subject knowledge in their field and work experience. 3 Several informants underscore that it is not internationalisation per se that is important for the employers, but the secondary effects of internationalisation: getting robust employees equipped to handle change and constantly shifting circumstances, and who have the ability to think innovatively. Another informant pointed out that a mobility project is in fact an entrepreneurial project: you have to learn to build a new life in a new country. Several informants also emphasise that mobility stays greatly impact the language and cultural skills, self confidence and self efficacy of the pupils, apprentices and students. 4 Organisations in the adult education sector also report that staff mobility and Strategic Partnerships have led to improved key competences among staff. One organisation has experienced increased demand for knowledge sharing and courses from other organisations after having participated in E+ projects. Within the VET sector in particular, informants point out several positive effects of mobility stays. Many refer to improved subject specific competence for pupils in fields not offered at the pupils school. A number of schools, in particular in the VET sector, utilise VET mobility strategically to be able to offer students specialised training in a sub field they cannot offer at their own school, and that is often not even available in Norway. In line with findings from the Impact Study, some informants in the VET sector also report that pupils and apprentices that return from mobility stays get apprenticeships or jobs back home because of their mobility stay. Increased opportunity for employment is a reported effect also in the youth field, among volunteers. Many report having obtained a job because of their volunteering experience. At a 20 year anniversary celebration for EVS in Norway in 2016, Bufdir interviewed many of the former volunteers about the impact their EVS experience had on their lives, and many reported how they had acquired jobs because of their volunteering experience. In the youth field, objective one pertains to improving key competences and skills of young people, including those with fewer opportunities, and promoting participation in democratic life in Europe and the labour market, active citizenship, intercultural dialogue, social inclusion and solidarity. In addition to increasing the employability of volunteers, two effects stand out from the interview material. A recurring theme from the interviews was the impact of mobility stays on marginalised youth. Several informants, both at the National Agency level and the level of the participating organisations, report that mobility stays particularly benefit youth who are marginalised in their local communities, by giving them a chance to reinvent themselves. The informants narratives go as follows: The mobility projects give marginalised youth a chance to be in a new context where they are given a new role, are seen with fresh eyes, and learn new skills. This makes them feel competent, and contributes to changing their self 2 See e.g. SIU (2013): Living and Learning Exchange Studies Abroad. 3 European Commission (2014). 4 Findings in Meng Hsuan Chou and Åse Gornitzka (2011) support these findings, as does a survey among Norwegian exchange pupils in upper secondary school support this finding (SIU 2016). 9

perception. Upon their return, they are seen as more resourceful and often participate more (social inclusion). These narratives are supported by a dissertation that further found that youth exchanges contribute to changing young dropouts learner identity from negative to positive, increase several of their key competences, and motivate them to take further education (Vasbø, 2011). According to SIU, a similar effect is observed in mobility projects in the VET sector that aim to reduce dropout rates. Transnational research findings show that mobility projects contribute to improving youth s key competences and skills in general, not just those of marginalised youth. 5 Research findings for the Norwegian participants are in line with those of the transnational findings. In particular, participants from Norwegian Youth in Action projects reported increased interpersonal, social and intercultural competences in addition to being able to communicate in another language. 6 Another salient theme was the importance of the programme for promoting participation in democratic life and active citizenship. Several municipalities and counties utilise the programme actively in order to lay the grounds for better youth participation in politics. Several municipalities have taken advantage of the programme to develop youth councils, which gives youth a formal role in local politics and in municipal planning. There are several examples of municipalities that have built up their youth work around Erasmus+, and use the programme to engage youth locally. When returning from mobility stays, the municipalities recruit them to contribute actively back in to their community. Research findings also indicate that participating in Erasmus+ projects for youth increases the political and social participation of the individual participants. More than 40 percent of Norwegian youth that were part of a Youth in Action project reported that they participated in political and social activities to a greater extent than before. 7 Objective 2: To foster quality improvements In the field of education and training, objective 2 is to foster quality improvements, innovation excellence and internationalisation at the level of education and training organisations. The most frequently reported effect from programme participation at the level of the participating organisations is improved teaching competence and quality, through teacher mobility and Strategic Partnerships. Existing survey material on school internationalisation supports this finding. In primary and lower secondary school, 70 percent of principals at schools that have participated in internationalisation programmes believe it has a positive effect on the school s academic offerings (SIU, 2015). In upper secondary school, 84 percent of teachers and principals believe international cooperation improves teachers competence (SIU, 2011). There are also numerous examples of teachers and organisations introducing new teaching methods as a result of Strategic Partnerships or teacher mobility, within the school, adult education and higher education sectors. According to one HEI there has been a large increase in the percentage of staff on mobility who report that they have developed new teaching methods as a result of the mobility project. An example from higher education illustrates how Strategic Partnerships can lead to the development of new methods and processes in the educational field. Three universities in Norway, the UK and Spain have developed a teaching app for nursing students in all three languages. Starting in the fall of 2017, the app will allow nursing students in the three countries to download e compendia through the app. This opens up new opportunities when it comes to organisation, student involvement and digitalisation in nursing education. More specifically, the app may facilitate decentralised teaching and increase opportunities for 5 RAY (2014). 6 Huang (2013). 7 Ibid. 10

supplementary training. There are also examples of HEIs that have developed new study programs as part of E+ projects, e.g. an online study program in Aramaic, developed in a partnership between a Norwegian university and universities in Germany and the UK. Informants from both SIU and participating organisations underscore the value of E+ for organisational development and entrepreneurial activities for the participating organisations. Although many of the projects do not represent innovations in a European or global context, they can be seen as innovative at the level of the participating organisation. An example is a primary school, which reorganised their entire mathematics teaching system after having participated in a Strategic Partnership with schools in Ireland, Greece and the Czech Republic. They also emphasise that projects with an entrepreneurial focus often have tangible results, for instance student start ups. However, several organisations point out that innovation and entrepreneurial activities are an integral part of their strategy, and that it is hard to isolate the actual effect of the Erasmus+ projects vis à vis other initiatives. Nevertheless, they do believe that there are synergetic benefits resulting from the various initiatives. Several informants, especially at the HEI level, also pointed out the benefits of Erasmus+ for the internationalisation process of the organisations. Clearly, there are direct and immediate internationalisation effects through each ongoing project. Also, informants pointed out several secondary or indirect effects; participation in Erasmus+ projects is prestigious and can increase the status of the organisation and give access to new network and contacts, as well as other programs and in financial sources, if used strategically. Furthermore, Erasmus+ can lead to greater international faculty recruitment for organisations participating in Erasmus+. Two of the largest universities in Norway report that they attract talented students through mobility projects who either choose to stay or later return as PhD students or faculty. As one informant points out, Norwegian students and staff who go on mobility also serve as international ambassadors for the institution, which can further affect international recruitment. In the youth field, most of the organisations we talked to underscore that Erasmus+ is providing a unique opportunity to work actively on raising the quality of youth work, by enhancing youth workers knowledge or by developing new products and methods that can be used in youth work. Few such opportunities exist in the youth field, and they find it very valuable e.g. to be able to send their youth workers to courses. The youth workers return with new methods and reignited enthusiasm, which they spread within the organisations. To some organisations, Erasmus+ funds are critical for both competency and organisational development. The NAU underscore the important role of Erasmus+ in developing new research and building competence within the youth field, which can contribute to increasing quality in youth work and raising youth workers professional status. (Question 3) To what extent have Erasmus+ actions influenced policy developments in the domains of education and training, youth and sport in your country? Which actions were most effective in doing so? Are there marked differences between fields? There is great consensus among our informants at the policy and NA level that there is a very high degree of overlap and alignment between Norwegian and EU goals within both the educational field and the youth field. Within the field of education and training in general, Norwegian and EU policy development is closely connected, e.g. Norway and the EU both participate in the Bologna process, which has greatly affected the development of Norwegian and EU educational policy in higher education. The Ministry of Education and Research considers it to be of utmost importance that E+ is supporting the Bologna Process and contributing to several of the activities in this pan European process to modernise higher education, make it more transparent and to enhance cooperation in the European Higher Education Area. 11

There are also several examples of how former programmes have contributed to changing the educational field in Norway, as well as laws and regulations. 8 One example is the introduction of Erasmus Mundus, which resulted in a change in the Act Relating to Universities and University Colleges in order to clarify that joint master degrees were permitted. Informants at the policy and NA levels in particular point out three issues that are high on the agenda in both Norway and EU: dropout rates, basic skills and VET education. Within the EU, as in Norway, improving VET education and the status of the education is a political priority, and there is an ongoing discussion on how to achieve this. The teaching of basic skills in the workplace is an area where Norway is considered to be at the forefront in Europe. This has also been the theme of several Erasmus+ projects. Regarding drop out rates, informants at both policy and NA levels underscore the importance of sectors and countries working together in order to lower the rates, and the Erasmus+ programme is viewed as an important tool in this respect. Although dropout rates are high on the political agenda in Norway irrespective of Erasmus+, informants at the policy level point out that E+ projects may affect how Norwegian educational authorities at the national, regional and local level work to reduce or prevent students dropping out. As an example, according to leaders at the NA level, the integration of several programmes into one has facilitated more cross sectorial cooperation to deal with topics such as dropout rates. Within the youth field, there are several examples of how E+ projects contribute to policy development, in particular when it comes to enabling youth participation in the political and administrative processes at local and regional levels, through the creation of youth councils. In 2013, a project with participants from youth councils in Mid Norway focused on promoting youth participation in transportation planning. Politicians from both the regional and the national level participated, and as a result of the attention it brought, the government has suggested making youth participation in transportation planning statutory. There are also examples of the programme being used actively to achieve political goals locally. One county has used the programme as part of their effort to halt depopulation, and a municipality has used it to reduce dropout in secondary education. An example of how Erasmus+ funded projects within the youth field can affect policy making on a smaller scale is an NGO initiated project that trains youth leaders in leadership, decision making, campaigning and how to press for political action on relevant topics. Leading politicians, e.g. the Minister of Foreign Affairs, are invited to their meetings, and in 2015, several participants in the project, among them four Norwegians, were sent to Paris to participate in the COP 21 on climate change. Are some actions more effective than others in affecting policy development? There is no substantial evidence that supports a claim that some actions are more effective than others in influencing policy developments. However, the NAUs and the NAs bring up actions they believe have a particular potential for affecting policy development. The NAU for education and training believes that KA3 projects have the greatest potential to affect policy making, especially with the increased emphasis on these actions within the current programme period. The policy level in education and training has been involved in various innovative projects within KA2 and KA3, through the application process, and being part of the steering committees/implementation boards in the projects. This is contributing to dissemination of results and higher level of awareness of policy implications for the projects. In the youth field also, the NAU and the NA point to KA3 actions as particularly important for influencing policy development. The NAs also consider KA1 mobility actions important to influencing policy. Within the VET sector for instance, pupil, apprentice and teacher mobility has improved understanding of various 8 Meng Hsuan Chou and Åse Gornitzka (2011) describe this development in the report Den femte frihet og Kunnskapens Europa. Konsekvenser for Norge. 12

countries systems and created a need for recognition of foreign VET education. Such recognition will make it easier to carry out a mobility stay in another country. These processes lead to further alignment of educational systems. One example is a plan for all countries to develop curricula based on learning outcome. Another is increased focus on dividing courses into modules. Better aligned curricula can later facilitate worker mobility between these countries. In the youth field, there are also examples of projects within KA2 Strategic Partnerships that aim to affect policy development. An example is an organisation involved in a partnership that has the purpose of developing methods to improve youth participation. As a part of the project, the organisation is working with a public agency in Norway to look at ways to increase youth participation throughout the entirety of the agency s service system. (Question 4) What specific approaches (such as co financing, promotion or others) have you taken in order to try to enhance the effects of Erasmus+ in our country? To what extent have these approaches been effective? Can any particular points for improvement be identified? Several efforts are being made at both the level of the National Authorities and the National Agencies to enhance the effects of Erasmus+ in Norway. Within the field of education and training, international cooperation is high on the political agenda in Norway, and its place in educational policy has been increasingly consolidated through policy documents, institutionalisation and funding. Through a 2008 09 white paper, the government sought to better anchor the goal of increased internationalisation in national educational policy by defining internationalisation in education not only as a goal in and of itself, but also as a means to improve the quality and relevance of Norwegian education. 9 This is further emphasised in a recent white paper on quality in higher education, where internationalisation is defined as a prerequisite for quality in education. 10 The Ministry also emphasises the growing institutionalisation of internationalisation work, both at the policy level and at the level of the participating organisation, a development that has been strengthened by the stricter requirements in Erasmus+ to anchor projects at an institutional level. Moreover, internationalisation is increasingly becoming part of the curricula at various levels. There is also more interaction and collaboration across organisations. For example, in the higher education sector NOKUT (The Norwegian Agency for Quality Assurance in Education) is increasing its focus on internationalisation when developing new regulations for the quality of study programmes. As a followup, SIU and NOKUT will collaborate on analysis of the impact of internationalisation as well as promotion of high quality student exchange. As part of the government s emphasis on internationalisation of education, funding incentives have been strengthened. In higher education, part of the result based funding for HEIs is based on number of student mobilities. 11 In order to further incentivise institutions to receive and send more students, the government has increased the per student incentive from 2017, to 1100. The financial institutional incentive for sending out students on Erasmus+ mobility vis à vis all other internationalisation programmes, is further strengthened by 50%, a 1650 per student incentive. Furthermore, with the introduction of Erasmus+, the Ministry of Education and Research increased SIU s operating funds with 1,2 million annually in order to enhance SIU s role in the implementation of the programme. 9 St. meld. 14 (2008 2009), p. 5. 10 St. meld. 16 (2016 2017), p. 63. 11 Prop. 1 S (2016 2017): Kunnskapsdepartementet. 13

From 2017, the government also rewards HE institutions financially for participation in E+ centralised actions, as has already been the case for participation in Horizon 2020. Educational cooperation through Erasmus+ is strongly encouraged, and in 2016, the government issued strategic goals for Norway s participation in the programme. Within the adult education sector SIU received extra funding from the Ministry of Education and Research to increase the international activity. The funds were used partly for preparatory visits and partly to organise a contact seminar in Brussels, which resulted in at least three Strategic Partnership applications. At the NA level, in order to increase Norwegian participation in centralised projects, SIU has allocated seed money for such projects. Organisations that aim to apply for Knowledge alliance, Sector Skills alliances etc. can apply for up to 11,000 in seed funding for the preparation of the application. Most of the Norwegian projects that have been awarded centralised funds had received seed money for the development of their project. Within the youth field, the Ministry of Children and Equality looks at ways to combine Erasmus+ with other grant schemes, in order to achieve synergetic effects. They are also promoting Erasmus+ in relevant settings. The NAs are also working to enhance the effects of Erasmus+ through informational and promotional activities, such as information meetings, application writing seminars, and seminars with organisations that have been awarded grants. The organisations are in general very content with the support and help they receive from SIU and Bufdir. However, both NAs wish they had the capacity to engage in more promotional work in order to reach more organisations. This was a general concern expressed by nearly all informants at this level. Both NAs believe that they could be more proactive in their recruitment of new organisations, and that there is untapped potential there. At SIU, programme officers in several sectors emphasise the need for broad dissemination and communication of the results of Erasmus+ and the various E+ projects, to both key stakeholders and potential new organisations in order to increase interest. However, dissemination of results require robust data. SIU is therefore calling for better systems for facilitating and enabling measurement of results and effects. (Question 5) Do you consider that certain actions of the programme are more effective than others? Are there differences across fields? What are the determining factors for making these actions of the programme more effective? Based on the interview material, there is little evidence to indicate that certain actions are more effective than others. Rather, we have the distinct impression that the E+ actions are effective in different ways and at different levels, and that they complement each other. There is broad consensus at the NA level in both fields that mobility should remain the core activity of Erasmus+. Across fields and sectors there is agreement that mobility projects have a particular and immediate effect on the individual level, because of the sheer number of participants. However, although mobility is considered to have an effect primarily on the individuals that participate in a mobility project, the informants believe that such projects over time can have a broader effect at both an institutional and a national level. Several informants at SIU and some of the schools that were interviewed underscored the importance of VET pupil and apprentice mobility. Some VET schools report that they have experienced improved recruitment to the programmes that offer such projects. The opportunity for mobility may therefore have a broader effect in contributing to making VET education more attractive. 14

Furthermore, some VET schools have experienced that pupil and apprentice mobility may lead to closer collaboration between the school and the training establishment if both parts participate in the project. They also see great potential for quality improvements and development of new teaching methods in this action, as teachers who join pupils on mobility stays are put in contact with a new professional environment. The importance of Strategic Partnerships is underscored by both NAs, and by several organisations and organisations within the education and training and the youth fields. Informants emphasise the effects at the institutional level in particular. They argue that Strategic Partnerships can affect quality, content and innovation by giving organisations an opportunity to work goal oriented, structured and long term with other organisations. Strategic Partnerships are viewed as a unique opportunity to work on long term quality improvement. One informant from a youth organisation believe the ripple effects from Strategic Partnerships are greater than from mobility projects, as partnerships allow organisations to work more closely with important partners. Partnerships offer organisations an opportunity to expand their network, exchange knowledge and experiences. However, the effect that Strategic Partnerships may have on an individual level should not be underestimated. Although the projects usually involve fewer participants than mobility projects, they have the potential to reach many individuals, e.g. through products that are developed in the project. One example is the teaching app for nursing education, which in the long run, by increasing availability, can give more people access to higher education. The following example from a county in western Norway illustrates one possible effect of a Strategic Partnership: Through a County consortium, French and German language teachers in upper secondary education can go on Erasmus+ staff mobility to a French and a German university. Through a Regio project with the county and a Norwegian university, the French university has developed a teaching programme for, and in collaboration with, the county s French language teachers. As a part of the process, the programme leader has visited the county to observe French instruction in relevant schools and to discuss the teachers expectations, methods and the Norwegian school system with teachers and school leadership. The result is a programme that is highly relevant to the Norwegian teachers needs. The county contrasts this experience with their experience of sending teachers of German language on mobility to a university in Germany. This course was not developed through a partnership process, and the participating teachers found the instruction to be insufficiently adapted to their reality and needs. The county s representative is confident that the different experiences of the teachers are due to the partnership process of developing and customizing the programme for the teachers of French language, which would not be possible without a Strategic Partnership. Programme officers at SIU also emphasised the significance of VET Strategic Partnerships. While pupil and apprentice mobility in the VET sector has been and is important in order to identify areas for improvement and standardisation across countries, Strategic Partnerships provide an opportunity to work more methodically and strategically to improve VET, which has the potential to affect development, quality and content at the institutional level and the systemic level. Furthermore, two HEIs with experience from both partnerships and centralised projects, considered Strategic Partnerships to be an important stepping stone to participation in centralised projects, as it enables organisations to develop good projects. One factor that is considered to determine effectiveness within the education and training field, is the stricter requirements in Erasmus+ to anchor projects in the leadership. Several informants at the NA level points out that this may strengthen the effect of each project at the institutional level, because projects are better aligned with the organisation s goal and embedded in the organisation s strategy. These 15

requirements seem to have had an effect on the institutionalisation of projects, and several schools view these requirements as a positive change from the previous programmes. Within the youth field, KA3 is considered particularly important for influencing policy development, especially concerning the participation of youth in political processes. As regards effects at the individual level, informants at both Bufdir and the youth organisations emphasise the effect of volunteering on the individuals that participate in EVS, because of the long duration of the mobility. At the same time, they underscore the value of youth exchanges because they can serve more youth, and have valuable learning effects on the individual, although such mobilities involve shorter stays. The NAU points to the fact that youth exchange and EVS can offer youth an early experience with international mobility, and they also emphasise the inclusive nature of youth exchange and the opportunity it represents for marginalised youth in particular. A Norwegian research study on pupils that had dropped out of school after lower secondary found that mobility exchanges as short as two weeks had an impact on a number of the pupils key competences (Vasbø, 2011). It also had an impact on their self confidence, self understanding, their sense of mastering social and academic situations and helped them develop a positive learner identity, which finally was decisive for convincing them that they would be able to finish upper secondary school. One informant argues that youth worker mobility is more effective than other types of mobility, because of a multiplier effect : Through the work of one youth worker, the organisation can reach a larger group of youth. Another informant emphasised this action as an effective way to develop new methods and learn from the experiences of others. (Question 6) To what extent has the integration of several programmes into Erasmus+ made the programme more effective in your country? It is too early in the programme period to draw any substantiated conclusions about whether the integration has made the programme more effective, especially if we interpret the term effect in the strict statistical sense. However, informants at both the policy level and the NA level see several positive developments that have the potential to increase effectiveness. Within the education and training field, both the NA leadership and several programme officers highlight the positive aspects of streamlining the programme. They believe a restructuring was necessary in order to make the programme more coherent and unified, and that this can have a positive impact on the branding of the programme. Better branding means that Erasmus+ can reach more pupils, students, youth, teachers and organisations, which means greater potential for impact. At the same time, programme officers in the VET and school sectors point out that the previous programmes Leonardo and Comenius had a strong brand name, and that it will take time for Erasmus+ to obtain a similar brand position within these sectors. In the youth field, the NAU believes that being part of Erasmus+ brings more legitimacy to youth work that it is beneficial to be part of the Erasmus+ family. The NA also sees positive synergy effects in that they can join in on several of the other NA s activities, such as informational meetings, which is something they would not have done if the youth field were not part of Erasmus+. More legitimacy and more visibility does again mean potential for reaching more youth and thus greater impact. The NA leaders in both fields believe the potential for collaboration across sectors and fields is greater through Erasmus+ than through previous programmes, especially through the Strategic Partnership actions. This belief is supported by both NAUs. The fact that HEIs participate in projects within all sectors in Norway, illustrate this. There are also several examples of Strategic Partnerships where NGOs from the youth field are collaborating with educational organisations, and the education and training field is starting to see more collaboration across its sectors. An example is the aforementioned increase in crosssectoral collaboration to combat dropout rates. 16