Adaptation and validation of the instrument Clinical Learning Environment and Supervision for medical students in primary health care

Transcription

1 Öhman et al. BMC Medical Education (2016) 16:308 DOI /s RESEARCH ARTICLE Open Access Adaptation and validation of the instrument Clinical Learning Environment and Supervision for medical students in primary health care Eva Öhman 1,3*, Hassan Alinaghizadeh 1, Päivi Kaila 1, Håkan Hult 2, Gunnar H. Nilsson 1 and Helena Salminen 1 Abstract Background: Clinical learning takes place in complex socio-cultural environments that are workplaces for the staff and learning places for the students. In the clinical context, the students learn by active participation and in interaction with the rest of the community at the workplace. Clinical learning occurs outside the university, therefore is it important for both the university and the student that the student is given opportunities to evaluate the clinical placements with an instrument that allows evaluation from many perspectives. The instrument Clinical Learning Environment and Supervision (CLES) was originally developed for evaluation of nursing students clinical learning environment. The aim of this study was to adapt and validate the CLES instrument to measure medical students perceptions of their learning environment in primary health care. Methods: In the adaptation process the face validity was tested by an expert panel of primary care physicians, who were also active clinical supervisors. The adapted CLES instrument with 25 items and six background questions was sent electronically to 1,256 medical students from one university. Answers from 394 students were eligible for inclusion. Exploratory factor analysis based on principal component methods followed by oblique rotation was used to confirm the adequate number of factors in the data. Construct validity was assessed by factor analysis. Confirmatory factor analysis was used to confirm the dimensions of CLES instrument. Results: The construct validity showed a clearly indicated four-factor model. The cumulative variance explanation was 0.65, and the overall Cronbach s alpha was All items loaded similarly with the dimensions in the non-adapted CLES except for one item that loaded to another dimension. The CLES instrument in its adapted form had high construct validity and high reliability and internal consistency. Conclusion: CLES, in its adapted form, appears to be a valid instrument to evaluate medical students perceptions of their clinical learning environment in primary health care. Keywords: Medical students, Primary health care, Clinical learning environment, Validation * Correspondence: Eva.ohman@ki.se 1 Division of Family Medicine, Department of Neurobiology Care Sciences and Society, Karolinska Institutet, Alfred Nobels allé 23, Huddinge SE , Sweden 3 Academic primary health care centre (APC), County Council of Stockholm, Alfred Nobels allé 10, Huddinge, Sweden Full list of author information is available at the end of the article The Author(s) Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License ( which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

2 Öhman et al. BMC Medical Education (2016) 16:308 Page 2 of 8 Background Clinical learning occurs in a multidimensional environment, a place where the patient gets help, a workplace for the staff and a learning place for the student, a place containing physical, social and educational dimensions [1, 2]. Learning in real workplaces through encounters with patients and their families, other health care professions and students is an essential part of medical education. The main purpose of learning in real workplaces is to give the student opportunities to translate theoretical knowledge into practice, to provide early professional contact, and to allow the student to build an identity as a professional [3]. Students who have their clinical placement at a primary health care (PHC) centre meet patients of several ages with various complaints, a context which is usually perceived as stimulating by the students [2, 4]. At the PHC centre, the student is also given the opportunity to see the patient as an individual [4]. The student has the possibility to interact with the supervisor, other students and professions [2, 5]. This is important according the theory of social learning, where the engagement and participation with others in the community is the basis of learning, learning as social participation [6]. The role of the supervisor is identified as a key factor for a meaningful learning experience [2]. Students describe how a good relationship between a student and a supervisor is characterised by a positive attitude, openness, trust, and an atmosphere that allows the student to ask questions and thus reveal gaps of knowledge [3, 4, 7, 8]. Supervision at a PHC centre is often organized as a one-to-one relationship where a student has an appointed doctor as supervisor. It has been reported that one-to-one relationships allow the supervisor to observe and support the student s learning process more individually and gradually let the student take care of patients more independently [2]. The clinical practice in PHC occurs outside the university and the student is dependent not only on the supervisor but also on the rest of the staff, individuals from different professions [2, 5]. This multifaceted learning environment requires a multifaceted instrument for its evaluation. A systematic review suggested in 2010 that the Dundee Ready Education Environment Measure (DREEM), the Postgraduate Hospital Educational Environment Measure (PHEEM) and the Clinical Learning Environment and Supervision (CLES) are the most suitable instruments for undergraduate medical, postgraduate medical and nursing education [9]. DREEM covers several aspects of an educational environment at university as a learning environment [10, 11]. PHEEM is an internationally used instrument for measuring the educational climate of postgraduate hospital environments [12]. The PHEEM instrument has three subscales: perceptions of role autonomy, perceptions of teaching and perceptions of social support [12]. CLES is an instrument originally developed for the evaluation of the clinical learning environment of nursing students [13]. CLES + T, the instrument developed from the original CLES instrument, is currently used since 2007 for evaluation of the quality of the clinical learning environment in Hospital District of Helsinki and Uusimaa, in Finland [14]. After the BEME review was published two new instruments for measuring clinical teaching environment for medical students has been created; Manchester Clinical Placement Index (MCPI) 2012 [15] and the Undergraduate Clinical Education Environment Measure (UCEEM) 2013 [16] Both instruments were validated for evaluation of the clinical learning environment of medical students in hospitals and in PHC. An instrument that could be used for evaluation of the clinical learning environment of both medical students and other students from other health care professions in PHC would give new opportunities to create systems for quality control and give more nuanced feedback to both the university and the clinical sites. Items in CLES are relatively independent of profession. Considering this and the results from previous validation studies, the CLES instrument was chosen for this study. The aim of this study was to adapt and validate the CLES instrument to measure medical students perceptions of their learning environment in PHC. Methods Context and participants Medical students at Karolinska Institutet, Stockholm Sweden, had clinical placements in PHC for 10 weeks, spread over nine semesters, during their clinical education. The period at the PHC centre varied from two to seven days per semester. The students had their clinical placements at 152 different PHC centres, depending on which semester the students were in their education. The adapted CLES instrument was sent as a webbased questionnaire to 1,256 medical students in spring The web programme showed who had responded to the survey but not what they had answered. A reminder was sent one week after the first inquiry to the students who had not responded. All items in the web questionnaire were mandatory. The entire CLES websurvey is available in Additional file 1. The CLES instrument The original CLES instrument was created in 2002 as an instrument designed for evaluation of the clinical learning environment of nursing students in Finland [13]. CLES was developed from extensive literature reviews, audits and the previous work of the Finnish research group. The CLES instrument contained 27 items and was divided into five sub-dimensions. Its face validity

3 Öhman et al. BMC Medical Education (2016) 16:308 Page 3 of 8 was tested by an expert panel. CLES was then tested by Finnish nurse students (n = 162) and the instrument was assessed by nine clinical teachers. Exploratory factor analysis was used to analyses the construct validity and the reliability was ranged from 0.94 to 0.73 tested by Cronbach s Alpha [13]. CLES was further developed to CLES + T in 2008, containing a new dimension: Role of nurse teacher. The other dimensions were Supervisor relationship, Pedagogical atmosphere at the ward, Leadership style of the ward manager and Premises of nursing on the ward [17]. The CLES instrument has 25 items and utilizes a 5- point Likert scale: (1) Fully disagree, (2) Disagree to some extent, (3) Neither agree nor disagree, (4) Agree to some extent, and (5) Fully agree. The CLES + T instrument has been tested by several psychometric tests [18 20] CLES + T has been validated for evaluation of the clinical learning environment for nursing students in PHC in Sweden [20]. Adaptation and assessing the face and content validity of the instrument The original CLES instrument was developed to measure nursing students perceptions of their learning environment in hospital units. The original CLES instrument was developed with the added dimension Role of nursing teacher and became the CLES + T instrument. The authors of this article decided to remove the dimension Role of nursing teacher from the original instrument for the purpose of this study because there is no comparable role of a teacher at a PHC centre to facilitate the medical students learning. Some items and terms such as ward and ward manager (WM) in the original CLES were not applicable to PHC and have been replaced with PHC centre and manager at the PHC centre (Table 1). The dimension in the original instrument Premises of nursing on the ward was not suitable since nursing philosophy not is applicable in the context of medical students in PHC and therefore it was changed by the authors of the article to Premises for the patient. In order to minimize the risk of response biases, the four items in the dimensions Premises for the patient were adapted by using meanings that were appropriate for respondents in our sample. Item 31) The ward s nursing philosophy was clearly defined was adapted to The PHC Centre has a clearly defined vision and a mission statement for patient care that is clearly described. Item 32) Patients received individual nursing care was adapted to patients received individualised care. Item 33) There were no problems in the information flow related to patients care was adapted to There were no problems in the information flow related to patient care (Discussion about individual patients and the transmission of information about individual patient Table 1 Adaptation of the CLES items to the context of medical students in PHC The CLES items version 2008 Overall I am satisfied with the supervision I received I felt comfortable going to the ward at the start of my shift During staff meetings (e.g., before shifts) I felt comfortable taking part in the discussion There was a positive atmosphere on the ward There were sufficient meaningful learning situations on the ward The ward can be regarded as a good learning environment The WM regarded the staff on her/his ward as a key resource The WM was a team member Feedback from the WM could easily be considered a learning situation The ward s nursing philosophy was clearly defined Patients received individual nursing care There were no problems in the information flow related to patients care Documentation of nursing (e.g., nursing plans, daily recording of nursing procedures etc.) was clear The CLES items adapted for medical students Overall, I am satisfied with the supervision I received at the PHC centre I felt comfortable going to the PHC centre every day of my practice During staff meetings I felt comfortable taking part in the discussions There was a positive atmosphere at the PHC centre There were sufficient meaningful learning situations at the PHC centre The PHC centre can be regarded as a good learning environment The manager of the PHC centre regarded the staff at their PHC centre as a key resource The manager of the PHC centre was a team member Feedback from the manager of the PHC centre could easily be considered as a learning situation. The PHC centre has a clearly defined vision and a mission statement for patient care that is clearly described Patients received individualised care There were no problems in the information flow related to patient care (Discussions about individual patients and the transmission of information about individual patient cases to other colleagues and team members were handled respectfully) Documentation of patient care (e.g., medical records and other medical procedures etc.) was clear

4 Öhman et al. BMC Medical Education (2016) 16:308 Page 4 of 8 cases to other colleagues and team members were handled respectfully). Item 34) Documentation of nursing (e.g. nursing plans, daily recording of nursing procedures etc.) was clear was adapted to Documentation of patient care (e.g. medical records and other medical procedures etc.) was clear. Those and others adaptation are also described in Table 1. After the adaptation process, an expert panel assessed the face- and content validity. The expert panel consisted of five clinically active primary care physicians, and clinical teachers in PHC. All adaptation was performed in collaboration with Mikko Saarikoski, the creator of the original CLES instrument. Definitions The terms supervisor, tutor, and mentor have been used slightly differently in different studies. In this study, the term supervisor was used to describe a person with a formal mandate to supervise students. The term manager at the PHC centre was used to describe the person who is the manager of a single PHC centre. Statistics The first step was to find out how well the adapted CLES measured the clinical learning environment for medical students in PHC, the construct validity. To assess the construct validity, with the aim to analyse the underlying structure of all items and control for grouping tendency, exploratory factor analysis was used. The suitability of the data was confirmed by the Kaiser- Meyer-Olkin (KMO) index of sampling adequacy and a significant Bartlett test of sphericity. The reliability and the internal consistency of the instrument were controlled by using Cronbach s alpha coefficient. Analysis of Cronbach s alpha was performed to control for internal consistency. Exploratory factor analysis based on principal component methods, followed by oblique rotation was used to confirm the number of factors. Oblique rotation was used with purpose to show associations among factors. The next step was to confirm if there was an adequate number of factors. Confirmatory factor analysis (CFA) based on the polychoric correlation was used to confirm if the four factors model was correct in the final step and chosen critical Fit value for acceptance were Root Mean Square Residual (RMSR), Standardized RMSR, Goodness of Fit Index (GFI), Adjusted Goodness of Fit Index (AGFI), Parsimony Goodness of Fit Index (PGFI) and Bentler-Bonett NFI. The term factor is a statistical term and therefore factor was used in the statistical part of the methods section. In the discussion and in the tables, the word dimension was used. All statistical analyses were performed using the SAS 9.3 software (SAS Institute, Cary, NC, USA). Results A total of 394 students answered the questionnaire (mean age of 26 years, range years); 63 % of the students were women and 37 % were men. Between 101 and 160 questionnaires were sent to nine different semesters and between 30 and 53 answers where received from each semester. All items in the web questionnaire were mandatory, so the questionnaires were answered fully and completely, and consequently the dataset contained no missing data. Construct validity As shown in Table 2 of the 25 items in the adapted CLES loaded to the four factors with a loading above 0.5. Almost all items, 23 out of 25, had loadings above 0.5. The lower limit was drawn at 0.3 for items loadings to factors. All items loaded similarly to those of the CLES from 2008, without the removed dimension T [17] except for one item. In the original CLES, the item The ward s nursing philosophy was clearly defined loaded in the fourth dimension, Premises of nursing on the ward. For the purpose of our study, this item was adapted and rephrased as The PHC centre has a clearly defined vision and a mission statement for patient care that is clearly described (see Table 1). This item moved to dimension 3, Leadership style of the manager of the PHC centre. Reliability and internal consistency The rated adequacy of the sampling was 0.95 according to Kaiser-Meyer-Olkin analysis, which showed that it was appropriate to perform factor analysis on the data. The items clearly loaded to a four-factor model with a 65 % cumulative variance explanation. Eigenvalue for factor 1 was showing a high grade of explanation of the variance in the factor. Eigenvalue for factor 2 was 2.14, 1.26 for factor 3 and for factor 4, Proportion had highest value 0.48for factor 1, 0.09 for factor 2, 0.05 for factor 3, and 0.04 for 4. The reliability of the instrument was estimated using Cronbach s alpha, which measured how consistent items were within each factor. The internal consistency for the 25 items was found to be high, with an overall Cronbach s alpha value of Cronbach s alpha was 0.91 for factor 1, 0.92 for factor 2, and 0.95 for factors 3 and 4. (Table 2). These four dimensions were confirmed by CFA and RMSR = 0.06, SRMSR = 0.06, GFI = 0.99, AGFI = 0.99, PGFI = 0.89 and NFI = 0.99 all indicating a good fit. For additional results see the Additional files containing:

5 Öhman et al. BMC Medical Education (2016) 16:308 Page 5 of 8 Table 2 CLES validation for medical students in PHC with exploratory factor analysis confirmed with confirmatory factor analysis. The table shows factor loadings for both EFA and CFA and results of Cronbach s Alpha Items nr a Item b EFA c CFA d Cronbach s alpha e D1 Supervisor relationship (Dimension) Item 1 My supervisor showed a positive attitude towards supervision Item 2 I felt that I received individual supervision Item 3 I continuously received feedback from my supervisor Item 4 Overall I am satisfied with the supervision I received at the PHC centre Item 5 The supervision was based on a relationship of equality and promoted my learning Item 6 There was a mutual interaction in the supervisory relationship Item 7 Mutual respect and approval prevailed in the supervisory relationship Item 8 The supervisory relationship was characterized by a sense of trust D2 Pedagogical atmosphere on the PHC centre Item 9 The staffs was easy to approach Item 10 I felt comfortable going to the PHC centre every day of my practice Item 11 During staff meetings I felt comfortable taking part in the discussions Item 12 There was a positive atmosphere at the PHC centre Item 13 The staff was generally interested in student supervision Item 14 The staff learned to know the students by their personal names Item 15 There were sufficient meaningful learning situations at the PHC centre Item 16 The learning situation were multidimensional in terms of content Item 17 The PHC centre can be regarded as a good learning environment D3 Leadership style of the manager of the PHC centre Item 27 The manager of the PHC centre regarded the staff at their PHC centre as a key resource Item 28 The manager of the PHC centre was a team member Item 29 Feedback from the manager of the PHC centre could easily be considered as a learning situation Item 30 The effort of individual employees was appreciated Item 31 The PHC centre has a clearly defined vision and mission statement for the patient care that is clearly described D4 Premises of the patient Item 32 Patients received individualised care Item 33 There were no problems in the information flow related to patient care (Discussions about individual patients and the transmission of information about individual patient cases to other colleagues and team members were handled respectfully) Item 34 Documentation of patient care (e.g. medical records and other medical procedures etc.) was clear a Item numbered in the original CLES b Item translated for PHC c Exploratory Factor Analysis d Second-order Confirmatory Factor Analysis e Cronbach s alpha when item was deleted Additional file 2: Table S3. The means and standard deviations of the items in the CLES instrument. Additional file 3: Table S4. The frequency of the Likert scale answers of the items in the CLES instrument. Additional file 4: Table S5. The inter-factor correlations of the CLES instrument. Discussion The main finding of our study was that CLES, in its adapted form, appears to be a valid instrument for measuring medical students perceptions of the learning environment in PHC. The items clearly loading to a four-factor model indicated that CLES can be regarded as valid for this new target group and new context. In our study one item, the item that highlights the perspective on the patient care moved from its original dimension Premises for the patient to a new dimension. The item The PHC centre has a clearly defined vision and mission statement for patient care that is clearly described loaded to the dimension Leadership style of the

6 Öhman et al. BMC Medical Education (2016) 16:308 Page 6 of 8 clinical manager of the PHC centre. This item might have changed its meaning in the adaptation process. It might be logical that the item moved to another dimension when the context was a PHC centre and the target group medical students. The medical students placement at the PHC centre varied between two to seven days per semester. The items in the dimension Leadership style of the manager of the PHC centre might be difficult for medical students to answer adequately if they only had had a PHC placement for a few days. Longer clinical placements might enable more interaction with managers and other staff in the PHC. Although both the context and the target audience are new, we found basically the same loading pattern as in one previous study [13] except for one item, which indicates the stability of the instrument in our learning environment. The reason to choose CLES for adaptation and validation instead of using existing evaluation instrument, asforexampledreemorpheem,wastheambition to find a validated instrument suitable for medical students in the special clinical learning environment in PHC where students from other professions also have clinical placements. To be able to evaluate the learning environment of students from different professions, with the same instrument would facilitate the qualitative work and make it possible to compare the results. DREEM is one of the often used and recommended instruments but does not cover the aspects of the clinical learning environment [9 11]. PHEEM is a validated instrument developed for postgraduate hospital based junior doctors that is frequently used and that is translated to several languages, [12]. During the literature search for this study, we could not find studies for any of the instruments above that discussed the validation of the instrument DREEM or PHEEM to PHC. Therefore the choice to use CLES was made. One previous study has shown CLES to be valid for evaluation of the learning environment of nurse students in PHC [20]. There exist today two other instruments that have been created for evaluation of the medical students clinical learning environment in PHC. In 2012, the Manchester Clinical Placement Index (MCPI) was introduced [19]. The MCPI contains eight items with the opportunity for the student to comment freely on each of them, and the same items are used for both hospitals and PHC [15]. Compared to MCPI, CLES contains a larger number of items per dimension, which may increase the students possibility to describe their perception of the clinical learning environment in a more differentiated way. In 2013, the Undergraduate Clinical Education Environment Measure (UCEEM) was introduced, an instrument that contains 25 items that highlight many aspects of the clinical learning environment [16]. Neither MCPI nor UCEEM include the perspective of patient care. Patients are an indispensable part of medical students learning, but studies investigating the clinical learning environment of medical students rarely highlight the dimensions of the patient or the health care philosophy that prevails in the clinic. The CLES s dimension Premises for the patient may give the student a possibility to evaluate their perception of patient philosophy and the approach to the patient at the PHC centre. As previous studies have shown students learn by doing [3, 5] and the learning occurs in, and is influenced by, a social context [2, 5, 6, 21]. It has been shown in a study of Hendelman and colleagues that 72 % of the medical students have, sometime during their clerkship, witnessed a lapse in professionalism, carried out by for example physicians, nurse or other staff [22, 23]. As medical education in PHC takes place in a complex environment, occurring outside the university, it is necessary to make sure that it is possible for the student to evaluate and give expression from many different perspectives. Items in the dimension Supervisor relationship and Pedagogical atmosphere at the PHC centre in CLES cover both aspects of the relation between the student and supervisor and the pedagogical atmosphere at the PHC centre. CLES in the future The items in CLES are relatively independent of profession, which could make the instrument suitable to be adapted for evaluation of several professions learning environment. An evaluation instrument that can be used to evaluate the clinical learning environment for students from multiple healthcare professions could be used to obtain a more complete picture of the clinical learning environment. It would also facilitate the comparison of units and clinics. The original CLES instrument for nursing educations has been adapted to local contexts [19, 24]. It is possible that similar adaptation needs to be made if the instrument is going to be introduced for medical students and students from other professionals in a wider context. In Finland, CLES + T is used by hospital and medical universities for quality control of the clinical learning environment [14]. As the Finnish example, there may be a large potential for the CLES instrument to be used for the evaluation of the clinical learning environment for several student professions at a PHC centre. The results of the evaluation could be used to compare different PHC centres` learning environment. Feedback can be given to both the supervisor, the PHC centre, the student and the medical university, thus ideally improving the quality of the clinical learning environment.

7 Öhman et al. BMC Medical Education (2016) 16:308 Page 7 of 8 A quantitative measurement with CLES can give valid information about students perceptions, but also qualitative methods such as observations and interviews are needed for a deeper understanding of the clinical learning in PHC. A qualitative part was introduced to the version of CLES that was implemented for evaluation of the learning environment of medical students in PHC. Strengths and limitations This study has both strengths and limitation. Students who answered the CLES questionnaire were all medical students who had recently had a clinical placement in PHC which could be considered as a strength. The fact that all items in the adapted CLES were mandatory could be considered as both a strength and a limitation. The number of responses can be regarded as sufficient because all items were mandatory to answer. Each item was answered by 394 participants, and there were no missing values. The limitation of using mandatory items could be that if a student did not want to answer one of the items, they could not leave it and continue. This could possible make the student reluctant to continue and exit from the survey. The CLES instrument was created in the early 2000s. Education and educational premises for clinical learning develop continuously over time, and new pedagogical methods might require other questions or items in order to adequately evaluate the clinical environment in future. Conclusion Our study shows that the adapted CLES instrument, when used among medical students in PHC, had high construct validity with items clearly loading to a fourfactor model. Our results showed both high reliability and high internal consistency. The CLES can be considered to be a promising tool for the evaluation of today s learning environments for medical students in PHC. Additional files Additional file 1: The Clinical Learning Environment and Supervision (CLES) in its adapted form, sent to medical students who had clinical practice in primary health care. Additional file 2: Table S3. The means and standard deviations of the items in the CLES instrument. Additional file 3: Table S4. The frequency of the Likert scale answers of the items in the CLES instrument. Additional file 4: Table S5. The inter-factor correlations of the CLES instrument. Abbreviations CLES: Clinical Learning Environment and Supervision; DREEM: Dundee Ready Education Environment Measure; MCPI: Manchester Clinical Placement Index; PHC: Primary Health Care; PHEEM: Postgraduate Hospital Educational Environment Measure; UCEEM: Undergraduate Clinical Education Environment Measure Acknowledgement Thanks to all the medical students who contributed to the collected data by answering the items in the instrument CLES. Funding Funding by grants from the Stockholm County Council, Sweden. Availability of data and material The authors will provide the data set that was the basis of the analysis made in the study on request. Authors contributions Study Design: PK, HS, HH. Data Collection and Analysis: EÖ, HA, GN, HS, Manuscript Writing: EÖ, HA, PK, HS, GN, HS. Review of manuscript: PK, HH, GN, HA, HS. All authors read and approved the final manuscript. Competing interests The authors declare that they have no competing interests. Consent for publication Not applicable. Ethics approval and consent to participate The study was approved by the Regional Ethical Review Board in Stockholm Sweden. The students were informed in the web-based questionnaire about the possibility of withdrawing their participation during the study. The respondents were also informed about the anonymity of their responses. Contact information for the project was given in the , and an attached letter included further information about the purpose of the study. Authors information Eva Öhman, PhD student, RN, course administrator at the Academic primary health care centre (APC) County Councile of Stockholm. Phd student at Department of Neurobiology, Care Sciences and Society. Karolinska Institutet (KI), Sweden. Hassan Alinaghizadeh, Statistician, Academic primary health care centre (APC), Stockholm County Council. Päivi Kaila, RN, PhD, Senior Lecturer, Department of Neurobiology, Care Sciences and Society. Håkan Hult, Professor, Linköping s University. Gunnar Nilsson MD, Professor, Division for Family Medicine, Department of Neurobiology, Care Sciences and Society. Helena Salminen, MD, PhD, Senior Lecturer, Division for Family Medicine, Department of Neurobiology, Care Sciences and Society. Author details 1 Division of Family Medicine, Department of Neurobiology Care Sciences and Society, Karolinska Institutet, Alfred Nobels allé 23, Huddinge SE , Sweden. 2 Linköping University, Linköping, Sweden. 3 Academic primary health care centre (APC), County Council of Stockholm, Alfred Nobels allé 10, Huddinge, Sweden. Received: 26 May 2016 Accepted: 28 October 2016 References 1. Billet S. Workplace participatory practices. J Work Learn. 2004;16(6): van der Zwet J, Hanssen VGA, Zwietering PJ, Muijtjens AMM, van der Vleuten CPM, Metsemakers JFM, et al. Workplace learning in general practice: Supervision, patient mix and independence emerge from the black box once again. Med Teach. 2010;32: van der Zwet J, Zwietering PJ, Teunissen PW, Van der Vleuten CPM, Scherpbier AJJA. Workplace learning from a socio-cultural perspective: creating developmental space during the general practice clerkship. Adv Health Sci Educ. 2011;16: O Sullivan M, Martin J, Murray E. Students perception of the relative advantages and disadvantage of community-based and hospital-based teaching: a qualitative study. Med Educ. 2000;34: Dornan T, Boshuizen H, King N, Scherpbier A. Experience-based learning: a model linking the processes and outcomes of medical students workplace learning. Med Educ. 2007;41: Wenger E. Communities of practice: Learning, meaning, and identity. Cambridge University press 1998 p 4.

8 Öhman et al. BMC Medical Education (2016) 16:308 Page 8 of 8 7. Silverstone Z, Whitehouse C, Willis S, Mc Ardle P, Jones A, O Neill PA. Students conceptual model of a good community attachment. Med Educ. 2001;35: Stalmeijer RE, Dolmans DHJM, Wolfhagen IHAP, Scerpbier AJJA. Cognitive apprenticeship in clinical practice: can it stimulate learning in the opinion of students? Adv in Health Sci Educ. 2009;14: Soemantri D, Herrera C, Riquelme A. Measuring the educational environment in health professions studies: A systematic review. Med Teach. 2010;32: Roff S, McAleer S, Harden R, Al-Qahtani M, Uddin A, Deza H, Groenen G, Primparyon P. Development of the Dundee Ready Education Environment Measuer (DREEM). Med Teach. 1997;19: Roff S. The Dundee Ready Educational Environment Measure (DREEM) a generic instrument for measuring student s perception of undergraduate health professions curricula. Med Teach. 2005;27: Roff S, Mc Aleer S, Skinner A. Development and validation of an instrument to measure the postgraduate clinical learning and teaching educational environment for hospital-based junior doctors in the UK. Med Teach. 2005;27(4): Saarikoski M, Leino-Kilpi H. The clinical learning environment and supervision by staff nurses: developing the instrument. Int J Nurs Stud. 2002;39: Meretoja R. Saarikoski M. Evidence based development of clinical learning environment in Finnish health care services. Proseedings article to Eval 2012 conference June Pori Finland. handle/10024/65313/improvement_by_evaluation_2012.pdf#page= Dornan T, Muijtjens A, Graham J, Scherpbier A, Boshuizen H. Manchester Clinical Placement Index (MCPI) conditions for medical students learning in hospital and community placements. Adv in Health Sci Educ. 2012;17: Strand P, Sjöborg K, Stalmeijer R, Wichman-Hansen G, Jakobsson U, Edgren G. Development and psychometric evaluation of the Undergraduate Clinical Education Environment Measure (UCEEM). Med Teach. 2013;35: Saarikoski M, Isoaho H, Warne T, Leino-Kilpi H. The nurse teacher in clinical practice: developing the new sub-dimension to the clinical learning environment and supervision (CLES) scale. Int J Nurs Stud. 2008;45: Johansson U-B, Kaila P, Ahlner-Elmqvist M, Leksell J, Isoaho H, Saarikoski M. Clinical learning environment, supervision and nurse teacher evaluation scale: psychometric evaluation of the Swedish version. J Adv Nurs. 2010;66: De Witte N, Labeau S, De Keyzer W. The clinical learning environment and supervision instrument (CLES): Validity and reliability of the Dutch version (CLES + NL). Int J Nurs Stud. 2011;48: Bos E, Alinaghizadeh H, Saarikoski M, Kaila P. Validating the clinical learning environment, supervision and nurse teacher CLES + T instrument in primary healthcare settings using confirmatory factor analysis. J Clin Nurs. 2012;21: Dornan T, Scherpbier A, Boshuizen H. Supporting medical students workplace learning: experience-based learning (ExBL). Clin Teach. 2009;6: Hendelman W, Byszewski A. Formation of medical student professional identity: categorizing lapses of professionalism, and the learning environment. BMC Med Educ. 2014;14: Dornan T, Tan N, Boshuizen H, Gick R, Isba R, Mann K, et al. How and what do medical students learn in clerkships? Experience based learning (ExBL). Adv in Health Sci Educ. 2014;19: Vizcaya-Moreno M, Pérez-Canaveras RM, De Juan J, Saarikoski M. Development and psychometric testing of the clinical learning environment, supervision and nurse teacher evaluation scale CLES + TB. The Spanish version. Int J Nurs Stud. 2015;52: Submit your next manuscript to BioMed Central and we will help you at every step: We accept pre-submission inquiries Our selector tool helps you to find the most relevant journal We provide round the clock customer support Convenient online submission Thorough peer review Inclusion in PubMed and all major indexing services Maximum visibility for your research Submit your manuscript at