MASTER OUTCOMES EVALUATION BSN PROGRAM University of Puerto Rico Mayagüez Campus College of Arts and Sciences
UNIVERSITY OF PUERTO RICO MAYAGUEZ CAMPUS COLLEGE OF ARTS AND SCIENCES DEPARTMENT OF NURSING MASTER : OUTCOMES EVALUATION 2014-2019 BSN PROGRAM EVALUATION STANDARD 1: Mission and Administrative Capacity The mission of the nursing education unit reflects the governing organization s core values and is congruent with its mission/goals. The governing organization and program have administrative capacity resulting in effective delivery of the nursing program and achievement of identified program outcomes. OUTCOMES: 1.1 The mission/philosophy and program outcomes of the nursing education unit are congruent with the core values and mission/goals of the governing organization. 1.2 The governing organization and nursing education unit ensure representation of the nurse administrator and nursing faculty in governance activities; opportunities exist for student representation in governance activities. 1.3 Communities of interest have input into program processes and decision making. 1.4 Partnerships that exist promote excellence in nursing education, enhance the profession, and benefit the community. 1.5 The nursing education unit is administered by a nurse who holds a graduate degree with a major in nursing and is doctorally prepared. 1.6 The nurse administrator is experientially qualified, meets governing organization and state requirements, and is oriented and mentored to the role. Indicators/ Method 1.7 When present, nursing program coordinators and/or faculty who assist with program administration are academically and experientially qualified. 1.8 The nurse administrator has authority and responsibility for the development and administration of the program and has adequate time and resources to fulfill the role responsibilities. 1.9 The nurse administrator has the authority to prepare and administer the program budget with faculty input. 1.10 Policies for nursing faculty and staff are comprehensive, provide for the welfare of faculty and staff, and are consistent with those of the governing organization; differences are justified by the goals and outcomes of the nursing education unit. 1.11 Distance education, when utilized, is congruent with the mission of the governing organization and the mission/philosophy of the nursing education unit. Report of Data Collection & Responsible person/committee: Actions or Comments I. MISSION AND ADMINISTRATIVE CAPACITY A. Congruency 1. Vision 2. Mission/Philosophy 3. NEU Conceptual Framework Every 5 years and as needed or required UPR- UPRM-College of Arts and Sciences-NEU Mission, Vision Department Strategic Plan Philosophy of the NEU Outcomes of the NEU UPR-UPRM-College of Arts and Sciences-NEU Organization Chart General Regulation of the UPR Undergraduate Catalogue Director of Nursing Education Unit Faculty Curriculum Committee
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 2 Indicators/ Method Report of Data Collection & Actions or Comments Responsible person/committee: 4. Goals 5. NEU Outcomes 6. Societal and Professional Trends 7. Policies, Procedures and Bylaws Professional Nursing Standards of CPEPR Safety National Standards Standards of Professional Association (ACEN) Institutional Policies Faculty Minutes Curriculum Committee Minutes B. Governance Organization 1. Director of NEU 2. Faculty 3. Students Yearly or as needed Listing of participation of faculty and students in governance Committees/Task Forces/Workgroups of the UPRM and NEU The General By-laws of the Students of UPR Director of Nursing Education Unit NEU Standing Committees C. Administrator 1. Academic credential 2. Experience 3. Authority and responsibility As necessary or required (According to Certification 86-87-476 of the Administrative Board). According to Certification 86-87-476 of the Administrative Board-UPRM Curriculum Vitae Portfolio Credentials of the Nurse Administrator Faculty Handbook UPRM and NEU Human Resources UPRM Standards and Criteria of ACEN 2013 Director of NEU 4. Welfare of Faculty and Staff Every 2 years or as needed Faculty Satisfaction and Staff See NEU Organizational Chart D. Policies of Nursing Faculty/Staff 1. Consistent 2. Accessibility 3. Rationale for policies that differ from governing organization As necessary or required General Regulation Policies of the UPRM UPR, UPRM-College of Arts and Sciences and NEU Website Undergraduate Catalogue Accrediting Agency Report (MSCHE, CSE, ACEN) Rules and Regulations of State of Board of Nursing in Puerto Rico
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 3 Indicators/ Method Report of Data Collection & Actions or Comments Responsible person/committee National Safety Standards Professional Nursing Standards E. Communities of interest At the end of every academic year Evidence of participation of Communities of Interest Partnership agreements (MOU, description of partnerships, contracts, grants, etc.) Evaluation Committee Minutes Faculty Minutes F. Partnerships Memorandum of Understanding (MOU) with UPRM-UPR Aguadilla, Utuado and Ponce) (Certification No. 115 1996-97) UPR Boards of Trustees Other Memorandum Director of NEU The Associate Director UPR System Legal Services Evaluation Committee G. Budget Fiscal Year Faculty Minutes Budget Discussion with Faculty Director of Nursing Budget Report and Administrative Budget Officer ACEN Accreditation Standards OIIP Budget The UPR System (Certification Number 100-2005-2006) Board of Trustees Budget Regulation of UPR Dean of College of Arts and Sciences Dean of Administration College of Arts and Sciences Director of Nursing Education Unit Questionnaire of Faculty Satisfaction Administrative Officer
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 4 EVALUATION STANDARD 2: Faculty and Staff Qualified and credentialed faculty is sufficient in number to ensure the achievement of the student learning outcomes and program outcomes. Sufficient qualified staff are available to support the nursing education unit. OUTCOMES: 2.1 Full-time faculty hold a minimum of a graduate degree with a major in nursing; a minimum of 25% of the full-time faculty also hold an earned doctorate or are currently enrolled in doctoral study. Full- and part-time faculty include those individuals teaching and/or evaluating students in classroom, clinical, or laboratory settings. 2.2 Part-time faculty hold a minimum of a graduate degree with a major in nursing. 2.3 Faculty (full- and part-time) credentials meet governing organization and state requirements. 2.4 Preceptors, when utilized, are academically and experientially qualified, oriented, mentored, and monitored, and have clearly documented roles and responsibilities. 2.5 The number of full-time faculty is sufficient to ensure that the student learning outcomes and program outcomes are achieved. 2.6 Faculty (full- and part-time) maintains expertise in their areas of responsibility, and their performance reflects scholarship and evidence-based teaching and clinical practices. 2.7 The number, utilization, and credentials of staff and non-nurse faculty within the nursing education unit are sufficient to achieve the program goals and outcomes. 2.8 Faculty (full- and part-time) are oriented and mentored in their areas of responsibility. 2.9 Systematic assessment of faculty (full- and part-time) performance demonstrates competencies that are consistent with program goals and outcomes. 2.10 Faculty (full- and part-time) engage in ongoing development and receive support for instructional and distance technologies. Indicators/ Method Report of Data Collection & Actions or Comments Responsible person /Committee: I. FACULTY A. Credentials B. Scholarship activities C. Performance/evaluation D. Staff Yearly and/ or as needed Law 9 Oct 11, 1987 Law 11 June 23, 1976 Law 82 June 1 st 1973 UPR General Regulation NEU Faculty Bylaws. Personnel Committee NEU Director of NEU II. ADMINISTRATIVE STAFF A. Director B. Associate Director C. Administrative Officer D. Administrative Secretaries E. Laboratory Nurse F. Auxiliary Services Evaluation Report by the NEU Personnel Committee Appendix Modules for Evaluations: A, B, C, F, G, H, I, L (Certification 86-87- 476 of the Administrative Board UPRM Professional Portfolios Faculty Curriculum Vitae COE Survey Academic Course Allocation (workload) Job Description
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 5 Indicators/ Method Report of Data Collection & Responsible person/committee: Actions or Comments Certification UPR General Regulation State requirement and affiliated agencies requirement Report of activity involvement submitted to the Director of the NEU Faculty, lab personnel, and staff academic and experiential credentials Position and Job Descriptions and responsibilities for faculty, lab personnel and staff Evidence of scholarly activities as defined by the nursing education unit Policies for evaluation processes Evidence of orientation and mentoring processes for faculty and staff E. Orientation and Mentorship As needed COE Survey Director of NEU In progress NEU Mentorship Plan Mentorship Guidelines and Reports Certification 96-97-596 UPRM-Professional Enrichment Center (PEC) Bylaws of the Faculty of the Department of Nursing
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 6 EVALUATION STANDARD 3: Students Student policies and services support the achievement of the student learning outcomes and program outcomes of the nursing education unit. OUTCOMES: 3.1 Policies for nursing students are congruent with those of the governing organization, publicly accessible, non-discriminatory, and consistently applied; differences are justified by the student learning outcomes and program outcomes. 3.2 Public information is accurate, clear, consistent, and accessible, including the program s accreditation status and the ACEN contact information. 3.3 Changes in policies, procedures, and program information are clearly and consistently communicated to students in a timely manner. 3.4 Student services are commensurate with the needs of nursing students, including those receiving instruction using alternative methods of delivery. 3.5 Student educational records are in compliance with the policies of the governing organization and state and federal guidelines. 3.6 Compliance with the Higher Education Reauthorization Act Title IV eligibility and certification requirements is maintained, including default rates and the results of financial or compliance audits. 3.6.1 A written, comprehensive student loan repayment program addressing student loan information, counseling, monitoring, and cooperation with lenders is available. 3.6.2 Students are informed of their ethical responsibilities regarding financial assistance. 3.6.3 Financial aid records are maintained in compliance with the policies of the governing organization, state, and federal guidelines. 3.7 Records reflect that program complaints and grievances receive due process and include evidence of resolution. 3.8 Orientation to technology is provided, and technological support is available to students. 3.9 Information related to technology requirements and policies specific to distance education are accurate, clear, consistent, and accessible. Indicators/ Method Report of Data Collection & Person responsible/committee Actions or Comments J. STUDENTS A. Policies 1. Congruency 2. Accessible 3. Non-discriminatory 4. Consistency 5. Compliance 6. Complaint/Grievances B. Services C. Integrity D. Technology Yearly and/ or as needed Review of Undergraduate Catalogue, UPRM Institutional Policies, NEU Brochure, NEU Student Manual, UPRM Website, NEU Website Evidence of currency, accuracy, clarity, completeness, and consistency of all program information (paper or electronic) Revision of Institutional Policies Tittle IV Regulation Act, FERPA, ADA, and other federal and state guidelines and regulations Complaint and Grievances, Policies and Record Admission Policies and Criteria Associate Director Curriculum Committee Teaching Resources and Faculty Development Committee Skills Labs Personnel Dean of Student Deanship of Student Ombudsperson of Student Counselor of the NEU
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 7 Indicators/ Method Report of Data Collection & Actions or Comments Person responsible/committee Certification No. 040-1998-99 Board of Trustee of the UPR. Financial Policies Students credential for Clinical Practice Interview with Directors of Support Services Interview with Financial Director and Registrar Officer Certification 83-2 Academic Senate-UPRM Liability Insurance Evidence of Tutoring Program Admission Policies Transfer Policies Interview with the Affiliated Coordinators Satisfaction with the Alumni of the Program Management Plan for the Recruitment, Retention Marketing and Advertising
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 8 EVALUATION STANDARD 4: CURRICULUM The curriculum supports the achievement of the identified student learning outcomes and program outcomes of the nursing education unit consistent with safe practice in contemporary health care environments. OUTCOMES: 4.1 The curriculum incorporates established professional standards, guidelines, and competencies, and has clearly articulated student learning outcomes and program outcomes consistent with contemporary practice. 4.2 The student learning outcomes are used to organize the curriculum, guide the delivery of instruction, direct learning activities, and evaluate student progress. 4.3 The curriculum is developed by the faculty and regularly reviewed to ensure integrity, rigor, and currency. 4.4 The curriculum includes general education courses that enhance professional nursing knowledge and practice. 4.5 The curriculum includes cultural, ethnic, and socially diverse concepts and may also include experiences from regional, national, or global perspectives. 4.6 The curriculum and instructional processes reflect educational theory, interprofessional collaboration, research, and current standards of practice. 4.7 Evaluation methodologies are varied, reflect established professional and practice competencies, and measure the achievement of the student learning outcomes. 4.8 The length of time and the credit hours required for program completion are congruent with the attainment of identified student learning outcomes and program outcomes and consistent with the policies of the governing organization, state and national standards, and best practices. 4.9 Practice learning environments support the achievement of student learning outcomes and program outcomes. 4.10 Students participate in clinical experiences that are evidence-based and reflect contemporary practice and nationally established patient health and safety goals. 4.11 Written agreements for clinical practice agencies are current, specify expectations for all parties, and ensure the protection of students. 4.12 Learning activities, instructional materials, and evaluation methods are appropriate for all delivery formats and consistent with the student learning Indicators / Method Report of Data collection & Actions or Comments Person responsible/ committee IV. Curriculum and Instruction: Educational Purposes A. Curriculum Every 5 years or as needed Review of: Program Philosophy, Vision, and Mission, NEU Conceptual Framework, Program and Student Learning Outcomes, Curriculum Designs, Program Competencies, Literature, Curriculum Sequence Brochure NEU Director Associate Director Curriculum Committee Evaluation Committee Faculty Evidence of Faculty systematic review of the Curriculum (Faculty meetings, Curriculum Committee and Evaluation Committee meetings minutes)
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 9 Indicators / Method Report of Data collection & Actions or Comments Person responsible/ committee At the end of Academic Year Every Semester Every year or depending of agreement the Program by Graduating Students of the Baccalaureate of Science in Nursing Evidence that diverse concepts, best practices and national patient health and safety goals are incorporated into the curriculum Course materials (syllabi, evaluation methods, learning activities) Sample of student written work Evidence that program length facilitates achievement of learning outcomes and is consistent with state and national standards Class and clinical schedule Affiliated contracts and agreements Evaluation tools/methodologies for classes, clinical and labs. and revision of: Undergraduate Catalogue General Courses Syllabus Nursing Courses Syllabus Certification #130-Council of Higher Education of P.R. Certification No. 83-2 Academic Senate UPRM B. Achievement of Program Outcomes and revision of: Guidelines for Professional Nursing Practice Standards of CPEPR Student Learning Outcomes National Safety Goals Program Outcomes Revision of students Program Competencies Evaluation tools and methods in every nursing courses
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 10 Indicators / Method Report of Data collection & Actions or Comments Person responsible/ committee ACEN Accreditation Standards ACEN Self Study Report Nursing Code of Ethics of the CPEPR Law #9 of October 11, 1987 Literature review of new issues and trends of societal and practice of nursing that affects health in PR Affiliated Agencies Questionnaire for the Graduating Students of the Baccalaureate of Science in Nursing Program Satisfaction with the Program by Alumni Employer s Satisfaction with the Alumni of the Program Aggregated Qualitative Data from each Questionnaire as collected Record of verbal or written grievances C. Practice learning environments Review of facilities and resources utilizing Clinical Agencies Survey by students Evaluation and recommendation of a potential new affiliated agencies by Faculty Associate Director and governance authorities evaluation of clinical contracts and/or agreements Affiliated Agencies
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 11 EVALUATION STANDARD 5: RESOURCES Fiscal, physical, and learning resources are sustainable and sufficient to ensure the achievement of the student learning outcomes and program outcome of the nursing education unit. OUTCOMES: 5.1 Fiscal resources are sustainable and sufficient to ensure the achievement of the student learning outcomes and program outcome and commensurate with the resources of governing organization. 5.2 Physical resources are sufficient to ensure the achievement of nursing education unit outcomes and meet the needs of faculty, staff, and students. 5.3 Learning resources and technology are selected with faculty input and are comprehensive current and accessible faculty and students. 5.4 Fiscal, physical, technological, and learning resources are sufficient to meet the needs of the faculty and students engaged in alternative methods of delivery. 5.5 Learning resources fundamental to all educational activities, and the library are adequately supported and stuffed to accomplish students learning outcomes. Indicators/ Method Report of Data Collection & Responsible person/committee: Actions or Comments V. Resources A. Fiscal Resources Every year or as needed Review of : General Budget of the UPRM NEU Budget - Interview with the Administrative Assistant Comparative Table of mean salaries Faculty meeting minutes College of Arts & Sciences Research and Project Allocations Faculty Satisfaction Survey Teaching Resources and Faculty Development Committee NEU Administration B. Physical Resources Every year or as needed Evaluation of administrative and clerical support services Physical and learning resources and facilities inventory Graduating Student Satisfaction with the Program Survey Faculty Satisfaction Survey Teaching Resources and Faculty Development Committee NEU Administration Skills Lab Personnel C. Learning Resources Every year or as needed NEU resource inventory Minutes of Teaching Resources and Faculty Development Committee Faculty recommendations Graduating Student Satisfaction with the Program Survey Graduates Student Satisfaction with Program Survey NEU Administration Sills Lab Personnel
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 12 Indicators/ Method Report of Data Collection & Responsible person/committee: Actions or Comments D. Technological Resources Every year or as needed NEU Technological resources inventory Graduating Student Satisfaction Survey Teaching Resources and Faculty Development Committee NEU Administration
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 13 EVALUATION STANDARD 6: Program evaluation demonstrates that students and graduates have achieved the student learning outcomes, program outcomes and role- specific graduate competencies of the nursing education unit. OUTCOMES: 6.1 The systematic plan for evaluation of the nursing education unit emphasizes the ongoing assessment and evaluation of each of the following: Student learning outcomes; Program outcomes; Role-specific graduate competencies; and The ACEN Standards. The systematic plan of evaluation contains specific, measurable expected levels of achievement; frequency of assessment; appropriate assessment methods; and a minimum of three years of data for each component within the plan.** 6.2 Evaluation findings are aggregated and trended by program option, location, and date of completion and are sufficient to inform program decision-making for the maintenance and improvement of the student learning outcomes and the program outcomes. 6.3 Evaluation findings are shared with communities of interest. 6.4 The program demonstrates evidence of achievement in meeting the program outcomes. 6.4.1 Performance on licensure exam: The program's three-year mean for the licensure exam pass rate will be at or above the national mean for the same three-year period. 6.4.2 Program completion: Expected levels of achievement for program completion are determined by the faculty and reflect student demographics and program options. 6.4.3 Graduate program satisfaction: Qualitative and quantitative measures address graduates six to twelve months post-graduation. 6.4.4 Employer program satisfaction: Qualitative and quantitative measures address employer satisfaction with graduate preparation for entry-level positions six to twelve months post-graduation. 6.4.5 Job placement rates: Expected levels of achievement are determined by the faculty and are addressed through quantified measures six to twelve months postgraduation. VI. OUTCOMES Indicators/ Method Report of Data Collection & Responsible person/committee: Actions or Comments A. Systematic Evaluation Plan Yearly or as indicated Comparative analysis of proposed evaluation plan schedule Evaluation of Nursing Courses Survey Evaluation of Affiliated Agencies Survey Graduating Students Satisfaction with the Program every year Graduates Satisfaction with the Program Survey every year NEU Director Evaluation Committee Associate Director Faculty Curriculum Committee
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 14 Indicators/ Method Report of Data Collection & Responsible person /Committee: Actions or Comments Employer s Evaluation Satisfaction Survey every year Evaluation of Faculty Satisfaction Survey Aggregated qualitative data on each questionnaire as collected B. Report of Evaluation Findings Yearly report with improvement or continuation plan. Evaluation Committee minutes Faculty Meeting minutes Evaluation Finding Reports NEU Director Evaluation Committee Associate Director Curriculum Committee Associate Director s Report Comparison of Attrition and Retention Rates Report of the Office of Institutional Research and Planning UPRM Graduation Rates Report Faculty Team Member Outreach Recruitment and Alumni Committee C. Program Outcomes D. 1. Nursing Board Passing Rate Yearly or as need Puerto Rico Board of Nurse Examiners Report Associate Director of Nursing Annual Report Law 9 of October 11, 1987 and its Regulations 2. Program Completion a. Graduate Rate b. Attrition Rate Yearly Report of Institutional Research and Planning Office (OIIP) Report of Associate Director Faculty Meeting Minutes of the State Board Report, Strategic Planning for Maintenance and Board 3. Program Satisfaction a. Graduating Students Satisfaction Yearly the Program by Graduating Students of the Baccalaureate of Science in Nursing Program
MASTER - OUTCOMES EVALUATION 2014-2019 PAGE 15 Indicators/ Method Report of Data Collection & Responsible person/committee: Actions or Comments Aggregated Qualitative Data Evaluation Committee Minutes Faculty Meeting Minutes Revision for Improvement Plan Affiliated meeting minutes b. Graduates Programs Satisfaction c. Employer Satisfaction d. Employment Rates Questionnaire for the Evaluation Satisfaction with the Program by Alumni Evaluation Committee Minutes Faculty Meeting Minutes Employer s Satisfaction with the Alumni of the Program Evaluation Committee Minutes Faculty Meeting Minutes the Program by Graduating Students of the Baccalaureate of Science in Nursing Program Improvement Plan Report dtl June 2014