Annual Report for Assessment of Outcomes 2012-13 Subject Area Committee Name: Nursing Contact person: Doris Rink For LDC/DE: Core outcome(s) assessed: For CTE: Degree or certificate* assessed: Professional Competence *please attach a table showing the alignment of the degree or certificate outcomes with the College Core Outcomes Please address the questions below and send to learningassessment@pcc.edu by June 21, 2013 with Annual Report in the subject line Note: Information provided in this report may be inserted into or summarized in Section 2C Program Review Outline. 1. Describe changes that have been implemented towards improving students attainment of outcomes that resulted from recent outcome assessments. These may include but are not limited to changes to content, materials, instruction, pedagogy etc. Please be sure to describe the connection between the assessment results and the changes made. This Assessment correlates with PCC s Core Outcome of professional competence One focus of PCC s Nursing Program s Integrative Practicum (final term NRS 224) is assessing students preparation and readiness to take and pass the National Council Licensure Examination-RN (NCLEX). Passing NCLEX-RN demonstrates a students ability to apply the knowledge, skills and attitudes necessary to enter and succeed in the nursing profession.(pcc Core Outcome Professional Competence) In 2012 NRS 224 students had a written project titled NCLEX PREP/Student Readiness plan. This project had two parts, part one was completed by students taking a ATI Proctored NCLEX Comprehensive Predictor exam at the beginning of the term and then develop and complete a remediation plan based on the results of the ATI Proctored NCLEX Comprehensive Predictor exam. The exam identifies the areas the student needs to review. In addition, this proctored exam gives each student their score and their percent chance of passing the NCLEX-RN on their first try. The grading for this project was pass/no pass. (See attached 2012 NCLEX PREP/Student Readiness Project document). In preparation for spring 2013 NRS 224 second year faculty evaluated this same assignment/project, NCLEX PREP/Student Readiness plan. They determined that although all students passed the assignment approximately 50% of NRS 224 students did not complete the written assignment portio. To increase student compliance with this important NCLEX readiness assignment as well as increasing student s probability of successfully passing the NCLEX-RN, it was decided that points would be given to this project and a grading rubric would be developed. All faculty would assign points using the grading rubric. In addition, students would take two ATI Proctored NCLEX Comprehensive Predictor exams, version A at the beginning of the term and version C at the end of the term after completion of the written portion of the project. After taking the first exam students were required to identify 1 or more of the NCLEX Major Content Area of concern that needed further review. Once the area(s) were identified each student constructed and completed a systematic tracking tool (remediation plan).
Upon completion of the plan they were required to complete a one page evaluation.(see attached 2013 NCLEX PREP/Student Readiness Project document). After completing the NCLEX Prep/Student Readiness Plan project the student was eligible to take the second ATI Proctored NCLEX Comprehensive Predictor exam, version C. NRS 224 2012 and 2013 student course evaluation question regarding ATI proctored exams found that students found ATI proctored testing beneficial to meeting course outcomes. For each outcome assessed this year: 2. Describe the assessment design (tool and processes) used. Include relevant information about: The nature of the assessment (e.g., written work, project, portfolio, exam, survey, performance etc.) and if it is direct (assesses evidence mastery of outcomes) or indirect (student s perception of mastery). Please give rationale for indirect assessments (direct assessments are preferable). Assessment Tool Design: The EXCEl spread sheet assessment tool recorded three pieces of data; (1)Column one project points given to the students, maximum was 20 points, (2) Column form A, ATI Proctored NCLEX Comprehensive Predictor exam score and probability of passing the NCLEX-RN exam on the first try, (3) Column three form C, ATI Proctored NCLEX Comprehensive Predictor exam score and probability of passing the NCLEX-RN exam on the first try. All Documents are attached at end of this assessment. NRS 224 Project NCLEX Prep/Student Readiness Plan 2012. NRS 224 Project NCLEX Prep/Student Readiness Plan 2013. EXCEL Spread sheet with NCLEX Readiness assignment score and pre and post ATI Proctored NCLEX Comprehensive Predictor exam scores. NRS 224 grading rubric Project NCLEX Prep/Student Readiness Plan 2013 The student sample assessed (including sample size relative to the targeted student population for the assessment activity) process and rationale for selection of the student sample. Why was this group of students and/or courses chosen? 1. The sample size was all 53 NRS 224 students. Results 53/53 students took both ATI Proctored NCLEX Comprehensive Predictor exams. I recorded all this data on the EXCEL Spreadsheet. This data was obtained from the ATI Testing Faculty website. Seventeen of 53 students did not have their Student Record available as of July 9, 2013. For those students I was unable to record their project scores. 2.Passing NCLEX-RN demonstrates a students ability to apply the knowledge, skills and attitudes necessary to enter and succeed in the nursing profession. Any rubrics, checklists, surveys or other tools that were used to evaluate the student work. (Please include with your report OK to include in appendix). Where appropriate, identify benchmarks. See attached documents. NRS 224 Project NCLEX Prep/Student Readiness Plan 2012. NRS 224 Project NCLEX Prep/Student Readiness Plan 2013. EXCEL Spread sheet with NCLEX Readiness assignment/project score and pre and post ATI Proctored NCLEX Comprehensive Predictor exam scores and probability of passing NCLEX-RN on the firsttry
NRS 224 Grading Rubric for NCLEX Readiness written assignment How you analyzed results, including steps taken to ensure that results are reliable (consistent from one evaluator to another. All faculty used the NRS 224 grading rubric.the form A and Form C ATI proctored NCLEX Comprehensive Predictor exam were given and scored by ATI using software. 3. Provide information about the results (i.e., what did you learn about how well students are meeting the outcomes)? Results of the 53 students written assignment 29 scored 20/20, 5 scored 19/20, 1 scored 18/20 and one scored 15/20. Seventeen students did not have NRS 224 Project NCLEX Prep/Student Readiness Plan 2013 scores available as of July 9 2013. All 53 students took the form A and Form C ATI proctored NCLEX Comprehensive Predictor exams by June 12, 2013. When reported scores from form A were compared to reported scores from form C 16 of 53 or 30% had a lower score on the second form C test when compared to the first test form A. If scored (e.g., if a rubric or other scaled tool is used), please report the data, and relate to any appropriate benchmarks. Results should be broken down in a way that is meaningful and useful for making improvements to teaching/learning. Please show those specific results. See XCEL Spread sheet for data and results 4. Identify any changes that should, as a result of this assessment, be implemented to help improve students attainment of outcomes. (These may include, but are not limited to, changes in curriculum, content, materials, instruction, pedagogy etc). My recommendations to the Nursing SAC will be 1.Continue with this assignment/project as is for NRS 224 compare2014 data to the collected in 2013. 2. Students that have initial ATI proctored NCLEX Comprehensive Predictor exam score of less than 69 have 4 instead of 3 written progress reports. 3. ESOL Students were the majority of students that scored below 69. I will work with as they reflect on this and assist them to determine if there are ways to improve their probability of success. 4. Encourage second year to complete student records in a timely manner so results will be LAC is complete and on time. 5. Reflect on the effectiveness of this assessment tool and assessment process. Please describe any changes to assessment methodology that would lead to more meaningful results if this assessment were to be repeated (or adapted to another outcome). Is there a different kind of assessment tool or process that the SAC would like to use for this outcome in the future? If the assessment tool and processes does not need to be revised, please indicate this. See above.
NCLEX PREP/STUDENT READINESS PLAN Nursing 224 Grading This project is for personal development in preparation for NCLEX. The project is REQUIRED but will be graded on a Pass/No Pass basis. Faculty advisor will be involved with each step of this readiness plan. Identification of problem area Identify area of concern. Provide rationale as to why you believe this is an area that would benefit from further review. Recognition of problem area can come from several sources including but not limited to: Self disclosure of feelings of inadequacy ATI scores Construction of plan to improve area(s) of concern Plan must include specific actions and a timeline for achievement. Must be approved by faculty advisor. Implementation, reflection, and evaluation Summary of progress will be completed weekly either through email or other form of written communication with faculty advisor. Implementation should follow planned timeline. Upon completion of the plan, a written reflection will be submitted to your faculty advisor and will include: how it worked, any hurdles faced in completion of plan what you would change if you had it to do over, how you felt about it s completeness if you made adjustment(s): what were they, why did you make them and did it work better for you after adjustment(s) made do you feel more prepared to sit for NCLEX? Why or why not? NRS 224 NCLEX Prep/Student Readiness Plan 2/17/2010
NCLEX PREP/STUDENT READINESS PLAN Nursing 224- Integrative Practicum Project Grading This project is for personal development in preparation for NCLEX. The project is REQUIRED and worth possible maximum points of 20. Please refer to the rubric for grading this project. Faculty advisor will be involved with each step of this readiness plan. Instructions: Completion of the ATI Proctored Assessment Comprehensive Predictor Complete the required ATI Proctored Assessment Comprehensive Predictor as scheduled. This ATI assessment is scheduled in Week 1 and Week 2. Any ATI completion of this assessment after these dates will be considered late. Identification of problem area Identify area of concern from the result of the Comprehensive Predictor. Provide specific rationale as to why you believe this is an area that would benefit from further review. Recognition of problem area can come from several sources including but not limited to: Self disclosure of feelings of inadequacy ATI scores Construction of plan to improve area(s) of concern Construct your remediation or improvement plan. Include in the remediation or improvement plan: o Goals/objectives using SMART ; Specific Measurable Attainable Realistic Timeline o Implementation o Evaluation Create your own systematic tracking form or tool or use a suggested tracking form. Remediation or improvement plan and tracking form must be approved by faculty advisor. Original: 03/2013 PCC
Implementation, reflection, and evaluation Summary of progress will be completed either through e-mail or other form of written communication with faculty advisor. The following are the timelines for submitting completed summary report of progress: o Week 3 = 04/18/2013 (Thursday) o Week 6 = 05/09/2013 (Thursday) o Week 10 = 06/03/2013 (Monday) Implementation should follow a planned timeline. Upon completion of the plan, a one-page summary of your written reflection will be submitted to your faculty advisor and will include: How it worked? Any hurdles faced in completion of plan What you would change if you had it to do over? How you felt about its completeness? If you made adjustment(s): what were they, why did you make them and did it work better for you after adjustment(s) made? Do you feel more prepared to sit for NCLEX? Why or why not? Original: 03/2013 PCC
NCLEX PREP/STUDENT READINESS PLAN PROJECT SAMPLE FORM Name: Adviser: Nursing Subject: Instructions: 1) Select the appropriate nursing subject Nursing Subjects: Fundamentals of Nursing; Maternal/Newborn; Pediatric (Children);Mental Health; Medical-Surgical; Community; Leadership; & Other; 2) Use one form for each nursing subject; 3) Complete each column as directed. NCLEX Identify subject area Remediation Plan Remediation Plan Evaluation Plan Follow-up Plan Subject Area of concerns from the o State your o List specific o State the indicators o How it worked? result of your ATI goals/objectives remediation (evidence) to o Any obstacles/hurdles Comprehensive o Include timeline(s) actions determine meeting faced in implementing Predictor. Write the o Use SMART o Use a variety of the objectives. your plan? o Specify whether the specific concern for appropriate o What adjustments would objectives have each subject area. specific been fully met, make? (e.g. ATI score for remediation partially met 0r not each subject area) actions met. Management of Care Safety & Infection Control Health Promotion & Maintenance Psychosocial Integrity Basic Care & Comfort Pharmacological & Parenteral Therapies Reduction of Risk Potential Physiological Adaptation Due Dates: Week 3 = 04/18 Thursday; Week 6 = 05/09 Thursday and; Week 10 = 06/03 Monday
Project Comp P A Comp P C 1 20/20 70.7/93% 72.7/ 94% 2 20/20 76/96% 79/98% 3 19/20 70/91% 68/88% 4 74.0/95% 75.3/96% 5 70.0/91% 74.7/96% 6 20/20 78.7/98% 76/97% 7 20/20 70.7/92 68.7/89* 8 20/20 68/88 73.3/95% 9 81.3/99 80/98* 10 20/20 72.7/94 78.87/98 11 69.3/90 75.3/97% 12 20/20 76/97 72/94% 13 74/95 72.7/94% 14 72.7/94% 63.3/75% 15 67.3/87% 67.3/87 16 20/20 71.3/93% 78.7/98% 17 20/20 71.3/93 68/88%* 18 18/20 I 68/88% 62/73* 19 74.7/96% 76/96% 20 72.7/94% 72/94% 21 86.0/99% 86/99% 22 20/20 74/95 73.3/95%* 23 69.3/90% 74.7/96% 24 19/20 76/97% 82/99% 25 69.3/90% 74.7/96% 26 20/20 66.7/86 66.7/86 27 20/20 76./96 80.7/98% 28 20/20 58.7/60 61.3/70 29 20/20 81.3/99 82.7/99% 30 20/20 74.7/96 *73.3/95% 31 75.3/96 *72/94% 32 20/20 74.7/96 71.3/93* 33 19/20 87/99 84/99* 34 15 L/20 77.3/97 76.7/97* 35 19/20 65.3/82 61.3/70* 36 20/20 79.3/98 79.3/98 37 20/20 60/65 57.3*/65% 38 20/20 74.7/95 78.3/98 39 20/20 80.7/99 80.7/99 40 20/20 72/94 76.7/97 41 20/20 66.7/86 75.3/95 42 20/20 64/69 74/95 43 20/20 65.3/82 70/91 44 69.3/90 58/65% 45 68/88 72/94% 46 84/99%
47 20/20 65.3/82 65.3/82% 48 20/20 80.0/98 83.3/99 49 20/20 68.7/90 70/91% 50 74/95 69.3/90* 51 20/20 57.3/54 62/71% 52 19/20 76/97 80.7/99 53 20/20 72.7/94 75.3/96% RESULTS 17/53 32 %data missing 16/53 30% decrease in Will recommend faculty get Student Reecords completed by last day of spring ter
n scores from exam A to exam C c this to be addressed in 2014 LAC Assessment rm 2014.