STAR GAZING Identifying and Improving the Performance of STudents At Risk of NCLEX Failure Dr. Robyn Nelson, Dean, College of Nursing Mr. Arte Libunao, University Executive Director Campus Operations Identifying our Students 2 1
Introduction ACADEMIC FACTORS GPA, SPECIFIC COURSES (PATHO, MED SURG, LAST NURSING COURSE IN THE CURRICULUM), PERFORMANCE ON STANDARDIZED TESTS, COMPLETION OF STRUCTURED REVIEW COURSE NON ACADEMIC FACTORS TEST ANXIETY, SELF ESTEEM, FATIGUE, ROLE STRAIN, FAMILY AND WORK OBLIGATIONS FACULTY RESPONSIBILITY CURRICULUM MAPPED TO NCLEX BLUEPRINT, EMPHASIS ON TEST TAKING SKILLS AND PRACTICE QUESTIONS STUDENT RESPONSIBILITY COMPLETE PRACTICE QUESTIONS, SELF CARE ACADEMIC POLICIES ADMISSION STANDARDS, RAISE MINIMUM PASSING SCORES, PROGRESSION POLICY, REQUIRED REMEDIATION, COURSE SEQUENCE Motivation To have NCLEX outcomes better than State average consistently exceed 90% pass rates and continue to admit students with a minimum GPA of 2.0 Programmatic Accreditation : The Commission on Collegiate Nursing Education (CCNE) The NCLEX RN pass rate for each campus/site and track is 80% or higher for the first time takers for the most recent calendar year California Board of Registered of Nursing 1431. Licensing Examination Pass Rate Standard The nursing program shall maintain a minimum pass rate of seventy five percent (75%) for first time licensing examination candidates. Job Placement Rates (minimum 70% placed 6 months after receipt of ATT; Loan Default Rates and Gainful Employment 2
Challenges Clear understanding of factors that lead to or impede success on the NCLEX GPA, Cs in Pre reqs, Performance on standardized exams Lack of a system that would aggregate and disaggregate data in real time that faculty could use to help identify at risk students easily. Historically when we achieved less than desired outcomes, our improvement plans were based more on hunch and conjecture than on the predictive probability of passing NCLEX. Project Foot-print/Road Map I. Collect Data Difficult and challenging to solve the problem without data Demographics, admission, third party proctored assessment data, academic, etc. Created longitudinal database II. Analyze Data Compile factors {features or variables} correlated with NCLEX pass or fail Identify characteristics of students who passed the board exam versus those who did not pass, e.g., 21 25 year old males III. Predict student NCLEX outcome Built 40 different /diversified predictive models Assess models accuracy and efficacy IV. Deploy operational and analytical dashboards for the end user NOTA Dashboard NCLEX Academic Actions Plans (Customized remediation by student) V. Discover, learn and improve Continuous improvement process 3
Predict student NCLEX outcome Predictors {or Features} Used in Modeling Student Demographic Data Gender Age Race/Ethnicity Campus Student Admission Data HESI TEAS V SAT ACT Third Party Proctored Assessment Data Maternal Newborn Fundamentals Adult Medical Surgical Mental Health Pharmacology Nursing Care of Children Community Health Nutrition Leadership Student Academic Data (course by course) Science Courses General Education Courses Non-Clinical Nursing Courses Clinical Nursing Courses Derived Aggregate Variables Number of Transfer Courses Number of Failed Science Courses Number of Failed GE Courses Number of Failed Non-Clinical Nursing Courses Number of Failed Clinical Nursing Courses Science GPA General Education GPA Non-Clinical Nursing GPA Clinical Nursing GPA 91% Accuracy 96 Predictors {Features or Columns} 2362 Observations {Rows} 40 different predictive models were built What is NOTA Dashboard? A simple, centralized and concise NCLEX Operational Tracking and Analysis tool designed to facilitate a common academic language. Drive more effective decisions through academic and operational analytics A Central Portal: 3 click approach Within 3 clicks, get to the information you need. Identify STARs Students at Risk of Failing NCLEX Using Predictive Model Improve the performance of STARs Using customized remediation and tutoring 4
NCLEX Data Collection Portal FERPA Centralized Data Collection 9 Click # 1 5
Click # 2 Click # 3 student details on the 88.75% Click # 2 6
Click # 1 FERPA Click # 2 7
Click # 3 Faculty Development of NCLEX Academic Action Plan 8
Faculty Development of Academic Action Plan Comments Recorded on Academic Action Plan 9
Monitoring by Nursing Leadership Example of Monitoring Nursing Leadership 10
Keeping Graduates Engaged Click # 1 Graduate Motivation NCLEX Specialists and team maintain contact through relationship building up to and beyond NCLEX test date Time to Test: encourages and facilitates a short period from graduation to NCLEX test Recent graduates and NCLEX passers come back as grad panels to present and share their experiences with current nursing students Career Services maintains contact with graduates to encourage utilization of all NCLEX preparation resources and explains the importance of passing NCLEX for employment 11
Cost of Implementation and Production IT creation of data repository, web based Academic Action Plans IR creation of student risk assessment Faculty can use the risk assessment model to create AAPs Automated, web based processes allow higher student to faculty ratios for the tutoring/remediation/advisement Excellent return on low cost Investment Benefits of Implementation and Production Improve: Faculty Student relationships Student retention / persistence NCLEX pass rates Graduation rates Placement rates 12
Q&A Please feel free to contact Robyn Nelson rnelson@westcoastuniversity.edu Direct (949) 783 4814 Arte Libunao alibunao@westcoastuniversity.edu Direct (949) 783 4841 Thank you for your commitment to the future of healthcare our students! 13