Use of a Validation Study to Analyze Entry-Level Nursing Practice Between Triennial Practice Analysis Cycles

Transcription

1 Use of a Validation Study to Analyze Entry-Level Nursing Practice Between Triennial Practice Analysis Cycles Nicole Williams, MSN, RN-BC Nursing Content Manager, Examinations Doyoung Kim, PhD, Senior Psychometrician, Examinations

2 Outline Background NCLEX Practice Analysis and the Exam Construct Purpose Validation of the NCLEX Test Plan Literature Review Standards for Practice Analysis Results Entry-Level Nursing Trends Summary

3 BACKGROUND

4 NCLEX Practice Analysis Assists in defining the exam construct A triennial survey of entry-level nursing activities Approved Subject Matter Experts develop a list of activities relevant to entry-level nursing Results from the NCLEX Practice Analysis are used to develop the NCLEX Test Plan

5 NCLEX Practice Analysis Survey is distributed to 12,000 newly licensed entry-level nurses across all NCLEX areas Entry-level nurses are requested to rate a list of nursing activities considering two questions: 1. How important is the activity related to client safety and decreasing complications? 2. How often do you perform this activity?

6 NCLEX Practice Analysis Based on the data from the NCLEX Practice Analysis, the NCLEX Test Plan is developed NCSBN policy committee - NCLEX Examination Committee (NEC) and Member Boards of Nursing make test plan recommendations NCSBN Delegate Assembly approves (or makes recommendations for) the NCLEX Test Plan

7 NCLEX Continuous Practice Analysis Method of validating the current NCLEX Test Plan between triennial practice analysis cycles Separate sampling of newly licensed entrylevel nurses is used Same activity statements and survey format as the NCLEX Practice Analysis

8 NCLEX Continuous Practice Analysis Monitor the data to detect changes in entrylevel practice that would necessitate a review of the currently approved NCLEX Test Plan Overall, data in both the NCLEX Practice Analysis and Continuous Practice Analysis is similar Trends reflected were gradual over time

9 PURPOSE

10 Purpose Perform a comparative analysis of the data in the NCLEX Practice Analysis and the Continuous Practice Analysis Validate the approved NCLEX Test Plan between triennial Practice Analysis cycles

11 LITERATURE REVIEW

12 Literature Review Downing, S.M. & Haladyna, T. M. (2006). Handbook of Test Development. A critical component in test development is defining the content to be tested A systematic, comprehensive, defensible methodology outlining content definition must be utilized in high-stakes examinations

13 Literature Review American Educational Research Association, American Psychological Association & National Council on Measurement in Education, (1999). The Standards for Educational and Psychological Testing. While the methodology is left up to the developer, an empirical job analysis is endorsed as the beginning task in content definition

14 RESULTS

15 Results Trends Survey ratings reflected an increase in frequency and importance in activities designated in the Management of Care category Entry-level registered nurses are spending more time managing the care of the current client population The time spent by an entry-level nurse in each NCLEX Test Plan category has increased as well as their performance of multi-tasking

16 NCLEX-RN Test Plan Management of Care The nurse provides and directs nursing care that enhances the care delivery setting to protect the client and health care personnel.

17 ACTIVITY STATEMENT COMPARISONS

18 Activity Statement Comparison Top 30 activity statements in both importance and frequency Location position in top 30 Overall group rating in frequency and importance

19 Activity Statement Comparison During , Management of Care Minimal statements in the top 30

20 Activity Statement Comparison Beginning in 2008, an upward trend is noted in Management of Care Increase in statements in the top 30, more importantly, in the top 10

21 Activity Statement Representation Management Care # of Activity Statements Practice Analysis and Continuous Practice Analysis

22 NCLEX-RN Test Plan 0.25 Management of Care 0.2 Test Plan Percentage NCLEX-RN Approved Dates

23 Honorable Mention Apply principles of infection control (e.g., hand hygiene, surgical asepsis, isolation, sterile technique, universal/standard) Ensure proper identification of client when providing care

24 TIME SPENT IN ENTRY-LEVEL NURSING

25 Total Time in Each NCLEX Test Plan Category Hours Management of Care Safety and Infection Control Health Promotion and Maintenance Psychosocial Integrity Basic Care and Comfort Pharmacological and Parenteral Therapies Reduction of Risk Potential Physiological Adaptation Practice Analysis and Continuous Practice Analysis

26 Overall Total Time Spent by Entry- Level Nurses Total Time Hours Practice Analysis and Continuous Practice Analysis

27 Total Time in Management of Care Management of Care Hours Practice Analysis & Continuous Practice Analysis

28 SUMMARY

29 Summary NCSBN applies rigor to established industry standards to ensure a systematic, comprehensive, defensible methodology is used to establish content domain Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entrylevel nurses are spending more time multitasking as well as coordinating and managing client care.

30