Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using...
Transcript of Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using...
![Page 1: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/1.jpg)
Use of a Validation Study to Analyze Entry-Level Nursing Practice Between Triennial Practice Analysis Cycles
Nicole Williams, MSN, RN-BC Nursing Content Manager, Examinations Doyoung Kim, PhD, Senior Psychometrician, Examinations
![Page 2: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/2.jpg)
Outline
§ Background § NCLEX® Practice Analysis and the Exam Construct
§ Purpose § Validation of the NCLEX Test Plan
§ Literature Review § Standards for Practice Analysis
§ Results § Entry-Level Nursing Trends
§ Summary
![Page 3: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/3.jpg)
BACKGROUND
![Page 4: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/4.jpg)
NCLEX® Practice Analysis
§ Assists in defining the exam construct § A triennial survey of entry-level nursing
activities § Approved Subject Matter Experts develop a
list of activities relevant to entry-level nursing
§ Results from the NCLEX Practice Analysis are used to develop the NCLEX Test Plan
![Page 5: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/5.jpg)
NCLEX® Practice Analysis
§ Survey is distributed to 12,000 newly licensed entry-level nurses across all NCLEX areas
§ Entry-level nurses are requested to rate a list of nursing activities considering two questions: 1. How important is the activity related to client
safety and decreasing complications? 2. How often do you perform this activity?
![Page 6: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/6.jpg)
NCLEX® Practice Analysis
§ Based on the data from the NCLEX Practice Analysis, the NCLEX Test Plan is developed
§ NCSBN policy committee - NCLEX Examination Committee (NEC) and Member Boards of Nursing make test plan recommendations
§ NCSBN Delegate Assembly approves (or makes recommendations for) the NCLEX Test Plan
![Page 7: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/7.jpg)
NCLEX® Continuous Practice Analysis
§ Method of validating the current NCLEX Test Plan between triennial practice analysis cycles
§ Separate sampling of newly licensed entry-level nurses is used
§ Same activity statements and survey format as the NCLEX Practice Analysis
![Page 8: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/8.jpg)
NCLEX® Continuous Practice Analysis
§ Monitor the data to detect changes in entry-level practice that would necessitate a review of the currently approved NCLEX Test Plan
§ Overall, data in both the NCLEX Practice Analysis and Continuous Practice Analysis is similar
§ Trends reflected were gradual over time
![Page 9: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/9.jpg)
PURPOSE
![Page 10: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/10.jpg)
Purpose
§ Perform a comparative analysis of the data in the NCLEX Practice Analysis and the Continuous Practice Analysis
§ Validate the approved NCLEX Test Plan between triennial Practice Analysis cycles
![Page 11: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/11.jpg)
LITERATURE REVIEW
![Page 12: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/12.jpg)
Literature Review
§ Downing, S.M. & Haladyna, T. M. (2006). Handbook of Test Development. § “A critical component in test development is
defining the content to be tested” § “A systematic, comprehensive, defensible
methodology outlining content definition must be utilized in high-stakes examinations”
![Page 13: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/13.jpg)
Literature Review
§ American Educational Research Association, American Psychological Association & National Council on Measurement in Education, (1999). The Standards for Educational and Psychological Testing. § “While the methodology is left up to the
developer, an empirical job analysis is endorsed as the beginning task in content definition”
![Page 14: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/14.jpg)
RESULTS
![Page 15: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/15.jpg)
Results
§ Trends § Survey ratings reflected an increase in frequency
and importance in activities designated in the Management of Care category
§ Entry-level registered nurses are spending more time managing the care of the current client population
§ The time spent by an entry-level nurse in each NCLEX Test Plan category has increased as well as their performance of multi-tasking
![Page 16: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/16.jpg)
NCLEX-RN® Test Plan
Management of Care The nurse provides and directs nursing care that enhances the care delivery setting to protect the client and health care personnel.
![Page 17: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/17.jpg)
ACTIVITY STATEMENT COMPARISONS
![Page 18: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/18.jpg)
Activity Statement Comparison
§ Top 30 activity statements in both importance and frequency
§ Location position in top 30 § Overall group rating in frequency and
importance
![Page 19: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/19.jpg)
Activity Statement Comparison
§ During 2005-2007, Management of Care
§ Minimal statements in the top 30
![Page 20: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/20.jpg)
Activity Statement Comparison
§ Beginning in 2008, an upward trend is noted in Management of Care
§ Increase in statements in the top 30, more importantly, in the top 10
![Page 21: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/21.jpg)
Activity Statement Representation
0
2
4
6
8
10
12
2005 2006 2007 2008 2009 2010 2011 2012 2013
# of
Act
ivity
Sta
tem
ents
Practice Analysis and Continuous Practice Analysis
Management Care
![Page 22: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/22.jpg)
NCLEX-RN® Test Plan
0
0.05
0.1
0.15
0.2
0.25
2004 2007 2010 2013
Test
Pla
n Pe
rcen
tage
NCLEX-RN® Approved Dates
Management of Care
![Page 23: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/23.jpg)
Honorable Mention
§ Apply principles of infection control (e.g., hand hygiene, surgical asepsis, isolation, sterile technique, universal/standard)
§ Ensure proper identification of client when providing care
![Page 24: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/24.jpg)
TIME SPENT IN ENTRY-LEVEL NURSING
![Page 25: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/25.jpg)
Total Time in Each NCLEX® Test Plan Category
0.00
1.00
2.00
3.00
4.00
5.00
6.00
7.00
2005 2006 2007 2008 2009 2010 2011 2012 2013
Hou
rs
Practice Analysis and Continuous Practice Analysis
Management of Care
Safety and Infection Control
Health Promotion and Maintenance
Psychosocial Integrity
Basic Care and Comfort
Pharmacological and Parenteral Therapies Reduction of Risk Potential
Physiological Adaptation
![Page 26: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/26.jpg)
Overall Total Time Spent by Entry-Level Nurses
0.00
5.00
10.00
15.00
20.00
25.00
30.00
35.00
40.00
45.00
2005 2006 2007 2008 2009 2010 2011 2012 2013
Hours
Practice Analysis and Continuous Practice Analysis
Total Time
![Page 27: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/27.jpg)
Total Time in Management of Care
0.00
1.00
2.00
3.00
4.00
5.00
6.00
7.00
2005 2006 2007 2008 2009 2010 2011 2012 2013
Hours
Practice Analysis & Continuous Practice Analysis
Management of Care
![Page 28: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/28.jpg)
SUMMARY
![Page 29: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/29.jpg)
Summary
§ NCSBN applies rigor to established industry standards to ensure a systematic, comprehensive, defensible methodology is used to establish content domain
§ Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level nurses are spending more time multitasking as well as coordinating and managing client care.
![Page 30: Use of a Validation Study to Analyze Entry-Level Nursing ... · Analysis of nursing trends using the triennial NCLEX Practice Analysis and the Continuous Practice Analysis noted entry-level](https://reader034.fdocuments.us/reader034/viewer/2022050208/5f5b4270e382eb4970546ca2/html5/thumbnails/30.jpg)