NotesFAQContact Us
Search Tips
ERIC Number: ED530764
Record Type: Non-Journal
Publication Date: 2011
Pages: 135
Abstractor: As Provided
Reference Count: N/A
ISBN: ISBN-978-1-1247-2142-2
Assessing the Reliability of Simulation Evaluation Instruments Used in Nursing Education: A Test of Concept Study
Adamson, Katie Anne
ProQuest LLC, Ph.D. Dissertation, Washington State University
Human patient simulation (HPS) provides experiential learning opportunities for student nurses and may be used as a supplement or alternative to traditional clinical education. The body of evidence supporting HPS as a teaching strategy is growing. However, challenges associated with measuring student learning and performance in HPS activities continue to be a barrier to building the evidence base supporting or contesting the efficacy of HPS in nursing education. This proof of concept study included the development and utilization of a database of leveled, video-archived HPS scenarios for assessing the reliability (inter-rater, inter-instrument, and intra-rater or test-retest) and internal consistency of data produced using the Lasater Clinical Judgment Rubric[C] (LCJR), the Seattle University Evaluation Tool[C] and the Creighton Simulation Evaluation Instrument TM (C-SEI). Twenty-nine nurse educators completed the six-week study procedures. Descriptive statistics and ANOVA comparisons of means supported the validity of the leveled, video-archived scenarios. The inter-rater reliability of data from the LCJR[C] was ICC (2,1) (95% CI) = 0.889, (0.402, 0.984) the inter-rater reliability of data from the Seattle University Evaluation Tool[C] was ICC (2,1) (95% CI) = 0.858 (0.286, 0.979) and the inter-rater reliability of data from the C-SEI TM was ICC (2,1) (95% CI) = 0.952 (0.697, 0.993). Using ICC (3,1) (95% CI), the intra-rater reliability of data from the LCJR[C] was 0.908 (0.125, 0.994), from the Seattle University Evaluation Tool[C] it was 0.907 (0.120, 0.994), and from the C-SEI TM it was, 0.883 (-0.001, 0.992). The internal consistencies of the LCJR[C], Seattle University Evaluation Tool[C] and C-SEI TM using Cronbach's Alpha were alpha = 0.974, 0.965, and 0.979 respectively. These results provided valuable information for educators and researchers seeking to measure student learning outcomes from HPS activities. Further, the success of this study provided evidence for the feasibility of a novel method for rapid instrument assessment which is being used for ongoing national research. [The dissertation citations contained here are published with the permission of ProQuest LLC. Further reproduction is prohibited without permission. Copies of dissertations may be obtained by Telephone (800) 1-800-521-0600. Web page:]
ProQuest LLC. 789 East Eisenhower Parkway, P.O. Box 1346, Ann Arbor, MI 48106. Tel: 800-521-0600; Web site:
Publication Type: Dissertations/Theses - Doctoral Dissertations
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: Washington