Diagnostic Competency During Simulation-Based Learning Tool

Abstract

The Diagnostic Competency During Simulation-Based (DCDS) Learning Tool (Burt & Olson, 2023) is designed as an educational instrument to comprehensively assess individual diagnostic reasoning competencies among nurse practitioner (NP) students in simulation-based learning environments. Its content is structured around six competency domains, which were derived from existing instruments and curriculum learning objectives (Ahmed et al., 2017; American Board of Internal Medicine, 2021). The DCDS Learning Tool comprises 28 items, and its evaluation included ratings from a sample of experts and faculty. The reliability and validity of these items have been established. This tool aims to enhance the assessment of diagnostic reasoning by providing nurse practitioner educators with detailed, actionable, and competency-specific measures to promote improvement.

Keywords

Individual Diagnostic Reasoning Competencies; Nurse Practitioner Students; Nursing Education; Simulated-Based Learning Experiences

Authors

Burt, Leah; Olson, Andrew

---

Purpose

The purpose of the DCDS Learning Tool is to broaden the scope of diagnostic reasoning assessment by offering nurse practitioner educators precise, actionable, and competency-specific measurements. These measurements are intended to facilitate the improvement of diagnostic reasoning skills in students.

Validity

Content Validity: The final individual competency domain scale content validity index (CVI) scores ranged from 0.9175 to 1.0, with the total scale CVI score reaching 0.98.

Reliability

Interrater Reliability: The intra-class correlation coefficient (ICC) for the DCDS Learning Tool was 0.548 (p < 0.0001, 95% confidence interval CI [0.482–0.612]).

Factor Analysis

No data is Available.

Instrument: DCDS Learning Tool

Test Type: Original

Format: The DCDS Learning Tool is designed for use across a variety of simulation scenarios. It guides educators to consider scenario characteristics before evaluating learner performance. Raters assign ordinal-level judgments (minimal, partial, or complete) to observed behaviors. If a student demonstrates only a portion of the behaviors described within an item, raters are advised to assign a lower rating. Educators utilizing the DCDS tool should analyze learner behavior ratings to identify trends and inconsistencies between competencies. During feedback sessions, educators should emphasize behaviors that will facilitate the student’s progression to the next competency rating level.

Language Available: English

Population Group: Human; Male; Female

Age Group: Adulthood (18 yrs & older)

Population Details:

• Location: United States

• Respondents: Experts; Nursing Education Faculty

Test Methodology: Test Validity; Content Validity; Test Reliability; Interrater Reliability

Authors

Author ORCID Identifier: No data is Available

Affiliation Email Addresses:

• Leah Burt: [email protected]

• Andrew Olson: No data is Available

Correspondence Address:
Leah Burt: University of Illinois Chicago College of Nursing, Department of Biobehavioral Nursing Science, 845 South Damen Avenue (MC 802), Chicago, Illinois, United States, 60612, [email protected]

Permissions & Fee and Test Year

Permissions: Contact Corresponding Author
Fee: No
Test Year: 2023

References

Burt, L., & Olson, A. (2023). Development and psychometric testing of the Diagnostic Competency During Simulation-based (DCDS) Learning Tool. Journal of Professional Nursing, 45, 51–59. https://doi.org/10.1016/j.profnurs.2023.01.008

Items of the DCDS Learning Tool

This measure consists of 28 items. No data is Available.