NURS 766 Week 3 Written Assignment 3: Appraising the Item Varieties Example

Appraising the Item Varieties for a Heart Failure Exam: What Each Format Can and Cannot Measure

The Decision and the Criteria

The heart failure unit exam will measure six objectives, three of them at the level of analysis or above. The choice of item formats will decide whether the exam measures those objectives or only appears to. McDonald (2018) treats format selection as a match between the behavior an objective names and the kind of response an item can capture, and warns that formats differ in how reliably they can be scored and how much time they demand of item writers. Each format below is therefore appraised on four criteria: the levels of thinking it can reach, how it is scored, the effort it takes to write and review and the flaws most likely to weaken it.

Single-Answer Multiple Choice

Single-answer multiple choice remains the most efficient format. It samples a wide range of content in little testing time, it is scored objectively and its statistics are easy to interpret. It can reach application and analysis when the stem presents a patient situation rather than a fact, as in an item asking what to do first for a patient with low potassium who is due for digoxin. Its limits are well known: students can reach the answer by eliminating options, and poorly written items test recognition rather than reasoning. The format is strongest when items use three well-built options, since adding a weak fourth option adds reading without improving discrimination (Hartigan-Rogers et al., 2019).

Multiple Response

Multiple-response items ask students to select every correct option, which suits objectives that involve recognizing several cues at once, such as the signs of worsening fluid overload. They reduce guessing compared with single-answer items, but their scoring decides whether they are fair. All-or-nothing scoring treats a student who finds four of five cues the same as one who finds none. Partial credit scoring, introduced with the Next Generation NCLEX, gives credit for each correct choice and subtracts for incorrect ones. In a prelicensure program that switched to NGN-style partial credit, Norton and Yockey (2026) tracked course repeaters across one semester of traditional scoring and the next; scores rose significantly on each of four unit exams, yet the repeaters still did not reliably outscore their classmates, so the authors concluded that partial credit measured knowledge more finely without inflating grades.

Clinical Judgment Formats

The newer formats are built around a case, so a single patient story supports several items, each targeting a different step of clinical judgment. Matrix items present several findings or actions in rows and ask students to classify each one, which measures cue recognition efficiently. Drop-down cloze items embed choices within sentences, which suits analyzing a patient's condition. Highlight items ask students to mark the relevant findings in a nurse's note, which resembles reading a real chart. Bowtie items place the likely condition in the center, with two actions on one side and two monitoring parameters on the other, so a single item measures several steps at once. Trend items present data over time and ask what has changed.

Their strength is validity for clinical judgment objectives; their cost is effort. Hensel et al. (2024) describe a statewide project in which twenty champions drawn from thirteen nursing schools wrote 54 case studies, 33 bowties and 21 trend items for an open test bank, and in twelve months teachers drew on those items over sixty thousand times. That number shows the demand for these items, and the scale of the project shows how much work they take. Quality is also harder to judge. Wilson (2026) developed a rubric for evaluating both traditional and clinical judgment items across ten domains of content, construction and cognitive demand; in a first test on three bowtie items written by artificial intelligence, the rubric separated stronger from weaker items, though raters agreed exactly on only 57% of ratings, with 81% within two points. Even with a rubric, judging these items takes practice.

Constructed Response

Short-answer and essay items ask students to produce rather than select an answer, which reaches the highest levels, such as developing a discharge teaching plan. They eliminate guessing and reveal reasoning, but they take time to answer and to grade, cover less content per hour and are scored less consistently unless graded with a rubric. McDonald (2018) recommends using them sparingly on exams and preparing the model answer and point allocation before students write, so that the first papers graded do not set the standard by accident.

Fairness and Accessibility Across Formats

Formats also differ in how fair they are to different students. Case-based items demand more reading, which can disadvantage students who read more slowly, including many students whose first language is not English, even when they know the content well. Drag-and-drop and highlight items depend on comfort with the testing software. McDonald (2018) counts clear, simple language among the basic requirements of every item for this reason: an item should measure nursing knowledge, not reading speed or skill with a mouse. For the heart failure exam, this means keeping case stems short and free of unnecessary detail, giving students practice with every format before it counts and allowing time for reading in the exam's time limit. It also means that a student who struggles on the case but does well on single-answer items may be showing a reading problem rather than a judgment problem, which is worth a conversation before the next exam.

Formats also differ in how easily they can be shared and reused. Single-answer items can be banked, revised and reused across terms with little effort. Case-based items are harder to protect, because one memorable case can circulate among students, and harder to revise, because changing one detail may change the key for several items. A program investing in clinical judgment items should plan for a larger bank, rotated across terms, rather than reusing the same few cases.

Summary Comparison

The Item Mix for the Unit Exam

The heart failure exam will have 30 points. Eighteen will come from single-answer multiple-choice items, mostly at the application level, to cover pathophysiology, medications and classification efficiently. Four will come from two multiple-response items on fluid overload cues, scored with the plus-minus rule. Eight will come from one unfolding case with a matrix item on cue recognition, a cloze item on the likely problem and a bowtie on actions and monitoring, which together measure the two highest-level objectives. The discharge teaching objective will be measured outside the exam, with a rubric, since an essay item would add grading time without sampling more content. Dickison et al. (2019) describe integrating the clinical judgment model across a curriculum rather than confining it to final exams, and putting a case on every unit exam is one small way to do that.

Conclusion

No format is good or bad in itself; a format is good when it asks students to do what the objective says. Single-answer items remain the backbone of the unit exam because they are efficient and reliable, multiple-response items earn their place with partial credit scoring and one well-built case carries the clinical judgment objectives. The test administration paper will show how the exam's statistics confirm or challenge these choices.

References

Dickison, P., Haerling, K. A., & Lasater, K. (2019). Integrating the National Council of State Boards of Nursing clinical judgment model into nursing educational frameworks. Journal of Nursing Education, 58(2), 72-78. https://doi.org/10.3928/01484834-20190122-03

Hartigan-Rogers, J. A., Redmond, S., Cobbett, S., Cifuentes, K., Honan, D., Richard, E., Sheane, V., & VanTassell, T. (2019). A, B, or C? A quasi-experimental multi-site study investigating three option multiple choice questions. International Journal of Nursing Education Scholarship, 16(1). https://doi.org/10.1515/ijnes-2019-0061

Hensel, D., Billings, D. M., & Wiseman, R. (2024). Evaluation of the Maryland Next Gen Test Bank Project: Implications and recommendations. Nursing Education Perspectives, 45(4), 225-229. https://doi.org/10.1097/01.NEP.0000000000001239

McDonald, M. E. (2018). The nurse educator's guide to assessing learning outcomes (4th ed.). Jones & Bartlett Learning.

Norton, L. M., & Yockey, J. (2026). Partial credit scoring: A helping hand or a crutch? Journal of Nursing Education, 65(8), 502-504. https://doi.org/10.3928/01484834-20260224-05

Wilson, P. (2026). A standardized rubric for evaluating NCLEX items: Traditional and clinical judgment item formats. Nurse Educator. Advance online publication. https://doi.org/10.1097/NNE.0000000000002285