PERC 2021 Abstract Detail Page
Previous Page | New Search | Browse All
| Abstract Title: | Comparing item response theory models for ranking incorrect response options |
|---|---|
| Abstract: | Previous work has shown that item response theory may be used to rank incorrect response options to multiple-choice items on commonly used assessments. This work has shown that, when the correct response to each item is specified, a nominal response model (NRM) may be used to rank the incorrect options. We seek to determine the robustness of these results by applying the NRM to all response choices, without specifying the correct response. We apply these analyses to multiple data sets (each with more than 9,000 response sets), including pre-instruction and post-instruction responses. We find that the rankings generated without specifying the correct response are consistent with the previously published rankings for one data set; however, we find noticeable differences between rankings generated from different data sets. We provide evidence that discrepancies may result from differences in response rates for less commonly chosen responses. |
| Abstract Type: | Contributed Poster Presentation |
| Session Time: | Poster Session 2 Room C |
| Poster Number: | 2C-3 |
Author/Organizer Information | |
| Primary Contact: |
Trevor I. Smith Rowan University Glassboro, NJ 08028 Phone: 856-256-4848 |
| Co-Author(s) and Co-Presenter(s) |
Mohammad A. Kazmi, Rowan University Richard R. Sarles, III, Rowan University Joshua A. Sbrana, Rowan University Cody W. Soper, Rowan University Nasrine Bendjilali, Rowan University |
