home - login - register

PERC 2022 Abstract Detail Page

Previous Page  |  New Search  |  Browse All

Abstract Title: Methods for utilizing Item response theory with Coupled, Multiple-Response assessments
Abstract Type: Contributed Poster Presentation
Abstract: Recent years have seen a movement within the research-based assessment development community towards item formats that go beyond simple multiple-choice formats. Some have moved towards free-response questions, particularly at the upper-division level; however, free-response items have the constraint that they must be scored by hand.  To avoid this limitation, some assessment developers have moved toward formats that maintain the closed-response format, while still providing more nuanced insight into student reasoning.  One such format is known as coupled, multiple response (CMR).  This format pairs multiple-choice and multiple-response formats to allow students to both commit to an answer in addition to selecting options that correspond with their reasoning. In addition to being machine-scorable, this format allows for more nuanced scoring than simple right or wrong.  However, such nuanced scoring presents a potential challenge with respect to utilizing certain testing theories to construct validity arguments for the assessment.  In particular, Item Response Theory (IRT) models often assume dicotomously scored items.  While polytomous IRT models do exist, each brings with it certain constraints and limitations.  Here, we will explore multiple IRT models and scoring schema using data from an existing CMR test, with the goal of providing guidance and insight for possible methods for simultaneously leveraging the affordances of both the CMR format and IRT models in the context of constructing validity arguments for research-based assessments.
Session Time: Poster Session 3
Poster Number: III-64
Contributed Paper Record: Contributed Paper Information
Contributed Paper Download: Download Contributed Paper

Author/Organizer Information

Primary Contact: Bethany Wilcox
University of Colorado Boulder
Phone: 9704125014
and Co-Presenter(s)
Katherine Rainey, University of Colorado Boulder
Michael Vignal, University of Colorado Boulder

Contributed Poster

Contributed Poster: Download the Contributed Poster