Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric
written by
Kristen Rodenhausen and J. Christopher Moore
We have developed and validated a rubric for the assessment and scaffolding of problem-solving process in introductory physics courses via an iterative approach. The current version of the rubric consists of eight criteria based on research in expert-like problem solving practice and aspects of Cooperative Group Problem Solving (CGPS) pedagogy. In contrast to recent work on problem-solving assessment for use in research and curriculum development, this rubric was specifically designed for instructor use in the assignment of grades and for student use as a scaffold. This means that the rubric can be used within group problem-solving activities as a student support, formative assessment of individual work, and summative assessment, such as exams. For this study, the rubric was used to score N = 166 student solutions to 6 individually-assigned homework problems covering content in introductory mechanics in a course enrolling 32 students. Inter-rater and re-rater reliability was high for undergraduate Learning Assistant raters receiving only moderate training (approximately 4 hours). Factor analysis identified two factors that have been categorized as: (1) framing & defining, and (2) planning & execution. These factors align with our initial theory of the construct, suggesting evidence for criterion-related validity. Tau-equivalent reliability was found to be 0.76, and an item-total correlations test demonstrated all criteria correlations consistent with averaged behavior.
Physics Education Research Conference 2022
Part of the PER Conference series
Grand Rapids, MI: July 13-14, 2022
Pages 389-394
This material is released under a Creative Commons Attribution 4.0 license.
Further distribution of this work must maintain attribution to the published article's author(s), title, proceedings citation, and DOI.
<a href="https://www.per-central.org/items/detail.cfm?ID=16265">Rodenhausen, Kristen, and J. Christopher Moore. "Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric." Paper presented at the Physics Education Research Conference 2022, Grand Rapids, MI, July 13-14, 2022.</a>
K. Rodenhausen and J. Moore, , presented at the Physics Education Research Conference 2022, Grand Rapids, MI, 2022, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634).
K. Rodenhausen and J. Moore, Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric, presented at the Physics Education Research Conference 2022, Grand Rapids, MI, 2022, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634>.
Rodenhausen, K., & Moore, J. (2022, July 13-14). Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric. Paper presented at Physics Education Research Conference 2022, Grand Rapids, MI. Retrieved May 15, 2025, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634
Rodenhausen, Kristen, and J. Christopher Moore. "Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric." Paper presented at the Physics Education Research Conference 2022, Grand Rapids, MI, July 13-14, 2022. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634 (accessed 15 May 2025).
Rodenhausen, Kristen, and J. Christopher Moore. "Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric." Physics Education Research Conference 2022. Grand Rapids, MI: 2022. 389-394 of PER Conference. 15 May 2025 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634>.
@inproceedings{
Author = "Kristen Rodenhausen and J. Christopher Moore",
Title = {Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric},
BookTitle = {Physics Education Research Conference 2022},
Pages = {389-394},
Address = {Grand Rapids, MI},
Series = {PER Conference},
Month = {July 13-14},
Year = {2022}
}
%A Kristen Rodenhausen %A J. Christopher Moore %T Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric %S PER Conference %D July 13-14 2022 %P 389-394 %C Grand Rapids, MI %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634 %O Physics Education Research Conference 2022 %O July 13-14 %O application/pdf
%0 Conference Proceedings %A Rodenhausen, Kristen %A Moore, J. Christopher %D July 13-14 2022 %T Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric %B Physics Education Research Conference 2022 %C Grand Rapids, MI %P 389-394 %S PER Conference %8 July 13-14 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634
Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.