home - login - register

Conference Proceedings Detail Page

Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric
written by Kristen Rodenhausen and J. Christopher Moore
We have developed and validated a rubric for the assessment and scaffolding of problem-solving process in introductory physics courses via an iterative approach. The current version of the rubric consists of eight criteria based on research in expert-like problem solving practice and aspects of Cooperative Group Problem Solving (CGPS) pedagogy. In contrast to recent work on problem-solving assessment for use in research and curriculum development, this rubric was specifically designed for instructor use in the assignment of grades and for student use as a scaffold. This means that the rubric can be used within group problem-solving activities as a student support, formative assessment of individual work, and summative assessment, such as exams. For this study, the rubric was used to score N = 166 student solutions to 6 individually-assigned homework problems covering content in introductory mechanics in a course enrolling 32 students. Inter-rater and re-rater reliability was high for undergraduate Learning Assistant raters receiving only moderate training (approximately 4 hours). Factor analysis identified two factors that have been categorized as: (1) framing & defining, and (2) planning & execution. These factors align with our initial theory of the construct, suggesting evidence for criterion-related validity. Tau-equivalent reliability was found to be 0.76, and an item-total correlations test demonstrated all criteria correlations consistent with averaged behavior.
Physics Education Research Conference 2022
Part of the PER Conference series
Grand Rapids, MI: July 13-14, 2022
Pages 389-394
Subjects Levels Resource Types
Education - Basic Research
- Assessment
= Formative Assessment
= Instruments
= Methods
= Summative Assessment
- Problem Solving
= Processes
- Research Design & Methodology
= Validity
- Lower Undergraduate
- Assessment Material
= Rubric
- Reference Material
= Research study
PER-Central Type Intended Users Ratings
- PER Literature
- Researchers
- Professional/Practitioners
  • Currently 0.0/5

Want to rate this material?
Login here!


Format:
application/pdf
Mirror:
https://doi.org/10.1119/perc.2022…
Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license. Further distribution of this work must maintain attribution to the published article's author(s), title, proceedings citation, and DOI.
Rights Holder:
American Association of Physics Teachers
DOI:
10.1119/perc.2022.pr.Rodenhausen
NSF Number:
2150788
Keyword:
PERC 2022
Record Creator:
Metadata instance created September 7, 2022 by Lyle Barbato
Record Updated:
September 14, 2022 by Lyle Barbato
Last Update
when Cataloged:
September 15, 2022
ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
K. Rodenhausen and J. Moore, , presented at the Physics Education Research Conference 2022, Grand Rapids, MI, 2022, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634).
AJP/PRST-PER
K. Rodenhausen and J. Moore, Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric, presented at the Physics Education Research Conference 2022, Grand Rapids, MI, 2022, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634>.
APA Format
Rodenhausen, K., & Moore, J. (2022, July 13-14). Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric. Paper presented at Physics Education Research Conference 2022, Grand Rapids, MI. Retrieved February 12, 2025, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634
Chicago Format
Rodenhausen, Kristen, and J. Christopher Moore. "Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric." Paper presented at the Physics Education Research Conference 2022, Grand Rapids, MI, July 13-14, 2022. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634 (accessed 12 February 2025).
MLA Format
Rodenhausen, Kristen, and J. Christopher Moore. "Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric." Physics Education Research Conference 2022. Grand Rapids, MI: 2022. 389-394 of PER Conference. 12 Feb. 2025 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634>.
BibTeX Export Format
@inproceedings{ Author = "Kristen Rodenhausen and J. Christopher Moore", Title = {Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric}, BookTitle = {Physics Education Research Conference 2022}, Pages = {389-394}, Address = {Grand Rapids, MI}, Series = {PER Conference}, Month = {July 13-14}, Year = {2022} }
Refer Export Format

%A Kristen Rodenhausen %A J. Christopher Moore %T Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric %S PER Conference %D July 13-14 2022 %P 389-394 %C Grand Rapids, MI %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634 %O Physics Education Research Conference 2022 %O July 13-14 %O application/pdf

EndNote Export Format

%0 Conference Proceedings %A Rodenhausen, Kristen %A Moore, J. Christopher %D July 13-14 2022 %T Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric %B Physics Education Research Conference 2022 %C Grand Rapids, MI %P 389-394 %S PER Conference %8 July 13-14 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16265&DocID=5634


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The AJP/PRST-PER presented is based on the AIP Style with the addition of journal article titles and conference proceeding article titles.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric:


Know of another related resource? Login to relate this resource to it.
Save to my folders

Contribute

Related Materials

Similar Materials