home - login - register

Conference Proceedings Detail Page

Reliability and Validity of an Introductory Physics Problem-Solving Grading Rubric
written by Kristen Rodenhausen and J. Christopher Moore
We have developed and validated a rubric for the assessment and scaffolding of problem-solving process in introductory physics courses via an iterative approach. The current version of the rubric consists of eight criteria based on research in expert-like problem solving practice and aspects of Cooperative Group Problem Solving (CGPS) pedagogy. In contrast to recent work on problem-solving assessment for use in research and curriculum development, this rubric was specifically designed for instructor use in the assignment of grades and for student use as a scaffold. This means that the rubric can be used within group problem-solving activities as a student support, formative assessment of individual work, and summative assessment, such as exams. For this study, the rubric was used to score N = 166 student solutions to 6 individually-assigned homework problems covering content in introductory mechanics in a course enrolling 32 students. Inter-rater and re-rater reliability was high for undergraduate Learning Assistant raters receiving only moderate training (approximately 4 hours). Factor analysis identified two factors that have been categorized as: (1) framing & defining, and (2) planning & execution. These factors align with our initial theory of the construct, suggesting evidence for criterion-related validity. Tau-equivalent reliability was found to be 0.76, and an item-total correlations test demonstrated all criteria correlations consistent with averaged behavior.
Physics Education Research Conference 2022
Part of the PER Conference series
Grand Rapids, MI: July 13-14, 2022
Pages 389-394
Subjects Levels Resource Types
Education - Basic Research
- Assessment
= Formative Assessment
= Instruments
= Methods
= Summative Assessment
- Problem Solving
= Processes
- Research Design & Methodology
= Validity
- Lower Undergraduate
- Assessment Material
= Rubric
- Reference Material
= Research study
PER-Central Type Intended Users Ratings
- PER Literature
- Researchers
- Professional/Practitioners
  • Currently 0.0/5

Want to rate this material?
Login here!


Format:
application/pdf
Mirror:
https://doi.org/10.1119/perc.2022…
Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license. Further distribution of this work must maintain attribution to the published article's author(s), title, proceedings citation, and DOI.
Rights Holder:
American Association of Physics Teachers
DOI:
10.1119/perc.2022.pr.Rodenhausen
NSF Number:
2150788
Keyword:
PERC 2022
Record Creator:
Metadata instance created September 7, 2022 by Lyle Barbato
Record Updated:
September 14, 2022 by Lyle Barbato
Last Update
when Cataloged:
September 15, 2022
Save to my folders

Contribute

Related Materials

Similar Materials