home - login - register

Conference Proceedings Detail Page

Analyzing AI and student responses through the lens of sensemaking and mechanistic reasoning
written by Dean A. Zollman, Amogh Sirnoorkar, and James T. Laverty
Physics education research (PER) shares a rich tradition of designing learning environments that promote valued epistemic practices such as sensemaking and mechanistic reasoning. Recent technological advancements, particularly artificial intelligence has caught significant traction in the PER community due to its human-like, sophisticated responses to physics tasks. In this study, we contribute to the ongoing efforts by comparing AI (ChatGPT) and student responses to a physics task through the cognitive frameworks of sensemaking and mechanistic reasoning. Findings highlight that by virtue of its training data set, ChatGPT's response provide evidence of mechanistic reasoning and mimics the vocabulary of experts in its responses. On the other hand, half of students' responses evidenced sensemaking and reflected an effective amalgamation of diagram-based and mathematical reasoning, showcasing a comprehensive problem-solving approach. In other words, while AI responses reflected how physics is talked about, a part of students' responses reflected how physics is practiced during problem solving. We discuss the implications of this finding with an emphasis on epistemology of AI responses and designing next-generation assessments in physics.
Physics Education Research Conference 2023
Part of the PER Conference series
Sacramento, CA: July 19-20, 2023
Pages 415-420
Subjects Levels Resource Types
Education - Applied Research
- Instructional Material Design
= Problem/Question
- Technology
= Computers
Education - Basic Research
- Assessment
= Methods
- Problem Solving
= Processes
- Student Characteristics
= Skills
- Lower Undergraduate
- Reference Material
= Research study
PER-Central Type Intended Users Ratings
- PER Literature
- Researchers
  • Currently 0.0/5

Want to rate this material?
Login here!


Format:
application/pdf
Mirror:
https://doi.org/10.1119/perc.2023…
Access Rights:
Free access
License:
This material is released under a Creative Commons Attribution 4.0 license. Further distribution of this work must maintain attribution to the published article's author(s), title, proceedings citation, and DOI.
Rights Holder:
American Association of Physics Teachers
DOI:
10.1119/perc.2023.pr.Zollman
NSF Number:
2013339
Keyword:
PERC 2023
Record Creator:
Metadata instance created September 20, 2023 by Lyle Barbato
Record Updated:
September 27, 2023 by Lyle Barbato
Last Update
when Cataloged:
October 15, 2023

2023 Notable Paper

Author: Lyle
Posted: May 15, 2024 at 2:14PM

This paper was one of seven 2023 PERC Proceedings papers selected as notable by PERLOC and the Notable Papers subcommittee.

» reply

Post a new comment on this item
ComPADRE is beta testing Citation Styles!

Record Link
AIP Format
D. Zollman, A. Sirnoorkar, and J. Laverty, , presented at the Physics Education Research Conference 2023, Sacramento, CA, 2023, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16619&DocID=5799).
AJP/PRST-PER
D. Zollman, A. Sirnoorkar, and J. Laverty, Analyzing AI and student responses through the lens of sensemaking and mechanistic reasoning, presented at the Physics Education Research Conference 2023, Sacramento, CA, 2023, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16619&DocID=5799>.
APA Format
Zollman, D., Sirnoorkar, A., & Laverty, J. (2023, July 19-20). Analyzing AI and student responses through the lens of sensemaking and mechanistic reasoning. Paper presented at Physics Education Research Conference 2023, Sacramento, CA. Retrieved June 16, 2025, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16619&DocID=5799
Chicago Format
Zollman, D, A. Sirnoorkar, and J. Laverty. "Analyzing AI and student responses through the lens of sensemaking and mechanistic reasoning." Paper presented at the Physics Education Research Conference 2023, Sacramento, CA, July 19-20, 2023. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16619&DocID=5799 (accessed 16 June 2025).
MLA Format
Zollman, Dean, Amogh Sirnoorkar, and James Laverty. "Analyzing AI and student responses through the lens of sensemaking and mechanistic reasoning." Physics Education Research Conference 2023. Sacramento, CA: 2023. 415-420 of PER Conference. 16 June 2025 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16619&DocID=5799>.
BibTeX Export Format
@inproceedings{ Author = "Dean Zollman and Amogh Sirnoorkar and James Laverty", Title = {Analyzing AI and student responses through the lens of sensemaking and mechanistic reasoning}, BookTitle = {Physics Education Research Conference 2023}, Pages = {415-420}, Address = {Sacramento, CA}, Series = {PER Conference}, Month = {July 19-20}, Year = {2023} }
Refer Export Format

%A Dean Zollman %A Amogh Sirnoorkar %A James Laverty %T Analyzing AI and student responses through the lens of sensemaking and mechanistic reasoning %S PER Conference %D July 19-20 2023 %P 415-420 %C Sacramento, CA %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16619&DocID=5799 %O Physics Education Research Conference 2023 %O July 19-20 %O application/pdf

EndNote Export Format

%0 Conference Proceedings %A Zollman, Dean %A Sirnoorkar, Amogh %A Laverty, James %D July 19-20 2023 %T Analyzing AI and student responses through the lens of sensemaking and mechanistic reasoning %B Physics Education Research Conference 2023 %C Sacramento, CA %P 415-420 %S PER Conference %8 July 19-20 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16619&DocID=5799


Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The AJP/PRST-PER presented is based on the AIP Style with the addition of journal article titles and conference proceeding article titles.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.

Analyzing AI and student responses through the lens of sensemaking and mechanistic reasoning:


Know of another related resource? Login to relate this resource to it.
Save to my folders

Supplements

Contribute

Related Materials

Similar Materials