ChatGPT reflects student misconceptions in physics

Wheeler, Sav; Scherr, Rachel E.

» home » Detail Page

Conference Proceedings Detail Page

ChatGPT reflects student misconceptions in physics

written by Sav Wheeler and Rachel E. Scherr

With many students turning to machine learning models such as ChatGPT for homework help, diagnosing the accuracy of the information these technologies purport across different fields is more important than ever. In this study, we find that ChatGPT's responses to standard physics questions are consistent with an accurate theoretical understanding, but are often incorrect when applied to a given system, reflecting many of the same misconceptions as students.

Physics Education Research Conference 2023
Part of the PER Conference series
Sacramento, CA: July 19-20, 2023
Pages 386-390

download 377kb .pdf
Last Modified: September 20, 2023

Subjects	Levels	Resource Types
Education - Applied Research - Technology Education - Basic Research - Alternative Conceptions - Assessment = Methods - Societal Issues	- Lower Undergraduate	- Reference Material = Research study

PER-Central Type	Intended Users	Ratings
- PER Literature	- Researchers	Currently 0.0/5 Want to rate this material? Login here!

Format:: application/pdf
Mirror:: https://doi.org/10.1119/perc.2023…
Access Rights:: Free access
License:: This material is released under a Creative Commons Attribution 4.0 license. Further distribution of this work must maintain attribution to the published article's author(s), title, proceedings citation, and DOI.
Rights Holder:: American Association of Physics Teachers
DOI:: 10.1119/perc.2023.pr.Wheeler
Keyword:: PERC 2023
Record Creator:: Metadata instance created September 20, 2023 by Lyle Barbato
Record Updated:: October 11, 2023 by Lyle Barbato
Last Update when Cataloged:: October 15, 2023

2023 Notable Paper

Author: Lyle
Posted: May 15, 2024 at 2:15PM

This paper was one of seven 2023 PERC Proceedings papers selected as notable by PERLOC and the Notable Papers subcommittee.

» reply

Post a new comment on this item

ComPADRE is beta testing Citation Styles!

Record Link

<a href="https://www.per-central.org/items/detail.cfm?ID=16614">Wheeler, Sav, and Rachel Scherr. "ChatGPT reflects student misconceptions in physics." Paper presented at the Physics Education Research Conference 2023, Sacramento, CA, July 19-20, 2023.</a>

AIP Format

S. Wheeler and R. Scherr, , presented at the Physics Education Research Conference 2023, Sacramento, CA, 2023, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16614&DocID=5794).

AJP/PRST-PER

S. Wheeler and R. Scherr, ChatGPT reflects student misconceptions in physics, presented at the Physics Education Research Conference 2023, Sacramento, CA, 2023, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16614&DocID=5794>.

APA Format

Wheeler, S., & Scherr, R. (2023, July 19-20). ChatGPT reflects student misconceptions in physics. Paper presented at Physics Education Research Conference 2023, Sacramento, CA. Retrieved October 11, 2024, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16614&DocID=5794

Chicago Format

Wheeler, Sav, and Rachel Scherr. "ChatGPT reflects student misconceptions in physics." Paper presented at the Physics Education Research Conference 2023, Sacramento, CA, July 19-20, 2023. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16614&DocID=5794 (accessed 11 October 2024).

MLA Format

Wheeler, Sav, and Rachel Scherr. "ChatGPT reflects student misconceptions in physics." Physics Education Research Conference 2023. Sacramento, CA: 2023. 386-390 of PER Conference. 11 Oct. 2024 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16614&DocID=5794>.

BibTeX Export Format

@inproceedings{ Author = "Sav Wheeler and Rachel Scherr", Title = {ChatGPT reflects student misconceptions in physics}, BookTitle = {Physics Education Research Conference 2023}, Pages = {386-390}, Address = {Sacramento, CA}, Series = {PER Conference}, Month = {July 19-20}, Year = {2023} }

Refer Export Format

%A Sav Wheeler %A Rachel Scherr %T ChatGPT reflects student misconceptions in physics %S PER Conference %D July 19-20 2023 %P 386-390 %C Sacramento, CA %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16614&DocID=5794 %O Physics Education Research Conference 2023 %O July 19-20 %O application/pdf

EndNote Export Format

%0 Conference Proceedings %A Wheeler, Sav %A Scherr, Rachel %D July 19-20 2023 %T ChatGPT reflects student misconceptions in physics %B Physics Education Research Conference 2023 %C Sacramento, CA %P 386-390 %S PER Conference %8 July 19-20 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16614&DocID=5794

Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.

Citation Source Information

The AIP Style presented is based on information from the AIP Style Manual.

The AJP/PRST-PER presented is based on the AIP Style with the addition of journal article titles and conference proceeding article titles.

The APA Style presented is based on information from APA Style.org: Electronic References.

The Chicago Style presented is based on information from Examples of Chicago-Style Documentation.

The MLA Style presented is based on information from the MLA FAQ.