Conference Proceedings Detail Page
|
Exploring Large Language Models as Formative Feedback Tools in Physics
Significance of formative assessments and feedback is well-established in physics education, yet implementation in large enrollment physics courses poses substantial challenges such as scalability of timely personalized feedback. As part of efforts to productively incorporate large language models (LLMs) into physics education, we use a mixed method approach to compare human and artificial intelligence (AI) feedback to students on conceptual synthesis questions in an introductory mechanics course. We present our preliminary analysis showcasing the promising results and current limitations of tailored numerical and written AI feedback. We found that with physics instructors' guidance, AI provides relevant and timely written feedback to students. Nevertheless, AI struggles with edge cases and with specificity to students' answers, both of which are better handled by humans. Future work will investigate improving feedback quality by using rubrics to prompt AI, with the goal to enhance its potential utility to the physics education community.
Physics Education Research Conference 2024
Part of the PER Conference series Boston, MA: July 10-11, 2024 Pages 126-131
2024 Honorable Mention Award Winner
Author: Lyle This 2024 PERC Proceedings paper was awarded the "2024 Honorable Mention Award" by PERLOC and the Notable Papers subcommittee.
» reply
Post a new comment on this item
ComPADRE is beta testing Citation Styles!
Record Link
<a href="https://www.per-central.org/items/detail.cfm?ID=16883">El-Adawy, S, A. MacDonagh, and M. Abdelhafez. "Exploring Large Language Models as Formative Feedback Tools in Physics." Paper presented at the Physics Education Research Conference 2024, Boston, MA, July 10-11, 2024.</a>
AIP Format
S. El-Adawy, A. MacDonagh, and M. Abdelhafez, , presented at the Physics Education Research Conference 2024, Boston, MA, 2024, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16883&DocID=5950).
AJP/PRST-PER
S. El-Adawy, A. MacDonagh, and M. Abdelhafez, Exploring Large Language Models as Formative Feedback Tools in Physics, presented at the Physics Education Research Conference 2024, Boston, MA, 2024, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16883&DocID=5950>.
APA Format
El-Adawy, S., MacDonagh, A., & Abdelhafez, M. (2024, July 10-11). Exploring Large Language Models as Formative Feedback Tools in Physics. Paper presented at Physics Education Research Conference 2024, Boston, MA. Retrieved March 13, 2026, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16883&DocID=5950
Chicago Format
El-Adawy, S, A. MacDonagh, and M. Abdelhafez. "Exploring Large Language Models as Formative Feedback Tools in Physics." Paper presented at the Physics Education Research Conference 2024, Boston, MA, July 10-11, 2024. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16883&DocID=5950 (accessed 13 March 2026).
MLA Format
El-Adawy, Shams, Aidan MacDonagh, and Mohamed Abdelhafez. "Exploring Large Language Models as Formative Feedback Tools in Physics." Physics Education Research Conference 2024. Boston, MA: 2024. 126-131 of PER Conference. 13 Mar. 2026 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16883&DocID=5950>.
BibTeX Export Format
@inproceedings{
Author = "Shams El-Adawy and Aidan MacDonagh and Mohamed Abdelhafez",
Title = {Exploring Large Language Models as Formative Feedback Tools in Physics},
BookTitle = {Physics Education Research Conference 2024},
Pages = {126-131},
Address = {Boston, MA},
Series = {PER Conference},
Month = {July 10-11},
Year = {2024}
}
Refer Export Format
%A Shams El-Adawy %A Aidan MacDonagh %A Mohamed Abdelhafez %T Exploring Large Language Models as Formative Feedback Tools in Physics %S PER Conference %D July 10-11 2024 %P 126-131 %C Boston, MA %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16883&DocID=5950 %O Physics Education Research Conference 2024 %O July 10-11 %O application/pdf
EndNote Export Format
%0 Conference Proceedings %A El-Adawy, Shams %A MacDonagh, Aidan %A Abdelhafez, Mohamed %D July 10-11 2024 %T Exploring Large Language Models as Formative Feedback Tools in Physics %B Physics Education Research Conference 2024 %C Boston, MA %P 126-131 %S PER Conference %8 July 10-11 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16883&DocID=5950 Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.
Citation Source Information
The AIP Style presented is based on information from the AIP Style Manual. The AJP/PRST-PER presented is based on the AIP Style with the addition of journal article titles and conference proceeding article titles. The APA Style presented is based on information from APA Style.org: Electronic References. The Chicago Style presented is based on information from Examples of Chicago-Style Documentation. The MLA Style presented is based on information from the MLA FAQ. Exploring Large Language Models as Formative Feedback Tools in Physics:Know of another related resource? Login to relate this resource to it. |
SupplementsContributeRelated MaterialsSimilar Materials |
Save to my folders
