Conference Proceedings Detail Page
|
Using IBM’s Watson to automatically evaluate student short answer responses
Recent advancements in natural language processing (NLP) have generated interest in using computers to assist in the coding and analysis of students' short answer responses for PER or classroom applications. We train a state-of-the-art NLP, IBM's Watson, and test its agreement with humans in three varying experimental cases. By exploring these cases, we begin to understand how Watson behaves with ideal and more realistic data, across different levels of training, and across different types of categorization tasks. We find that Watson's self-reported confidence for categorizing samples is reasonably well-aligned with its accuracy, although this can be impacted by features of the data being analyzed. Based on these results, we discuss implications and suggest potential applications of this technology to education research.
Physics Education Research Conference 2022
Part of the PER Conference series Grand Rapids, MI: July 13-14, 2022 Pages 82-87
ComPADRE is beta testing Citation Styles!
Record Link
<a href="https://www.per-central.org/items/detail.cfm?ID=16213">Campbell, J, K. Ansell, and T. Stelzer. "Using IBM’s Watson to automatically evaluate student short answer responses." Paper presented at the Physics Education Research Conference 2022, Grand Rapids, MI, July 13-14, 2022.</a>
AIP Format
J. Campbell, K. Ansell, and T. Stelzer, , presented at the Physics Education Research Conference 2022, Grand Rapids, MI, 2022, WWW Document, (https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16213&DocID=5582).
AJP/PRST-PER
J. Campbell, K. Ansell, and T. Stelzer, Using IBM’s Watson to automatically evaluate student short answer responses, presented at the Physics Education Research Conference 2022, Grand Rapids, MI, 2022, <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16213&DocID=5582>.
APA Format
Campbell, J., Ansell, K., & Stelzer, T. (2022, July 13-14). Using IBM’s Watson to automatically evaluate student short answer responses. Paper presented at Physics Education Research Conference 2022, Grand Rapids, MI. Retrieved March 18, 2025, from https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16213&DocID=5582
Chicago Format
Campbell, J, K. Ansell, and T. Stelzer. "Using IBM’s Watson to automatically evaluate student short answer responses." Paper presented at the Physics Education Research Conference 2022, Grand Rapids, MI, July 13-14, 2022. https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16213&DocID=5582 (accessed 18 March 2025).
MLA Format
Campbell, Jennifer, Katherine Ansell, and Timothy Stelzer. "Using IBM’s Watson to automatically evaluate student short answer responses." Physics Education Research Conference 2022. Grand Rapids, MI: 2022. 82-87 of PER Conference. 18 Mar. 2025 <https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16213&DocID=5582>.
BibTeX Export Format
@inproceedings{
Author = "Jennifer Campbell and Katherine Ansell and Timothy Stelzer",
Title = {Using IBM’s Watson to automatically evaluate student short answer responses},
BookTitle = {Physics Education Research Conference 2022},
Pages = {82-87},
Address = {Grand Rapids, MI},
Series = {PER Conference},
Month = {July 13-14},
Year = {2022}
}
Refer Export Format
%A Jennifer Campbell %A Katherine Ansell %A Timothy Stelzer %T Using IBM's Watson to automatically evaluate student short answer responses %S PER Conference %D July 13-14 2022 %P 82-87 %C Grand Rapids, MI %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16213&DocID=5582 %O Physics Education Research Conference 2022 %O July 13-14 %O application/pdf
EndNote Export Format
%0 Conference Proceedings %A Campbell, Jennifer %A Ansell, Katherine %A Stelzer, Timothy %D July 13-14 2022 %T Using IBM's Watson to automatically evaluate student short answer responses %B Physics Education Research Conference 2022 %C Grand Rapids, MI %P 82-87 %S PER Conference %8 July 13-14 %U https://www.compadre.org/Repository/document/ServeFile.cfm?ID=16213&DocID=5582 Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.
Citation Source Information
The AIP Style presented is based on information from the AIP Style Manual. The AJP/PRST-PER presented is based on the AIP Style with the addition of journal article titles and conference proceeding article titles. The APA Style presented is based on information from APA Style.org: Electronic References. The Chicago Style presented is based on information from Examples of Chicago-Style Documentation. The MLA Style presented is based on information from the MLA FAQ. Using IBM’s Watson to automatically evaluate student short answer responses:Know of another related resource? Login to relate this resource to it. |
ContributeRelated MaterialsSimilar Materials |
Save to my folders
