written by
Pascal Klein, Sebastian Becker, Stefan Kuchemann, and Jochen Kuhn
The test of understanding graphs in kinematics (TUG-K) has widely been used to assess students' understanding of this subject. The TUG-K poses different objectives to the test takers such as (1) the selection of a graph from a textual description, (2) the selection of corresponding graphs, and (3) the selection of a textual description from a graph. Whether test takers follow these task requirements is usually inferred from evaluating the test scores as correct or incorrect, yet the process of how students actually interact with the different tasks remains unknown. Recent studies have shown that eye tracking can provide rich insight into student's interaction with multiple-choice tasks. In the current work, we analyzed the eye movement patterns of N=115 high school students while solving the TUG-K. Each question was divided into a question area (Q) and an option area (O), then gaze transitions between Q and O and between different options were calculated. A cluster analysis using the transition metrics revealed three item groups, containing the aforementioned objectives of the items. The clusters remain stable for different subsamples of our dataset, for instance, considering only the correct or only the incorrect responses, or considering high- or low-confidence responses. We conclude that eye movements can reflect task demands on a procedural level well beyond the classical methods of evaluating test scores, eventually making eye tracking an additional method for item analysis that can be utilized to confirm or explore test and item structures.
<a href="https://www.per-central.org/items/detail.cfm?ID=15606">Klein, P, S. Becker, S. Kuchemann, and J. Kuhn. "Test of understanding graphs in kinematics: Item objectives confirmed by clustering eye movement transitions." Phys. Rev. Phys. Educ. Res. 17, no. 1, (March 17, 2021): 013102.</a>
P. Klein, S. Becker, S. Kuchemann, and J. Kuhn, , Phys. Rev. Phys. Educ. Res. 17 (1), 013102 (2021), WWW Document, (https://doi.org/10.1103/PhysRevPhysEducRes.17.013102).
P. Klein, S. Becker, S. Kuchemann, and J. Kuhn, Test of understanding graphs in kinematics: Item objectives confirmed by clustering eye movement transitions, Phys. Rev. Phys. Educ. Res. 17 (1), 013102 (2021), <https://doi.org/10.1103/PhysRevPhysEducRes.17.013102>.
Klein, P., Becker, S., Kuchemann, S., & Kuhn, J. (2021, March 17). Test of understanding graphs in kinematics: Item objectives confirmed by clustering eye movement transitions. Phys. Rev. Phys. Educ. Res., 17(1), 013102. Retrieved April 6, 2025, from https://doi.org/10.1103/PhysRevPhysEducRes.17.013102
Klein, P, S. Becker, S. Kuchemann, and J. Kuhn. "Test of understanding graphs in kinematics: Item objectives confirmed by clustering eye movement transitions." Phys. Rev. Phys. Educ. Res. 17, no. 1, (March 17, 2021): 013102, https://doi.org/10.1103/PhysRevPhysEducRes.17.013102 (accessed 6 April 2025).
Klein, Pascal, Sebastian Becker, Stefan Kuchemann, and Jochen Kuhn. "Test of understanding graphs in kinematics: Item objectives confirmed by clustering eye movement transitions." Phys. Rev. Phys. Educ. Res. 17.1 (2021): 013102. 6 Apr. 2025 <https://doi.org/10.1103/PhysRevPhysEducRes.17.013102>.
@article{
Author = "Pascal Klein and Sebastian Becker and Stefan Kuchemann and Jochen Kuhn",
Title = {Test of understanding graphs in kinematics: Item objectives confirmed by clustering eye movement transitions},
Journal = {Phys. Rev. Phys. Educ. Res.},
Volume = {17},
Number = {1},
Pages = {013102},
Month = {March},
Year = {2021}
}
%0 Journal Article %A Klein, Pascal %A Becker, Sebastian %A Kuchemann, Stefan %A Kuhn, Jochen %D March 17, 2021 %T Test of understanding graphs in kinematics: Item objectives confirmed by clustering eye movement transitions %J Phys. Rev. Phys. Educ. Res. %V 17 %N 1 %P 013102 %8 March 17, 2021 %U https://doi.org/10.1103/PhysRevPhysEducRes.17.013102
Disclaimer: ComPADRE offers citation styles as a guide only. We cannot offer interpretations about citations as this is an automated procedure. Please refer to the style manuals in the Citation Source Information area for clarifications.