home - login - register

PERC 2024 Abstract Detail Page

Previous Page  |  New Search  |  Browse All

Abstract Title: Analysis of student interactions with a Large Language Model in an Introductory Physics Lab Setting.
Abstract Type: Contributed Poster Presentation
Abstract: At Portland State University, we have pioneered the integration of OpenAI's GPT-4 Large Language Module (LLM) into the introductory physics laboratory, serving as a virtual teaching assistant. The primary teaching goal of this assistant was to provide immediate feedback and support to students as they worked through the physics lab activity. To study this novel implementation of generative AI in education, we analyzed transcripts of student interactions with the LLM during the lab session. We evaluated the nature of student interactions with the chatbot and assessed the quality of the LLM's responses. Additionally, we conducted pre- and post-surveys to gather qualitative insights from students regarding their experience using the LLM assistant. This paper presents the key findings of the study, including specific examples from the transcript analysis and student surveys.
Session Time: Poster Session 2
Poster Number: B98

Author/Organizer Information

Primary Contact: Travis Kregear
Portland State University
Portland, OR
Co-Author(s)
and Co-Presenter(s)
Marina Babayeva, Charles University, Czech Republic
Ralf Widenhorn, Portland State University

Contributed Poster

Contributed Poster: Download the Contributed Poster