The use of the Physics GRE in graduate admissions has gained considerable attention in recent years. While studies have shown the problematic nature of the exam quantitatively, it is time that student experiences were also included in the discussion. In this qualitative study, we interviewed 69 current graduate physics and astronomy students about their process of deciding where to apply to graduate school. Physics GRE requirements played a substantial role in this decision, with 48 students mentioning the test as part of their process to narrow programs down to a personalized short-list. Participants discussed potential barriers (e.g., financial and travel) that affected some students, but not others, which created an unequal playing field for grad school applicants. Secondly, while the participants noticed a shift towards more departments having "optional'' GRE language, female student participants still felt the need to take and submit their Physics GRE scores, while male student participants truly saw "optional'' as optional. These results suggest that graduate programs requiring the Physics GRE are doing more than asking prospective graduate students to simply take a physics test, and that the use of 'optional' requirement language may be inadvertently disadvantaging the very students that they are trying to recruit.