TY - GEN
T1 - Understanding Programming Students' Help-Seeking Preferences in the Era of Generative AI
AU - Penney, Jacob
AU - Acharya, Pawan
AU - Hilbert, Peter
AU - Parekh, Priyanka
AU - Sarma, Anita
AU - Steinmacher, Igor
AU - Gerosa, Marco
N1 - Publisher Copyright:
© 2025 Copyright held by the owner/author(s). Publication rights licensed to ACM.
PY - 2025/10/21
Y1 - 2025/10/21
N2 - Novice programming students frequently engage in help-seeking to find information and learn about programming concepts. Among the available resources, generative AI (GenAI) chatbots appear resourceful, widely accessible, and less intimidating than human tutors. Programming instructors are actively integrating these tools into classrooms. However, our understanding of how novice programming students trust GenAI chatbots-and the factors influencing their usage-remains limited. To address this gap, we investigated the learning resource selection process of 20 novice programming students tasked with studying a programming topic. We split our participants into two groups: one using ChatGPT (n=10) and the other using a human tutor via Discord (n=10). We found that participants held strong positive perceptions of ChatGPT's speed and convenience but were wary of its inconsistent accuracy, making them reluctant to rely on it for learning entirely new topics. Accordingly, they generally preferred more trustworthy resources for learning (e.g., instructors, tutors), preferring ChatGPT for low-stakes situations or more introductory and common topics. We conclude by offering guidance to instructors on integrating LLM-based chatbots into their curricula-emphasizing verification and situational use-and to developers on designing chatbots that better address novices' trust and reliability concerns.
AB - Novice programming students frequently engage in help-seeking to find information and learn about programming concepts. Among the available resources, generative AI (GenAI) chatbots appear resourceful, widely accessible, and less intimidating than human tutors. Programming instructors are actively integrating these tools into classrooms. However, our understanding of how novice programming students trust GenAI chatbots-and the factors influencing their usage-remains limited. To address this gap, we investigated the learning resource selection process of 20 novice programming students tasked with studying a programming topic. We split our participants into two groups: one using ChatGPT (n=10) and the other using a human tutor via Discord (n=10). We found that participants held strong positive perceptions of ChatGPT's speed and convenience but were wary of its inconsistent accuracy, making them reluctant to rely on it for learning entirely new topics. Accordingly, they generally preferred more trustworthy resources for learning (e.g., instructors, tutors), preferring ChatGPT for low-stakes situations or more introductory and common topics. We conclude by offering guidance to instructors on integrating LLM-based chatbots into their curricula-emphasizing verification and situational use-and to developers on designing chatbots that better address novices' trust and reliability concerns.
KW - computing education
KW - cs1
KW - generative ai
KW - help-seeking behavior
KW - human-ai interaction
KW - novice programming students
UR - https://www.scopus.com/pages/publications/105021397700
UR - https://www.scopus.com/pages/publications/105021397700#tab=citedBy
U2 - 10.1145/3736181.3747165
DO - 10.1145/3736181.3747165
M3 - Conference contribution
AN - SCOPUS:105021397700
T3 - CompEd 2025 - Proceedings of the ACM Global Computing Education Conference 2025
SP - 15
EP - 21
BT - CompEd 2025 - Proceedings of the ACM Global Computing Education Conference 2025
PB - Association for Computing Machinery, Inc
T2 - 3rd ACM Global Computing Education Conference, CompEd 2025
Y2 - 21 October 2025 through 25 October 2025
ER -