doi: 10.18178/ijiet.2026.16.11.2752
Who Seeks AI Help? Student Characteristics and Performance Outcomes with LLM-based Programming Assistant
- 1Department of Computer and Information Science and Engineering, University of Florida, Gainesville, USA
- 2College of Liberal Arts and Sciences, University of Florida, Gainesville, USA
- 3Department of Engineering Education, University of Florida, Gainesville, USA
- Manuscript receivedApril 1, 2026
- revisedMay 22, 2026
- acceptedJuly 30, 2026
- publishedNovember 19, 2026
Abstract
With the rising popularity of computer science programs, students from different majors are enrolling in programming courses. There is a lack of personalized feedback and one-on-one guidance for learning programming due to large class sizes. This study explores the potential of the Large Language Model (LLM)-based application, CodeHelp, for learning programming in introductory programming courses. CodeHelp is an Artificial Intelligence (AI) tool that lets students submit problematic code snippets, error messages, and questions, offering guidance without giving direct answers. The study aims to identify the characteristics of students who utilized CodeHelp and how it impacted their performance in the course. CodeHelp was provided in an introductory programming class at a university in the United States with 508 students enrolled. A total of 155 students chose to explore CodeHelp. Survey responses, CodeHelp usage, and course outcomes were used for analysis. Results show that CodeHelp users are students with better time management skills and who report a higher sense of responsibility and accountability compared to non-users. CodeHelp users also showed improved academic performance compared to non-users.
Keywords
- Artificial Intelligence (AI)-tutor
- Large Language Models (LLMs)
- introductory programming
- learning programming
- AI programming assistant
- CodeHelp
How to Cite
Neha Rani, Anh Le, Joanna M. Mijares, and Ashish Aggarwal, "Who Seeks AI Help? Student Characteristics and Performance Outcomes with LLM-based Programming Assistant," International Journal of Information and Education Technology, vol. 16, no. 11, pp. 3031-3040, 2026. https://doi.org/10.18178/ijiet.2026.16.11.2752
Copyright & License
Copyright © 2026 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).