International Journal of
Information and Education Technology

Editor-In-Chief: Prof. Jon-Chao Hong
Frequency: Monthly
ISSN: 2010-3689 (Online)
E-mali: editor@ijiet.org
Publisher: IACSIT Press
 

OPEN ACCESS
3.9
CiteScore

IJIET 2026 Vol.16(11): 3031-3040
doi: 10.18178/ijiet.2026.16.11.2752

Who Seeks AI Help? Student Characteristics and Performance Outcomes with LLM-based Programming Assistant

Neha Rani1,* , Anh Le1 , Joanna M. Mijares2 , Ashish Aggarwal3

  • 1Department of Computer and Information Science and Engineering, University of Florida, Gainesville, USA
  • 2College of Liberal Arts and Sciences, University of Florida, Gainesville, USA
  • 3Department of Engineering Education, University of Florida, Gainesville, USA

* Corresponding author

  • Manuscript receivedApril 1, 2026
  • revisedMay 22, 2026
  • acceptedJuly 30, 2026
  • publishedNovember 19, 2026

Abstract

With the rising popularity of computer science programs, students from different majors are enrolling in programming courses. There is a lack of personalized feedback and one-on-one guidance for learning programming due to large class sizes. This study explores the potential of the Large Language Model (LLM)-based application, CodeHelp, for learning programming in introductory programming courses. CodeHelp is an Artificial Intelligence (AI) tool that lets students submit problematic code snippets, error messages, and questions, offering guidance without giving direct answers. The study aims to identify the characteristics of students who utilized CodeHelp and how it impacted their performance in the course. CodeHelp was provided in an introductory programming class at a university in the United States with 508 students enrolled. A total of 155 students chose to explore CodeHelp. Survey responses, CodeHelp usage, and course outcomes were used for analysis. Results show that CodeHelp users are students with better time management skills and who report a higher sense of responsibility and accountability compared to non-users. CodeHelp users also showed improved academic performance compared to non-users.

Keywords

  • Artificial Intelligence (AI)-tutor
  • Large Language Models (LLMs)
  • introductory programming
  • learning programming
  • AI programming assistant
  • CodeHelp
IJIET-V16N11-2752

How to Cite

Copied

Neha Rani, Anh Le, Joanna M. Mijares, and Ashish Aggarwal, "Who Seeks AI Help? Student Characteristics and Performance Outcomes with LLM-based Programming Assistant," International Journal of Information and Education Technology, vol. 16, no. 11, pp. 3031-3040, 2026. https://doi.org/10.18178/ijiet.2026.16.11.2752

Copyright & License

Copyright © 2026 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).

Article Metrics in Dimensions

Menu