Using ChatGPT in Teaching Computer Programming and Studying its Impact on Students Performance

Abstract

Given the recent emergence of artificial intelligence as an important topic that can contribute to improve curricula and lecture delivery, an increasing number of scholars are investigating its impact in various educational fields. The ChatGPT, which is an artificial intelligence model developed by OpenAI, represents a significant advancement in the generative artificial intelligence area. Since its announcement, integrating the ChatGPT into computer programming curricula - and into other scientific curricula - has yielded some challenges. The main challenge is clearly evident in the conduct of in-class tests and in-lab assignments, where the students are given specific tasks to be accomplished within a certain time frame. As they might seek help from ChatGPT, these types of assessments could be considered a potential threat to academic integrity and may be viewed as a form of academic dishonesty. This study aims at integrating ChatGPT into computer programming curricula, exploring its potential to enhance undergraduate education. It follows a mixed methods approach to examine the potential integration of ChatGPT in teaching computer programming as a supplementary tool. A quasi-experimental design is followed, in which an experimental group is allowed to use ChatGPT and compared to a control group that was not. A research sample of 26 undergraduate students (13 males, 13 females) from the College of Education at Sultan Qaboos University participated in the study. The methodology encompassed three research instruments: in-class exams, in-lab assignments, and semi-structured interviews. These research instruments were utilized to assess the impact of ChatGPT on students' academic performance, which served as both independent (use of ChatGPT) and dependent (student performance) variables. The quantitative analysis revealed a significant enhancement in students' performance, while the qualitative analysis of semi-structured interviews indicated that participants view ChatGPT as a valuable support for learning. Feedback from participants suggested combining ChatGPT with traditional teaching methods to optimize learning outcomes. This study highlights the feasibility and educational benefits of incorporating AI tools like ChatGPT into teaching methodologies. It suggests that such integration can provide a more engaging and effective learning environment, potentially revolutionizing computer programming education. This paper supports e-learning practice by integrating AI-driven tools like ChatGPT into the educational framework and advances the e-learning area by demonstrating these technologies' potential to improve student academic performance in the learning environments. However, the study also acknowledges the need for further research to explore the long-term effects of AI integration in educational settings and to address any emerging challenges. These findings propose a promising direction for future curricular enhancements and suggest an effective method for the integration of AI technologies to support and enrich traditional educational frameworks.