Effects of ChatGPT on students’ academic performance in Pakistan higher education classrooms

Effects of ChatGPT on students’ academic performance in Pakistan higher education classrooms
  • Roumeliotis, K. I. & Tselikas, N. D. ChatGPT and open-AI models: A preliminary review. Future Internet. 15, 192 (2023).

    Article 

    Google Scholar 

  • Cheung, S. K., Kwok, L. F., Phusavat, K. & Yang, H. H. Shaping the future learning environments with smart elements: challenges and opportunities. Int. J. Educational Technol. High. Educ. 18, 1–9 (2021).

    Article 

    Google Scholar 

  • Pedro, F., Subosa, M., Rivas, A. & Valverde, P. Artificial intelligence in education: Challenges and opportunities for sustainable development. (2019).

  • Mhlanga, D. Open AI in education, the responsible and ethical use of ChatGPT towards lifelong learning. Education, the Responsible and Ethical Use of ChatGPT Towards Lifelong Learning (2023).

  • Mishra, P., Warr, M. & Islam, R. TPACK in the age of ChatGPT and generative AI. J. Digit. Learn. Teacher Educ. 39, 235–251 (2023).

    Article 

    Google Scholar 

  • Dwivedi, Y. K. et al. So what if ChatGPT wrote it? Multidisciplinary perspectives on opportunities, challenges and implications of generative conversational AI for research, practice and policy. Int. J. Inf. Manag. 71, 102642 (2023).

    Google Scholar 

  • Latif, E. et al. Artificial general intelligence (AGI) for education. arXiv preprint arXiv:2304.12479 (2023).

  • Gill, S. S. et al. Transformative effects of ChatGPT on modern education: emerging era of AI chatbots. Internet Things Cyber-Physical Syst. 4, 19–23 (2024).

    Article 

    Google Scholar 

  • Onal, S. & Kulavuz-Onal, D. A. cross-disciplinary examination of the instructional uses of ChatGPT in higher education. J. Educ. Technol. Syst., 00472395231196532 (2023).

  • Haleem, A., Javaid, M. & Singh, R. P. An era of ChatGPT as a significant futuristic support tool: A study on features, abilities, and challenges. BenchCouncil Trans. Benchmarks Stand. Evaluations. 2, 100089 (2022).

    Article 

    Google Scholar 

  • Javaid, M., Haleem, A., Singh, R. P., Khan, S. & Khan, I. H. Unlocking the opportunities through ChatGPT tool towards ameliorating the education system. BenchCouncil Trans. Benchmarks Stand. Evaluations. 3, 100115 (2023).

    Article 

    Google Scholar 

  • Domenech, J. In 9th International Conference on Higher Education Advances (HEAd’23). IEEE.

  • Rasul, T. et al. The role of ChatGPT in higher education: benefits, challenges, and future research directions. J. Appl. Learn. Teach. 6 (2023).

  • Limo, F. A. F. et al. Personalized tutoring: ChatGPT as a virtual tutor for personalized learning experiences. Social Space. 23, 293–312 (2023).

    Google Scholar 

  • Wu, T. T., Lee, H. Y., Li, P. H., Huang, C. N. & Huang, Y. M. Promoting self-regulation progress and knowledge construction in blended learning via ChatGPT-based learning aid. J. Educational Comput. Res. 61, 3–31 (2024).

    Article 

    Google Scholar 

  • Firaina, R. & Sulisworo, D. Exploring the usage of ChatGPT in higher education: frequency and impact on productivity. Buletin Edukasi Indonesia. 2, 39–46 (2023).

    Article 

    Google Scholar 

  • Rudolph, J., Tan, S. & Tan, S. ChatGPT: bullshit spewer or the end of traditional assessments in higher education? J. Appl. Learn. Teach. 6 (2023).

  • Hunter-Johnson, Y., Liu, T., Murray, K., Niu, Y. & Suprise, M. Higher education as a tool for veterans in transition: battling the challenges. J. Continuing High. Educ. 69, 1–18 (2021).

    Article 

    Google Scholar 

  • Elbanna, S. & Armstrong, L. Exploring the integration of ChatGPT in education: adapting for the future. Manage. Sustain. Arab. Rev. (2023).

  • Shihab, S. R., Sultana, N. & Samad, A. Revisiting the use of ChatGPT in business and educational fields: possibilities and challenges. BULLET: Jurnal Multidisiplin Ilmu. 2, 534–545 (2023).

    Google Scholar 

  • Roy, D. & Putatunda, T. From textbooks to chatbots: integrating AI in english literature classrooms of India. J. e-Learning Knowl. Soc. 19, 65–73 (2023).

    Google Scholar 

  • Chaudhry, I. S., Sarwary, S. A. M., Refae, E., Chabchoub, H. & G. A. & Time to revisit existing student’s performance evaluation approach in higher education sector in a new era of ChatGPT—A case study. Cogent Educ. 10, 2210461 (2023).

    Article 

    Google Scholar 

  • Karakas, A. In Transforming the Language Teaching Experience in the Age of AI 215–233 (IGI Global, 2023).

  • Michel-Villarreal, R., Vilalta-Perdomo, E., Salinas-Navarro, D. E., Thierry-Aguilera, R. & Gerardou, F. S. Challenges and opportunities of generative AI for higher education as explained by ChatGPT. Educ. Sci. 13, 856 (2023).

    Article 

    Google Scholar 

  • Kaplan-Rakowski, R., Grotewold, K., Hartwick, P. & Papin, K. Generative AI and teachers’ perspectives on its implementation in education. J. Interact. Learn. Res. 34, 313–338 (2023).

    Google Scholar 

  • Ahmad, T. Scenario based approach to re-imagining future of higher education which prepares students for the future of work. High. Educ. Skills Work-Based Learn. 10, 217–238 (2020).

    Article 

    Google Scholar 

  • Wang, T. et al. Exploring the potential impact of artificial intelligence (AI) on international students in higher education: generative AI, chatbots, analytics, and international student success. Appl. Sci. 13, 6716 (2023).

    Article 
    CAS 

    Google Scholar 

  • Aithal, P. & Aithal, S. Application of ChatGPT in higher education and Research–A futuristic analysis. Int. J. Appl. Eng. Manage. Lett. (IJAEML). 7, 168–194 (2023).

    Article 

    Google Scholar 

  • Ullah, R., Ismail, H. B., Khan, M. T. I. & Zeb, A. Nexus between chat GPT usage dimensions and investment decisions making in Pakistan: moderating role of financial literacy. Technol. Soc. 76, 102454 (2024).

    Article 

    Google Scholar 

  • Zeb, A., Ullah, R. & Karim, R. Exploring the role of ChatGPT in higher education: opportunities, challenges and ethical considerations. Int. J. Inform. Learn. Technol. 41, 99–111. (2024).

    Article 

    Google Scholar 

  • Casheekar, A., Lahiri, A., Rath, K., Prabhakar, K. S. & Srinivasan, K. A contemporary review on chatbots, AI-powered virtual conversational agents, ChatGPT: applications, open challenges and future research directions. Comput. Sci. Rev. 52, 100632 (2024).

    Article 

    Google Scholar 

  • Hua, S., Jin, S. & Jiang, S. The limitations and ethical considerations of Chatgpt. Data Intell. 6, 201–239 (2024).

    Article 

    Google Scholar 

  • Sun, Y., Sheng, D., Zhou, Z. & Wu, Y. AI hallucination: towards a comprehensive classification of distorted information in artificial intelligence-generated content. Humanit. Social Sci. Commun. 11, 1–14 (2024).

    Article 

    Google Scholar 

  • Petrič, G. Everyone talks everything with ChatGPT: students’ uses of ChatGPT and their impact on learning performance. Int. J. Technol. Hum. Interact. (IJTHI). 20, 1–22 (2024).

    Article 

    Google Scholar 

  • Dillon, A. et al. The use of large Language model tools such as ChatGPT in academic writing in english medium education postgraduate programs: A grounded theory approach. J. Educators Online. 21, n2 (2024).

    Article 

    Google Scholar 

  • Rasul, T. et al. The role of ChatGPT in higher education: benefits, challenges, and future research directions. J. Appl. Learn. Teach. 6, 41–56 (2023).

    Google Scholar 

  • Shloul, A. T. et al. Role of activity-based learning and ChatGPT on students’ performance in education. Comput. Educ. Artif. Intell., 100219 (2024).

  • Dahri, N. A. et al. Investigating AI-based academic support acceptance and its impact on students’ performance in Malaysian and Pakistani higher education institutions. Educ. Inform. Technol., 1–50 (2024).

  • Shah, M. H. A., Ali, Z. & Shah, A. Challenging factors towards the effective use of ChatGPT in education in Province Sindh, Pakistan: application of TAM model. Int. J. Acad. Res. Humanit. 4, 86–94 (2024).

    Google Scholar 

  • Amjad, A. I., Aslam, S. & Tabassum, U. Tech-infused classrooms: A comprehensive study on the interplay of mobile learning, ChatGPT and social media in academic attainment. Eur. J. Educ. 59, e12625 (2024).

    Article 

    Google Scholar 

  • Davis, F. D. A Technology Acceptance Model for Testing New End-User Information Systems: Theory and Results 291 thesis, Cambridge, (1986).

  • Sorce, J. & Issa, R. R. Extended technology acceptance model (TAM) for adoption of information and communications technology (ICT) in the US construction industry. J. Inform. Technol. Constr. 26 (2021).

  • Isaac, O., Abdullah, Z., Ramayah, T. & Mutahar, A. M. Internet usage within government institutions in Yemen: an extended technology acceptance model (TAM) with internet self-efficacy and performance impact. Sci. Int. 29, 737–747 (2017).

    Google Scholar 

  • Sharma, S. & Yadav, R. Chat GPT–A technological remedy or challenge for education system. Global J. Enterp. Inform. Syst. 14, 46–51 (2022).

    Google Scholar 

  • Abuhassna, H. et al. Development of a new model on utilizing online learning platforms to improve students’ academic achievements and satisfaction. Int. J. Educational Technol. High. Educ. 17, 1–23 (2020).

    Article 

    Google Scholar 

  • Huang, J. & Li, S. Opportunities and challenges in the application of ChatGPT in foreign Language teaching. Int. J. Educ. Social Sci. Res. 6, 75–89 (2023).

    Article 

    Google Scholar 

  • Aldossari, M. Q. & Sidorova, A. Consumer acceptance of internet of things (IoT): smart home context. J. Comput. Inform. Syst. 60, 507–517 (2020).

    Google Scholar 

  • Phan, T. N., Ho, T. V. & Le-Hoang, P. V. Factors affecting the behavioral intention and behavior of using E–Wallets of youth in Vietnam. J. Asian Finance Econ. Bus. (JAFEB). 7, 295–302 (2020).

    Article 

    Google Scholar 

  • Chao, C. M. Factors determining the behavioral intention to use mobile learning: an application and extension of the UTAUT model. Front. Psychol. 10, 1652 (2019).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Alshahrani, A. The impact of ChatGPT on blended learning: current trends and future research directions. Int. J. Data Netw. Sci. 7, 2029–2040 (2023).

    Article 

    Google Scholar 

  • Al-Yaqoobi, N. S. S. & Tan, M. I. B. I. The technology acceptance model theory and unified theory of acceptance and use of technology (UTAUT). IJASOS-International E-J. Adv. Social Sci. 7, 645–653 (2021).

    Google Scholar 

  • Rane, N. L., Choudhary, S. P., Tawde, A. & Rane, J. ChatGPT is not capable of serving as an author: ethical concerns and challenges of large Language models in education. Int. Res. J. Modernization Eng. Technol. Sci. 5, 851–874 (2023).

    Google Scholar 

  • Bower, M., DeWitt, D. & Lai, J. W. Reasons associated with preservice teachers’ intention to use immersive virtual reality in education. Br. J. Edu. Technol. 51, 2215–2233 (2020).

    Article 

    Google Scholar 

  • Yilmaz, H., Maxutov, S., Baitekov, A. & Balta, N. Student attitudes towards chat GPT: A technology acceptance model survey. Int. Educational Rev. 1, 57–83 (2023).

    Article 

    Google Scholar 

  • Chang, Y. W., Hsu, P. Y., Chen, J., Shiau, W. L. & Xu, N. Utilitarian and/or hedonic shopping–consumer motivation to purchase in smart stores. Industrial Manage. Data Syst. 123, 821–842 (2023).

    Article 

    Google Scholar 

  • Ma, X. & Huo, Y. Are users willing to embrace ChatGPT? Exploring the factors on the acceptance of chatbots from the perspective of AIDUA framework. Technol. Soc. 75, 102362 (2023).

    Article 

    Google Scholar 

  • Junior, W. G., Marasco, E., Kim, B., Behjat, L. & Eggermont, M. How ChatGPT can inspire and improve serious board game design. Int. J. Serious Games. 10, 33–54 (2023).

    Article 

    Google Scholar 

  • Al-Abdullatif, A. M. Modeling students’ perceptions of chatbots in learning: integrating technology acceptance with the Value-Based adoption model. Educ. Sci. 13, 1151 (2023).

    Article 

    Google Scholar 

  • Iandoli, L. Annual review Article: the dual mindset of design-driven entrepreneurship: the case for a pedagogy of making and artefact-centred entrepreneurship education. Int. Small Bus. J. 41, 349–370 (2023).

    Article 

    Google Scholar 

  • Jo, H. Understanding AI tool engagement: A study of ChatGPT usage and word-of-mouth among university students and office workers. Telematics Inform. 85, 102067 (2023).

    Article 

    Google Scholar 

  • Gundu, T. in International Symposium on Human Aspects of Information Security and Assurance. 418–431 (Springer).

  • De Guinea, A. O. & Markus, M. L. Why break the habit of a lifetime? Rethinking the roles of intention, habit, and emotion in continuing information technology use. MIS Q., 433–444 (2009).

  • Butarbutar, R., Ruing, F. H., Basri, N., Tuharea, V. U. & Leba, S. M. R. Unpacking online collaborative learning in teaching EFL speaking: insights from three rural area case studies. Qualitative Rep. 28, 3379–3401 (2023).

    Google Scholar 

  • Muftić, F., Kadunić, M., Mušinbegović, A. & Abd Almisreb, A. Exploring medical breakthroughs: A systematic review of ChatGPT applications in healthcare. Southeast. Europe J. Soft Comput. 12, 13–41 (2023).

    Google Scholar 

  • Yu, H. Reflection on whether chat GPT should be banned by academia from the perspective of education and teaching. Front. Psychol. 14, 1181712 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Kumar Sharma, A. & Sharma, R. The role of generative pre-trained Transformers (GPTs) in revolutionising digital marketing: A conceptual model. J. Cult. Mark. Strategy. 8, 80–92 (2023).

    Article 

    Google Scholar 

  • Ajzen, I. The theory of planned behavior: frequently asked questions. Hum. Behav. Emerg. Technol. 2, 314–324 (2020).

    Article 

    Google Scholar 

  • Saif, N. et al. Chat-GPT; validating technology acceptance model (TAM) in education sector via ubiquitous learning mechanism. Comput. Hum. Behav., 108097 (2023).

  • Tayan, O., Hassan, A., Khankan, K. & Askool, S. Considerations for adapting higher education technology courses for AI large Language models: A critical review of the impact of ChatGPT. Mach. Learn. Appl., 100513 (2023).

  • Aithal, P. & Aithal, S. Optimizing the use of artificial intelligence-powered Gpts as teaching and research assistants by professors in higher education institutions: a study on smart utilization. Int. J. Manage. Technol. Social Sci. 8, 368–401 (2023).

    Google Scholar 

  • Exintaris, B., Karunaratne, N. & Yuriev, E. Metacognition and critical thinking: using ChatGPT-Generated responses as prompts for critique in a problem-solving workshop (SMARTCHEMPer). J. Chem. Educ. 100, 2972–2980 (2023).

    Article 
    CAS 

    Google Scholar 

  • Tsai, M. L., Ong, C. W. & Chen, C. L. Exploring the use of large Language models (LLMs) in chemical engineering education: Building core course problem models with Chat-GPT. Educ. Chem. Eng. 44, 71–95 (2023).

    Article 

    Google Scholar 

  • Jacobi, L. The structure of discussions in an online communication course: what do students find most effective? J. Univ. Teach. Learn. Pract. 14, 11 (2017).

    Google Scholar 

  • Stephenson, N. S. & Sadler-McKnight, N. P. Developing critical thinking skills using the science writing heuristic in the chemistry laboratory. Chem. Educ. Res. Pract. 17, 72–79 (2016).

    Article 

    Google Scholar 

  • Adarkwah, M. A., Ying, C., Mustafa, M. Y. & Huang, R. in International Conference on Smart Learning Environments. 117–126 (Springer).

  • Lian, Y., Tang, H., Xiang, M. & Dong, X. Public attitudes and sentiments toward ChatGPT in China: A text mining analysis based on social media. Technol. Soc. 76, 102442 (2024).

    Article 

    Google Scholar 

  • Quintana, C. et al. In Scaffolding 337–386 ( Psychology Press, 2018).

  • Song, C. & Song, Y. Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted Language learning for EFL students. Front. Psychol. 14 (2023).

  • Huallpa, J. J. Exploring the ethical considerations of using chat GPT in university education. Periodicals Eng. Nat. Sci. 11, 105–115 (2023).

    Article 

    Google Scholar 

  • Ali, A. Exploring the transformative potential of technology in overcoming educational disparities. Int. J. Multidisciplinary Sci. Arts 2 (2023).

  • Foroughi, B. et al. Determinants of intention to use ChatGPT for educational purposes: findings from PLS-SEM and FsQCA. Int. J. Human–Computer Interact. 40, 4501–4520 (2024).

    Article 

    Google Scholar 

  • Dash, G. & Paul, J. CB-SEM vs PLS-SEM methods for research in social sciences and technology forecasting. Technol. Forecast. Soc. Chang. 173, 121092 (2021).

    Article 

    Google Scholar 

  • Ma, L., Yao, H. & Hou, J. Exploring the relationship between supervisor support and anxiety of graduate students in China: the mediating role of scientific research efficacy. Asia-Pacific Educ. Researcher. 33, 321–329 (2024).

    Article 

    Google Scholar 

  • Zeb, A., Gan, G. G. G., Wei, O. J. & Karim, R. Examining the nexus between situational factors and job performance through the mediating role of work engagement and self-efficacy. J. Public. Affairs. 24, e2915 (2024).

    Article 

    Google Scholar 

  • Ashraf, M. A., Sahar, N., Kamran, M. & Alam, J. Impact of self-efficacy and perfectionism on academic procrastination among university students in Pakistan. Behav. Sci. 13, 537 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Hafaiedh, A. B. Research ethics for social scientists: between ethical conduct and regulatory compliance by mark Israel and lain hay. Int. Social Sci. J. 60, 467–472. (2009).

    Article 

    Google Scholar 

  • Saunders, M., Lewis, P. & Thornhill, A. Research methods for business students eight edition. Qual. Mark. Res. Int. J. (2019).

  • Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M. & Thiele, K. O. Mirror, mirror on the wall: a comparative evaluation of composite-based structural equation modeling methods. J. Acad. Mark. Sci. 45, 616–632 (2017).

    Article 

    Google Scholar 

  • Zuo, H., Zeb, A. & Ismail, F. & Bin Othayman, M. Transformational leadership: enhancing corporate entrepreneurship for fostering competitiveness. J. Competitiveness 16 (2024).

  • Mah, W. L., Ali, N. A. & Zawawi, D. Assessing validity of sources of innovation, innovation and firm performance for variance-based structural equation modelling. Int. J. Acc. 3, 71–87 (2018).

    Google Scholar 

  • Saif, N. et al. Chat-GPT; validating technology acceptance model (TAM) in education sector via ubiquitous learning mechanism. Comput. Hum. Behav. 154, 108097 (2024).

    Article 

    Google Scholar 

  • Song, C. & Song, Y. Enhancing academic writing skills and motivation: assessing the efficacy of ChatGPT in AI-assisted Language learning for EFL students. Front. Psychol. 14, 1260843 (2023).

    Article 
    PubMed 
    PubMed Central 

    Google Scholar 

  • Zeb, A., Rehman, F. U., Bin Othayman, M. & Rabnawaz, M. Artificial intelligence and ChatGPT are fostering knowledge sharing, ethics, academia and libraries. Int. J. Inform. Learn. Technol. 42(1), 67–83 (2025).

    Article 

    Google Scholar 

  • link