Article Open Access

Integration of Artificial Intelligence in Academic Research: To What Extent Do Students' Knowledge, Understanding, and Use Depend on Technology?

Tuti Iriani, Nur Azisah, Yusrina Luthfiana, Bimo Nugroho

Abstract


The development of artificial intelligence (AI) technology has had a significant impact on higher education. This study aims to assess the level of knowledge, understanding, and use of AI among students in the context of final project preparation. This study uses a quantitative descriptive approach to measure three main dimensions—knowledge, understanding, and practical use (application) in the context of academic research. The population in this study consisted of 172 students from the Faculty of Engineering, Universitas Negeri Jakarta, who were conducting academic research. The sampling technique employed was non-probability sampling, utilizing a purposive sampling approach. Data analysis used exploratory factor analysis (EFA). The results showed that students have excellent knowledge of AI. Meanwhile, the understanding of AI shows varying levels, with the majority falling into the sufficient and low categories, indicating a need to improve AI literacy. The use of AI by students is primarily focused on aspects of writing, research, and document creation, with a reasonably consistent usage pattern and an average duration of 1-2 hours per session. These findings confirm that students actively utilize various AI in the academic process, but still require training and supervision to ensure that AI use can be carried out ethically and responsibly. The results of this study are important as a basis for developing institutional policies and ethical regulations related to the integration of AI into academic processes, as well as a reference for designing effective training programs to improve students' competency in optimally utilizing AI technology.

Keywords


Artificial Intelligence, Knowledge, Understanding, Usage, Final Project

References


X. Chen and S. Feng, “Analyzing Students’ Information Behavior in Generative AI-Supported Small Group Discussions,” in Proceedings of the Eleventh ACM Conference on Learning @ Scale, New York, NY, USA: ACM, Jul. 2024, pp. 325–329. doi: 10.1145/3657604.3664657.

J. A. B. Parra, Á. E. S. Escobar, and A. P. P. Martínez, “Artificial Intelligence in Education: Benefits, Challenges, and Ethical Considerations According to Scientific Evidence,” J. Cris. Risk Commun., vol. 7, no. S5, pp. 48–65, 2024, doi: 10.63278/jicrcr.vi.606.

J. Huang, S. Saleh, and Y. Liu, “A Review on Artificial Intelligence in Education,” Acad. J. Interdiscip. Stud., vol. 10, no. 3, p. 206, May 2021, doi: 10.36941/ajis-2021-0077.

G. Dishon, “New data, old tensions: Big data, personalized learning, and the challenges of progressive education,” Theory Res. Educ., vol. 15, no. 3, pp. 272–289, Nov. 2017, doi: 10.1177/1477878517735233.

A. J. Bingham, J. F. Pane, E. D. Steiner, and L. S. Hamilton, “Ahead of the Curve: Implementation Challenges in Personalized Learning School Models,” Educ. Policy, vol. 32, no. 3, pp. 454–489, May 2018, doi: 10.1177/0895904816637688.

H. H. S. Ip et al., “Design and Evaluate Immersive Learning Experience for Massive Open Online Courses (MOOCs),” IEEE Trans. Learn. Technol., vol. 12, no. 4, pp. 503–515, Oct. 2019, doi: 10.1109/TLT.2018.2878700.

G. Quer, E. D. Muse, N. Nikzad, E. J. Topol, and S. R. Steinhubl, “Augmenting diagnostic vision with AI.,” Lancet (London, England), vol. 390, no. 10091, p. 221, Jul. 2017, doi: 10.1016/S0140-6736(17)31764-6.

S.-H. Kong et al., “Guest Editorial Introduction to the Special Issue on Intelligent Transportation Systems Empowered by AI Technologies,” IEEE Trans. Intell. Transp. Syst., vol. 20, no. 10, pp. 3765–3770, Oct. 2019, doi: 10.1109/TITS.2019.2940856.

H. Hariaty, V. Elita, and A. Dilaluri, “Gambaran Stres pada Mahasiswa Tingkat Akhir yang Sedang Mengerjakan Skripsi,” J. Keperawatan Prof., vol. 11, no. 1, pp. 45–51, Feb. 2023, doi: 10.33650/jkp.v11i1.5539.

M. Khalifa and M. Albadawy, “Using artificial intelligence in academic writing and research: An essential productivity tool,” Comput. Methods Programs Biomed. Updat., vol. 5, p. 100145, 2024, doi: 10.1016/j.cmpbup.2024.100145.

L. Lukman, R. Agustina, and R. Aisy, “Problematika Penggunaan Artificial Intelligence (AI) untuk Pembelajaran di Kalangan Mahasiswa STIT Pemalang,” Madaniyah, vol. 13, no. 2, pp. 242–255, 2024, doi: 10.58410/madaniyah.v13i2.826.

A. Carobene, A. Padoan, F. Cabitza, G. Banfi, and M. Plebani, “Rising adoption of artificial intelligence in scientific publishing: evaluating the role, risks, and ethical implications in paper drafting and review process,” Clin. Chem. Lab. Med., vol. 62, no. 5, pp. 835–843, 2024, doi: 10.1515/cclm-2023-1136.

Oyelude, A. A. Artificial intelligence (AI) tools for academic research. Library Hi Tech News, 41(8), 18-20, 2024, https://doi.org/10.1108/LHTN-08-2024-0131

T. K. F. Chiu, “The impact of Generative AI (GenAI) on practices, policies and research direction in education: a case of ChatGPT and Midjourney,” Interact. Learn. Environ., vol. 32, no. 10, pp. 6187–6203, Nov. 2024, doi: 10.1080/10494820.2023.2253861.

R. Winkler and M. Soellner, “Unleashing the Potential of Chatbots in Education: A State-Of-The-Art Analysis,” Acad. Manag. Proc., vol. 2018, no. 1, p. 15903, Aug. 2018, doi: 10.5465/AMBPP.2018.15903abstract.

P. Gu, “Enhancing Educational Outcomes by Boosting Artificial Intelligence Application in Personalized Learning,” Sci. Insights Educ. Front., vol. 24, no. 1, pp. 3831–3833, Sep. 2024, doi: 10.15354/sief.24.co346.

M. Lan and X. Zhou, “A qualitative systematic review on AI empowered self-regulated learning in higher education,” npj Sci. Learn., vol. 10, no. 1, p. 21, May 2025, doi: 10.1038/s41539-025-00319-0.

C.-P. Dai, F. Ke, Y. Pan, J. Moon, and Z. Liu, “Effects of Artificial Intelligence-Powered Virtual Agents on Learning Outcomes in Computer-Based Simulations: A Meta-Analysis,” Educ. Psychol. Rev., vol. 36, no. 1, p. 31, Mar. 2024, doi: 10.1007/s10648-024-09855-4.

N. J. Kim and M. K. Kim, “Teacher’s Perceptions of Using an Artificial Intelligence-Based Educational Tool for Scientific Writing,” Front. Educ., vol. 7, Mar. 2022, doi: 10.3389/feduc.2022.755914.

K. Kim and K. Kwon, “A systematic review of the evaluation in K-12 artificial intelligence education from 2013 to 2022,” Interact. Learn. Environ., vol. 33, no. 1, pp. 103–131, Jan. 2025, doi: 10.1080/10494820.2024.2335499.

N. T. Huyen, N. P. Lien, and P. T. Thuy, “Challenges of AI in Education: A Systematic Review,” IOSR J. Res. Method Educ., vol. 15, no. 3, pp. 37–46, 2025, doi: 10.9790/7388-1503013746.

Y. Jin, L. Yan, V. Echeverria, D. Gaševi?, and R. Martinez-Maldonado, “Generative AI in higher education: A global perspective of institutional adoption policies and guidelines,” Comput. Educ. Artif. Intell., vol. 8, p. 100348, Jun. 2025, doi: 10.1016/j.caeai.2024.100348.

L. Casal-Otero, A. Catala, C. Fernández-Morante, M. Taboada, B. Cebreiro, and S. Barro, “AI literacy in K-12: a systematic literature review,” Int. J. STEM Educ., vol. 10, no. 1, p. 29, Apr. 2023, doi: 10.1186/s40594-023-00418-7.

H.-S. Kim, N. Y. Kim, and Y. Cha, “Is It Beneficial to Use AI Chatbots to Improve Learners’ Speaking Performance?,” J. Asiat., vol. 18, no. 1, pp. 161–178, Apr. 2021, doi: 10.18823/asiatefl.2021.18.1.10.161.

I. Khan, A. R. Ahmad, N. Jabeur, and M. N. Mahdi, “An artificial intelligence approach to monitor student performance and devise preventive measures,” Smart Learn. Environ., vol. 8, no. 1, p. 17, Dec. 2021, doi: 10.1186/s40561-021-00161-y.

F. Clarizia, F. Colace, M. Lombardi, F. Pascale, and D. Santaniello, “Chatbot: An Education Support System for Student,” in Cyberspace Safety and Security, A. Castiglione, F. Pop, M. Ficco, and F. Palmieri, Eds., Springer, 2018, pp. 291–302. doi: 10.1007/978-3-030-01689-0_23.

Labadze, L., Grigolia, M., & Machaidze, L. Role of AI chatbots in education: systematic literature review. International journal of Educational Technology in Higher education, 20(1), 56, 2023, https://doi.org/10.1186/s41239-024-00461-6

D. R. E. Cotton, P. A. Cotton, and J. R. Shipway, “Chatting and cheating: Ensuring academic integrity in the era of ChatGPT,” Innov. Educ. Teach. Int., vol. 61, no. 2, pp. 228–239, Mar. 2024, doi: 10.1080/14703297.2023.2190148.

P. H. Barber et al., “Disparities in Remote Learning Faced by First-Generation and Underrepresented Minority Students during COVID-19: Insights and Opportunities from a Remote Research Experience,” J. Microbiol. Biol. Educ., vol. 22, no. 1, Apr. 2021, doi: 10.1128/jmbe.v22i1.2457.

R. Luckin, “Towards artificial intelligence-based assessment systems,” Nat. Hum. Behav., vol. 1, no. 3, p. 0028, Mar. 2017, doi: 10.1038/s41562-016-0028.

Y.-Z. Hsieh et al., “ARCS-Assisted Teaching Robots Based on Anticipatory Computing and Emotional Big Data for Improving Sustainable Learning Efficiency and Motivation,” Sustainability, vol. 12, no. 14, p. 5605, Jul. 2020, doi: 10.3390/su12145605.

D. Rooein, “Data-driven EDU chatbots,” in Companion proceedings of the 2019 world wide web conference, 2019, pp. 46–49.

Hwang, G. J., & Chang, C. Y. A review of opportunities and challenges of chatbots in education. Interactive Learning Environments, 31(7), 4099-4112, 2021, https://doi.org/10.1080/10494820.2021.1952615

H. F. Kaiser, “An Index of Factorial Simplicity,” Psychometrika, vol. 39, no. 1, pp. 31–36, Mar. 1974, doi: 10.1007/BF02291575.

J. C. Nunnally, “An Overview of Psychological Measurement,” in Clinical Diagnosis of Mental Disorders, Boston, MA: Springer US, 1978, pp. 97–146. doi: 10.1007/978-1-4684-2490-4_4.

J. M. Cortina, “What is coefficient alpha? An examination of theory and applications.,” J. Appl. Psychol., vol. 78, no. 1, pp. 98–104, Feb. 1993, doi: 10.1037/0021-9010.78.1.98.

A. Pigola, I. C. Scafuto, P. R. da Costa, and V. M. J. Nassif, “Artificial Intelligence in Academic Research,” Int. J. Innov., vol. 11, no. 3, pp. 01–09, 2023, doi: 10.5585/2023.24508.

F. Al Mahmud, “Investigating EFL Students’ Writing Skills Through Artificial Intelligence: Wordtune Application as a Tool,” J. Lang. Teach. Res., vol. 14, no. 5, pp. 1395–1404, Sep. 2023, doi: 10.17507/jltr.1405.28.

M. Musib et al., “Artificial intelligence in research,” Science (80-. )., vol. 357, no. 6346, pp. 28–30, Jul. 2017, doi: 10.1126/science.357.6346.28.

B. Burger, D. K. Kanbach, S. Kraus, M. Breier, and V. Corvello, “On the use of AI-based tools like ChatGPT to support management research,” Eur. J. Innov. Manag., vol. 26, no. 7, pp. 233–241, Dec. 2023, doi: 10.1108/EJIM-02-2023-0156.

A. Wibowo and I. Faridah, “Integration of Artificial Intelligence in Completing Final Projects as a Form of Student Independence and Creativity,” J. Intelekt. J. Pendidik. dan Stud. Keislam., vol. 14, no. 3, pp. 449–466, Dec. 2024, doi: 10.33367/ji.v14i3.6453.

K. Seo, J. Tang, I. Roll, S. Fels, and D. Yoon, “The impact of artificial intelligence on learner–instructor interaction in online learning,” Int. J. Educ. Technol. High. Educ., vol. 18, no. 1, p. 54, Dec. 2021, doi: 10.1186/s41239-021-00292-9.

I. A. Rizki et al., “Cooperative model, digital game, and augmented reality-based learning to enhance students critical thinking skills and learning motivation,” J. Pedagog. Res., vol. 8, no. 1, pp. 339–355, Feb. 2024, doi: 10.33902/JPR.202423825.

G. A. Manu, J. Enstein, D. Y. . Fallo, Y. A. Benufinit, M. M. B. Sogen, and K. J. Taku Neno, “Pendidikan dan Kecerdasan Buatan: Workshop Penerapan Chat GPT dan Text to Speech Prosa.ai untuk Meningkatkan Keterampilan Dosen di Nusa Tenggara Timur,” Pengabdi. Masy. Ilmu Pendidik., vol. 3, no. 2, pp. 16–21, 2023, doi: 10.37792/pemimpin.v3i2.986.

L. Z. Asril and V. Fathira, “Utilization of Artificial Intelligence (AI) in Completing Final Project at University Level,” Lect. J. Pendidik., vol. 16, no. 1, pp. 254–265, Feb. 2025, doi: 10.31849/lectura.v16i1.25698.

L. Chen, P. Chen, and Z. Lin, “Artificial Intelligence in Education: A Review,” IEEE Access, vol. 8, pp. 75264–75278, 2020, doi: 10.1109/ACCESS.2020.2988510.

S. D. Sulistyaningrum, “Utilizing Online Paraphrasing Tools to Overcome Students’ Paraphrasing Difficulties in Literature Reviews,” J. English Lang. Stud., vol. 6, no. 2, p. 229, Sep. 2021, doi: 10.30870/jels.v6i2.11582.

A. Puspa, D. B. Saputra, and L. Haryana, “The Use of Google Translate in EFL Essay Writing: Is It a Cheating?,” ENGLISH Fr. Acad. J. English Lang. Educ., vol. 7, no. 1, p. 47, May 2023, doi: 10.29240/ef.v7i1.6868.

A. Abbas, “Analisis Survey Penggunaan Artificial Intelligence (AI) dalam Penulisan Tugas Akhir Karya Tulis Ilmiah (TA-KTI) di Kampus Akademi Ilmu Komputer (AIKOM) Ternate, Maluku Utara, Indonesia,” Pros. Semin. Nas. Univ. Muhammadiyah Bone, vol. 1, no. 1, pp. 93–96, 2023, doi: https://doi.org/10.56983/prosidingkemahasiswaan.v1i1.1461.

Z. Slimi, “The Impact of Artificial Intelligence on Higher Education: An Empirical Study,” Eur. J. Educ. Sci., vol. 10, no. 1, Mar. 2023, doi: 10.19044/ejes.v10no1a17.

S. Zulfikasari, B. Sulistio, and W. Aprilianasari, “Utilization of Chat GPT Artificial Intelligence (AI) in Student’s Learning Experience Gen-Z Class,” Lect. J. Pendidik., vol. 15, no. 1, pp. 259–272, Feb. 2024, doi: 10.31849/lectura.v15i1.18840.

R. Marrone, V. Taddeo, and G. Hill, “Creativity and Artificial Intelligence—A Student Perspective,” J. Intell., vol. 10, no. 3, p. 65, Sep. 2022, doi: 10.3390/jintelligence10030065.




DOI: https://doi.org/10.52088/ijesty.v5i4.1515

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Tuti Iriani, Nur Azisah, Yusrina Luthfiana, Bimo Nugroho

International Journal of Engineering, Science, and Information Technology (IJESTY) eISSN 2775-2674