Usability Evaluation of Virtual Reality Metaverse Lab Using Usability Testing With the User-Centered Design Approach
Abstract
Advances in educational technology have introduced immersive tools such as Virtual Reality (VR) to support complex learning, especially in abstract fields like chemistry. Metaverselab was developed to provide a safe virtual environment for conducting laboratory experiments, yet early implementation revealed substantial usability issues. Students experienced difficulties with the interface, confusion in navigation, and insufficient guidance, which affected the overall learning experience. This study aims to evaluate and improve the usability and user experience of the Metaverselab platform using a User-Centered Design (UCD) approach. The research applied an iterative process involving 40 student respondents and used two standardized instruments: the System Usability Scale (SUS) and the User Experience Questionnaire (UEQ). Both instruments were administered during the initial and final evaluation stages to measure changes in usability and user experience after improvements were introduced. Initial results showed low usability, with an average SUS score of 50.81 and UEQ benchmark values categorized as “Bad” in all dimensions. Based on these findings, specific user requirements were identified and translated into targeted design solutions. Key improvements included an interactive tutorial for first-time users, descriptive information pop-ups for laboratory tools, and undo–redo functions to support error recovery during experiments. Post-implementation testing demonstrated substantial improvement. The average SUS score increased by 44.16% to 73.25, placing the system in the “Good” usability category. UEQ results also improved significantly, with the Efficiency dimension rated “Excellent,” while Attractiveness, Perspicuity, and Stimulation were rated “Good.” These results confirm that the UCD approach effectively identifies user needs and produces design interventions that enhance the usability, efficiency, and overall learning experience of virtual educational platforms.
Keywords
References
I. N. T. A. Putra, A. Yuniarti, H. Fabroyir, and I. P. B. G. P. Raharja, “Transformer Performance Evaluation in 3D Reconstruction of Balinese Mask Wood Carving,” in 2024 International Seminar on Intelligent Technology and Its Applications (ISITIA), 2024, pp. 285–289.
I. N. T. A. Putra, K. S. Kartini, P. S. U. Putra, I. N. W. Adnyana, and N. K. N. N. Pande, “Design and Development of Interactive Media Application Based on Android Case Study of Hydrocarbon Chemical Lesson Materials,” in 2021 6th International Conference on New Media Studies (CONMEDIA), IEEE, 2021, pp. 113–117.
Y. Zhang and K. Choi, “Game Flow and Attitude in Computer-Based Business Simulations: Implications For Management Education,” Journal of Applied Learning & Teaching, vol. 8, no. 2, Jul. 2025, doi: 10.37074/jalt.2025.8.2.8.
L. Amaral, J. Santos, F. Soares, J. Felix, L. Cardoso, and T. H. Nascimento, “Interactive Educational Game for Chemistry in Virtual Reality with User Gesture Interactions via Smartwatches,” in Proceedings of the 26th Symposium on Virtual and Augmented Reality, 2024, pp. 294–298.
I. N. T. A. Putra, A. Yuniarti, and H. Fabroyir, “BaliMask3D Dataset for 3D Completion and Reconstruction of Traditional Balinese Masks,” Sci Data, vol. 12, no. 1, p. 1233, 2025.
A. Agfary, M. Muhallim, and S. Paembonan, “Augmented Reality Media Pembelajaran Reproduksi Tumbuhan Pada Siswa Kelas IX Sekolah Menengah Pertama (SMP) di SMP Negeri 8 Kota Palopo,” Jurnal Informatika dan Teknik Elektro Terapan, vol. 13, no. 1, 2025.
E. Ay Kaya and C. Yang?n Ersanl?, “Metaverse Effect: Exploring Students’ Vocabulary Achievement, Retention, and Perceptions in Virtual Environments,” Journal of Metaverse, vol. 5, no. 2, pp. 92–103, Apr. 2025, doi: 10.57019/jmv.1557771.
K. S. Kartini, I. M. M. Yusa, I. N. W. Adnyana, and I. N. T. A. Putra, “Impact of Augmented Reality on High School Students’ Motivation and Understanding of Acid-Base Titration Concepts,” Edelweiss Applied Science and Technology, vol. 8, no. 6, pp. 7559–7569, 2024.
A. S. D. Martha, S. Widowati, D. P. Rahayu, M. I. Nursyawal, and R. R. Hariz, “Examining Usability and Student Experience of ChatGPT as a Learning Tool on Moodle in Higher Education,” in 2024 International Conference on Information Technology Systems and Innovation (ICITSI), IEEE, 2024, pp. 8–13.
B. Sousa, M. Marques, and L. Pombo, “EDUCITY app user experience: School students’ perspective using UEQ,” in EDULEARN24 Proceedings, IATED, 2024, pp. 3392–3401.
R. Siregar, A. Nasikun, and R. Ferdiana, “Immersive Virtual Reality-based Serious Game for Fire Drill Education,” in 2024 16th International Conference on Information Technology and Electrical Engineering (ICITEE), IEEE, 2024, pp. 358–363.
P. Acevedo, A. J. Magana, B. Benes, and C. Mousas, “A Systematic Review of Immersive Virtual Reality in STEM Education: Advantages and Disadvantages on Learning and User Experience,” IEEE Access, vol. 12, pp. 189359–189386, 2024, doi: 10.1109/ACCESS.2024.3489233.
R. Afandi and H. B. Santoso, “Improving the Usability and User Experience of a Ticketing and Knowledge Base Web Application: A Case Study of the ESDM 136 Contact Center,” The Indonesian Journal of Computer Science, vol. 14, no. 1, 2025.
F. A. F. Illahi, K. A. Laksitowening, and R. Nurtantyana, “User-Centered Design Approach in Mobile AR: Application for Hydrocarbon Visualization in Chemistry Course,” JURNAL INFOTEL, vol. 17, no. 1, pp. 38–53, 2025.
C. S. Chew, M. N. S. Zafarin, N. H. M. Zain, R. Aminuddin, T. G. Tan, and K. O. Chin, “Transforming Secondary School Chemistry Learning with Virtual Reality,” in 2024 IEEE 22nd Student Conference on Research and Development (SCOReD), IEEE, 2024, pp. 482–487.
R. van Dinther, L. de Putter, and B. Pepin, “Features of Immersive Virtual Reality to Support Meaningful Chemistry Education,” J Chem Educ, vol. 100, no. 4, pp. 1537–1546, 2023.
C.-H. Wang, “Education in the Metaverse: Developing Virtual Reality Teaching Materials for K–12 Natural Science,” Educ Inf Technol (Dordr), vol. 30, no. 7, pp. 8637–8658, 2025.
E. Zilles Borba, A. G. Corrêa, R. de Deus Lopes, and M. Zuffo, “Usability in Virtual Reality: Evaluating User Experience With Interactive Archaeometry Tools in Digital Simulations,” Multimed Tools Appl, vol. 79, no. 5, pp. 3425–3447, 2020.
F. Tzortzoglou, S. Vosinakis, A. Gardeli, and A. Sofos, “Interaction Design in Mobile Augmented Reality for Education: Insights from a Systematic Review,” in Proceedings of the 3rd International Conference of the ACM Greek SIGCHI Chapter, 2025, pp. 212–221.
M. S. van de Warenburg, C. Kamphuis, S. Hummelink, D. J. O. Ulrich, and M. L. A. W. Vehmeijer-Heeman, “Augmented Reality for Medical Education in the Primary Survey of Burns: an Exploratory Study,” Injury, p. 112747, 2025.
A. Mirabdolah, M. Alaeifard, and A. Marandi, “User-Centered Design in HCl: Enhancing Ssability and Interaction in Complex Systems,” International Journal of Advanced Human Computer Interaction, vol. 1, no. 1, pp. 16–33, 2023.
B. Laugwitz, T. Held, and M. Schrepp, “Construction and evaluation of a user experience questionnaire,” in Symposium of the Austrian HCI and usability engineering group, Springer, 2008, pp. 63–76.
S. Gelbvaks, C. D. A. Bersot, and J. E. G. Pereira, “Usability and Educational Potential of a Virtual Reality Software for Training in a Target-Controlled Infusion Pump Handling: a Pilot Study,” Perioperative Anesthesia Reports, vol. 3, p. 0, 2025.
ISO 9241-210, Ergonomics of Human-System interaction-Part 210: Human-Centred Design for Interactive Systems (ISO 9241-210: 2010). ISO, 2010.
Q. Mao, P.-L. Teh, S. J. Wang, and H. Wang, “Freedom to Personalize Walking Aids: a User-Centric Design Framework for Age-Friendly Smart Canes,” Int J Hum Comput Interact, pp. 1–16, 2025.
M. L. Wong, C. W. Khong, and H. Thwaites, “Applied UX and UCD Design Process in Interface Design,” Procedia-Social and Behavioral Sciences, vol. 51, pp. 703–708, 2012.
H. Maulana, D. C. Kurniasari, L. S. P. Wardhani, T. S. Mustofa, and E. A. Sutrisni, “Implementation of Design Thinking in Designing UPN Wellness & Youth Support Applications for Student Mental Health,” Nusantara Science and Technology Proceedings, pp. 831–842, 2025.
A. Bianco, P. Farrugia, and N. Sammut Bartolo, “Bridging Human-Centred Design and Engineering Education: a Case Study of Pharmaceutical Packaging for the Elderly,” 2025.
O. Zechner, H. Schrom-Feiertag, R. Wespi, D. Pretolesi, Q. Nguyen, and M. Tscheligi, “Enhancing Mixed Reality Simulation Training Technology With Real-Time Performance Visualization: Mixed Methods Study With Medical First Responders,” JMIR XR and Spatial Computing (JMXR), vol. 1, no. 1, p. e57655, 2024.
E. Salinas, R. Cueva, and F. Paz, “A Systematic Review of User-Centered Design Techniques,” in International Conference on Human-Computer Interaction, Springer, 2020, pp. 253–267.
S. Litwin, M. Mohabir, I. S. Kocak, and D. Singh, “Creating a Parent-Informed Pediatric Emergency Department Wait Time App: Human-Centered Design Approach to Creating an AI Health Care Tool,” J Particip Med, vol. 17, p. e66644, 2025.
Y. Choi, P. Thamjamrassri, Y. Yoon, and H.-J. Kong, “Usability of Virtual Reality Based Bathroom Safety Education System for Dementia Caregiver: A Nielsen Heuristics Approach,” Stud Health Technol Inform, vol. 329, pp. 2006–2007, 2025.
M. Schrepp, “User experience questionnaire handbook,” All you need to know to apply the UEQ successfully in your project, vol. 10, 2015.
S. Singh and A. Kaur, “Relative Assessment of Traditional and Cloud Enabled Augmented Reality Applications for Chemistry Teaching and Learning Practices,” SN Comput Sci, vol. 6, no. 3, pp. 1–15, 2025.
G. W. Young, S. Stehle, B. Y. Walsh, and E. Tiri, “Exploring Virtual Reality in the Higher Education Classroom: Using VR to Build Knowledge and Understanding,” Journal of Universal Computer Science, no. 8, pp. 904–928, 2020.
L. W. Ward, D. Spencer, D. Chauhan, and M. Oliver-Hoyo, “Lessons Learned: the Use of an Augmented Reality Application in Organic Chemistry Laboratories,” in Frontiers in Education, Frontiers Media SA, 2024, p. 1384129.
F. Bruni, V. Mancuso, and E. Pedroli, “How to Evaluate User Experience in Digital Health? A Scoping Review of Questionnaires in Virtual Reality Applications,” Front Digit Health, vol. 7, p. 1561364, 2025.
A. Somrak, M. Poga?nik, and J. Guna, “Suitability and Comparison of Questionnaires Assessing Virtual Reality-Induced Symptoms and Effects and User Experience in Virtual Environments,” Sensors, vol. 21, no. 4, p. 1185, 2021.
L. Emma, “User-Centered Design to Enhance Accessibility and Usability in Digital Systems,” no. December, 2024.
A. K. Darmawan, M. A. Hamzah, B. Bakir, M. Walid, A. Anwari, and I. Santosa, “Exploring Usability Dimension of Smart Regency Service With Indonesian Adaptation of The System Usability Scale (SUS) and User Experience Questionnaire (UEQ),” in 2021 International Conference on Computer Science, Information Technology, and Electrical Engineering (ICOMITEE), IEEE, 2021, pp. 74–79.
A. N. Darmawan, A. Faroqi, and A. Pratama, “Evaluation of Student UX on E-Learning Web Using User Experience Questionnaire (UEQ),” bit-Tech, vol. 8, no. 1, pp. 1120–1130, 2025.
DOI: https://doi.org/10.52088/ijesty.v5i4.1497
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 Ketut Sepdyana Kartini, I Made Marthana Yusa, I Nyoman Widhi Adnyana, I Nyoman Tri Anindia Putra
The works in the IJESTY Journal are licensed under a Creative Commons Attribution 4.0 International Public License (CC BY 4.0).