Article Open Access

Multiperson Automated Attendance System Based on Face Recognition Using YOLO and DeepFace with Active Learning

Didit Suprihanto, Adi Pandu Wirawan, Kahlil Gibran Saputra, Arif Harjanto, Imam Muhammad Hakim, Happy Nugroho

Abstract


Accurate student attendance tracking is essential in academic environments, yet traditional methods remain inefficient and vulnerable to manipulation. This research presents a classroom attendance system based on facial recognition that integrates YOLO for multiperson face detection and the SFace model from the DeepFace framework for feature extraction and identity matching. A key contribution of this study is the implementation of an Active Learning mechanism that enables the system to update its embedding Database using user-provided corrections, enabling continuous adaptation to real classroom conditions. The system was developed as a Python-based desktop application and evaluated using 38 group images captured with various devices under uncontrolled lighting, diverse head poses, occlusion, and different classroom densities. Performance was assessed using accuracy, False Rejection Rate (FRR), and False Acceptance Rate (FAR) across two scenarios: before and after Active Learning. Experimental results show a substantial improvement after the learning process, with accuracy increasing from 52.0% to 96.6%, while maintaining a low FAR of 0%. These findings demonstrate that Active Learning effectively enhances recognition performance by enriching the embedding Database with real-world facial variations that do not present during initial registration. Overall, the proposed system highlights the importance of integrating Active Learning into face recognition–based attendance applications to improve robustness and adaptability in unconstrained multiperson classroom environments.


Keywords


Face Recognition, YOLO, DeepFace, Active Learning, Automated Attendance, Deep Learning

References


M. M. Al-dabbagh, “A Review of Students Attendance Management Systems,” vol. 10, no. 3, pp. 136–145, 2025.

N. M. Hassan, M. A. Moussa, and M. H. M. Mahmoud, “CNN and Adaboost fusion model for multiface recognition based automated verification system of students attendance,” Indones. J. Electr. Eng. Comput. Sci., vol. 35, no. 1, pp. 133–139, 2024, doi: 10.11591/ijeecs.v35.i1.pp133-139.

P. Jiang et al., “ScienceDirect A Review of Yolo Algorithm Developments A Review of Yolo Algorithm Developments,” 2022, doi: 10.1016/j.procs.2022.01.135.

G. Jocher, J. Qiu, and A. Chaurasia, “Ultralytics YOLO,” 2023. [Online]. Available: https://ultralytics.com

S. Serengil and A. Ozpinar, “A Benchmark of Facial Recognition Pipelines and Co-Usability Performances of Modules,” J. Inf. Technol., vol. 17, no. 2, pp. 95–107, 2024, doi: 10.17671/gazibtd.1399077.

Y. Zhong, W. Deng, J. Hu, D. Zhao, X. Li, and D. Wen, “SFace: Sigmoid-Constrained Hypersphere Loss for Robust Face Recognition,” IEEE Trans. Image Process., vol. 30, no. 10,4,5,8, pp. 2587–2598, 2021, doi: 10.1109/TIP.2020.3048632.

A. P. Chawla, S. E. Juliet, A. Suman, A. Khan, and G. Manikandan, “Deep Learning based Multi-face Recognition System for Automatic Attendance Registering in Classrooms,” in Proceedings of the 6th International Conference on Deep Learning, Artificial Intelligence and Robotics (ICDLAIR 2024), Atlantis Press, 2025, pp. 203–214. doi: 10.2991/978-94-6463-740-3_18.

Y. Gal, R. Islam, and Z. Ghahramani, “Deep Bayesian active learning with image data,” 34th Int. Conf. Mach. Learn. ICML 2017, vol. 3, pp. 1923–1932, 2017.

D. Li, Z. Wang, Y. Chen, R. Jiang, W. Ding, and M. Okumura, “A Survey on Deep Active Learning: Recent Advances and New Frontiers,” IEEE Trans. Neural Networks Learn. Syst., vol. 36, no. 4, pp. 5879–5899, 2025, doi: 10.1109/TNNLS.2024.3396463.

G. S. M. Diyasa, A. Fauzi, M. Idhom, and A. Setiawan, “Multi-face Recognition for the Detection of Prisoners in Jail using a Modified Cascade Classifier and CNN,” J. Phys. Conf. Ser., vol. 1844, no. 1, p. 12005, Mar. 2021, doi: 10.1088/1742-6596/1844/1/012005.

E. C. A. Mondesir, Group Face Recognition : Identifying and Tracking Multiple Individuals, no. Icciet 2024. Atlantis Press International BV. doi: 10.2991/978-94-6463-471-6.

M. Djamaluddin, R. Munir, N. P. Utama, and A. I. Kistijantoro, “Open-Set Profile-to-Frontal Face Recognition on a Very Limited Dataset,” IEEE Access, vol. 11, pp. 65787–65797, 2023, doi: 10.1109/ACCESS.2023.3289923.

A. Anshari, S. A. Hirtranusi, D. I. Sensuse, Kautsarina, and R. R. Suryono, “Face Recognition for Identification and Verification in Attendance System: A Systematic Review,” in 2021 IEEE International Conference on Communication, Networks and Satellite (COMNETSAT), 2021, pp. 316–323. doi: 10.1109/COMNETSAT53002.2021.9530817.

R. Takezoe, X. U. Liu, S. Mao, M. T. Chen, S. Zhang, and X. Wang, “Deep Active Learning for Computer Vision : Past and Future,” pp. 1–18.

P. X. Huang, W. Hu, and L. L. X. Wang, “YMIR : A Rapid Data-centric Development Platform for Vision Applications,” no. NeurIPS, pp. 1–8, 2021.

Lindevs, “Pre-Trained Yolov8-Face models,” 2024. [Online]. Available: https://github.com/lindevs/yolov8-face

A. Sanjaya, A. B. Setiawan, U. Mahdiyah, I. N. Farida, and A. R. Prasetyo, “PENGUKURAN KEMIRIPAN MAKNA MENGGUNAKAN COSINE SIMILARITY MEASUREMENT OF MEANING SIMILARITY USING COSINE SIMILARITY AND,” vol. 10, no. 4, pp. 747–752, 2023, doi: 10.25126/jtiik.2023106864.

Supiyanto and Sriyono, “Metode Cosine Similarity Untuk Mendeteksi Kemiripan Pada Dokumen Teks,” SAINS J. MIPA, vol. 1, pp. 1–7, 2023.

V. Tomar, N. Kumar, and A. R. Srivastava, “Single sample face recognition using deep learning: a survey,” Artif. Intell. Rev., vol. 56, no. 1, pp. 1063–1111, 2023, doi: 10.1007/s10462-023-10551-y.

D. Sanberg, “Face Recognition using Tensorflow.” [Online]. Available: https://github.com/davidsandberg/facenet

J. Deng, J. Guo, J. Yang, N. Xue, I. Kotsia, and S. Zafeiriou, “ArcFace: Additive Angular Margin Loss for Deep Face Recognition,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 44, no. 10_Part_1, pp. 5962–5979, Oct. 2022, doi: 10.1109/TPAMI.2021.3087709.

S. Serengil and A. Ozpinar, “LightFace: A Hybrid Deep Face Recognition Framework,” 2020. doi: 10.1109/ASYU50717.2020.9259802.

A. Puspitasari, D. Sava, and D. Roliawati, “Indonesian Journal on Data Science Penerapan ResNet-50 CNN untuk Optimalisasi Klasifikasi pada Data Fashion,” vol. 3, no. 1, pp. 1–12, 2025.

A. Laurent, “Active Learning and Human Feedback for Large Language Models,” 2025. Accessed: Dec. 27, 2025. [Online]. Available: https://intuitionlabs.ai/articles/active-learning-hitl-llms

A. Jalaluddin and S. Mulyono, “MENGGUNAKAN METODE HAAR CASCADE CLASSIFIER DAN LOCAL BINARY PATTERN HISTOGRAM PADA AKSES,” vol. 1, no. 1, 2023.




DOI: https://doi.org/10.52088/ijesty.v5i4.1772

Refbacks

  • There are currently no refbacks.


Copyright (c) 2025 Didit Suprihanto, Adi Pandu Wirawan, Kahlil Gibran Saputra, Arif Harjanto, Imam Muhammad Hakim, Happy Nugroho

International Journal of Engineering, Science, and Information Technology (IJESTY) eISSN 2775-2674