Aplikasi Absensi Pengenalan Wajah dengan Menggunakan Algoritma YOLOv11
DOI:
https://doi.org/10.35870/jtik.v10i3.5965Keywords:
YOLOv11, Face Recognition, Attendance SystemAbstract
Manual or semi-manual attendance recording may lead to recap errors, delayed reporting, and misuse such as proxy attendance. This study develops a web-based attendance prototype leveraging You Only Look Once version 11 (YOLOv11) to perform face detection and identity recognition within a single end-to-end pipeline. The research stages include a literature review, data acquisition and pre-processing (640×640 letterbox resize and normalization), transfer-learning-based model training, and system implementation using Laravel and MySQL integrated with a Python inference service exposed via a REST API. Model performance was assessed using standard detection metrics (precision, recall, mAP@0.5, and mAP@0.5:0.95), complemented by black-box functional testing of core application modules (enrollment, attendance logging, and reporting). Internal evaluation demonstrates strong performance with precision of 0.982, recall of 0.975, mAP@0.5 of 0.987, and mAP@0.5:0.95 of 0.963. Nevertheless, performance degrades under challenging real-world conditions (extreme low-light, backlight, mask usage, and partial occlusion) and on external dataset testing, suggesting sensitivity to domain shift. Overall, the proposed system indicates practical potential for real-time attendance automation and reduced recording errors, while highlighting the need for richer, more diverse training data and cross-domain evaluation to improve generalization.
Downloads
References
Badgett, T., & Myers, G. J. (2023). The art of software testing. Wiley-Blackwell.
Chen, W., Huang, H., Peng, S., Zhou, C., & Zhang, C. (2021). YOLO-face: A real-time face detector. Visual Computing. https://doi.org/10.1007/s00371-020-01831-7.
Deng, J., Guo, J., Xue, N., & others. (2019). ArcFace: Additive angular margin loss for deep face recognition. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
Everingham, M., Van Gool, L., Williams, C. K. I., & others. (2010). The Pascal Visual Object Classes (VOC) Challenge. International Journal. https://doi.org/10.1007/S11263-009-0275-4
Goodfellow, I. J., Bengio, Y., & Courville, A. C. (2016). Deep learning. MIT Press.
Hahn, V. K., & Marcel, S. (2022). Biometric template protection for neural-network-based face recognition systems: A survey of methods and evaluation techniques. IEEE Transactions on Information Forensics and Security.
He, L., Zhou, Y., Liu, L., & Ma, J. (2024). Research and application of YOLOv11-based object segmentation in intelligent recognition at construction sites. Buildings.
Jegham, N., Koh, C. Y., Abdelatti, M., & Hendawi, A. (2024). YOLO evolution: A comprehensive benchmark and architectural review of YOLOv12, YOLOv11, and their previous versions. arXiv Preprints, arXiv2411.00201.
Jocher, G. (2020). Ultralytics YOLOv5. Version 7.0. AGPL-3.0 License.
Kaur, G., Sinha, R., Tiwari, P. K., Yadav, S. K., Pandey, P., & others. (2022). Face mask recognition system using CNN model. Neuroscience.
Khanam, R., & Hussain, M. (2024). YOLOv11: An overview of the key architectural enhancements. arXiv Preprints, 241017725.
Lee, Y. H., & Kim, Y. (2020). Comparison of CNN and YOLO for object detection. Journal of Semiconductors, 2020.
Li, W., Wang, M., Wang, H., & Zhang, Y. (2020). Object detection based on semi-supervised domain adaptation for imbalanced domain resources. Machine Vision and Applications, 2020. https://doi.org/10.1007/s00138-020-01068-3.
Loshchilov, I., & Hutter, F. (2017). Decoupled weight decay regularization. arXiv Preprints, ARXIV.1711.05101.
Mahmoud, M., Kasem, M. S. E., & Kang, H. S. (2024). A comprehensive survey of masked faces: Recognition, detection, and unmasking. arXiv Preprints, arXiv2405.05900.
Mamieva, D., Abdusalomov, A. B., Mukhiddinov, M., & others. (2023). Improved face detection method via learning small faces on hard images based on a deep learning approach. Sensors.
Mostafa, S. A., Ravi, S., Zebari, D. A., Zebari, N. A., & others. (2024). A YOLO-based deep learning model for real-time face mask detection via drone surveillance in public spaces. Information Sciences.
Muhammad, M. A., & Mulyani, Y. (2021). Library attendance system using YOLOv5 face recognition. 2021 International Conference on....
Nowrin, A., Afroz, S., Rahman, M. S., Mahmud, I., & others. (2021). Comprehensive review on face mask detection techniques in the context of COVID-19. IEEE Access.
Parkhi, O., Vedaldi, A., & Zisserman, A. (2015). Deep face recognition. BMVC 2015-Proceedings.
Patel, J., Gandhi, S., Katheriya, V., Pataliya, P., & others. (2025). Enhancing classroom attendance systems with face recognition through CCTV using deep learning. Procedia Computer Science.
Pressman, R. S. (2020). Software engineering: A practitioner's approach. McGraw Hill.
Rahaf, A., Maali, A., Ftoon, A., & Saleh, A. (2022). Deep learning techniques for detecting and recognizing face masks: A survey. Digital Public Health.
Sahputra, I., Fikry, M., & others. (2024). A robust approach to student attendance using web-based facial recognition. Proceedings of....
Santoso, J. T., Sediyono, E., Hartomo, K. D., & others. (2024). Optimizing attendance system: Integrating liveness detection and deep learning for reliable face recognition. JUITA Journal.
Sapkota, R., & Karkee, M. (2025). Ultralytics YOLO evolution: An overview of YOLO26, YOLO11, YOLOv8, and YOLOv5 object detectors for computer vision and pattern recognition. arXiv Preprints, arXiv2510.09653.
Schroff, F., Kalenichenko, D., & Philbin, J. (2015). FaceNet: A unified embedding for face recognition and clustering. arXiv Preprints, arXiv1503.03832.
Sommerville, I. (2016). Software engineering tenth edition. Harambee University.
Suto, J. (2024). Using data augmentation to improve the generalization capability of an object detector on remote-sensed insect trap images. Sensors.
Taigman, Y., Yang, M., Ranzato, M., & Wolf, L. (2014). DeepFace: Closing the gap to human-level performance in face verification. In 2014 IEEE Conference on Computer Vision and Pattern Recognition (pp. 1701–1708). https://doi.org/10.1109/CVPR.2014.220.
Wang, C. Y., Bochkovskiy, A., & others. (2023). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
Wang, M., & Deng, W. (2021). Deep face recognition: A survey. Neurocomputing.
Wang, M., Li, S., Zhang, X., & Feng, G. (2025). Facial privacy in the digital era: A comprehensive survey on methods, evaluation, and future directions. Computer Science Review.
Xu, Q., Zhu, Z., Ge, H., Zhang, Z., & others. (2021). Effective face detector based on YOLOv5 and super-resolution reconstruction. Mathematical Methods in Applied Sciences, 2021. https://doi.org/10.1155/2021/7748350.
Yang, S., Xiao, W., Zhang, M., Guo, S., Zhao, J., & others. (2022). Image data augmentation for deep learning: A survey. arXiv Preprints.
Yang, W., Yuan, Y., Ren, W., Liu, J., & others. (2020). Advancing image understanding in poor visibility environments: A collective benchmark study. Image Processing.
Yu, J., & Zhang, W. (2021). Face mask wearing detection algorithm based on improved YOLO-v4. Sensors.
Yu, Z., Huang, H., Chen, W., Su, Y., Liu, Y., & Wang, X. (2024). Yolo-facev2: A scale and occlusion aware face detector. Pattern Recognition.
Zhalgas, A., Amirgaliyev, B., & Sovet, A. (2025). Robust face recognition under challenging conditions: A comprehensive review of deep learning methods and challenges. Applied Sciences.
Zhang, F., Zhang, F., Bazarevsky, V., Vakunov, A., & Tkachenka, A. (2020). MediaPipe Hands: On-device real-time hand tracking. Education & Society. https://doi.org/10.48550/arXiv.2006.10214.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Vanness Bee, Ery Hartati
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
1. Copyright Retention and Open Access License
Authors retain copyright of their work and grant the journal non-exclusive right of first publication under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
This license allows unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
2. Rights Granted Under CC BY 4.0
Under this license, readers are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, including commercial use
- No additional restrictions — the licensor cannot revoke these freedoms as long as license terms are followed
3. Attribution Requirements
All uses must include:
- Proper citation of the original work
- Link to the Creative Commons license
- Indication if changes were made to the original work
- No suggestion that the licensor endorses the user or their use
4. Additional Distribution Rights
Authors may:
- Deposit the published version in institutional repositories
- Share through academic social networks
- Include in books, monographs, or other publications
- Post on personal or institutional websites
Requirement: All additional distributions must maintain the CC BY 4.0 license and proper attribution.
5. Self-Archiving and Pre-Print Sharing
Authors are encouraged to:
- Share pre-prints and post-prints online
- Deposit in subject-specific repositories (e.g., arXiv, bioRxiv)
- Engage in scholarly communication throughout the publication process
6. Open Access Commitment
This journal provides immediate open access to all content, supporting the global exchange of knowledge without financial, legal, or technical barriers.
