Published: 2026-04-01
Factors Affecting the Effectiveness of CBT Implementation in Student Learning Evaluation Using UTAUT: A Case Study at SMAS Katolik Sint Pieter Waikabubak
DOI: 10.35870/ijsecs.v6i1.6600
Abstract
This study examines the digital transition in the student learning evaluation system at SMA Katolik Sint Pieter Waikabubak through the adoption of a Computer-Based Test (CBT) application. Although CBT has been in use since 2023, persistent issues — including unstable internet connections and limited exam monitoring features — have raised legitimate questions regarding its operational effectiveness. This study aims to evaluate the effectiveness of CBT in student learning assessments and to identify the factors that shape students' behavioral intention to use the system. A quantitative approach grounded in the Unified Theory of Acceptance and Use of Technology (UTAUT) was applied. The findings demonstrate that CBT adoption has measurably improved the transparency and accuracy of learning evaluations. Performance Expectancy, Effort Expectancy, Social Influence, and Facilitating Conditions each exert a statistically significant effect on students' intention to use CBT, with Perceived Usefulness emerging as the strongest predictor. Age and gender were found to moderate several of these relationships. The results indicate that adequate school infrastructure and an accessible application interface are decisive factors in the success of exam digitization. Schools are advised to continue strengthening their technical and physical support systems to sustain long-term adoption of this technology.
Keywords
Catholic High School; CBT; Efficiency; Learning Evaluation; UTAUT
Article Information
This article has been peer-reviewed and published in the International Journal Software Engineering and Computer Science (IJSECS). The content is available under the terms of the Creative Commons Attribution 4.0 International License.
-
Issue: Vol. 6 No. 1 (2026)
-
Section: Articles
-
Published: 2026-04-01
-
License: CC BY 4.0
-
Copyright: © 2026 Authors
-
DOI: 10.35870/ijsecs.v6i1.6600
AI Research Hub
This article is indexed and available through various AI-powered research tools and citation platforms. Our AI Research Hub ensures that scholarly work is discoverable, accessible, and easily integrated into the global research ecosystem.
Ardiyanto Dapadeda, Universitas Stella Maris Sumba
Department of Informatics Engineering, Faculty of Engineering, Universitas Stella Maris Sumba, Southwest Sumba Regency, East Nusa Tenggara Province, Indonesia
Marlina Dama Lero, Universitas Stella Maris Sumba
Department of Informatics Engineering, Faculty of Engineering, Universitas Stella Maris Sumba, Southwest Sumba Regency, East Nusa Tenggara Province, Indonesia
Maria Wilda Malo, Universitas Stella Maris Sumba
Department of Digital Business, Faculty of Engineering, Universitas Stella Maris Sumba, Southwest Sumba Regency, East Nusa Tenggara Province, Indonesia
-
Abdul Gani Jamora Nasution. (2020). Metodologi penelitian: Kualitatif dan kuantitatif. [Publisher not identified].
-
Aprianto, L. A. (2022). Tinjauan literatur: Penerimaan teknologi model UTAUT. KONSTELASI: Konvergensi Teknologi dan Sistem Informasi, 2(1). https://doi.org/10.24912/konstelasi.v2i1
-
Bella Putri Oktavia, Sari, B. W., & Erawati, A. (2020). Efektivitas implementasi CBT pada siswa akuntansi di SMKN A Madiun. Jurnal Akuntansi: Kajian Ilmiah Akuntansi, 7(2). https://doi.org/10.30656/jak.v7i2
-
Blut, M., Chong, A. Y. L., Tsiga, Z., & Venkatesh, V. (2022). Meta-analysis of the unified theory of acceptance and use of technology (UTAUT): Challenging its validity and charting a research agenda in the red ocean. Journal of the Association for Information Systems, 23(1), 13–95. https://ssrn.com/abstract=3963030
-
Dapadeda, A., Handarkho, Y. D., & Mudjihartono, P. (2025). Factors influencing low adoption of mobile banking in underdeveloped regions in Indonesia, based on modified Push–Pull–Mooring theory. Electronic Journal of Information Systems in Developing Countries, 91(4), 1–16. https://doi.org/10.1002/isd2.70023
-
Damasari, E. (2023). Efektivitas penggunaan computer based test (CBT) berbasis Microsoft 365 terhadap kompetensi guru di MIN 1 Rejang Lebong [Unpublished manuscript]. [Institution not identified].
-
Hair, J. F., Jr., Matthews, L. M., Matthews, R. L., & Sarstedt, M. (2021). Partial least squares structural equation modeling (PLS-SEM) using R: A workbook. Springer. https://doi.org/10.1007/978-3-030-80519-7
-
Hozair, M. F. A. (2024). Analisa kepuasan pengguna aplikasi CBT di Universitas Islam Madura menggunakan metode PIECES. Jurnal MNEMONIC, 7(2). https://doi.org/10.36040/mnemonic.v7i2
-
Makmun, S., Aliyah, N., & Nafisah, P. (2024). CBT (computer based test) sebagai alat evaluasi terhadap pembelajaran matematika: Studi kasus di Madrasah Aliyah Sumenep. Jurnal Pendidikan Agama Islam, 4(1), 1–12. http://ejournal.idia.ac.id/index.php/fakta
-
Momani, A. M. (2020). The unified theory of acceptance and use of technology: A new approach in technology acceptance. International Journal of Sociotechnology and Knowledge Development, 12(3), 79–98. https://doi.org/10.4018/IJSKD.2020070105
-
Nadhilah Idzni Majdina, & Putri, A. T. (2024). Penentuan ukuran sampel menggunakan rumus Bernoulli dan Slovin: Konsep dan aplikasinya. Jurnal Ilmiah Matematika dan Pendidikan Matematika (JMP), 16(1), 73–84.
-
Rachman, A. (Ed.). (2024). Metode penelitian kuantitatif, kualitatif dan R&D (1st ed.). CV Saba Jaya Publisher.
-
Restu Ningsih, S., & Yusfika Marlis, R. (2020). Aplikasi computer based test untuk pelaksanaan ujian sekolah menengah atas. JOISIE: Journal of Information System and Informatics Engineering, 4(2), 105–111.
-
Rizal, M. H. A., & Fatah, F. (2022). Pengaruh aplikasi pembelajaran dan teori behavioristik terhadap efektivitas pembelajaran siswa jurusan keagamaan. Inovasi Kurikulum, 19(1), 54–68. https://ejournal.upi.edu/index.php/JIK
-
Rosmaladewi, O., Bunga Widdian, D., & Khaerani, N. N. (2023). Implementasi aplikasi ujian computer based test (CBT) di SMK Piramida Kabupaten Bandung. Eduprof: Islamic Education Journal, 5(1). https://doi.org/10.47453/eduprof.xxx
-
Septiana, N. (2021). Pemanfaatan aplikasi CBT sebagai alat evaluasi pada mata kuliah dasar-dasar pendidikan MIPA dan morfologi tumbuhan. Jurnal Kajian Pendidikan IPA, 1(2), 62–70.
-
Septiana, N., & Rohmadi, M. (2024). Persepsi mahasiswa terhadap aplikasi CBT Android berbasis ExamBrowser sebagai alat evaluasi paper less. JRIP: Jurnal Riset dan Inovasi Pembelajaran, 4(1), 448–457.
-
Setiawan, I., Suprihatin, H., & Pujiastuti, E. (2022). Pengembangan sistem computer based test pada SMK Bintang Harapan Cibarusah Bekasi untuk pelaksanaan ujian. Jurnal AbdiMas Nusa Mandiri, 4(2), 38–42. https://doi.org/10.33480/abdimas.v4i2.2878
-
Sutarso, Y., Laga, S. A., Mukhlis, I. R., Suprianto, G., Pratama, Y. H. C., Natasya, A. R., & Maharani, G. D. (2023). Pemanfaatan aplikasi computer based test untuk mengukur pencapaian siswa dalam pembelajaran sekolah Islam. Jurnal Inovasi Hasil Pengabdian Masyarakat (JIPEMAS), 6(1), 83–98. https://doi.org/10.33474/jipemas.v6i1.17644
-
Udayana, S., & Wardani, K. (2021). Efektivitas penggunaan sistem computer based test dan paper based test dalam pelaksanaan ujian tengah semester bahasa Indonesia di SMPN 6 Singaraja. Jurnal Pendidikan Bahasa dan Sastra Indonesia. https://ejournal.undiksha.ac.id/index.php/JJPBS
-
Venkatesh, V. (2022). Adoption and use of AI tools: A research agenda grounded in UTAUT. Annals of Operations Research, 308(1–2), 641–652. https://doi.org/10.1007/s10479-020-03918-9
-
Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
1. Copyright Retention and Open Access License
Authors retain copyright of their work and grant the journal non-exclusive right of first publication under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
This license allows unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
2. Rights Granted Under CC BY 4.0
Under this license, readers are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, including commercial use
- No additional restrictions — the licensor cannot revoke these freedoms as long as license terms are followed
3. Attribution Requirements
All uses must include:
- Proper citation of the original work
- Link to the Creative Commons license
- Indication if changes were made to the original work
- No suggestion that the licensor endorses the user or their use
4. Additional Distribution Rights
Authors may:
- Deposit the published version in institutional repositories
- Share through academic social networks
- Include in books, monographs, or other publications
- Post on personal or institutional websites
Requirement: All additional distributions must maintain the CC BY 4.0 license and proper attribution.
5. Self-Archiving and Pre-Print Sharing
Authors are encouraged to:
- Share pre-prints and post-prints online
- Deposit in subject-specific repositories (e.g., arXiv, bioRxiv)
- Engage in scholarly communication throughout the publication process
6. Open Access Commitment
This journal provides immediate open access to all content, supporting the global exchange of knowledge without financial, legal, or technical barriers.