Main Content
Open Access Articles

Factors Affecting the Effectiveness of CBT Implementation in Student Learning Evaluation Using UTAUT: A Case Study at SMAS Katolik Sint Pieter Waikabubak

Main Article Content

  • Marlina Dama Lero1
  • Ardiyanto Dapadeda2*
  • Maria Wilda Malo3

Article Sidebar

Cover IJSECS VOLUME 6 NOMOR 1 APRIL 2026

Abstract

This study examines the digital transition in the student learning evaluation system at SMA Katolik Sint Pieter Waikabubak through the adoption of a Computer-Based Test (CBT) application. Although CBT has been in use since 2023, persistent issues — including unstable internet connections and limited exam monitoring features — have raised legitimate questions regarding its operational effectiveness. This study aims to evaluate the effectiveness of CBT in student learning assessments and to identify the factors that shape students' behavioral intention to use the system. A quantitative approach grounded in the Unified Theory of Acceptance and Use of Technology (UTAUT) was applied. The findings demonstrate that CBT adoption has measurably improved the transparency and accuracy of learning evaluations. Performance Expectancy, Effort Expectancy, Social Influence, and Facilitating Conditions each exert a statistically significant effect on students' intention to use CBT, with Perceived Usefulness emerging as the strongest predictor. Age and gender were found to moderate several of these relationships. The results indicate that adequate school infrastructure and an accessible application interface are decisive factors in the success of exam digitization. Schools are advised to continue strengthening their technical and physical support systems to sustain long-term adoption of this technology.

Article Details

How to Cite

Citation Format
Lero, M. D., Dapadeda, A., & Malo, M. W. (2026). Factors Affecting the Effectiveness of CBT Implementation in Student Learning Evaluation Using UTAUT: A Case Study at SMAS Katolik Sint Pieter Waikabubak. International Journal Software Engineering and Computer Science (IJSECS), 6(1), 84-97. https://doi.org/10.35870/ijsecs.v6i1.6600

References

22 References
  • Abdul Gani Jamora Nasution. (2020). Metodologi penelitian: Kualitatif dan kuantitatif. [Publisher not identified].
  • Aprianto, L. A. (2022). Tinjauan literatur: Penerimaan teknologi model UTAUT. KONSTELASI: Konvergensi Teknologi dan Sistem Informasi, 2(1). https://doi.org/10.24912/konstelasi.v2i1
  • Bella Putri Oktavia, Sari, B. W., & Erawati, A. (2020). Efektivitas implementasi CBT pada siswa akuntansi di SMKN A Madiun. Jurnal Akuntansi: Kajian Ilmiah Akuntansi, 7(2). https://doi.org/10.30656/jak.v7i2
  • Blut, M., Chong, A. Y. L., Tsiga, Z., & Venkatesh, V. (2022). Meta-analysis of the unified theory of acceptance and use of technology (UTAUT): Challenging its validity and charting a research agenda in the red ocean. Journal of the Association for Information Systems, 23(1), 13–95. https://ssrn.com/abstract=3963030
  • Dapadeda, A., Handarkho, Y. D., & Mudjihartono, P. (2025). Factors influencing low adoption of mobile banking in underdeveloped regions in Indonesia, based on modified Push–Pull–Mooring theory. Electronic Journal of Information Systems in Developing Countries, 91(4), 1–16. https://doi.org/10.1002/isd2.70023
  • Damasari, E. (2023). Efektivitas penggunaan computer based test (CBT) berbasis Microsoft 365 terhadap kompetensi guru di MIN 1 Rejang Lebong [Unpublished manuscript]. [Institution not identified].
  • Hair, J. F., Jr., Matthews, L. M., Matthews, R. L., & Sarstedt, M. (2021). Partial least squares structural equation modeling (PLS-SEM) using R: A workbook. Springer. https://doi.org/10.1007/978-3-030-80519-7
  • Hozair, M. F. A. (2024). Analisa kepuasan pengguna aplikasi CBT di Universitas Islam Madura menggunakan metode PIECES. Jurnal MNEMONIC, 7(2). https://doi.org/10.36040/mnemonic.v7i2
  • Makmun, S., Aliyah, N., & Nafisah, P. (2024). CBT (computer based test) sebagai alat evaluasi terhadap pembelajaran matematika: Studi kasus di Madrasah Aliyah Sumenep. Jurnal Pendidikan Agama Islam, 4(1), 1–12. http://ejournal.idia.ac.id/index.php/fakta
  • Momani, A. M. (2020). The unified theory of acceptance and use of technology: A new approach in technology acceptance. International Journal of Sociotechnology and Knowledge Development, 12(3), 79–98. https://doi.org/10.4018/IJSKD.2020070105
  • Nadhilah Idzni Majdina, & Putri, A. T. (2024). Penentuan ukuran sampel menggunakan rumus Bernoulli dan Slovin: Konsep dan aplikasinya. Jurnal Ilmiah Matematika dan Pendidikan Matematika (JMP), 16(1), 73–84.
  • Rachman, A. (Ed.). (2024). Metode penelitian kuantitatif, kualitatif dan R&D (1st ed.). CV Saba Jaya Publisher.
  • Restu Ningsih, S., & Yusfika Marlis, R. (2020). Aplikasi computer based test untuk pelaksanaan ujian sekolah menengah atas. JOISIE: Journal of Information System and Informatics Engineering, 4(2), 105–111.
  • Rizal, M. H. A., & Fatah, F. (2022). Pengaruh aplikasi pembelajaran dan teori behavioristik terhadap efektivitas pembelajaran siswa jurusan keagamaan. Inovasi Kurikulum, 19(1), 54–68. https://ejournal.upi.edu/index.php/JIK
  • Rosmaladewi, O., Bunga Widdian, D., & Khaerani, N. N. (2023). Implementasi aplikasi ujian computer based test (CBT) di SMK Piramida Kabupaten Bandung. Eduprof: Islamic Education Journal, 5(1). https://doi.org/10.47453/eduprof.xxx
  • Septiana, N. (2021). Pemanfaatan aplikasi CBT sebagai alat evaluasi pada mata kuliah dasar-dasar pendidikan MIPA dan morfologi tumbuhan. Jurnal Kajian Pendidikan IPA, 1(2), 62–70.
  • Septiana, N., & Rohmadi, M. (2024). Persepsi mahasiswa terhadap aplikasi CBT Android berbasis ExamBrowser sebagai alat evaluasi paper less. JRIP: Jurnal Riset dan Inovasi Pembelajaran, 4(1), 448–457.
  • Setiawan, I., Suprihatin, H., & Pujiastuti, E. (2022). Pengembangan sistem computer based test pada SMK Bintang Harapan Cibarusah Bekasi untuk pelaksanaan ujian. Jurnal AbdiMas Nusa Mandiri, 4(2), 38–42. https://doi.org/10.33480/abdimas.v4i2.2878
  • Sutarso, Y., Laga, S. A., Mukhlis, I. R., Suprianto, G., Pratama, Y. H. C., Natasya, A. R., & Maharani, G. D. (2023). Pemanfaatan aplikasi computer based test untuk mengukur pencapaian siswa dalam pembelajaran sekolah Islam. Jurnal Inovasi Hasil Pengabdian Masyarakat (JIPEMAS), 6(1), 83–98. https://doi.org/10.33474/jipemas.v6i1.17644
  • Udayana, S., & Wardani, K. (2021). Efektivitas penggunaan sistem computer based test dan paper based test dalam pelaksanaan ujian tengah semester bahasa Indonesia di SMPN 6 Singaraja. Jurnal Pendidikan Bahasa dan Sastra Indonesia. https://ejournal.undiksha.ac.id/index.php/JJPBS
  • Venkatesh, V. (2022). Adoption and use of AI tools: A research agenda grounded in UTAUT. Annals of Operations Research, 308(1–2), 641–652. https://doi.org/10.1007/s10479-020-03918-9
  • Venkatesh, V., Morris, M. G., Davis, G. B., & Davis, F. D. (2003). User acceptance of information technology: Toward a unified view. MIS Quarterly, 27(3), 425–478. https://doi.org/10.2307/30036540

Author Biographies

Marlina Dama Lero, Universitas Stella Maris Sumba

Department of Informatics Engineering, Faculty of Engineering, Universitas Stella Maris Sumba, Southwest Sumba Regency, East Nusa Tenggara Province, Indonesia

Ardiyanto Dapadeda, Universitas Stella Maris Sumba

Department of Informatics Engineering, Faculty of Engineering, Universitas Stella Maris Sumba, Southwest Sumba Regency, East Nusa Tenggara Province, Indonesia

Maria Wilda Malo, Universitas Stella Maris Sumba

Department of Digital Business, Faculty of Engineering, Universitas Stella Maris Sumba, Southwest Sumba Regency, East Nusa Tenggara Province, Indonesia

Downloads

OJS UsageStats Plugin
Download data is not yet available.

Similar Articles

You may also start an advanced similarity search for this article.

Most read articles by the same author(s)

Contrimetric

Recommended Articles

Journal Transparency

Additional Information

Learn more about how this journal ensures quality, ethics, and transparency.