Main Content

Abstract

This study compares the performance of Naïve Bayes, Long Short-Term Memory (LSTM), and Bidirectional LSTM (BiLSTM) models in sentiment analysis of EasyCash application reviews, with data balancing techniques applied throughout the process. The dataset was collected from the Google Play Store and processed through cleaning, tokenization, stemming, and normalization. Sentiment labeling classified reviews into positive, neutral, and negative categories. To address class imbalance, the Synthetic Minority Oversampling Technique (SMOTE) was applied prior to model training. Feature extraction was conducted using TF-IDF, and models were evaluated on accuracy, precision, recall, and F1-score. Naïve Bayes outperformed both LSTM and BiLSTM, producing higher accuracy and more stable results across evaluation metrics. The findings suggest that simpler machine learning models can be more effective than deep learning approaches when working with limited and imbalanced datasets. Careful data preprocessing, appropriate balancing techniques, and deliberate model selection remain central to achieving reliable sentiment classification performance in fintech applications.

Article Details

How to Cite

Citation Format
Abelia, F., & Fitriyani, F. (2026). A Comparative Performance Analysis of Naïve Bayes, LSTM, and BiLSTM with Data Balancing Techniques for Sentiment Analysis of EasyCash Application Reviews. International Journal Software Engineering and Computer Science (IJSECS), 6(1), 183-193. https://doi.org/10.35870/ijsecs.v6i1.6862

References

22 References
  • Adji, Y. B., Muhammad, W. A., Akrabi, A. N. L., & Noerlina. (2023). Perkembangan inovasi fintech di Indonesia. Business Economic, Communication, and Social Sciences Journal, 5(1), 47–58. https://doi.org/10.21512/becossjournal.v5i1.8675
  • Algamar, M. D., & Ismail, N. (2023). Data subject access request: What Indonesia can learn and operationalise in 2024? Journal of Central Banking Law and Institutions, 2(3), 481–512. https://doi.org/10.21098/jcli.v2i3.171
  • Alzoubi, S., Aldiabat, K., Al-Diabat, M., & Abualigah, L. (2024). An extensive analysis of several methods for classifying unbalanced datasets. Journal of Autonomous Intelligence, 7(3), 1–9. https://doi.org/10.32629/jai.v7i3.966
  • Amrie, J. H. W., Kurniawan, S., & Amrie, Y. R. S. (2022). Analysis of Google Play Store's sentiment review on Indonesia's P2P fintech platform. Proceedings of the IEEE Delhi Section Conference (DELCON), 1–5. https://doi.org/10.1109/DELCon54057.2022.9753108
  • Assyifa, D. S., & Luthfiarta, A. (2024). SMOTE-Tomek re-sampling based on random forest method to overcome unbalanced data for multi-class classification. Jurnal Ilmiah Teknologi Informasi dan Komunikasi, 9(2), 151–160. https://doi.org/10.25139/inform.v9i2.8410
  • Attar, R. W., Almusharraf, A., Alfawaz, A., & Hajli, N. (2022). New trends in e-commerce research: Linking social commerce and sharing commerce — a systematic literature review. Sustainability, 14(23), Article 16024. https://doi.org/10.3390/su142316024
  • Feriyanto, Qur'anisa, Z., Herawati, M., Lisvi, & Putri, M. H. (2024). Peran fintech dalam meningkatkan inklusi keuangan di era ekonomi digital. Gemilang Jurnal Manajemen dan Akuntansi, 4(3), 99–114. https://doi.org/10.63200/jebmass.v3i4.204
  • Fullah, A., Rahayu, S., Pratama, D., & Santoso, B. (2025). Analisis sentimen isu penyalahgunaan data pada layanan pinjaman online menggunakan support vector machine di platform X. Jurnal Informatika dan Teknik Elektro Terapan, 13(3s1), 1038–1047. https://journal.eng.unila.ac.id/index.php/jitet/article/view/7976
  • Gandasari, M., Hidayat, R. R., & Siswajanthy, F. (2025). Legal theory mengawasi fintech lending sebagai instrumen ekonomi digital. Indonesian Journal of Islamic Jurisprudence, Economic and Legal Theory, 3(1), 399–408. https://mail.shariajournal.com/index.php/ijijel/article/view/941/530
  • Helmi, M., Alharthi, S., & Habib, S. (2024). Online trust determinants, consumer perception, and purchase intent in Saudi e-commerce: Exploring determinants and evidence. Humanities and Management Sciences — Scientific Journal of King Faisal University, 100–107. https://doi.org/10.37575/h/mng/240001
  • Hesniati, H., & Limgestu, R. (2023). Determinants of intention to use Islamic fintech during Covid-19 pandemic. Ekuitas: Jurnal Ekonomi dan Keuangan, 7(4), 587–604. https://doi.org/10.24034/j25485024.y2023.v7.i4.5860
  • Kwon, Y., Lee, J. H., & Owens, J. (2023). Managing fintech risks. Asian Development Bank. https://doi.org/10.22617/brf230170-2
  • Laínez, N., & Gardner, J. (2023). Algorithmic credit scoring in Vietnam: A legal proposal for maximizing benefits and minimizing risks. Asian Journal of Law and Society, 10(3), 401–432. https://doi.org/10.1017/als.2023.6
  • Mehrban, S., Nadeem, M. W., Hussain, M., Ahmed, M. M., Hakeem, O., Saqib, S., Kiah, M. L. M., Abbas, F., Hassan, M., & Khan, M. A. (2020). Towards secure FinTech: A survey, taxonomy, and open research challenges. IEEE Access, 8, 23391–23406. https://doi.org/10.1109/access.2020.2970430
  • Mongkito, L. O. M. H. A. S., Ransi, N., Surimi, L., Tenriawaru, A., Gunawan, G., & Rauf, B. W. (2024). Analisis sentimen aplikasi peminjaman online berdasarkan ulasan pada Play Store menggunakan metode Naïve Bayes dan support vector machine (studi kasus: Adakami dan EasyCash). Anoatik Jurnal Teknologi Informasi dan Komputer, 2(2), 121–128. https://doi.org/10.33772/anoatik.v2i2.71
  • Noveandini, R., Wulandari, M. S., & Rasyad, F. (2025). Penerapan model LSTM pada analisis sentimen ulasan pengguna aplikasi Shopee Google Play Store. Fasilkom, 15(2), 290–296. https://ejurnal.umri.ac.id/index.php/jik/article/view/9150
  • Riska, Sulubara, S. M., & Nurkhalisah. (2025). Analisis hukum peer to peer lending pada platform Shopee Paylater: Perspektif kontrak elektronik dan perlindungan konsumen. Jurnal Ilmu Sosial dan Ilmu Politik, 32(3). Tahta Media Group. https://tahtamedia.co.id/index.php/issj/article/view/1555/1547
  • Shah, A., & Patel, D. K. K. N. (2025). A comparative study of machine learning and deep learning techniques for multilingual text classification. International Journal of Applied Mathematics, 38(8s), 1278–1283. https://ijamjournal.org/ijam/publication/index.php/ijam/article/view/640/589
  • Sulistyowati, T., & Husda, N. E. (2023). The trust factor: A comprehensive review of antecedents and their role in shaping online purchase intentions. Jurnal Ekonomi dan Bisnis Airlangga, 33(2), 229–244. https://doi.org/10.20473/jeba.v33i22023.229-244
  • Tritto, A., He, Y., & Junaedi, V. A. (2020). Governing the gold rush into emerging markets: A case study of Indonesia's regulatory responses to the expansion of Chinese-backed online P2P lending. Financial Innovation, 6(1). https://doi.org/10.1186/s40854-020-00202-4
  • Winarni, Hindasyah, A., & Sirait, T. S. (2025). Analisis sentimen pada pengguna aplikasi Dana menggunakan metode LSTM dan BERT untuk meningkatkan pengguna aplikasi Dana. Jurnal Ilmiah Pendidikan Dasar, 10(4), 240–250. https://ejurnal.umri.ac.id/index.php/jik/article/view/9150
  • Wulandari, H. A., Astuti, R. P., & Barokah, M. (2025). Peran teknologi finansial (fintech) dalam meningkatkan efisiensi layanan keuangan di Indonesia. Jurnal Penelitian Nusantara, 1(5), 113–120. https://doi.org/10.59435/menulis.v1i5.240

Author Biographies

Fitri Abelia, Institut Sains dan Bisnis Atma Luhur

Institut Sains dan Bisnis Atma Luhur, Pangkal Pinang City, Bangka Belitung Islands Province, Indonesia

Fitriyani Fitriyani, Institut Sains dan Bisnis Atma Luhur

Institut Sains dan Bisnis Atma Luhur, Pangkal Pinang City, Bangka Belitung Islands Province, Indonesia

Downloads

OJS UsageStats Plugin
Download data is not yet available.

Most read articles by the same author(s)

Contrimetric

Recommended Articles