A Comparative Performance Analysis of Naïve Bayes, LSTM, and BiLSTM with Data Balancing Techniques for Sentiment Analysis of EasyCash Application Reviews
DOI:
https://doi.org/10.35870/ijsecs.v6i1.6862Keywords:
Sentiment Analysis, Naïve Bayes, Fintech ReviewsAbstract
This study compares the performance of Naïve Bayes, Long Short-Term Memory (LSTM), and Bidirectional LSTM (BiLSTM) models in sentiment analysis of EasyCash application reviews, with data balancing techniques applied throughout the process. The dataset was collected from the Google Play Store and processed through cleaning, tokenization, stemming, and normalization. Sentiment labeling classified reviews into positive, neutral, and negative categories. To address class imbalance, the Synthetic Minority Oversampling Technique (SMOTE) was applied prior to model training. Feature extraction was conducted using TF-IDF, and models were evaluated on accuracy, precision, recall, and F1-score. Naïve Bayes outperformed both LSTM and BiLSTM, producing higher accuracy and more stable results across evaluation metrics. The findings suggest that simpler machine learning models can be more effective than deep learning approaches when working with limited and imbalanced datasets. Careful data preprocessing, appropriate balancing techniques, and deliberate model selection remain central to achieving reliable sentiment classification performance in fintech applications.
Downloads
References
Adji, Y. B., Muhammad, W. A., Akrabi, A. N. L., & Noerlina. (2023). Perkembangan inovasi fintech di Indonesia. Business Economic, Communication, and Social Sciences Journal, 5(1), 47–58. https://doi.org/10.21512/becossjournal.v5i1.8675
Algamar, M. D., & Ismail, N. (2023). Data subject access request: What Indonesia can learn and operationalise in 2024? Journal of Central Banking Law and Institutions, 2(3), 481–512. https://doi.org/10.21098/jcli.v2i3.171
Alzoubi, S., Aldiabat, K., Al-Diabat, M., & Abualigah, L. (2024). An extensive analysis of several methods for classifying unbalanced datasets. Journal of Autonomous Intelligence, 7(3), 1–9. https://doi.org/10.32629/jai.v7i3.966
Amrie, J. H. W., Kurniawan, S., & Amrie, Y. R. S. (2022). Analysis of Google Play Store's sentiment review on Indonesia's P2P fintech platform. Proceedings of the IEEE Delhi Section Conference (DELCON), 1–5. https://doi.org/10.1109/DELCon54057.2022.9753108
Assyifa, D. S., & Luthfiarta, A. (2024). SMOTE-Tomek re-sampling based on random forest method to overcome unbalanced data for multi-class classification. Jurnal Ilmiah Teknologi Informasi dan Komunikasi, 9(2), 151–160. https://doi.org/10.25139/inform.v9i2.8410
Attar, R. W., Almusharraf, A., Alfawaz, A., & Hajli, N. (2022). New trends in e-commerce research: Linking social commerce and sharing commerce — a systematic literature review. Sustainability, 14(23), Article 16024. https://doi.org/10.3390/su142316024
Feriyanto, Qur'anisa, Z., Herawati, M., Lisvi, & Putri, M. H. (2024). Peran fintech dalam meningkatkan inklusi keuangan di era ekonomi digital. Gemilang Jurnal Manajemen dan Akuntansi, 4(3), 99–114. https://doi.org/10.63200/jebmass.v3i4.204
Fullah, A., Rahayu, S., Pratama, D., & Santoso, B. (2025). Analisis sentimen isu penyalahgunaan data pada layanan pinjaman online menggunakan support vector machine di platform X. Jurnal Informatika dan Teknik Elektro Terapan, 13(3s1), 1038–1047. https://journal.eng.unila.ac.id/index.php/jitet/article/view/7976
Gandasari, M., Hidayat, R. R., & Siswajanthy, F. (2025). Legal theory mengawasi fintech lending sebagai instrumen ekonomi digital. Indonesian Journal of Islamic Jurisprudence, Economic and Legal Theory, 3(1), 399–408. https://mail.shariajournal.com/index.php/ijijel/article/view/941/530
Helmi, M., Alharthi, S., & Habib, S. (2024). Online trust determinants, consumer perception, and purchase intent in Saudi e-commerce: Exploring determinants and evidence. Humanities and Management Sciences — Scientific Journal of King Faisal University, 100–107. https://doi.org/10.37575/h/mng/240001
Hesniati, H., & Limgestu, R. (2023). Determinants of intention to use Islamic fintech during Covid-19 pandemic. Ekuitas: Jurnal Ekonomi dan Keuangan, 7(4), 587–604. https://doi.org/10.24034/j25485024.y2023.v7.i4.5860
Kwon, Y., Lee, J. H., & Owens, J. (2023). Managing fintech risks. Asian Development Bank. https://doi.org/10.22617/brf230170-2
Laínez, N., & Gardner, J. (2023). Algorithmic credit scoring in Vietnam: A legal proposal for maximizing benefits and minimizing risks. Asian Journal of Law and Society, 10(3), 401–432. https://doi.org/10.1017/als.2023.6
Mehrban, S., Nadeem, M. W., Hussain, M., Ahmed, M. M., Hakeem, O., Saqib, S., Kiah, M. L. M., Abbas, F., Hassan, M., & Khan, M. A. (2020). Towards secure FinTech: A survey, taxonomy, and open research challenges. IEEE Access, 8, 23391–23406. https://doi.org/10.1109/access.2020.2970430
Mongkito, L. O. M. H. A. S., Ransi, N., Surimi, L., Tenriawaru, A., Gunawan, G., & Rauf, B. W. (2024). Analisis sentimen aplikasi peminjaman online berdasarkan ulasan pada Play Store menggunakan metode Naïve Bayes dan support vector machine (studi kasus: Adakami dan EasyCash). Anoatik Jurnal Teknologi Informasi dan Komputer, 2(2), 121–128. https://doi.org/10.33772/anoatik.v2i2.71
Noveandini, R., Wulandari, M. S., & Rasyad, F. (2025). Penerapan model LSTM pada analisis sentimen ulasan pengguna aplikasi Shopee Google Play Store. Fasilkom, 15(2), 290–296. https://ejurnal.umri.ac.id/index.php/jik/article/view/9150
Riska, Sulubara, S. M., & Nurkhalisah. (2025). Analisis hukum peer to peer lending pada platform Shopee Paylater: Perspektif kontrak elektronik dan perlindungan konsumen. Jurnal Ilmu Sosial dan Ilmu Politik, 32(3). Tahta Media Group. https://tahtamedia.co.id/index.php/issj/article/view/1555/1547
Shah, A., & Patel, D. K. K. N. (2025). A comparative study of machine learning and deep learning techniques for multilingual text classification. International Journal of Applied Mathematics, 38(8s), 1278–1283. https://ijamjournal.org/ijam/publication/index.php/ijam/article/view/640/589
Sulistyowati, T., & Husda, N. E. (2023). The trust factor: A comprehensive review of antecedents and their role in shaping online purchase intentions. Jurnal Ekonomi dan Bisnis Airlangga, 33(2), 229–244. https://doi.org/10.20473/jeba.v33i22023.229-244
Tritto, A., He, Y., & Junaedi, V. A. (2020). Governing the gold rush into emerging markets: A case study of Indonesia's regulatory responses to the expansion of Chinese-backed online P2P lending. Financial Innovation, 6(1). https://doi.org/10.1186/s40854-020-00202-4
Winarni, Hindasyah, A., & Sirait, T. S. (2025). Analisis sentimen pada pengguna aplikasi Dana menggunakan metode LSTM dan BERT untuk meningkatkan pengguna aplikasi Dana. Jurnal Ilmiah Pendidikan Dasar, 10(4), 240–250. https://ejurnal.umri.ac.id/index.php/jik/article/view/9150
Wulandari, H. A., Astuti, R. P., & Barokah, M. (2025). Peran teknologi finansial (fintech) dalam meningkatkan efisiensi layanan keuangan di Indonesia. Jurnal Penelitian Nusantara, 1(5), 113–120. https://doi.org/10.59435/menulis.v1i5.240
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Fitri Abelia, Fitriyani Fitriyani
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
1. Copyright Retention and Open Access License
Authors retain copyright of their work and grant the journal non-exclusive right of first publication under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
This license allows unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
2. Rights Granted Under CC BY 4.0
Under this license, readers are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, including commercial use
- No additional restrictions — the licensor cannot revoke these freedoms as long as license terms are followed
3. Attribution Requirements
All uses must include:
- Proper citation of the original work
- Link to the Creative Commons license
- Indication if changes were made to the original work
- No suggestion that the licensor endorses the user or their use
4. Additional Distribution Rights
Authors may:
- Deposit the published version in institutional repositories
- Share through academic social networks
- Include in books, monographs, or other publications
- Post on personal or institutional websites
Requirement: All additional distributions must maintain the CC BY 4.0 license and proper attribution.
5. Self-Archiving and Pre-Print Sharing
Authors are encouraged to:
- Share pre-prints and post-prints online
- Deposit in subject-specific repositories (e.g., arXiv, bioRxiv)
- Engage in scholarly communication throughout the publication process
6. Open Access Commitment
This journal provides immediate open access to all content, supporting the global exchange of knowledge without financial, legal, or technical barriers.
