Abstract
This study utilizes the ResNet50 architecture with transfer learning techniques. The dataset consists of 5,200 facial images categorized into five classes: normal, dry, oily, combination, and sensitive. Data was split with an 80:10:10 ratio for training, validation, and testing. Data augmentation was applied to increase dataset variety. The recommendation system was developed using a content-based filtering approach with rule-based mapping between classification results and product attributes. The ResNet50 model achieved a classification accuracy of 90.4% on test data, with the highest F1-score for the oily class (94.7%) and the lowest for the sensitive class (86.9%). The recommendation system produced a Mean Reciprocal Rank (MRR) of 0.82 and precision@3 of 0.76. User satisfaction testing with 50 participants showed an 84% satisfaction rate. CNN with the ResNet50 architecture is effective for facial skin type classification with high accuracy. The integration of the classification system with content-based recommendation mechanisms successfully provides relevant skincare product recommendations. This system has the potential to become a digital tool that can enhance public skin health literacy and reduce errors in skincare product selection.
Article Details
How to Cite
Citation FormatReferences
20 References- Aggarwal, C. C. (2016). Recommender systems (Vol. 1, No. 1). Cham: Springer International Publishing.
- Baumann, L. (2006). The skin type solution: a revolutionary guide to your best skin ever. Bantam.
- Baumann, L. (2008). Understanding and treating various skin types: the Baumann Skin Type Indicator. Dermatologic clinics, 26(3), 359-373.
- Draelos, Z. D. (2018). The science behind skin care: Moisturizers. Journal of cosmetic dermatology, 17(2), 138-144. https://doi.org/10.1111/jocd.12490.
- Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017). Dermatologist-level classification of skin cancer with deep neural networks. nature, 542(7639), 115-118.
- Goodfellow, I., Bengio, Y., Courville, A., & Bengio, Y. (2016). Deep learning (Vol. 1, No. 2, pp. 1-800). Cambridge: MIT press.
- He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
- Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., ... Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv Preprint arXiv:1704.04861.
- Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). ImageNet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84-90.
- LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444.
- Misery, L., Boussetta, S., Nocera, T., Perez‐Cullell, N., & Taieb, C. (2009). Sensitive skin in Europe. Journal of the European Academy of Dermatology and Venereology, 23(4), 376-381. https://doi.org/10.1111/j.1468-3083.2008.03037.x.
- Mukhopadhyay, P. (2011). Cleansers and their role in various dermatological disorders. Indian journal of dermatology, 56(1), 2-6.
- Nelson, K., Taylor, E., & Walsh, D. (2020). Digital health literacy and accessibility. Journal of Medical Internet Research, 22(8), e18456.
- Park, S., Lee, J., & Kim, H. (2021). Deep learning-based skin condition classification using facial images. IEEE Access, 9, 43271–43280.
- Park, S., Moon, J., & Kim, Y. (2022). Accessibility and usability of AI-based skin diagnosis applications for general public. International Journal of Human-Computer Interaction, 38(5), 412–425.
- Research and Markets. (2023). Global skin care products market size, share & trends analysis report 2023–2027.
- Ricci, F., Rokach, L., & Shapira, B. (2022). Recommender systems handbook (3rd ed.). Springer.
- Shorten, C., & Khoshgoftaar, T. M. (2019). A survey on image data augmentation for deep learning. Journal of Big Data, 6(1), 1–48.
- Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv Preprint arXiv:1409.1556.
- World Health Organization. (2021). Digital health for all: Strengthening digital health implementation. WHO Press.
License
Copyright (c) 2026 Sri Lestari, Mesra Betty Yel, Ahlan Nur Fallah, Giraldi Freddy Simanungkalit, M. Ilyan Fadiliah, M. Dicky Adicandra, Dadang Iskandar Mulyana, Sutisna Sutisna

This work is licensed under a Creative Commons Attribution 4.0 International License.
This is an open-access journal distributed under the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, reproduction, and adaptation in any medium (even commercially), provided appropriate credit is given to the original author(s), a link to the license is provided, and any changes made are indicated. Authors retain copyright without restrictions and grant the journal the right of first publication as well as non-exclusive publishing rights for archiving, indexing, and scholarly dissemination.
Downloads
OJS UsageStats PluginSimilar Articles
- Determinan Niat Pembelian Produk Skincare Ramah Lingkungan di Indonesia: Pendekatan Theory of Planned Behavior yang Diperluas Kezia Rama Lisupindan Sumbung, Luki Adiati Pratomo · Jurnal EMT KITA · Vol. 10 No. 3 (2026): JULY 2026
- Pengaruh Dimensi Emotional Interaction terhadap Purchase Intention dengan Perceived Usefulness sebagai Variabel Intervening pada Produk Skincare Lokal di Social Commerce TikTok Afitrotul Akmalia, Ratna Listiana Dewanti · Jurnal EMT KITA · Vol. 8 No. 4 (2024): OCTOBER 2024
- Peran Kredibilitas Influencer, Iklan, Citra Merek dalam Memengaruhi Keputusan Pembelian Produk Skincare di TikTok Shop Vera Rindiani Kamila, Guruh Taufan Hariyadi, Imam Nuryanto, Febrianur Ibnu Fitroh Sukono Putra · Jurnal EMT KITA · Vol. 10 No. 3 (2026): JULY 2026
- Pengaruh Daya Tarik Influencer dan Brand Image Terhadap Keputusan Pembelian Produk Skincare (Studi Pada Konsumen Glad2Glow di Kalangan Gen Z) Defanny Rahman Pratiwi, Ati Hermawati · Jurnal EMT KITA · Vol. 10 No. 3 (2026): JULY 2026
- Pengaruh Strategi Promosi Melalui Media Sosial terhadap Keputusan Pembelian Produk DRW Putri Bustami Bustami, Andri Nofiar Am, Agnes Monica Febrianti Hutasoit · Jurnal EMT KITA · Vol. 10 No. 1 (2026): JANUARY 2026
You may also start an advanced similarity search for this article.
Recommended Articles
Journal Transparency
Additional InformationLearn more about how this journal ensures quality, ethics, and transparency.