Optimization of Hospital Queue Management Using Priority Queue Algorithm and Reinforcement Learning for Emergency Service Prioritization
DOI:
https://doi.org/10.35870/ijsecs.v4i2.2772Keywords:
Queue Management, Hospital, Priority Queue, Reinforcement LearningAbstract
This study aims to develop and implement an efficient hospital queue management system by integrating the Priority Queue algorithm with Reinforcement Learning (RL). The primary objective is to enhance the prioritization of emergency patients, ensuring that those with the most critical conditions receive timely care. The Priority Queue algorithm facilitates the sorting of patients based on the severity of their medical conditions, while RL enables the system to continuously learn and optimize the queue management process using historical data and real-time feedback. The research methodology includes data collection from hospital queues, algorithm model development, and simulated and real-world data validation. The results demonstrate that the combination of these algorithms significantly reduces waiting times for emergency patients and improves overall hospital operational efficiency. Additionally, implementing this algorithm has increased patient satisfaction due to shorter wait times and more timely services. The study concludes that the Priority Queue algorithm enhanced by RL is an effective solution for hospital queue management and recommends further research on larger scales and with more complex algorithms.
Downloads
References
Armony, M., Israelit, S., Mandelbaum, A., Marmor, Y., Tseytlin, Y., & Yom-Tov, G. (2015). On patient flow in hospitals: A data-based queueing-science perspective. Stochastic Systems, 5(1), 146-194. https://doi.org/10.1287/14-ssy153
Benevento, E., Aloini, D., Squicciarini, N., Dulmin, R., & Mininno, V. (2019). Queue-based features for dynamic waiting time prediction in emergency departments. Measuring Business Excellence, 23(4), 458-471. https://doi.org/10.1108/mbe-12-2018-0108
Liang, C. (2016). Queueing management and improving customer experience: Empirical evidence regarding enjoyable queues. Journal of Consumer Marketing, 33(4), 257-268. https://doi.org/10.1108/jcm-07-2014-1073
Brown, R. (1988). Calendar queues: A fast 0(1) priority queue implementation for the simulation event set problem. Communications of the ACM, 31(10), 1220-1227. https://doi.org/10.1145/63039.63045
Thorup, M. (2007). Equivalence between priority queues and sorting. Journal of the ACM, 54(6), 28. https://doi.org/10.1145/1314690.1314692
He, Q., Xie, J., & Zhao, X. (2012). Priority queue with customer upgrades. Naval Research Logistics (NRL), 59(5), 362-375. https://doi.org/10.1002/nav.21494
Liu, B., Xie, Q., & Modiano, E. (2019). Reinforcement learning for optimal control of queueing systems. Proceedings of Allerton Conference on Communication, Control, and Computing, 2019. https://doi.org/10.1109/allerton.2019.8919665
Maity, I., & Taleb, T. (2022). Resq: Reinforcement learning-based queue allocation in software-defined queuing framework. Journal of Networking and Network Applications, 2(4), 143-152. https://doi.org/10.33969/j-nana.2022.020402
Yousif, A., Hassan, H., & Muttasher, G. (2022). Applying reinforcement learning for random early detection algorithm in adaptive queue management systems. Indonesian Journal of Electrical Engineering and Computer Science, 26(3), 1684. https://doi.org/10.11591/ijeecs.v26.i3.pp1684-1691
Turnip, H., & Soewondo, P. (2022). Analisis manajemen anggaran pada rumah sakit rujukan di masa pandemi COVID-19. Jurnal Ekonomi Kesehatan Indonesia, 7(2), 124. https://doi.org/10.7454/eki.v7i2.5993
Suhartatik, S., Putra, D., Farlinda, S., & Wicaksono, A. (2022). Evaluasi keberhasilan implementasi SIMRS di rumah sakit X Kabupaten Jember dengan pendekatan metode TTF. J-Remi Jurnal Rekam Medik dan Informasi Kesehatan, 3(3), 231-242. https://doi.org/10.25047/j-remi.v3i3.2586
Armono, D. (2022). Pengukuran dan Evaluasi Kinerja Lembaga Rumah Sakit dalam Rangka Meningkatkan Kualitas Layanan Publik. Jurnal Aplikasi Bisnis, 19(2), 201-208. https://doi.org/10.20885/jabis.vol19.iss2.art1
Cho, Y., & Hong, P. (2023). Applying machine learning to healthcare operations management: CNN-based model for malaria diagnosis. Healthcare, 11(12), 1779. https://doi.org/10.3390/healthcare11121779
Elalouf, A., & Wachtel, G. (2021). Queueing problems in emergency departments: A review of practical approaches and research methodologies. Operations Research Forum, 3(1). https://doi.org/10.1007/s43069-021-00114-8
Zheng, L., Li, W., Wang, L., & Ou, J. (2023). Development and validation of machine learning-based models for prediction of adolescent idiopathic scoliosis: A retrospective study. Medicine, 102(14), e33441. https://doi.org/10.1097/md.0000000000033441
Imran, M., Zaman, U., Imtiaz, J., Fayaz, M., & Gwak, J. (2021). Comprehensive survey of IoT, machine learning, and blockchain for health care applications: A topical assessment for pandemic preparedness, challenges, and solutions. Electronics, 10(20), 2501. https://doi.org/10.3390/electronics10202501
Brown, N. (2024). Predicting accurate batch queue wait times on production supercomputers by combining machine learning techniques. Concurrency and Computation: Practice and Experience, 36(15). https://doi.org/10.1002/cpe.8112
Tassew, T., & Xu, M. (2022). A comprehensive review of the application of machine learning in medicine and healthcare. TechRxiv Preprints. https://doi.org/10.36227/techrxiv.21204779
Mishra, R. (2024). Deep learning techniques for forecasting emergency department patient wait times in healthcare queue systems. Research Square Preprints, 2024. https://doi.org/10.21203/rs.3.rs-4392800/v1
Davalos, D. (2024). A conceptual swarm intelligence framework for deriving a global healthcare machine learning model. International Journal of Business and Applied Social Science, 12(27). https://doi.org/10.33642/ijbass.v10n5p2
López Martínez, F. E. (2020). A Big Data and Machine Learning Model to Improve Medical Decision Support in Population Health Management (Doctoral dissertation).
Hijry, H., & Olawoyin, R. (2021). Predicting patient waiting time in the queue system using deep learning algorithms in the emergency room. International Journal of Industrial Engineering and Operations Management, 03(01), 33-45. https://doi.org/10.46254/j.ieom.20210103
Mtange, M. (2023). Log-in, track-it and customer-care: Women’s perspective of queueing technology system in healthcare in Kenya. Jurnal Komunikasi Ikatan Sarjana Komunikasi Indonesia, 8(1), 192-197. https://doi.org/10.25008/jkiski.v8i1.863
Septian, E. (2021). Penerapan sistem pelayanan aplikasi pendaftaran online di Rumah Sakit Umum Pusat Dr. Sardjito Yogyakarta. Matra Pembaruan, 5(1), 53-64. https://doi.org/10.21787/mp.5.1.2021.53-64
Sherzer, E., Senderovich, A., Baron, O., & Krass, D. (2022). Can machines solve general queueing systems? arXiv Preprint, 2022. https://doi.org/10.48550/arxiv.2202.01729
Vucevic, N., Perez-Romero, J., Sallent, O., & Agusti, R. (2007). Reinforcement learning for active queue management in mobile all-IP networks. Proceedings of the IEEE International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC). https://doi.org/10.1109/pimrc.2007.4394713.
Downloads
Published
Issue
Section
Categories
License
Copyright (c) 2024 Iwan Adhicandra, Safitri Nurhidayati, Tribowo Rachmat Fauzan
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:
1. Copyright Retention and Open Access License
Authors retain copyright of their work and grant the journal non-exclusive right of first publication under the Creative Commons Attribution 4.0 International License (CC BY 4.0).
This license allows unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
2. Rights Granted Under CC BY 4.0
Under this license, readers are free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, including commercial use
- No additional restrictions — the licensor cannot revoke these freedoms as long as license terms are followed
3. Attribution Requirements
All uses must include:
- Proper citation of the original work
- Link to the Creative Commons license
- Indication if changes were made to the original work
- No suggestion that the licensor endorses the user or their use
4. Additional Distribution Rights
Authors may:
- Deposit the published version in institutional repositories
- Share through academic social networks
- Include in books, monographs, or other publications
- Post on personal or institutional websites
Requirement: All additional distributions must maintain the CC BY 4.0 license and proper attribution.
5. Self-Archiving and Pre-Print Sharing
Authors are encouraged to:
- Share pre-prints and post-prints online
- Deposit in subject-specific repositories (e.g., arXiv, bioRxiv)
- Engage in scholarly communication throughout the publication process
6. Open Access Commitment
This journal provides immediate open access to all content, supporting the global exchange of knowledge without financial, legal, or technical barriers.
