Generative AI for Recognizing Nurse Training Activities in Skeleton-Based Video Data
Article
Mamun, M., Hossain, S., Islam, M. B. and Ahad, M. A. R. 2024. Generative AI for Recognizing Nurse Training Activities in Skeleton-Based Video Data. International Journal of Activity and Behavior Computing. 2024 (3), pp. 1-20. https://doi.org/10.60401/ijabc.34
Authors | Mamun, M., Hossain, S., Islam, M. B. and Ahad, M. A. R. |
---|---|
Abstract | Endotracheal suctioning (ES) is a complex procedure associated with a series of actions and inherent risks, particularly in the intensive care unit (ICU). Given the importance of precise execution, it is preferable to have skilled nurses perform ES tasks. To facilitate nurse training and ensure proficiency in ES procedures, automated nursing activity recognition presents a promising solution, offering benefits in terms of cost, time, and effort. In this paper, we propose a novel approach to nurse training activity recognition for ES tasks, leveraging the capabilities of Generative Artificial Intelligence (GenAI). Specifically, we demonstrate how Large Language Models (LLMs), a subset of GenAI, can enhance the efficiency of nursing activity recognition. By employing LLMs such as OpenAI’s Generative Pre-trained Transformer (ChatGPT), Google’s Gemini, and Microsoft’s Copilot, we aim to improve the accuracy and efficiency of our methodology. Our study identifies a clear gap in the utilization of LLMs for more accurate determination of nursing activities related to ES, with reduced human interaction. Through the integration of approaches and data features suggested by LLMs, we achieve a notable increase in accuracy from baseline 0.51 to 0.58, along with an elevated F1 score from 0.31 to 0.46. These results underscore the potential of LLMs, as a subset of GenAI, to enhance traditional problem-solving efficiency by offering robust solutions and procedures. |
Journal | International Journal of Activity and Behavior Computing |
Journal citation | 2024 (3), pp. 1-20 |
ISSN | 2759-2871 |
Year | 2024 |
Publisher | Care XDX Center, Kyushu Institute of Technology |
Accepted author manuscript | File Access Level Repository staff only |
Publisher's version | License File Access Level Anyone |
Digital Object Identifier (DOI) | https://doi.org/10.60401/ijabc.34 |
Publication dates | |
Online | 28 Aug 2024 |
Publication process dates | |
Accepted | 01 May 2024 |
Deposited | 28 Nov 2024 |
Copyright holder | © 2024, The Author(s) |
https://repository.uel.ac.uk/item/8y073
Download files
9
total views2
total downloads7
views this month2
downloads this month