HandovAR: A Framework of Collaborative ICU Nurse Handover System via Augmented Reality

This project develops a collaborative handover system using an augmented reality (AR) headset display to improve ICU nurse communication. It integrates in-situ AR visualisations and a cross-reality collaboration model to address cognitive challenges and data fragmentation in handovers. The prototype aims to enhance the accuracy and efficiency of handover for practical application in high-pressure settings. Broader impacts include applications in emergency care, rural health, and allied health professions, with potential for simulation training and multidisciplinary team support across diverse clinical environments.

This research addresses the challenges in the nurse handover process in critical care settings by designing an integrated solution that leverages immersive technologies. We propose an integrated approach consisting of the following innovative concepts: in-situ augmented reality (AR) overlays and a cross-reality collaborative model.

In-situ augmented reality overlays — The project will mainly explore the use of embedded visualisations (e.g., vital sign trends and digital anatomical models) in 3D space, displayed through augmented reality headsets at the bedside, to ensure data integrity over time and between nurses, assisting nurses in promptly identifying abnormal conditions, and enhancing clinical decision-making.

Cross-reality collaborative model — The project will also explore leveraging augmented reality to develop a cross-reality system that supports collaborative but remote and even asynchronous nurse handovers. Traditional handover requires nurses to be co-located, while AR could enable asynchronous information exchange (e.g., pre-recorded handover or a remote handover process for patient transfer) for shared understanding and flexible communication during the transition of care.