From Concept to Clinic: Multidisciplinary Design, Development, and Clinical Validation of Augmented Reality-Assisted Open Pancreatic Surgery

要旨

Wearable augmented reality (AR) systems have significant potential to enhance surgical outcomes through in-situ visualization of patient-specific data. Yet, efforts to develop AR-based systems for open surgery have been limited, lacking comprehensive interdisciplinary research and actual clinical evaluations in real surgical environments. Our research addresses this gap by presenting a user-centered design and development process of ARAS, an AR assistance for open pancreatic surgery. ARAS provides in-situ visualization of critical structures, such as the vascular system and the tumor, while offering a robust dual-layer registration method ensuring accurate registration during relevant phases of the surgery. We evaluated ARAS in clinical trials of 20 patients with pancreatic tumors. Accuracy validation and postoperative surgeon interviews confirmed its successful deployment, supporting surgeons in vascular localization and critical decision-making. Our work showcases AR's potential to fundamentally transform procedures for complex surgical operations, advocating a research shift toward ecological validation in open surgery.

著者
Hamraz Javaheri
German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
Omid Ghamarnejad
Allgemein-, Viszeral und Thoraxchirurgie, Chirurgische Onkologie, Klinikum Saarbrücken, Saarbrücken , Germany
Paul Lukowicz
German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
Gregor A. Stavrou
Allgemein-, Viszeral und Thoraxchirurgie, Chirurgische Onkologie, Klinikum Saarbrücken, Saarbrücken, Germany
Jakob Karolus
German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany
DOI

10.1145/3706598.3713458

論文URL

https://dl.acm.org/doi/10.1145/3706598.3713458

動画

会議: CHI 2025

The ACM CHI Conference on Human Factors in Computing Systems (https://chi2025.acm.org/)

セッション: Digital Health for Different User Needs

G314+G315
7 件の発表
2025-04-30 20:10:00
2025-04-30 21:40:00
日本語まとめ
読み込み中…