Realize Medical
Research Library · Independent literature review

Hepatobiliary & pancreatic (HPB): VR and AR surgical planning research

The library holds 34 Hepatobiliary & pancreatic (HPB) studies, published 2018–2026; 16 of them since 2024.

Study designs: 5 comparative or prospective studies, 3 retrospective studies, 4 surveys and user studies, 9 reviews and 13 case reports, case series and technical reports.

Hepatobiliary & pancreatic (HPB): studies by questionBar chart. Hepatobiliary & pancreatic (HPB): studies by question. Anatomy understanding 13, Prefer 3D planning 8, Accuracy 5, Patient outcomes 5, Time 4, Resident training 3.RESEARCH LIBRARY · INDEPENDENT LITERATURE REVIEWHepatobiliary & pancreatic (HPB):studies by question34 studies in the libraryAnatomy understanding13Prefer 3D planning8Accuracy5Patient outcomes5Time4Resident training3Positive findingMixedDescriptiveNo significant differenceRealize Medical Research Library · 631 studies · updated 2026-10-03

Key findings by question

Quoted from the studies. Each question lists the studies that report on it.

Do surgeons actually want to plan in 3D?

Of 8 studies with a finding on this question: 6 report a positive finding, 1 descriptive, 1 no significant difference. These reflect what each study's authors report.

  • Positive finding
    “Regarding usability and user experience the VR application achieved the highest scores without causing significant vegetative symptoms and was also the most preferred method (n=22, 73.3%)”

    Huettl 2021 · Comparative study · n: 20 cases

  • Positive finding
    “Mean SUS scores were 96.0 preoperatively and 95.5 postoperatively, reflecting excellent usability.”

    Lamadé 2026 · Retrospective case series · n: 5 patients

  • Positive finding
    “The prototype achieved a mean SUS score of 67.25 (SD 7.95), indicating acceptable usability.”

    Matsangidou 2026 · Survey/user study

Does it improve anatomical understanding?

Of 13 studies with a finding on this question: 11 report a positive finding, 1 mixed, 1 no significant difference. These reflect what each study's authors report.

  • Positive finding
    “The HoloCare™ MXR system was seamlessly integrated into all five cases and improved tumor localization and understanding of vascular anatomy.”

    Lamadé 2026 · Retrospective case series · n: 5 patients

  • Positive finding
    “In simulated multidisciplinary tumor board scenarios, clinicians reported improved spatial understanding, reduced cognitive load, and enhanced interdisciplinary communication.”

    Matsangidou 2026 · Survey/user study

  • Positive finding
    “Participants generally agreed that complex cases in particular could be assessed better (94.3%) and faster (84.8%) with VR than with traditional 2D display methods.”

    Kenngott 2022 · Survey/user study · n: 1 patient

Does it save time?

Of 4 studies with a finding on this question: 2 report a positive finding, 2 descriptive. These reflect what each study's authors report.

  • Positive finding
    “The median time for correct identification was 23.5 [4-138] s using the magnetic resonance imaging images and 6.00 [1-35] s using HoloLens (p < 0.001)”

    Pelanis 2020 · Comparative study

  • Positive finding
    “Compared to traditional hepatectomy in Group B, MR-assisted hepatectomy in Group A yielded a shorter operation time (202.86 ± 46.02 min vs 229.52 ± 57.13 min, P = 0.003)”

    Zhu 2022 · Retrospective cohort · n: 95 patients

  • Descriptive
    “Tumor assignment was significantly shorter with 3D PR models compared to 3D PDF (P<0.001) or VR application (P<0.001).”

    Huettl 2021 · Comparative study · n: 20 cases

All specialties

Is the planning accurate?

Of 5 studies with a finding on this question: 4 report a positive finding, 1 no significant difference. These reflect what each study's authors report.

  • Positive finding
    “Accuracy improved from 32.69% to 100% (students) and 74.47% to 100% (residents); time reduced by 54.40% and 51.12%.”

    Guo 2026 · Preprint (controlled trial)

  • Positive finding
    “The mixed-reality-based 3D anatomical model clearly visualized the anatomical configuration through rotation, which allowed the endoscopists to accurately identify the cystic duct and advance the guidewire into the gallbladder ( Fig. 5 a ).”

    Tanisaka 2025 · Case report (video/image) · n: 1 patient

  • Positive finding
    “A post-placement VR model showed visual concordance between the planned trajectory and the final stent path ( Video 1 ).”

    Namima 2025 · Case report (video/image) · n: 1 patient

Does it affect patient outcomes?

Of 5 studies with a finding on this question: 1 report a positive finding, 2 descriptive, 2 no significant difference. These reflect what each study's authors report.

  • Positive finding
    “The total postoperative complications and hospitalization days in Group A were significantly less than those in Group B [14 (37.84%) vs 35 (60.34%), P = 0.032 and 12.05 ± 4.04 d vs 13.78 ± 4.13 d, P = 0.049, respectively].”

    Zhu 2022 · Retrospective cohort · n: 95 patients

  • Descriptive
    “In another case, the hologram enabled a safe Gliisonean pedicle approach for hepato-cellular carcinoma with a hilar anatomical anomaly.”

    Saito 2020 · Case series · n: 2 patients

  • Descriptive
    “All patients underwent successful resection of tumor under the guidance of 3D visualization and VR technology.”

    Zhu 2019 · Case series · n: 20 patients

Hepatobiliary & pancreatic (HPB) studies on this questionAll specialties

Does it help train residents?

Of 3 studies with a finding on this question: 1 report a positive finding, 2 descriptive. These reflect what each study's authors report.

  • Positive finding
    “LiverXR-Plan enhances surgical planning competency and shifts liver surgery education from experience-dependent to data-driven decision-making.”

    Guo 2026 · Preprint (controlled trial)

  • Descriptive
    “These findings indicate that VR is associated with measurable advantages under higher task complexity, supporting its potential role in surgical education and preoperative planning, although the present design cannot isolate which immersive features drive this benefit.”

    Zolkin 2026 · Comparative study

  • Descriptive
    “Least potential was seen in nursing training (54.8%).”

    Kenngott 2022 · Survey/user study · n: 1 patient

Studies (34)

Effect of virtual reality on spatial-anatomical understanding in preoperative liver surgery: a randomized crossover study #

Zolkin A et al. · Scientific reports · 2026

Hepatobiliary & pancreatic (HPB) · Comparative study

“In complex models, VR significantly improved performance compared with desktop visualization (28.0 ± 3.3 vs. 26.4 ± 3.6; p = 0.002, d = 0.46), whereas results for simpler models were comparable.”

p = 0.002

DOIPubMedFree full text

Comparative Study of Segmentation Algorithms for the Generation of CT-Based Preoperative Planning Meshes of the Liver Vessels #

Pedraja J et al. · Journal of Medical and Biological Engineering · 2025

Hepatobiliary & pancreatic (HPB) · Comparative study · n: 9 patients

DOIFree full text

Investigating the utility of VR for spatial understanding in surgical planning: evaluation of head-mounted to desktop display #

Hattab G et al. · Scientific reports · 2021

Hepatobiliary & pancreatic (HPB) · Comparative study

“Results showed that the learning condition (HMD or DT) did not influence participants' memory and confidence ratings of the models.”

DOIPubMedFree full text

Virtual reality and 3D printing improve preoperative visualization of 3D liver reconstructions-results from a preclinical comparison of presentation modalities and user's preference #

Huettl F et al. · Annals of translational medicine · 2021

Hepatobiliary & pancreatic (HPB) · Comparative study · n: 20 cases

“Regarding usability and user experience the VR application achieved the highest scores without causing significant vegetative symptoms and was also the most preferred method (n=22, 73.3%)”

73.3%

DOIPubMedFree full text

Use of mixed reality for improved spatial understanding of liver anatomy #

Pelanis E et al. · Minimally invasive therapy & allied technologies · 2020

Hepatobiliary & pancreatic (HPB) · Comparative study

“From a total of 150 lesions, 89 were correctly assigned without significant difference between the modalities.”

DOIPubMedFree full text

Potential contribution of extended reality to safety in minimally invasive hepatectomy: a comparative study of laparoscopic and robotic approaches #

Naito S et al. · Journal of robotic surgery · 2026

Hepatobiliary & pancreatic (HPB) · Retrospective cohort · n: 102 patients

“Nevertheless, the estimated blood loss (median 150 mL vs. 100 mL, P = 0.054) and incidence of severe complications (6.4% vs. 0%, P = 0.094) did not differ significantly between the XR and non-XR groups.”

P = 0.054

DOIPubMed

First evaluation of augmented and mixed reality in open liver surgery #

Lamadé W et al. · Minimally invasive therapy & allied technologies · 2026

Hepatobiliary & pancreatic (HPB) · Retrospective case series · n: 5 patients

“The HoloCare™ MXR system was seamlessly integrated into all five cases and improved tumor localization and understanding of vascular anatomy.”

DOIPubMedFree full text

Application value of mixed reality in hepatectomy for hepatocellular carcinoma #

Zhu LY et al. · World journal of gastrointestinal surgery · 2022

Hepatobiliary & pancreatic (HPB) · Retrospective cohort · n: 95 patients

“Compared to traditional hepatectomy in Group B, MR-assisted hepatectomy in Group A yielded a shorter operation time (202.86 ± 46.02 min vs 229.52 ± 57.13 min, P = 0.003)”

P = 0.003

DOIPubMedFree full text

From Prototype to Practice: Mixed Methods Study of Human-Centered Design and Usability Evaluation of Augmented Reality for Complex Oncology Surgical Workflows #

Matsangidou M et al. · JMIR human factors · 2026

Hepatobiliary & pancreatic (HPB) · Survey/user study

“The prototype achieved a mean SUS score of 67.25 (SD 7.95), indicating acceptable usability.”

67.25 (SD 7.95)

DOIPubMedFree full text

Measuring Bound Attention During Complex Liver Surgery Planning: Feasibility Study #

Schneider T et al. · JMIR formative research · 2025

Hepatobiliary & pancreatic (HPB) · Survey/user study · n: 9 participants

“The AR condition had the highest scores for mental demand (median 75, IQR 70-85), effort (median 55, IQR 30-65), and frustration (median 40, IQR 15-75) compared with the VR and PC conditions.”

DOIPubMedFree full text

IMHOTEP: cross-professional evaluation of a three-dimensional virtual reality system for interactive surgical operation planning, tumor board discussion and immersive training for complex liver surgery in a head-mounted display #

Kenngott HG et al. · Surgical endoscopy · 2022

Hepatobiliary & pancreatic (HPB) · Survey/user study · n: 1 patient

“In the evaluation by 158 participants (57 medical students, 35 resident surgeons, 13 attending surgeons and 53 nurses), 89.9% found the VR system agreeable to work with.”

89.9%

DOIPubMedFree full text

Virtual Reality for Surgical Planning - Evaluation Based on Two Liver Tumor Resections #

Reinschluessel AV et al. · Frontiers in surgery · 2022

Hepatobiliary & pancreatic (HPB) · Qualitative/user study · n: 2 patients

“The participants used on average 14.3 min (SD = 3.59) to plan the cases in VR.”

14.3 min

DOIPubMedFree full text

[Virtual reality in liver surgery-Planning, advanced training, testing] #

Huber T et al. · Chirurgie (Heidelberg, Germany) · 2025

Hepatobiliary & pancreatic (HPB) · Narrative review

DOIPubMed

[Augmented and virtual reality in surgery: fields of application and exploratory studies exemplified by VIVATOP : Perioperative surgical planning and intraoperative support] #

Weyhe D et al. · Chirurgie (Heidelberg, Germany) · 2025

Hepatobiliary & pancreatic (HPB) · Narrative review

DOIPubMedFree full text

Integrating mixed reality, augmented reality, and artificial intelligence in complex liver surgeries: Enhancing precision, safety, and outcomes #

Wang X et al. · iLIVER · 2025

Hepatobiliary & pancreatic (HPB) · Narrative review

DOIPubMedFree full text

Technological Advances in Pre-Operative Planning #

Kowal MR et al. · Journal of clinical medicine · 2025

Hepatobiliary & pancreatic (HPB) · Narrative review

DOIPubMedFree full text

Enhancing liver surgery and transplantation: the role of 3D printing and virtual reality #

Kasai M et al. · Artificial Intelligence Surgery · 2024

Hepatobiliary & pancreatic (HPB) · Narrative review

“Though safely implemented, AR failed to improve outcomes over standard techniques in this initial experience”

DOIFree full text

[Application of mixed reality technology in the field of hepatobiliary surgery] #

Hou JC, Zhang YM · Zhonghua wai ke za zhi [Chinese journal of surgery] · 2022

Hepatobiliary & pancreatic (HPB) · Narrative review

DOIPubMed

[Liver Surgery 4.0 - Planning, Volumetry, Navigation and Virtual Reality] #

Huber T et al. · Zentralblatt fur Chirurgie · 2022

Hepatobiliary & pancreatic (HPB) · Narrative review

DOIPubMed

Uses of a dedicated 3D reconstruction software with augmented and mixed reality in planning and performing advanced liver surgery and living donor liver transplantation (with videos) #

Balci D et al. · Hepatobiliary & pancreatic diseases international · 2022

Hepatobiliary & pancreatic (HPB) · Narrative review

DOIPubMed

Show the other 14 studies

Virtual and Augmented Reality in Oncologic Liver Surgery #

Quero G et al. · Surgical oncology clinics of North America · 2019

Hepatobiliary & pancreatic (HPB) · Narrative review

DOIPubMed

Extended Reality-Based Hepatic Surgical Planning: Impact on Task Time, Anatomic Accuracy, and Cognitive Burden in Novice Surgeons #

Guo J et al. · Research Square · 2026

Hepatobiliary & pancreatic (HPB) · Preprint (controlled trial)

“Accuracy improved from 32.69% to 100% (students) and 74.47% to 100% (residents); time reduced by 54.40% and 51.12%.”

74.47% to 100%

DOI

Successful guidewire insertion into the gallbladder facilitated by a mixed-reality-based three-dimensional anatomical model #

Tanisaka Y et al. · Endoscopy · 2025

Hepatobiliary & pancreatic (HPB) · Case report (video/image) · n: 1 patient

“The mixed-reality-based 3D anatomical model clearly visualized the anatomical configuration through rotation, which allowed the endoscopists to accurately identify the cystic duct and advance the guidewire into the gallbladder ( Fig. 5 a ).”

DOIPubMedFree full text

Virtual reality cross-sections matched to endoscopic ultrasound for preprocedural simulation of hepaticogastrostomy #

Namima D et al. · Endoscopy · 2025

Hepatobiliary & pancreatic (HPB) · Case report (video/image) · n: 1 patient

“Switching to a whole-tree view clarified the duct caliber, curvature, distance to the common bile duct, and relationships with adjacent organs, helping predict guidewire direction and avoid unfavorable angles.”

DOIPubMedFree full text

Mixed-reality enhanced size-matching and graft reduction in paediatric living donor liver transplantation #

Gao Y et al. · HPB · 2024

Hepatobiliary & pancreatic (HPB) · Conference abstract

DOI

Using preoperative Virtual Reality simulation in liver surgery can help a young trainee surgeon #

Hayashi K et al. · HPB · 2024

Hepatobiliary & pancreatic (HPB) · Conference abstract

DOI

Augmented reality in hepatobiliary-pancreatic surgery: a technology at your fingertips #

Cremades Pérez M et al. · Cirugia espanola · 2023

Hepatobiliary & pancreatic (HPB) · Experience report

“For surgical planning, we have used 3D CT and MRI reconstructions to evaluate complex cases, which has made the interpretation of the anatomy more precise and the planning of the technique simpler.”

DOIPubMed

3D mixed-reality visualization of medical imaging data as a supporting tool for innovative, minimally invasive surgery for gastrointestinal tumors and systemic treatment as a new path in personalized treatment of advanced cancer diseases #

Wierzbicki R et al. · Journal of cancer research and clinical oncology · 2022

Hepatobiliary & pancreatic (HPB) · Case series · n: 8 patients

“The intraoperative hologram contributed to better presentation of tumor size and locations, more precise setting of needles used to irreversible electroporation and for determining ablation line in case of liver metastases.”

DOIPubMedFree full text

Patient-individualized resection planning in liver surgery using 3D print and virtual reality (i-LiVR)-a study protocol for a prospective randomized controlled trial #

Huber T et al. · Trials · 2022

Hepatobiliary & pancreatic (HPB) · Trial protocol · n: 100 patients (planned)

DOIPubMedFree full text

Using virtual 3D-models in surgical planning: workflow of an immersive virtual reality application in liver surgery #

Boedecker C et al. · Langenbeck's archives of surgery · 2021

Hepatobiliary & pancreatic (HPB) · Technical development

“Five highly experienced HPB surgeons of our department evaluated the VR application after using it for the very first time and considered it helpful according to the "System Usability Scale" (SUS) with a score of 76.6%.”

76.6%

DOIPubMedFree full text

Intraoperative 3D Hologram Support With Mixed Reality Techniques in Liver Surgery #

Saito Y et al. · Annals of surgery · 2020

Hepatobiliary & pancreatic (HPB) · Case series · n: 2 patients

“The intraoperative hologram contributed to better imagination of tumor locations, and for determining the parenchymal dissection line in the hepatectomy for the patients with more than 20 multiple colo-rectal liver metastases.”

DOIPubMedFree full text

[Three-dimensional visual assessment and virtual reality study of centrally located hepatocellular carcinoma on the axis of blood vessels] #

Zhu W et al. · Zhonghua wai ke za zhi [Chinese journal of surgery] · 2019

Hepatobiliary & pancreatic (HPB) · Case series · n: 20 patients

“All patients underwent successful resection of tumor under the guidance of 3D visualization and VR technology.”

DOIPubMed

IMHOTEP: virtual reality framework for surgical applications #

Pfeiffer M et al. · International journal of computer assisted radiology and surgery · 2018

Hepatobiliary & pancreatic (HPB) · Technical development · n: 1 patient

“The majority of the group stated that a complex surgical situation is easier to comprehend by using the framework, and that it is very well suited for education.”

DOIPubMedFree full text

[Preliminary use of HoloLens glasses in surgery of liver cancer] #

Shi L et al. · Zhong nan da xue xue bao. Yi xue ban · 2018

Hepatobiliary & pancreatic (HPB) · Technical note

“The exact match with the target organ was performed during the operation via HoloLens glasses leaded by the 3D model.”

DOIPubMed

Browse the whole library

Summarises published research on VR/AR surgical planning across all platforms. Not product labelling. For Elucis indications see /elucis.

Intended for healthcare professionals.

Summaries and quotes describe each study's methods and the findings its authors report. They are not claims by Realize Medical and may contain errors: please read the original paper. Inclusion is not an endorsement of any product or use.