| Congenital Heart Disease | |
DOI: 10.32604/chd.2022.019119
CASE REPORT
Multimodal Imaging with 3D-Holograms for Preoperative Planning in Pediatric Cardiac Surgery: A Unique Case Report
1Department of Congenital Cardiac Surgery, IRCCS Policlinico San Donato, San Donato Milanese, Milan, Italy
2ACHD Unit–Pediatric and Adult Congenital Heart Centre, IRCCS Policlinico San Donato, San Donato Milanese, Milan, Italy
*Corresponding Author: Alessandro Giamberti. Email: alessandro.giamberti@grupposandonato.it
Received: 04 February 2022; Accepted: 19 April 2022
Abstract: Multimodal imaging, including augmented or mixed reality, transforms the physicians’ interaction with clinical imaging, allowing more accurate data interpretation, better spatial resolution, and depth perception of the patient’s anatomy. We successfully overlay 3D holographic visualization to magnetic resonance imaging images for preoperative decision making of a complex case of cardiac tumour in a 7-year-old girl.
Keywords: Hologram; augmented reality; multimodal imaging; 3D; CHD; cardiac tumour; arrhythmia; anatomy
Since the early seventies, when the idea of 3D reality was born, physicians dreamed about holographic technology applied to medical science, aiming to help in clinical diagnosis and surgical practice. Today, what once was only science fiction, has become a ready-to-use technology. Augmented or mixed reality, in fact, accounting for head-sets made of translucent glasses, allows for real-time rendering of holographic 3D contents in the surrounding world, while preserving the interaction with the actual environment [1]. This technology is currently used for education, simulation, and procedural planning in the surgical and/or trans-catheter treatment of patients with congenital and acquired heart disease [2–10], but still presents some limitations.
Multimodal imaging can be considered a further step towards personalized medicine. The combination of imaging modalities, in fact, overcomes the limitations of each separate technique [6]. We report our experience with magnetic resonance imaging (MRI) and 3D-holograms technology overlay in decision making of a complex case of cardiac tumour in a child.
A 7-year-old girl, previously healthy, was admitted to the Emergency Department for syncope and wide QRS ventricular tachycardia of unknown origin. Physical examination was unremarkable, and no signs of hemodynamic decompensation were found.
She underwent electrical cardioversion and subsequent complete workup. The ECG-Holter 24 h monitoring demonstrated sinus rhythm with occasional premature ventricular contractions. Echo imaging showed a hyper-echogenic mass in the postero-lateral wall of left ventricle (LV), with preserved ejection fraction (EF = 60%). Gadolinium cardiac MRI confirmed the hypodense enhancement of a focal lesion (38 mm × 11 mm × 25 mm) with intramural extension in the postero-lateral wall of the left ventricle, suspicious for cardiac tumour (fibroma or rhabdomyoma). However, MRI could not discriminate if all the cardiac layers were affected, nor cardiac catheterization and CT scan could exclude major vascularization of the cardiac mass from the circumflex artery.
Hence, we created a holographic 3D model to plan how to approach the tumour, discriminating the precise layer’s involvement.
Cardiac MRI dynamic sequences in short axis view were used to build the holographic 3D model, using a prototype software platform (ARTINESS srl, Milan, Italy). The holographic 3D model and its overlay with MRI images confirmed that the extension of the tumour was limited to the epicardial and myocardial superficial layers, and thus the feasibility of surgical excision (Figs. 1 and 2).
Figure 1: 3D hologram model in short axis view. T: tumor; LV: Left Ventricle; RV: Right Ventricle; LVPM: Left Ventricular Papillary Muscle
Figure 2: Overlay of the MRI image with 3D hologram projection. T: tumor; LV: Left Ventricle; RV: Right Ventricle; LVPM: Left Ventricular Papillary Muscle
During surgery, the same holographic 3D model was displayed in theatre to simulate the incisions and the surgical steps, in order to obtain the best and safest resection of the tumour edges (Fig. 3).
Figure 3: Intra-operative holographic 3D reconstruction to simulate the incisions and the surgical steps performed by the surgeons
Under cardiopulmonary by-pass and cardioplegic cardiac arrest, the patient underwent complete excision of the cardiac tumour without entering the LV cavity, as predicted by the augmented reality.
Histology exam confirmed that the tumour was a large fibroma. The girl was discharged on postoperative day 6th, in good clinical conditions and with preserved ventricular function. No more episodes of rhythm disturbances were registered in the following 24 months.
On October 2018 the United States Food and Drug Administration (FDA) authorized, for the first time, mixed reality medical solution HoloLens (Microsoft, Redmond, WA, USA) to be used as preoperative planning resource [7]. 3D analysis of CHD and holographic navigation quickly became promising tools for diagnostic and therapeutic applications and have since been used for education and simulation.
This advanced digital technology and the possibility to have a patient-specific virtual reality, represents a tangible improvement compared to the 3D printed models. In fact, it overcomes its limitation in term of materials selection, long processing times, and costs.
3D holographic technology is today common practice in the pre-operative evaluation of complex CHD in many specialized centres, where multidisciplinary teams try to offer a more “personalized” approach to the most complex patients [1–3,9–11].
Current clinical applications include minimally invasive cardiac procedures, mitral valve surgery, and trans-catheter interventional procedures [2,7–11].
The potential for the use of 3D-holograms in combination with different imaging modalities in CHD patients would overcome the limitations of each separate technique [6], developing the full potential of augmented reality.
In our case the co-registration with the overlay of functional and structural images from MRI and 3D holographic model was the key to success. To our knowledge, this is the first reported case of augmented reality applied to the surgical excision of cardiac tumours in paediatric patients.
Ethics Approval: The IRCCS San Raffaele institutional review board permitted use of retrospectively collected anonymized data for publication and waived informed consent for the case report.
Funding Statement: The authors received no specific funding for this study.
Conflicts of Interest: The authors declare that they have no conflicts of interest to report regarding the present study.
1. Bruckheimer, E., Rotschild, C., Dagan, T., Amir, G., Kaufman, A. et al. (2016). Computer-generated real-time digital holography: First time use in clinical medical imaging. European Heart Journal–Cardiovascular Imaging, 17(8), 845–849. DOI 10.1093/ehjci/jew087. [Google Scholar] [CrossRef]
2. Butera, G., Sturla, F., Pluchinotta, F. R., Caimi, A., Carminati, M. (2019). Holographic augmented reality and 3D printing for advanced planning of sinus venosus ASD/Partial anomalous pulmonary venous return percutaneous management. JACC: Cardiovascular Interventions, 12(14), 1389–1391. DOI 10.1016/j.jcin.2019.03.020. [Google Scholar] [CrossRef]
3. Brun, H., Bugge, R., Suther, L., Birkeland, S., Kumar, R. et al. (2019). Mixed reality holograms for heart surgery planning: First user experience in congenital heart disease. European Heart Journal–Cardiovascular Imaging, 20(8), 883–888. DOI 10.1093/ehjci/jey184. [Google Scholar] [CrossRef]
4. Andolfi, C., Plana, A., Kania, P., Banerjee, P. P., Small, S. (2017). Usefulness of three-dimensional modeling in surgical planning, resident training, and patient education. Journal of Laparoendoscopic & Advanced Surgical Techniques, 27(5), 512–515. DOI 10.1089/lap.2016.0421. [Google Scholar] [CrossRef]
5. Liu, J., Al’Aref, S. J., Singh, G., Caprio, A., Moghadam, A. et al. (2019). An augmented reality system for image guidance of transcatheter procedures for structural heart disease. PLoS One, 14(7), e0219174. DOI 10.1371/journal.pone.0219174. [Google Scholar] [CrossRef]
6. Alacoque, X., Cuttone, F., Hadeed, K., Karsenty, C., Drzazga, P. et al. (2018). Multimodal imaging and three-dimensional cardiac computational modelling in the management of congenital heart disease: The secret to getting ahead is to get started. Archives of Cardiovascular Diseases, 111(6–7), 395–398. DOI 10.1016/j.acvd.2018.05.002. [Google Scholar] [CrossRef]
7. Goo, H. W., Park, S. J., Yoo, S. J. (2020). Advanced medical use of three-dimensional imaging in congenital heart disease: Augmented reality, mixed reality, virtual reality, and three-dimensional printing. Korean Journal of Radiology, 21(2), 133–145. DOI 10.3348/kjr.2019.0625. [Google Scholar] [CrossRef]
8. Gehrsitz, P., Rompel, O., Schöber, M., Cesnjevar, R., Purbojo, A. et al. (2021). Cinematic rendering in mixed-reality holograms: A new 3D preoperative planning tool in pediatric heart surgery. Frontiers in Cardiovascular Medicine, 8, 633611. DOI 10.3389/fcvm.2021.633611. [Google Scholar] [CrossRef]
9. Pasqualin, G., Sturla, F., D’Aiello, A. F., Chessa, M. (2021). Mixed reality navigation of a systemic venous baffle obstruction: Unravelling the percutaneous approach in atrial switch operation. European Heart Journal, 42(41), 4284. DOI 10.1093/eurheartj/ehaa961. [Google Scholar] [CrossRef]
10. Ender, J., Koncar-Zeh, J., Mukherjee, C., Jacobs, S., Borger, M. A. et al. (2008). Value of augmented reality-enhanced transesophageal echocardiography (TEE) for determining optimal annuloplasty ring size during mitral valve repair. The Annals of Thoracic Surgery, 86(5), 1473–1478. DOI 10.1016/j.athoracsur.2008.07.073. [Google Scholar] [CrossRef]
11. Belhaj Soulami, R., Verhoye, J. P., Nguyen Duc, H., Castro, M., Auffret, V. et al. (2016). Computer-assisted transcatheter heart valve implantation in valve-in-valve procedures. Innovations, 11(3), 193–200. DOI 10.1097/imi.0000000000000259. [Google Scholar] [CrossRef]
 | This work is licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |