Advancing Medical Imaging with AR: A Survey on Transforming 2D images into Immersive 3D Models

Medical imaging technologies, such as Magnetic Resonance Imaging (MRI) and Computed Tomography (CT) scans, have revolutionized the medical field by offering precise and detailed visualizations of internal structures, aiding in diagnosing and treating complex conditions like tumors, fractures, and organ abnormalities. However, these images are typically presented as 2D slices, requiring medical professionals to mentally reconstruct 3D anatomical relationships. This process can lead to spatial perception errors and increased cognitive load, limiting diagnostic accuracy and surgical planning. Augmented Reality (AR) emerges as a transformative solution to break these limitations, allowing the conversion of 2D medical scans into interactive 3D models. AR enhances the visualization of complex anatomy, aids in treatment planning, and supports medical education by providing an intuitive and immersive experience for clinicians and students alike. Our project focuses on developing an AR-based tool using ARCore/ARKit to enable real-time 3D visualization of MRI and CT scans. This tool has the potential to improve diagnostics, streamline surgical procedures, and make medical education more engaging and effective, paving the way for better patient outcomes.