Researchers from IBM developed a deep learning system that can perform image registration, or the process of aligning two or more images of the same scene, with superb accuracy and speed. The method uses generative adversarial networks (GANs), and has the potential to radically improve the analysis of magnetic resonance images, allowing doctors and specialists to spend less time applying geometric and algebraic equations to images, and more time on patients.
The problem is simple, MR images are often captured under variable conditions that affect the camera perspective or consent of the scene. Misalignment also occurs when different capture devices are used, meaning if a patient gets an MRI in one room, and then gets another one at a different hospital, a specialist would have to spend hours aligning the photos.
“Our primary contribution is in using GAN for medical image registration, and combining conditional and cyclic constraints to obtain realistic and smooth registration,” the IBM researchers stated in their research paper. “Experimental results demonstrate that we perform better than traditional iterative registration methods and other deep learning based methods that use conventional transformation approaches.”
Using NVIDIA Tesla GPUs with the cuDNN-accelerated TensorFlow deep learning framework, the team trained their system on over 40,000 retinal and cardiac images.
“Appropriate constraints in the GAN cost function produce accurately registered images in less than a second,” the researchers stated. “Experiments demonstrate their accuracy for multimodal retinal and cardiac MR image registration.”
Read more >
Related resources
- DLI course: Data Augmentation and Segmentation with Generative Networks for Medical Imaging
- DLI course: Image Classification with TensorFlow: Radiomics?€?1p19q Chromosome Status Classification
- GTC session: Revolutionizing Cardiac MRI Analysis and Diagnosis With AI: A Deep Dive into MONAI-Based Cardiac MRI Segmentation
- GTC session: Enhancing Radiopharmaceutical Decision Support with Telix’s AutoML and CDSS Platform
- GTC session: Exploring Breakthroughs in Healthcare using Generative AI for Radiology Imaging (Presented by AHEAD)
- SDK: MONAI Cloud API