Researchers from IBM developed a deep learning system that can perform image registration, or the process of aligning two or more images of the same scene, with superb accuracy and speed. The method uses generative adversarial networks (GANs), and has the potential to radically improve the analysis of magnetic resonance images, allowing doctors and specialists to spend less time applying geometric and algebraic equations to images, and more time on patients.
The problem is simple, MR images are often captured under variable conditions that affect the camera perspective or consent of the scene. Misalignment also occurs when different capture devices are used, meaning if a patient gets an MRI in one room, and then gets another one at a different hospital, a specialist would have to spend hours aligning the photos.
“Our primary contribution is in using GAN for medical image registration, and combining conditional and cyclic constraints to obtain realistic and smooth registration,” the IBM researchers stated in their research paper. “Experimental results demonstrate that we perform better than traditional iterative registration methods and other deep learning based methods that use conventional transformation approaches.”
Using NVIDIA Tesla GPUs with the cuDNN-accelerated TensorFlow deep learning framework, the team trained their system on over 40,000 retinal and cardiac images.
“Appropriate constraints in the GAN cost function produce accurately registered images in less than a second,” the researchers stated. “Experiments demonstrate their accuracy for multimodal retinal and cardiac MR image registration.”
Read more >
Related resources
- DLI course: Data Augmentation and Segmentation with Generative Networks for Medical Imaging
- GTC session: Examples of AI Development using DGX and MONAI, and Multi-Parametric Diagnostic Aid AI for Breakthrough Breast Cancer Screening Tests (Spring 2023)
- GTC session: Detecting Skin Diseases using AI (Spring 2023)
- GTC session: Actionable Insights for Surgical Practice (Spring 2023)
- Webinar: AI-enabled Neurology
- Webinar: How to place top 10 in a Kaggle Competition