Computer Vision / Video Analytics

AI Helps Monitor Cancer Treatment

AI-Generated Summary

  • Researchers from the National Institutes of Health, Ping An Insurance, and NVIDIA developed a deep learning-based method that automatically annotates tumors in cancer patients using the RECIST criteria.
  • The team trained convolutional neural networks on the DeepLesion dataset of 32,735 images using NVIDIA TITAN Xp GPUs and the cuDNN-accelerated PyTorch framework.
  • The neural network produces annotations with less variability than human radiologists, addressing the labor-intensive, subjective, and inconsistent nature of manual tumor measurement.
  • The research paper has been accepted for presentation at the 21st International Conference on Medical Image Computing & Computer Assisted Intervention (MICCAI) in Granada, Spain.

Next Step

Powered by NVIDIA Nemotron. AI-generated content may summarize information incompletely. Verify important information. Learn more

Measuring how tumors react to cancer treatment plays a major role in determining a patient’s outcome. The process, normally performed by trained radiologists, is labor-intensive, subjective and prone to inconsistency. To help alleviate the problem, researchers at the National Institutes of Health, the Ping An Insurance company, and a researcher presently at NVIDIA developed a deep learning-based method that can automatically annotate tumors in cancer patients.
“Measuring tumor diameters requires a great deal of professional knowledge and is time-consuming. Consequently, it is difficult and expensive to manually annotate large-scale datasets,” the researchers stated in their paper.
Using NVIDIA TITAN Xp GPUs and the cuDNN-accelerated PyTorch deep learning framework, the team trained their convolutional neural networks to annotate tumors on the RECIST (Response Evaluation Criteria In Solid Tumors) method, which are a set of published rules that define when cancer patients improve. The neural network was trained on thousands of images from the DeepLesion dataset which consists of 32,735 images measured via RECIST.
“Today, the majority of clinical trials evaluating cancer treatments use RECIST as an objective response measurement. Therefore, the quality of RECIST annotations will directly affect the assessment result and therapeutic plan,” the researchers said. “We are the first to automatically generate RECIST marks in a roughly labeled lesion region.”

The framework of the proposed method. The predicted mask and keypoint heatmaps are rendered with a color map for visualization purposes.

The team says their neural network is highly effective, producing annotations with less variability than those of human radiologists.
The paper has been accepted and will be presented at the 21st International Conference on Medical Image Computing & Computer Assisterd Intervention (MICCAI) in Granada, Spain later this year.  
Read more >

Discuss (0)

Tags