F.sh: A 3D Recurrent Residual Attention U-Net for Automated Multiple Sclerosis Lesion Segmentation


Authors : Mahdi Esmaeili Shafaei

Volume/Issue : Volume 9 - 2024, Issue 9 - September


Google Scholar : https://tinyurl.com/bddbbm7c

Scribd : https://tinyurl.com/3ah5an3e

DOI : https://doi.org/10.38124/ijisrt/IJISRT24SEP1439

Note : A published paper may take 4-5 working days from the publication date to appear in PlumX Metrics, Semantic Scholar, and ResearchGate.


Abstract : Multiple sclerosis (MS) is an autoimmune disease affecting the central nervous system, characterized by lesions in the brain and spinal cord. Accurate detection and localization of these lesions on MRI scans is crucial for diagnosis and monitoring disease progression. Manual segmentation is time-consuming and prone to inter-rater variability. This study proposes F.sh (3DR2AUNet), a novel deep learning architecture for automated MS lesion segmentation. F.sh combines 3D recurrent residual blocks, attention gates, and the U-Net structure to effectively capture lesion features. The model was trained and evaluated using a comprehensive approach, including patch-based preprocessing, data augmentation, and a composite loss function combining Binary Cross-Entropy and 3D Dice Loss. Experimental results demonstrate the superior performance of F.sh compared to baseline methods, achieving a Dice score of 0.92. The proposed approach has the potential to assist radiologists in the accurate and efficient assessment of MS lesion burden.

References :

  1. Reich, D. S., Lucchinetti, C. F., & Calabresi, P. A. (2018). Multiple sclerosis. New England Journal of Medicine, 378(2), 169-180.
  2. Filippi, M., Preziosa, P., Banwell, B. L., Barkhof, F., Ciccarelli, O., De Stefano, N., ... & Rocca, M. A. (2019). Assessment of lesions on magnetic resonance imaging in multiple sclerosis: practical guidelines. Brain, 142(7), 1858-1875.
  3. Thompson, A. J., Banwell, B. L., Barkhof, F., Carroll, W. M., Coetzee, T., Comi, G., ... & Cohen, J. A. (2018). Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria. The Lancet Neurology, 17(2), 162-173.
  4. Akkus, Z., Galimzianova, A., Hoogi, A., Rubin, D. L., & Erickson, B. J. (2017). Deep learning for brain MRI segmentation: state of the art and future directions. Journal of digital imaging, 30(4), 449-459.
  5. Ronneberger, O., Fischer, P., & Brox, T. (2015, October). U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention (pp. 234-241). Springer, Cham.
  6. Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., ... & Rueckert, D. (2018). Attention u-net: Learning where to look for the pancreas. arXiv preprint arXiv:1804.03999.
  7. He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770-778).
  8. Li, H., Xiong, P., An, J., & Wang, L. (2018). Pyramid attention network for semantic segmentation. arXiv preprint arXiv:1805.10180.
  9. Valanarasu, J. M. J., Sindagi, V. A., Hacihaliloglu, I., & Patel, V. M. (2021). KiU-Net: Towards accurate segmentation of biomedical images using over-complete representations. In International Conference on Medical Image Computing and Computer-Assisted Intervention (pp. 363-373). Springer, Cham.
  10. Taghanaki, S. A., Abhishek, K., Cohen, J. P., Cohen-Adad, J., & Hamarneh, G. (2021). Deep semantic segmentation of natural and medical images: a review. Artificial Intelligence Review, 54(1), 137-178.
  11. Gros, C., Lemay, A., Cohen-Adad, J., & Guttmann, C. R. (2021). Automatic segmentation of multiple sclerosis lesions using 3D residual fully convolutional neural networks. NeuroImage: Clinical, 29, 102541.
  12. Zhang, J., Wang, Y., Wang, Z., & Zhang, J. (2021). MS-Net: Multi-site network for improving deep learning with limited training data on lesion segmentation in multiple sclerosis. NeuroImage, 237, 118155.
  13. Kamnitsas, K., Ledig, C., Newcombe, V. F., Simpson, J. P., Kane, A. D., Menon, D. K., ... & Glocker, B. (2017). Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation. Medical image analysis, 36, 61-78.
  14. La Rosa, F., Fartaria, M. J., Abdulkadir, A., Rahmanzadeh, R., Lu, P. J., Galbusera, R., ... & Bach Cuadra, M. (2021). Multiple sclerosis cortical and WM lesion segmentation at 3T MRI: a deep learning method based on FLAIR and MP2RAGE. NeuroImage: Clinical, 31, 102736.
  15. Nair, T., Precup, D., Arnold, D. L., & Arbel, T. (2020). Exploring uncertainty measures in deep networks for multiple sclerosis lesion detection and segmentation. Medical image analysis, 59, 101557.

Multiple sclerosis (MS) is an autoimmune disease affecting the central nervous system, characterized by lesions in the brain and spinal cord. Accurate detection and localization of these lesions on MRI scans is crucial for diagnosis and monitoring disease progression. Manual segmentation is time-consuming and prone to inter-rater variability. This study proposes F.sh (3DR2AUNet), a novel deep learning architecture for automated MS lesion segmentation. F.sh combines 3D recurrent residual blocks, attention gates, and the U-Net structure to effectively capture lesion features. The model was trained and evaluated using a comprehensive approach, including patch-based preprocessing, data augmentation, and a composite loss function combining Binary Cross-Entropy and 3D Dice Loss. Experimental results demonstrate the superior performance of F.sh compared to baseline methods, achieving a Dice score of 0.92. The proposed approach has the potential to assist radiologists in the accurate and efficient assessment of MS lesion burden.

Never miss an update from Papermashup

Get notified about the latest tutorials and downloads.

Subscribe by Email

Get alerts directly into your inbox after each post and stay updated.
Subscribe
OR

Subscribe by RSS

Add our RSS to your feedreader to get regular updates from us.
Subscribe