Assessing Layer Normalization with BraTS MRI Data in a Convolution Neural Net - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2022

Assessing Layer Normalization with BraTS MRI Data in a Convolution Neural Net

Akhilesh Rawat
  • Fonction : Auteur
  • PersonId : 1332878
Rajeev Kumar
  • Fonction : Auteur
  • PersonId : 1332879

Résumé

Deep learning-based Convolutional Neural Network (CNN) architectures are commonly used in medical imaging. Medical imaging data is highly imbalanced. A deep learning architecture on its own is prone to overfit. As a result, we need a generalized model to mitigate total risk. This paper assesses a layer normalization (LN) technique in a CNN-based 3D U-Net for faster training and better generalization in medical imaging. Layer Normalization (LN) is mostly used in Natural Language Processing (NLP) tasks such as question-answering, handwriting sequence generation, etc. along with Recurrent Neural Network (RNN). The usage of LN is yet to be studied in case of medical imaging. In this context, we use brain MRI segmentation and train our model with LN and without normalization. We compare both models and our LN-based model gives $$32\%$$32% less validation loss over without normalization-based model. We achieve validation dice scores of unseen input data passes to LN based model of 0.90 ($$7.5\%$$7.5% higher than without normalization) for edema, 0.74 ($$12.5\%$$12.5% higher than without normalization) for non-enhancing tumor and 0.95 ($$1.5\% $$1.5%higher than without normalization) for enhancing tumor.
Fichier sous embargo
Fichier sous embargo
0 3 5
Année Mois Jours
Avant la publication
mercredi 1 janvier 2025
Fichier sous embargo
mercredi 1 janvier 2025
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04381305 , version 1 (09-01-2024)

Licence

Identifiants

Citer

Akhilesh Rawat, Rajeev Kumar. Assessing Layer Normalization with BraTS MRI Data in a Convolution Neural Net. 5th International Conference on Computational Intelligence in Data Science (ICCIDS), Mar 2022, Virtual, India. pp.124-135, ⟨10.1007/978-3-031-16364-7_10⟩. ⟨hal-04381305⟩
29 Consultations
1 Téléchargements

Altmetric

Partager

More