Transformer with Selective Shuffled Position Embedding for Early Detection of Knee Osteoarthritis - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Transformer with Selective Shuffled Position Embedding for Early Detection of Knee Osteoarthritis

Résumé

Knee OsteoArthritis (KOA) is a common musculoskeletal disorder, which causes reduced mobility for seniors. Early detection of such a disorder is important to limit its impact on people. Computer-Aided Diagnosis (CAD) systems based on deep learning methods have shown success in KOA diagnosis. Due to the high cost of labelling, the lack of sufficient data in the medical field is a significant challenge for training machine learning models. To improve the generalization capability of deep neural network models and avoid overfitting, data augmentation is essential. However, existing data augmentation techniques such as rotation and gamma correction are not effective at increasing the diversity of the original data. In this paper, we propose a novel approach based on the Vision Transformer (ViT) model with a Selective Shuffled Position Embedding (SSPE) strategy that generates different input sequences fixing and shuffling the position embedding of key and non-key patches, respectively, as a novel method of data augmentation for early detection of KOA (KL-0 vs KL-2). Experimental results demonstrate that our approach is valid as it can significantly improve the model’s classification performance.
Fichier non déposé

Dates et versions

hal-04559123 , version 1 (25-04-2024)

Licence

Paternité

Identifiants

Citer

Zhe Wang, Aladine Chetouani, Rachid Jennane. Transformer with Selective Shuffled Position Embedding for Early Detection of Knee Osteoarthritis. CBMI 2023: 20th International Conference on Content-based Multimedia Indexing, Sep 2023, Orleans France, France. pp.261-271, ⟨10.1145/3617233.3617250⟩. ⟨hal-04559123⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More