Multi level throttled attention for accurate and efficient classification of retinal diseases in OCT images

Abstract

The classification of retinal diseases using Optical Coherence Tomography images has gained significant attention in recent years. However, due to the heterogeneity of retinal disorders, achieving high classification accuracy remains challenging. While deep learning has improved the identification of various ophthalmic conditions, accurate and early diagnosis is still critical for effective clinical decision-making. Additionally, reducing computational complexity is essential for building scalable diagnostic systems. To address these challenges, we propose a novel Multi-level Throttled Attention (MLTA) model that first applies attention to extract important features, followed by throttling to filter out redundant or less useful features. This process is applied at multiple stages, operating on both Convolutional Neural Network layers and Transformer architectures, and then fuses them finally. This approach optimizes feature selection by preserving the most informative retinal features while discarding redundant ones from multi-level feature maps. As a result, the model enhances classification performance while reducing computational overhead. We evaluate our proposed model on two benchmark OCT datasets: OCT2017 and OCTID, achieving accuracy scores of 99.59 +/- 0.04% and 99.71 +/- 0.03%, respectively. Our method outperforms existing CNN-based and Vision Transformer-based models, demonstrating superior accuracy and efficiency through this hierarchical attention.