Lesion classification and diabetic retinopathy grading by integrating softmax and pooling operators into vision transformer

Introduction: Diabetic retinopathy grading plays a vital role in the diagnosis and treatment of patients. In practice, this task mainly relies on manual inspection using human visual system. However, the human visual system-based screening process is labor-intensive, time-consuming, and error-prone. Therefore, plenty of automated screening technique have been developed to address this task. Methods: Among these techniques, the deep learning models have demonstrated promising outcomes in various types of machine vision tasks. However, most of the medical image analysis-oriented deep learning approaches are built upon the convolutional operations, which might neglect the global dependencies between long-range pixels in the medical images. Therefore, the vision transformer models, which can unveil the associations between global pixels, have been gradually employed in medical image analysis. However, the quadratic computation complexity of attention mechanism has hindered the deployment of vision transformer in clinical practices. Bearing the analysis above in mind, this study introduces an integrated self-attention mechanism with both softmax and linear modules to guarantee efficiency and expressiveness, simultaneously. To be specific, a portion of query and key tokens, which are much less than the original query and key tokens, are adopted in the attention module by adding a set of proxy tokens. Note that the proxy tokens can fully utilize both the advantages of softmax and linear attention. Results: To evaluate the performance of the presented approach, the comparison experiments between state-of-the-art algorithms and the proposed approach are conducted. Experimental results demonstrate that the proposed approach achieves superior outcome over the state-of-the-art algorithms on the publicly available datasets. Discussion: Accordingly, the proposed approach can be taken as a potentially valuable instrument in clinical practices

Deep learning · Diabetes mellitus · Diabetic retinopathy · Lesion · Pathology · Pooling · Softmax function · Artificial Intelligence in Healthcare · Computer Science · Engineering · Medicine · Retinal Diseases and Treatments · Retinal Imaging and Analysis · Artificial Intelligence · Optometry

• ImageNet

  Jia Deng, Wei Dong et al.•2009 IEEE Conference on Computer…•2009

  Add to list

• Global Prevalence of Diabetes

  Sarah H Wild, Sarah Wild et al.•Diabetes Care•2004

  Add to list

• Novel Approach for Classification of Diabetics From Retinal Image Using Deep Learning Technique

  Open Access•A Umamageswari, S Deepa et al.•International Journal of Health…•2022

  Add to list