PADAr: physician-oriented artificial intelligence-facilitating diagnosis aid for retinal diseases

Po Kang Lin, Yu Hsien Chiu, Chiu Jung Huang, Chien Yao Wang, Mei Lien Pan, Da Wei Wang, Hong Yuan Mark Liao, Yong Sheng Chen, Chieh Hsiung Kuan, Shih Yen Lin*, Li Fen Chen*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Purpose: Retinopathy screening via digital imaging is promising for early detection and timely treatment, and tracking retinopathic abnormality over time can help to reveal the risk of disease progression. We developed an innovative physician-oriented artificial intelligence-facilitating diagnosis aid system for retinal diseases for screening multiple retinopathies and monitoring the regions of potential abnormality over time. Approach: Our dataset contains 4908 fundus images from 304 eyes with image-level annotations, including diabetic retinopathy, age-related macular degeneration, cellophane maculopathy, pathological myopia, and healthy control (HC). The screening model utilized a VGG-based feature extractor and multiple-binary convolutional neural network-based classifiers. Images in time series were aligned via affine transforms estimated through speeded-up robust features. Heatmaps of retinopathy were generated from the feature extractor using gradient-weighted class activation mapping++, and individual candidate retinopathy sites were identified from the heatmaps using clustering algorithm. Nested cross-validation with a train-to-test split of 80% to 20% was used to evaluate the performance of the screening model. Results: Our screening model achieved 99% accuracy, 93% sensitivity, and 97% specificity in discriminating between patients with retinopathy and HCs. For discriminating between types of retinopathy, our model achieved an averaged performance of 80% accuracy, 78% sensitivity, 94% specificity, 79% F1-score, and Cohen's kappa coefficient of 0.70. Moreover, visualization results were also shown to provide reasonable candidate sites of retinopathy. Conclusions: Our results demonstrated the capability of the proposed model for extracting diagnostic information of the abnormality and lesion locations, which allows clinicians to focus on patient-centered treatment and untangles the pathological plausibility hidden in deep learning models.

Original languageEnglish
Article number044501
JournalJournal of Medical Imaging
Volume9
Issue number4
DOIs
StatePublished - 1 Jul 2022

Keywords

  • computer-aided diagnosis
  • lesion-sites visualization
  • multi-retinopathy classification

Fingerprint

Dive into the research topics of 'PADAr: physician-oriented artificial intelligence-facilitating diagnosis aid for retinal diseases'. Together they form a unique fingerprint.

Cite this