Comparing humans and deep learning performance for grading AMD: A study in using universal deep features and transfer learning for automated AMD analysis

Philippe Burlina; Katia D Pacheco; Neil Joshi; David E Freund; Neil M Bressler

doi:10.1016/j.compbiomed.2017.01.018

Comparing humans and deep learning performance for grading AMD: A study in using universal deep features and transfer learning for automated AMD analysis

Comput Biol Med. 2017 Mar 1:82:80-86. doi: 10.1016/j.compbiomed.2017.01.018. Epub 2017 Jan 27.

Authors

Philippe Burlina¹, Katia D Pacheco², Neil Joshi³, David E Freund⁴, Neil M Bressler⁵

Affiliations

¹ Applied Physics Laboratory, The Johns Hopkins University, MD, USA; Retina Division, Wilmer Eye Institute, Johns Hopkins University School of Medicine, USA; Department of Computer Science, The Johns Hopkins University, MD, USA.
² Retina Division, Brazilian Center of Vision Eye Hospital, DF, Brazil.
³ Applied Physics Laboratory, The Johns Hopkins University, MD, USA.
⁴ Applied Physics Laboratory, The Johns Hopkins University, MD, USA. Electronic address: David.Freund@jhuapl.edu.
⁵ Retina Division, Wilmer Eye Institute, Johns Hopkins University School of Medicine, USA.

Abstract

Background: When left untreated, age-related macular degeneration (AMD) is the leading cause of vision loss in people over fifty in the US. Currently it is estimated that about eight million US individuals have the intermediate stage of AMD that is often asymptomatic with regard to visual deficit. These individuals are at high risk for progressing to the advanced stage where the often treatable choroidal neovascular form of AMD can occur. Careful monitoring to detect the onset and prompt treatment of the neovascular form as well as dietary supplementation can reduce the risk of vision loss from AMD, therefore, preferred practice patterns recommend identifying individuals with the intermediate stage in a timely manner.

Methods: Past automated retinal image analysis (ARIA) methods applied on fundus imagery have relied on engineered and hand-designed visual features. We instead detail the novel application of a machine learning approach using deep learning for the problem of ARIA and AMD analysis. We use transfer learning and universal features derived from deep convolutional neural networks (DCNN). We address clinically relevant 4-class, 3-class, and 2-class AMD severity classification problems.

Results: Using 5664 color fundus images from the NIH AREDS dataset and DCNN universal features, we obtain values for accuracy for the (4-, 3-, 2-) class classification problem of (79.4%, 81.5%, 93.4%) for machine vs. (75.8%, 85.0%, 95.2%) for physician grading.

Discussion: This study demonstrates the efficacy of machine grading based on deep universal features/transfer learning when applied to ARIA and is a promising step in providing a pre-screener to identify individuals with intermediate AMD and also as a tool that can facilitate identifying such individuals for clinical studies aimed at developing improved therapies. It also demonstrates comparable performance between computer and physician grading.

Keywords: Age-related macular degeneration, (AMD); Deep Convolutional Neural Networks, (DCNNs); Deep learning; Retinal image analysis; Transfer learning; Universal features.

Publication types

Comparative Study
Evaluation Study

MeSH terms

Algorithms*
Early Diagnosis
Fluorescein Angiography / methods*
Humans
Image Interpretation, Computer-Assisted
Machine Learning*
Macular Degeneration / classification
Macular Degeneration / diagnostic imaging*
Macular Degeneration / pathology*
Observer Variation
Pattern Recognition, Automated / methods*
Reproducibility of Results
Sensitivity and Specificity
Severity of Illness Index

Grants and funding

R21 EY024310/EY/NEI NIH HHS/United States