Skip to main content
Advertisement

Main menu

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • ASNR Foundation Special Collection
    • Most Impactful AJNR Articles
    • Photon-Counting CT
    • Spinal CSF Leak Articles (Jan 2020-June 2024)
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home

User menu

  • Alerts
  • Log in

Search

  • Advanced search
American Journal of Neuroradiology
American Journal of Neuroradiology

American Journal of Neuroradiology

ASHNR American Society of Functional Neuroradiology ASHNR American Society of Pediatric Neuroradiology ASSR
  • Alerts
  • Log in

Advanced Search

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • ASNR Foundation Special Collection
    • Most Impactful AJNR Articles
    • Photon-Counting CT
    • Spinal CSF Leak Articles (Jan 2020-June 2024)
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home
  • Follow AJNR on Twitter
  • Visit AJNR on Facebook
  • Follow AJNR on Instagram
  • Join AJNR on LinkedIn
  • RSS Feeds

AJNR is seeking candidates for the AJNR Podcast Editor. Read the position description.

Research ArticleAdult Brain
Open Access

A Stacked Generalization of 3D Orthogonal Deep Learning Convolutional Neural Networks for Improved Detection of White Matter Hyperintensities in 3D FLAIR Images

L. Umapathy, G.G. Perez-Carrillo, M.B. Keerthivasan, J.A. Rosado-Toro, M.I. Altbach, B. Winegar, C. Weinkauf, A. Bilgin and for the Alzheimer’s Disease Neuroimaging Initiative
American Journal of Neuroradiology April 2021, 42 (4) 639-647; DOI: https://doi.org/10.3174/ajnr.A6970
L. Umapathy
aFrom the Departments of Electrical and Computer Engineering (L.U., A.B.)
bMedical Imaging (L.U., G.G.P.-C., M.B.K., J.A.R.-T., M.I.A., B.W., A.B.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for L. Umapathy
G.G. Perez-Carrillo
bMedical Imaging (L.U., G.G.P.-C., M.B.K., J.A.R.-T., M.I.A., B.W., A.B.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for G.G. Perez-Carrillo
M.B. Keerthivasan
bMedical Imaging (L.U., G.G.P.-C., M.B.K., J.A.R.-T., M.I.A., B.W., A.B.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for M.B. Keerthivasan
J.A. Rosado-Toro
bMedical Imaging (L.U., G.G.P.-C., M.B.K., J.A.R.-T., M.I.A., B.W., A.B.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J.A. Rosado-Toro
M.I. Altbach
bMedical Imaging (L.U., G.G.P.-C., M.B.K., J.A.R.-T., M.I.A., B.W., A.B.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for M.I. Altbach
B. Winegar
bMedical Imaging (L.U., G.G.P.-C., M.B.K., J.A.R.-T., M.I.A., B.W., A.B.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for B. Winegar
C. Weinkauf
cSurgery (C.W.)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for C. Weinkauf
A. Bilgin
aFrom the Departments of Electrical and Computer Engineering (L.U., A.B.)
bMedical Imaging (L.U., G.G.P.-C., M.B.K., J.A.R.-T., M.I.A., B.W., A.B.)
dBiomedical Engineering (A.B.), University of Arizona, Tucson, Arizona
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for A. Bilgin
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • FIG 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 1.

    A, Overview of the proposed StackGen-Net. B, This consists of 3 DeepUNET3D CNNs, which are made up of convolutional blocks. The number of output feature maps is presented next to each convolutional block. Each DeepUNET3D predicts posterior probabilities for WMHs on orthogonal (axial, sagittal, and coronal) orientations of the 3D-FLAIR volumes. The Meta CNN combines axial, sagittal, and coronal posterior probabilities for a voxel to yield a final prediction for WMH. Sag indicates sagittal; Cor, coronal; ReLU, rectified linear unit.

  • FIG 2.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 2.

    Qualitative evaluation of WMH detection performance by StackGen-Net. Representative axial, coronal, and sagittal slices from a test subject are shown in the left panel. Manual annotations and predictions from StackGen-Net are overlaid in red. A, The insets from coronal images are zoomed in for better comparison of the prediction with the ground truth. Compared with manual annotation, StackGen-Net slightly overestimates the lesion contour. B, A comparison of WMH predictions from the orthogonal CNNs (axial, sagittal, and coronal) is shown. The yellow arrows show WMHs that were missed by a majority of the CNNs in the ensemble. These lesions would have been missed by a simple averaging or majority voting of the orthogonal CNN predictions but are identified correctly by StackGen-Net. Sag indicates sagittal; Cor, coronal.

  • FIG 3.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 3.

    Boxplot comparison of Dice scores, lesion-based F1 (F1-L), volume difference (VD), and area under precision-recall curve (AUC) scores on the test set. We found a significant improvement in Dice scores, AUC, and F1-L in StackGen-Net compared with other WMH segmentation techniques compared here. The asterisk denotes P < .001 (2-sided paired t test, n = 29).

  • FIG 4.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 4.

    Correlation between WMH volumes (milliliters) in ground truth annotations and StackGen-Net predictions. A, We observed a strong correlation between the predictions and ground truth. B, Bland-Altman plot shows a good agreement in WMH volumes between the ground truth annotations and StackGen-Net predictions. We found no significant differences between the 2 volumes (P = .15, n = 29). The coefficient of variation (CV) and the repeatability coefficient (RPC) are also shown.

Tables

  • Figures
    • View popup
    Table 1:

    Comparisona of StackGen-Net with variants of DeepUNET3D architecture

    DeepUNET3DOrthogonalStackGen-Net
    AxialSagittalCoronalAxial (E-A)(E-A)(E-MV)
    Dice (F1-P)0.74
    [SD, 0.06]
    0.73
    [SD, 0.08]
    0.72
    [SD, 0.02]
    0.73
    [SD, 0.07]
    0.75
    [SD, 0.08]
    0.75
    [SD, 0.08]
    0.76
    [SD, 0.07]
    Precision-P0.84
    [SD, 0.08]
    0.81
    [SD, 0.07]
    0.83
    [SD, 0.08]
    0.84
    [SD, 0.08]
    0.87
    [SD, 0.06]
    0.87
    [SD, 0.06]
    0.73
    [SD, 0.11]
    Recall-P0.66
    [SD, 0.08]
    0.67
    [SD, 0.10]
    0.64
    [SD, 0.12]
    0.78
    [SD, 0.09]
    0.66
    [SD, 0.10]
    0.67
    [SD, 0.10]
    0.79 
    [SD, 0.1]
    Precision-L0.81
    [SD, 0.10]
    0.79
    [SD, 0.09]
    0.85
    [SD, 0.11]
    0.84
    [SD, 0.09]
    0.88
    [SD, 0.09]
    0.87
    [SD, 0.09]
    0.75
    [SD, 0.11]
    Recall-L0.80
    [SD, 0.15]
    0.80
    [SD, 0.10]
    0.78
    [SD, 0.11]
    0.77
    [SD, 0.14]
    0.80
    [SD, 0.13]
    0.81
    [SD, 0.13]
    0.87
    [SD, 0.08]
    F1-L0.80
    [SD, 0.11]
    0.79
    [SD, 0.07]
    0.80
    [SD, 0.08]
    0.80
    [SD, 0.09]
    0.83
    [SD, 0.08]
    0.83
    [SD, 0.08]
    0.80
    [SD, 0.09]
    |VD|(%)21.2
    [SD, 10.5]
    16.9
    [SD, 10.8]
    23.5
    [SD, 13.0]
    22.7
    [SD, 11.2]
    24.3
    [SD, 11.3]
    22.3
    [SD, 10.9]
    12.3
    [SD, 12.7]
    • Note:—|VD| indicates absolute volume difference; P, pixel; L, lesion.

    • ↵a Mean [SD] on test cohort 1.

    • View popup
    Table 2:

    Comparison of StackGen-Net with other WMH detection techniques

    Test Cohort 1Test Cohort 2
    UNET2DDeepMedicUNET2D WS-EStackGen-NetUNET2DDeepMedicUNET2D WS-EStackGen-Net
    Dice (F1-P)0.43
    [SD, 0.17]
    0.62
    [SD, 0.09]
    0.67
    [SD, 0.09]
    0.76
    [SD, 0.07]
    0.27
    [SD, 0.20]
    0.58
    [SD, 0.15]
    0.66
    [SD, 0.17]
    0.76
    [SD, 0.09]
    Precision-P0.72
    [SD, 0.19]
    0.63
    [SD, 0.13]
    0.72
    [SD, 0.15]
    0.73
    [SD, 0.11]
    0.73
    [SD, 0.32]
    0.66
    [SD, 0.22]
    0.69
    [SD, 0.23]
    0.77
    [SD, 0.11]
    Recall-P0.32
    [SD, 0.19]
    0.63
    [SD, 0.18]
    0.64
    [SD, 0.07]
    0.79
    [SD,  0.1]
    0.18
    [SD, 0.16]
    0.53
    [SD, 0.13]
    0.67
    [SD, 0.12]
    0.75
    [SD, 0.09]
    Precision-L0.60
    [SD, 0.20]
    0.47
    [SD, 0.23]
    0.69
    [SD, 0.18]
    0.75
    [SD, 0.11]
    0.72
    [SD, 0.24]
    0.43
    [SD, 0.23]
    0.60
    [SD, 0.23]
    0.84
    [SD, 0.14]
    Recall-L0.37
    [SD, 0.09]
    0.86
    [SD, 0.09]
    0.79
    [SD, 0.15]
    0.87
    [SD, 0.08]
    0.26
    [SD, 0.14]
    0.71
    [SD, 0.10]
    0.74
    [SD, 0.13]
    0.67
    [SD, 0.13]
    F1-L0.44
    [SD, 0.10]
    0.54
    [SD, 0.11]
    0.71
    [SD, 0.09]
    0.80
    [SD, 0.09]
    0.37
    [SD, 0.16]
    0.50
    [SD, 0.20]
    0.63
    [SD, 0.15]
    0.73
    [SD, 0.11]
    |VD|(%)54.4
    [SD, 22.1]
    26.9
    [SD, 20.0]
    17.6
    [SD, 11.2]
    12.3
    [SD, 12.7]
    77.4
    [SD, 16.5]
    30.6
    [SD, 18.6]
    37.6
    [SD, 51.5]
    13.7
    [SD, 9.7]
    HD9519.5
    [SD, 8.6]
    15.9
    [SD, 16.1]
    10.8
    [SD, 6.7]
    5.27
    [SD, 3.15]
    30.6
    [SD, 20.9]
    21.8
    [SD, 22.9]
    19.5
    [SD, 18.8]
    17.1
    [SD, 21.0]
    AUC0.53
    [SD, 0.21]
    0.66
    [SD, 0.12]
    0.61
    [SD, 0.11]
    0.84
    [SD, 0.07]
    0.54
    [SD, 0.28]
    0.60
    [SD, 0.20]
    0.60
    [SD, 0.20]
    0.84
    [SD, 0.10]
    • Note:—HD95 indicates modified Hausdorff distance (mm); P, pixel; L, lesion; |VD| = absolute volume difference.

    • View popup
    Table 3:

    Interobserver variability in Dice scoresa

    Test Cohort 1Test Cohort 2
    Observer 2StackGen-NetObserver 2StackGen-Net
    Observer 10.68 (0.72)0.76 (0.74)0.66 (0.72)0.74 (0.75)
    Observer 20.65 (0.66)0.65 (0.72)
    • ↵a Mean (median) pair-wise Dice scores.

PreviousNext
Back to top

In this issue

American Journal of Neuroradiology: 42 (4)
American Journal of Neuroradiology
Vol. 42, Issue 4
1 Apr 2021
  • Table of Contents
  • Index by author
  • Complete Issue (PDF)
Advertisement
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Neuroradiology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
A Stacked Generalization of 3D Orthogonal Deep Learning Convolutional Neural Networks for Improved Detection of White Matter Hyperintensities in 3D FLAIR Images
(Your Name) has sent you a message from American Journal of Neuroradiology
(Your Name) thought you would like to see the American Journal of Neuroradiology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Cite this article
L. Umapathy, G.G. Perez-Carrillo, M.B. Keerthivasan, J.A. Rosado-Toro, M.I. Altbach, B. Winegar, C. Weinkauf, A. Bilgin, for the Alzheimer’s Disease Neuroimaging Initiative
A Stacked Generalization of 3D Orthogonal Deep Learning Convolutional Neural Networks for Improved Detection of White Matter Hyperintensities in 3D FLAIR Images
American Journal of Neuroradiology Apr 2021, 42 (4) 639-647; DOI: 10.3174/ajnr.A6970

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
0 Responses
Respond to this article
Share
Bookmark this article
A Stacked Generalization of 3D Orthogonal Deep Learning Convolutional Neural Networks for Improved Detection of White Matter Hyperintensities in 3D FLAIR Images
L. Umapathy, G.G. Perez-Carrillo, M.B. Keerthivasan, J.A. Rosado-Toro, M.I. Altbach, B. Winegar, C. Weinkauf, A. Bilgin, for the Alzheimer’s Disease Neuroimaging Initiative
American Journal of Neuroradiology Apr 2021, 42 (4) 639-647; DOI: 10.3174/ajnr.A6970
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Purchase

Jump to section

  • Article
    • Abstract
    • ABBREVIATIONS:
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSIONS
    • Footnotes
    • References
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Early detection of white matter hyperintensities using SHIVA-WMH detector
  • Crossref (3)
  • Google Scholar

This article has been cited by the following articles in journals that are participating in Crossref Cited-by Linking.

  • Convolutional Neural Network Based Frameworks for Fast Automatic Segmentation of Thalamic Nuclei from Native and Synthesized Contrast Structural MRI
    Lavanya Umapathy, Mahesh Bharath Keerthivasan, Natalie M. Zahr, Ali Bilgin, Manojkumar Saranathan
    Neuroinformatics 2022 20 3
  • Early detection of white matter hyperintensities usingSHIVA‐WMHdetector
    Ami Tsuchida, Philippe Boutinaud, Violaine Verrecchia, Christophe Tzourio, Stéphanie Debette, Marc Joliot
    Human Brain Mapping 2024 45 1
  • Accelerated diffusion tensor imaging with self-supervision and fine-tuning
    Phillip Martin, Diego Martin, Maria Altbach, Ali Bilgin
    Scientific Reports 2025 15 1

More in this TOC Section

Adult Brain

  • Diagnostic Neuroradiology of Monoclonal Antibodies
  • Clinical Outcomes After Chiari I Decompression
  • Segmentation of Brain Metastases with BLAST
Show more Adult Brain

Functional

  • Kurtosis and Epileptogenic Tubers: A Pilot Study
  • Glutaric Aciduria Type 1: DK vs. Conventional MRI
  • Multiparametric MRI in PEDS Pontine Glioma
Show more Functional

Similar Articles

Advertisement

Indexed Content

  • Current Issue
  • Accepted Manuscripts
  • Article Preview
  • Past Issues
  • Editorials
  • Editor's Choice
  • Fellows' Journal Club
  • Letters to the Editor
  • Video Articles

Cases

  • Case Collection
  • Archive - Case of the Week
  • Archive - Case of the Month
  • Archive - Classic Case

Special Collections

  • AJNR Awards
  • ASNR Foundation Special Collection
  • Most Impactful AJNR Articles
  • Photon-Counting CT
  • Spinal CSF Leak Articles (Jan 2020-June 2024)

More from AJNR

  • Trainee Corner
  • Imaging Protocols
  • MRI Safety Corner

Multimedia

  • AJNR Podcasts
  • AJNR Scantastics

Resources

  • Turnaround Time
  • Submit a Manuscript
  • Submit a Video Article
  • Submit an eLetter to the Editor/Response
  • Manuscript Submission Guidelines
  • Statistical Tips
  • Fast Publishing of Accepted Manuscripts
  • Graphical Abstract Preparation
  • Imaging Protocol Submission
  • Evidence-Based Medicine Level Guide
  • Publishing Checklists
  • Author Policies
  • Become a Reviewer/Academy of Reviewers
  • News and Updates

About Us

  • About AJNR
  • Editorial Board
  • Editorial Board Alumni
  • Alerts
  • Permissions
  • Not an AJNR Subscriber? Join Now
  • Advertise with Us
  • Librarian Resources
  • Feedback
  • Terms and Conditions
  • AJNR Editorial Board Alumni

American Society of Neuroradiology

  • Not an ASNR Member? Join Now

© 2025 by the American Society of Neuroradiology All rights, including for text and data mining, AI training, and similar technologies, are reserved.
Print ISSN: 0195-6108 Online ISSN: 1936-959X

Powered by HighWire