Skip to main content
Advertisement

Main menu

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • ASNR Foundation Special Collection
    • Most Impactful AJNR Articles
    • Photon-Counting CT
    • Spinal CSF Leak Articles (Jan 2020-June 2024)
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home

User menu

  • Alerts
  • Log in

Search

  • Advanced search
American Journal of Neuroradiology
American Journal of Neuroradiology

American Journal of Neuroradiology

ASHNR American Society of Functional Neuroradiology ASHNR American Society of Pediatric Neuroradiology ASSR
  • Alerts
  • Log in

Advanced Search

  • Home
  • Content
    • Current Issue
    • Accepted Manuscripts
    • Article Preview
    • Past Issue Archive
    • Video Articles
    • AJNR Case Collection
    • Case of the Week Archive
    • Case of the Month Archive
    • Classic Case Archive
  • Special Collections
    • AJNR Awards
    • ASNR Foundation Special Collection
    • Most Impactful AJNR Articles
    • Photon-Counting CT
    • Spinal CSF Leak Articles (Jan 2020-June 2024)
  • Multimedia
    • AJNR Podcasts
    • AJNR SCANtastic
    • Trainee Corner
    • MRI Safety Corner
    • Imaging Protocols
  • For Authors
    • Submit a Manuscript
    • Submit a Video Article
    • Submit an eLetter to the Editor/Response
    • Manuscript Submission Guidelines
    • Statistical Tips
    • Fast Publishing of Accepted Manuscripts
    • Graphical Abstract Preparation
    • Imaging Protocol Submission
    • Author Policies
  • About Us
    • About AJNR
    • Editorial Board
    • Editorial Board Alumni
  • More
    • Become a Reviewer/Academy of Reviewers
    • Subscribers
    • Permissions
    • Alerts
    • Feedback
    • Advertisers
    • ASNR Home
  • Follow AJNR on Twitter
  • Visit AJNR on Facebook
  • Follow AJNR on Instagram
  • Join AJNR on LinkedIn
  • RSS Feeds

AJNR is seeking candidates for the AJNR Podcast Editor. Read the position description.

Research ArticleAdult Brain

Deep Learning–Based Software Improves Clinicians' Detection Sensitivity of Aneurysms on Brain TOF-MRA

B. Sohn, K.-Y. Park, J. Choi, J.H. Koo, K. Han, B. Joo, S.Y. Won, J. Cha, H.S. Choi and S.-K. Lee
American Journal of Neuroradiology October 2021, 42 (10) 1769-1775; DOI: https://doi.org/10.3174/ajnr.A7242
B. Sohn
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.), Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for B. Sohn
K.-Y. Park
bDepartment of Neurosurgery (K.-Y.P.), Yonsei University College of Medicine, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for K.-Y. Park
J. Choi
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.), Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
cDepartment of Neurology (J.C.), Yonsei University College of Medicine, Seoul, South Korea
dDepartment of Neurology (J.C.), Seoul Medical Center, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J. Choi
J.H. Koo
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.), Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J.H. Koo
K. Han
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.), Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for K. Han
B. Joo
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.), Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for B. Joo
S.Y. Won
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.), Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for S.Y. Won
J. Cha
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.), Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J. Cha
H.S. Choi
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.), Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
eDepartment of Radiology (H.S.C.), Seoul Medical Center, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for H.S. Choi
S.-K. Lee
aFrom the Department of Radiology (B.S., J.C., J.H.K., K.H., B.J., S.Y.W., J.C., H.S.C., S.-K.L.), Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yonsei University College of Medicine, Seoul, South Korea
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for S.-K. Lee
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF
Loading

Article Figures & Data

Figures

  • Tables
  • FIG 1.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 1.

    Patient-selection flow diagram.

  • FIG 2.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 2.

    Change in individual diagnostic performance of clinicians. Arrow lines depict the change in diagnostic performance for each clinician without (red dot) and with (blue dot) software augmentation. The radiology resident showed no change in specificity between the 2 occasions (black dot). FP indicates false-positive.

  • FIG 3.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 3.

    Source (A) and MIP image (B) from TOF-MRA of 75-year-old female patient. There was a basilar top aneurysm, <3 mm. Human readers detected this lesion, but the computer-assisted detection software did not.

  • FIG 4.
    • Download figure
    • Open in new tab
    • Download powerpoint
    FIG 4.

    Source (A) and MIP (B) images from TOF-MRA of a 35-year-old female patient. Some human readers missed this lesion at first, but computer-assisted detection software detected it. C, During the second interpretation, human readers accepted the diagnosis of the software.

Tables

  • Figures
    • View popup
    Table 1:

    Patient demographics

    Positive for AneurysmNegative for AneurysmP Value
    No. of patients135197
    Age (range)62 (52–69)62 (53–73)P = .5a
    Sex (male ratio)36 (26.7%)84 (42.6%)P = .0029b
    No. of lesions1690
    • ↵a Mann-Whitney U test.

    • ↵b χ2 test.

    • View popup
    Table 2:

    Reader-individual diagnostic performances with/without CAD assistance

    ReaderHuman without CAD AssistanceHuman with CAD AssistanceHuman without vs with CAD Assistance (P Value)
    Sensitivity (%) (95% CI)Neurologist56.3 (47.9–64.7)84.4 (78.3–90.6)<.001
    Neurosurgeon74.8 (67.5–82.1)85.2 (79.2–91.2).032
    Radiologist86.7 (80.9–92.4)83.7 (77.5–89.9).493
    Resident76.3 (69.1–83.5)92.6 (88.2–97).001
    Specificity (%) (95% CI)Neurologist90.9 (86.8–94.9)92.9 (89.3–96.5).460
    Neurosurgeon92.9 (89.3–96.5)93.4 (89.9–96.9).842
    Radiologist95.9 (93.2–98.7)94.9 (91.9–98).629
    Resident99.5 (98.5–100)99.5 (98.5–100)>.999
    Sensitivity per lesion (%) (95% CI)Neurologist60.4 (53–67.7)91.7 (87.2–96.3)<.001
    Neurosurgeon82.2 (76–88.5)96.4 (93.7–99.2)<.001
    Radiologist90.5 (85.7–95.3)95.3 (92.2–98.3).070
    Resident80.5 (74.6–86.4)96.4 (93.7–99.2)<.001
    No. of false-positives per case (95% CI)Neurologist0.066 (0.044–0.099)0.072 (0.048–0.108).751
    Neurosurgeon0.069 (0.047–0.103)0.09 (0.062–0.132).200
    Radiologist0.039 (0.022–0.07)0.075 (0.051–0.112).028
    Resident0.006 (0.002–0.024)0.018 (0.008–0.04).179
PreviousNext
Back to top

In this issue

American Journal of Neuroradiology: 42 (10)
American Journal of Neuroradiology
Vol. 42, Issue 10
1 Oct 2021
  • Table of Contents
  • Index by author
  • Complete Issue (PDF)
Advertisement
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Neuroradiology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Deep Learning–Based Software Improves Clinicians' Detection Sensitivity of Aneurysms on Brain TOF-MRA
(Your Name) has sent you a message from American Journal of Neuroradiology
(Your Name) thought you would like to see the American Journal of Neuroradiology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Cite this article
B. Sohn, K.-Y. Park, J. Choi, J.H. Koo, K. Han, B. Joo, S.Y. Won, J. Cha, H.S. Choi, S.-K. Lee
Deep Learning–Based Software Improves Clinicians' Detection Sensitivity of Aneurysms on Brain TOF-MRA
American Journal of Neuroradiology Oct 2021, 42 (10) 1769-1775; DOI: 10.3174/ajnr.A7242

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
0 Responses
Respond to this article
Share
Bookmark this article
Deep Learning–Based Software Improves Clinicians' Detection Sensitivity of Aneurysms on Brain TOF-MRA
B. Sohn, K.-Y. Park, J. Choi, J.H. Koo, K. Han, B. Joo, S.Y. Won, J. Cha, H.S. Choi, S.-K. Lee
American Journal of Neuroradiology Oct 2021, 42 (10) 1769-1775; DOI: 10.3174/ajnr.A7242
del.icio.us logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Purchase

Jump to section

  • Article
    • Abstract
    • ABBREVIATIONS:
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSIONS
    • Footnotes
    • References
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • Responses
  • References
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • Automation Bias in AI-Assisted Detection of Cerebral Aneurysms on Time-of-Flight MR-Angiography
  • Automated Detection of Cerebral Aneurysms on TOF-MRA Using a Deep Learning Approach: An External Validation Study
  • Crossref (11)
  • Google Scholar

This article has been cited by the following articles in journals that are participating in Crossref Cited-by Linking.

  • Dense, deep learning-based intracranial aneurysm detection on TOF MRI using two-stage regularized U-Net
    Frédéric Claux, Maxime Baudouin, Clément Bogey, Aymeric Rouchaud
    Journal of Neuroradiology 2023 50 1
  • Brain Vessel Segmentation Using Deep Learning—A Review
    Mohammad Raihan Goni, Nur Intan Raihana Ruhaiyem, Muzaimi Mustapha, Anusha Achuthan, Che Mohd Nasril Che Mohd Nassir
    IEEE Access 2022 10
  • Automated Detection of Cerebral Aneurysms on TOF-MRA Using a Deep Learning Approach: An External Validation Study
    N.C. Lehnen, R. Haase, F.C. Schmeel, H. Vatter, F. Dorn, A. Radbruch, D. Paech
    American Journal of Neuroradiology 2022 43 12
  • Performance of deep learning in the detection of intracranial aneurysm: A systematic review and meta-analysis
    Feng Gu, Xiaoxiao Wu, Wenxue Wu, Zilan Wang, Xingyu Yang, Zhouqing Chen, Zhong Wang, Gang Chen
    European Journal of Radiology 2022 155
  • Role of artificial intelligence and machine learning in the diagnosis of cerebrovascular disease
    Kevin Gilotra, Sujith Swarna, Racheed Mani, Jade Basem, Reza Dashti
    Frontiers in Human Neuroscience 2023 17
  • Impact of an AI software on the diagnostic performance and reading time for the detection of cerebral aneurysms on time of flight MR-angiography
    Nils C. Lehnen, Arndt-Hendrik Schievelkamp, Christian Gronemann, Robert Haase, Inga Krause, Max Gansen, Tobias Fleckenstein, Franziska Dorn, Alexander Radbruch, Daniel Paech
    Neuroradiology 2024 66 7
  • Artificial intelligence in the diagnosis of cerebrovascular diseases using magnetic resonance imaging: A scoping review
    Yituo Wang, Zeru Zhang, Ying Peng, Silu Chen, Shuai Zhou, Jiqiang Liu, Song Gao, Guangming Zhu, Cong Han, Bing Wu
    iRADIOLOGY 2024 2 6
  • Automation bias in AI-assisted detection of cerebral aneurysms on time-of-flight MR angiography
    Su Hwan Kim, Severin Schramm, Evamaria Olga Riedel, Lena Schmitzer, Enrike Rosenkranz, Olivia Kertels, Jannis Bodden, Karolin Paprottka, Dominik Sepp, Martin Renz, Jan Kirschke, Thomas Baum, Christian Maegerlein, Tobias Boeckh-Behrens, Claus Zimmer, Benedikt Wiestler, Dennis M. Hedderich
    La radiologia medica 2025 130 4
  • A Novel Landmark-based Semi-supervised Deep Learning Method for Cerebral Aneurysm Detection Using TOF-MRA
    Hyeonsik Yang, Jieun Park, Eunyoung Regina Kim, Minho lee, ZunHyan Rieu, Donghyeon Kim, Beomseok Sohn, Kijeong lee
    Journal of the Korean Neurological Association 2024 42 4
  • Automatic diagnosis and measurement of intracranial aneurysms using deep learning in MRA raw images
    Qingning Yang, Fengxi Chen, Li Li, Rong Zeng, Jiaqing Li, Jingxu Xu, Chencui Huang, Junbang Feng, Chuanming Li
    Frontiers in Neurology 2025 16

More in this TOC Section

Adult Brain

  • Diagnostic Neuroradiology of Monoclonal Antibodies
  • Clinical Outcomes After Chiari I Decompression
  • Segmentation of Brain Metastases with BLAST
Show more Adult Brain

Functional

  • Kurtosis and Epileptogenic Tubers: A Pilot Study
  • Glutaric Aciduria Type 1: DK vs. Conventional MRI
  • Multiparametric MRI in PEDS Pontine Glioma
Show more Functional

Similar Articles

Advertisement

Indexed Content

  • Current Issue
  • Accepted Manuscripts
  • Article Preview
  • Past Issues
  • Editorials
  • Editor's Choice
  • Fellows' Journal Club
  • Letters to the Editor
  • Video Articles

Cases

  • Case Collection
  • Archive - Case of the Week
  • Archive - Case of the Month
  • Archive - Classic Case

Special Collections

  • AJNR Awards
  • ASNR Foundation Special Collection
  • Most Impactful AJNR Articles
  • Photon-Counting CT
  • Spinal CSF Leak Articles (Jan 2020-June 2024)

More from AJNR

  • Trainee Corner
  • Imaging Protocols
  • MRI Safety Corner

Multimedia

  • AJNR Podcasts
  • AJNR Scantastics

Resources

  • Turnaround Time
  • Submit a Manuscript
  • Submit a Video Article
  • Submit an eLetter to the Editor/Response
  • Manuscript Submission Guidelines
  • Statistical Tips
  • Fast Publishing of Accepted Manuscripts
  • Graphical Abstract Preparation
  • Imaging Protocol Submission
  • Evidence-Based Medicine Level Guide
  • Publishing Checklists
  • Author Policies
  • Become a Reviewer/Academy of Reviewers
  • News and Updates

About Us

  • About AJNR
  • Editorial Board
  • Editorial Board Alumni
  • Alerts
  • Permissions
  • Not an AJNR Subscriber? Join Now
  • Advertise with Us
  • Librarian Resources
  • Feedback
  • Terms and Conditions
  • AJNR Editorial Board Alumni

American Society of Neuroradiology

  • Not an ASNR Member? Join Now

© 2025 by the American Society of Neuroradiology All rights, including for text and data mining, AI training, and similar technologies, are reserved.
Print ISSN: 0195-6108 Online ISSN: 1936-959X

Powered by HighWire