Skip to main content
Advertisement

Main menu

  • Home
  • Content
    • Current Issue
    • Publication Preview--Ahead of Print
    • Past Issue Archive
    • Case of the Week Archive
    • Classic Case Archive
    • Case of the Month Archive
  • For Authors
  • About Us
    • About AJNR
    • Editors
    • American Society of Neuroradiology
  • Submit a Manuscript
  • Podcasts
    • Subscribe on iTunes
    • Subscribe on Stitcher
  • More
    • Subscribers
    • Permissions
    • Advertisers
    • Alerts
    • Feedback
  • Other Publications
    • ajnr

User menu

  • Subscribe
  • Alerts
  • Log in

Search

  • Advanced search
American Journal of Neuroradiology
American Journal of Neuroradiology

American Journal of Neuroradiology

  • Subscribe
  • Alerts
  • Log in

Advanced Search

  • Home
  • Content
    • Current Issue
    • Publication Preview--Ahead of Print
    • Past Issue Archive
    • Case of the Week Archive
    • Classic Case Archive
    • Case of the Month Archive
  • For Authors
  • About Us
    • About AJNR
    • Editors
    • American Society of Neuroradiology
  • Submit a Manuscript
  • Podcasts
    • Subscribe on iTunes
    • Subscribe on Stitcher
  • More
    • Subscribers
    • Permissions
    • Advertisers
    • Alerts
    • Feedback
  • Follow AJNR on Twitter
  • Visit AJNR on Facebook
  • Follow AJNR on Instagram
  • Join AJNR on LinkedIn
  • RSS Feeds
ReplyLETTER

Reply:

P. Tiwari and A. Madabhushi
American Journal of Neuroradiology November 2017, 38 (11) E94; DOI: https://doi.org/10.3174/ajnr.A5366
P. Tiwari
aDepartment of Biomedical Engineering Case Western Reserve University Cleveland, Ohio
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for P. Tiwari
A. Madabhushi
aDepartment of Biomedical Engineering Case Western Reserve University Cleveland, Ohio
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for A. Madabhushi
  • Article
  • Info & Metrics
  • References
  • PDF
Loading

We thank Dr Colby for his interest in our article “Computer-Extracted Texture Features to Distinguish Cerebral Radionecrosis from Recurrent Brain Tumors on Multiparametric MRI: A Feasibility Study.”

We are replying to Dr Colby's specific comment, “Therefore, while it may seem impressive that the imaging-based classifier attained 91% accuracy (10/11 cases) … we would, in fact, have attained the exact same diagnostic accuracy by ignoring all the machine-learning algorithms, relying solely on our general knowledge of the base rate that tumor recurrence is more common and assigning every holdout test case to the ‘recurrence’ class label without looking at a single image.”

While we appreciate Dr Colby's viewpoint, we respectfully disagree with his argument for at least a few reasons.

First, the test set was curated on the basis of the availability of studies that had pathologic confirmation (via multiple biopsies or surgical resections), which, in this case, happened to consist predominantly of recurrence cases. It was not compiled to be representative of the “true” distribution of tumor recurrence and necrosis cases. However, the image-based classifier during testing did not have this information a priori. Similarly, the readers were blinded to the class distribution of cases in the test set. It is certainly conceivable that readers, when reviewing cases in clinical practice, tend to factor in the a priori distribution of recurrence and necrosis cases into their diagnosis, but there is no suggestion that this information was explicitly taken into account by the readers during the course of this study.

Second, the null classifier alluded to by Dr Colby is more of an abstract, theoretic idea. It so happens that for the number of cases (n = 11 with 10 cancer recurrences and 1 necrosis) considered in the test set, applying the “null classifier,” which involves labeling every case as cancer recurrence, would yield the same accuracy as the machine classifier. However, one could argue that if we were to create a subset of studies that had just 1 radiation necrosis case in it, the null classifier would have an accuracy of 0% and the machine classifier would have a 100% accuracy; the machine classifier in the test was able to correctly identify the necrosis case. While the discussion of the performance of the null classifier is certainly interesting from a theoretic perspective, clearly neither the human readers nor the machine classifier in our study invoked this null classifier approach.

  • © 2017 by American Journal of Neuroradiology
PreviousNext
Back to top

In this issue

American Journal of Neuroradiology: 38 (11)
American Journal of Neuroradiology
Vol. 38, Issue 11
1 Nov 2017
  • Table of Contents
  • Index by author
  • Complete Issue (PDF)
Advertisement
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Neuroradiology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Reply:
(Your Name) has sent you a message from American Journal of Neuroradiology
(Your Name) thought you would like to see the American Journal of Neuroradiology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Reply:
P. Tiwari, A. Madabhushi
American Journal of Neuroradiology Nov 2017, 38 (11) E94; DOI: 10.3174/ajnr.A5366

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Reply:
P. Tiwari, A. Madabhushi
American Journal of Neuroradiology Nov 2017, 38 (11) E94; DOI: 10.3174/ajnr.A5366
del.icio.us logo Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Purchase

Jump to section

  • Article
  • Info & Metrics
  • References
  • PDF

Related Articles

  • Radiomics Approach Fails to Outperform Null Classifier on Test Data
  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Crossref
  • Google Scholar

This article has not yet been cited by articles in journals that are participating in Crossref Cited-by Linking.

More in this TOC Section

  • COVID-19 Related Central Nervous System Vasculopathy: Beyond Vasculitis
  • Reply:
  • Diagnostic Value of “Mushroom” Morphology in Vertebral Chordoma
Show more LETTERS

Similar Articles

Advertisement

News and Updates

  • Lucien Levy Best Research Article Award
  • Thanks to our 2020 Distinguished Reviewers
  • Press Releases

Resources

  • Evidence-Based Medicine Level Guide
  • How to Participate in a Tweet Chat
  • AJNR Podcast Archive
  • Ideas for Publicizing Your Research
  • Librarian Resources
  • Terms and Conditions

Opportunities

  • Share Your Art in Perspectives
  • Get Peer Review Credit from Publons
  • Moderate a Tweet Chat

American Society of Neuroradiology

  • Neurographics
  • ASNR Annual Meeting
  • Fellowship Portal
  • Position Statements

© 2021 by the American Society of Neuroradiology | Print ISSN: 0195-6108 Online ISSN: 1936-959X

Powered by HighWire