Inter- and Intrarater Agreement on the Outcome of Endovascular Treatment of Aneurysms Using MRA
Abstract
BACKGROUND AND PURPOSE: Patients treated with coiling are often followed by MR angiography. Our objective was to assess the inter- and intraobserver agreement in diagnosing aneurysm remnants and recurrences by using multimodality imaging, including TOF MRA.
MATERIALS AND METHODS: A portfolio composed of 120 selected images from 56 patients was sent to 15 neuroradiologists from 10 institutions. For each case, raters were asked to classify angiographic results (3 classes) of 2 studies (32 MRA-MRA and 24 DSA-MRA pairs) and to provide a final judgment regarding the presence of a recurrence (no, minor, major). Six raters were asked to independently review the portfolio twice. A second study, restricted to 4 raters having full access to all images, was designed to validate the results of the electronic survey.
RESULTS: The proportion of cases judged to have a major recurrence varied between 16.1% and 71.4% (mean, 35.0% ± 12.7%). There was moderate agreement overall (κ = 0.474 ± 0.009), increasing to nearly substantial (κ = 0.581 ± 0.014) when the judgment was dichotomized (presence or absence of a major recurrence). Agreement on cases followed-up by MRA-MRA was similarly substantial (κ = 0.601 ± 0.018). The intrarater agreement varied between fair (κ = 0.257 ± 0.093) and substantial (κ= 0.699 ± 0.084), improving with a dichotomized judgment concerning MRA-MRA comparisons. Agreement was no better when raters had access to all images.
CONCLUSIONS: There is an important variability in the assessment of angiographic outcomes of endovascular treatments. Agreement on the presence of a major recurrence when comparing 2 MRA studies or the MRA with the last catheter angiographic study can be substantial.
- © 2016 American Society of Neuroradiology
Jump to section
Related Articles
Cited By...
This article has been cited by the following articles in journals that are participating in Crossref Cited-by Linking.
- Pierre Bouillot, Olivier Brina, Bénédicte M. A. Delattre, Rafik Ouared, Alain Pellaton, Hasan Yilmaz, Paolo Machi, Karl‐Olof Lovblad, Mohamed Farhat, Vitor Mendes Pereira, Maria Isabel VargasMagnetic Resonance in Medicine 2019 81 1
- Sishi Xiang, Fu Fan, Peng Hu, Kun Yang, Xiaodong Zhai, Jiewen Geng, Zhe Ji, Jie Lu, Hongqi ZhangJournal of NeuroInterventional Surgery 2021 13 12
- Luke N. Ledbetter, Judah Burns, Robert Y. Shih, Amna A. Ajam, Michael D. Brown, Santanu Chakraborty, Melissa A. Davis, Andrew F. Ducruet, Christopher H. Hunt, Mary E. Lacy, Ryan K. Lee, Jeffrey S. Pannell, Jeffrey M. Pollock, William J. Powers, Gavin Setzen, Matthew D. Shaines, Pallavi S. Utukuri, Lily L. Wang, Amanda S. CoreyJournal of the American College of Radiology 2021 18 11
- Marc Kotowski, Behzad Farzin, Robert Fahed, François Guilbert, Miguel Chagnon, Tim E. Darsaut, Roy T. Daniel, Jean RaymondWorld Neurosurgery 2019 121
- A. Benomar, B. Farzin, G. Gevry, W. Boisseau, D. Roy, A. Weill, D. Iancu, F. Guilbert, L. Létourneau-Guillon, G. Jacquin, C. Chaalala, M.W. Bojanowski, M. Labidi, R. Fahed, D. Volders, T.N. Nguyen, J.-C. Gentric, E. Magro, G. Boulouis, G. Forestier, J.-F. Hak, J.S. Ghostine, Z. Kaderali, J.J. Shankar, M. Kotowski, T.E. Darsaut, J. RaymondAmerican Journal of Neuroradiology 2021 42 9
- Anass Benomar, Behzad Farzin, David Volders, Guylaine Gevry, Justine Zehr, Robert Fahed, William Boisseau, Jean-Christophe Gentric, Elsa Magro, Lorena Nico, Daniel Roy, Alain Weill, Charbel Mounayer, François Guilbert, Laurent Létourneau-Guillon, Gregory Jacquin, Chiraz Chaalala, Marc Kotowski, Thanh N. Nguyen, David Kallmes, Phil White, Tim E. Darsaut, Jean RaymondNeuroradiology 2021 63 9
- Devi P. Patra, Arjun Syal, Rudy J. Rahme, Karl R. Abi-Aad, Rohin Singh, Evelyn L. Turcotte, Breck A. Jones, Jenna Meyer, Miles Hudson, Brian W. Chong, Guilherme Dabus, Robert F. James, Chandan Krishna, Bernard R. BendokJournal of Neurosurgery 2022
- Jimmy Ghostine, Naim Khoury, Francis Cloutier, Marc Kotowski, Jean-Christophe Gentric, André L Batista, Alain Weill, Daniel Roy, Tim E Darsaut, Jean RaymondInterventional Neuroradiology 2016 22 6