Skip to main content
Advertisement

Main menu

  • Home
  • Content
    • Current Issue
    • Publication Preview--Ahead of Print
    • Past Issue Archive
    • Case of the Week Archive
    • Classic Case Archive
    • Case of the Month Archive
    • COVID-19 Content and Resources
  • For Authors
  • About Us
    • About AJNR
    • Editors
    • American Society of Neuroradiology
  • Submit a Manuscript
  • Podcasts
    • Subscribe on iTunes
    • Subscribe on Stitcher
  • More
    • Subscribers
    • Permissions
    • Advertisers
    • Alerts
    • Feedback
  • Other Publications
    • ajnr

User menu

  • Subscribe
  • Alerts
  • Log in

Search

  • Advanced search
American Journal of Neuroradiology
American Journal of Neuroradiology

American Journal of Neuroradiology

  • Subscribe
  • Alerts
  • Log in

Advanced Search

  • Home
  • Content
    • Current Issue
    • Publication Preview--Ahead of Print
    • Past Issue Archive
    • Case of the Week Archive
    • Classic Case Archive
    • Case of the Month Archive
    • COVID-19 Content and Resources
  • For Authors
  • About Us
    • About AJNR
    • Editors
    • American Society of Neuroradiology
  • Submit a Manuscript
  • Podcasts
    • Subscribe on iTunes
    • Subscribe on Stitcher
  • More
    • Subscribers
    • Permissions
    • Advertisers
    • Alerts
    • Feedback
  • Follow AJNR on Twitter
  • Visit AJNR on Facebook
  • Follow AJNR on Instagram
  • Join AJNR on LinkedIn
  • RSS Feeds
Research ArticleInterventional

Reliability of the Modified TICI Score among Endovascular Neurosurgeons

D.M. Heiferman, N.C. Pecoraro, A.W. Wozniak, K.C. Ebersole, L.M. Jimenez, M.R. Reynolds, A.J. Ringer and J.C. Serrone
American Journal of Neuroradiology August 2020, 41 (8) 1441-1446; DOI: https://doi.org/10.3174/ajnr.A6696
D.M. Heiferman
aFrom the Department of Neurological Surgery (D.M.H., N.C.P., M.R.R., J.C.S.), Clinical Research Office (A.W.W.), Loyola University Stritch School of Medicine and Loyola University Medical Center, Maywood, Illinois
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for D.M. Heiferman
N.C. Pecoraro
aFrom the Department of Neurological Surgery (D.M.H., N.C.P., M.R.R., J.C.S.), Clinical Research Office (A.W.W.), Loyola University Stritch School of Medicine and Loyola University Medical Center, Maywood, Illinois
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for N.C. Pecoraro
A.W. Wozniak
aFrom the Department of Neurological Surgery (D.M.H., N.C.P., M.R.R., J.C.S.), Clinical Research Office (A.W.W.), Loyola University Stritch School of Medicine and Loyola University Medical Center, Maywood, Illinois
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for A.W. Wozniak
K.C. Ebersole
bDepartment of Neurological Surgery (K.C.E.), University of Kansas Medical Center, Kansas City, Kansas; and Mayfield Brain & Spine (L.M.J., A.J.R.), Cincinnati, Ohio.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for K.C. Ebersole
L.M. Jimenez
bDepartment of Neurological Surgery (K.C.E.), University of Kansas Medical Center, Kansas City, Kansas; and Mayfield Brain & Spine (L.M.J., A.J.R.), Cincinnati, Ohio.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for L.M. Jimenez
M.R. Reynolds
aFrom the Department of Neurological Surgery (D.M.H., N.C.P., M.R.R., J.C.S.), Clinical Research Office (A.W.W.), Loyola University Stritch School of Medicine and Loyola University Medical Center, Maywood, Illinois
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for M.R. Reynolds
A.J. Ringer
bDepartment of Neurological Surgery (K.C.E.), University of Kansas Medical Center, Kansas City, Kansas; and Mayfield Brain & Spine (L.M.J., A.J.R.), Cincinnati, Ohio.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for A.J. Ringer
J.C. Serrone
aFrom the Department of Neurological Surgery (D.M.H., N.C.P., M.R.R., J.C.S.), Clinical Research Office (A.W.W.), Loyola University Stritch School of Medicine and Loyola University Medical Center, Maywood, Illinois
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for J.C. Serrone
  • Article
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • References
  • PDF
Loading

Abstract

BACKGROUND AND PURPOSE: The modified TICI score is the benchmark for quantifying reperfusion after mechanical thrombectomy. There has been limited investigation into the reliability of this score. We aim to identify intra-rater and inter-rater reliability of the mTICI score among endovascular neurosurgeons.

MATERIALS AND METHODS: Four independent endovascular neurosurgeons (raters) reviewed angiograms of 67 patients at 2 time points. κ statistics assessed inter- and intrarater reliability and compared raters’-versus-proceduralists’ scores. Reliability was also assessed for occlusion location and by dichotomizing modified TICI scores (0–2a versus 2b–3).

RESULTS: Interrater reliability was moderate-to-substantial, weighted κ = 0.417–0.703, overall κ = 0.374 (P < .001). The dichotomized modified TICI score had moderate-to-substantial interrater agreement, κ statistics = 0.468–0.715, overall κ = 0.582 (P < .001). Intrarater reliability was moderate-to-almost perfect, weighted κ = 0.594–0.81. The dichotomized modified TICI score had substantial-to-almost perfect reliability, κ = 0.632–0.82. Proceduralists had fair-to-moderate agreement with raters, weighted κ = 0.348–0.574, and the dichotomized modified TICI score had fair-to-moderate agreement, κ = 0.365–0.544. When proceduralists and raters disagreed, proceduralists’ scores were higher in 79.6% of cases. M1 followed by ICA occlusions had the highest agreement.

CONCLUSIONS: The modified TICI score is a practical metric for assessing reperfusion after mechanical thrombectomy, though not without limitations. Agreement improved when scores were dichotomized around the clinically relevant threshold of successful revascularization. Interrater reliability improved with time, suggesting that formal training of interventionalists may improve reporting reliability. Agreement of the modified TICI scale is best with M1 and ICA occlusion and becomes less reliable with more distal or posterior circulation occlusions. These findings should be considered when developing research trials.

ABBREVIATIONS:

mTICI
modified TICI
TIMI
Thrombolysis in Myocardial Infarction

Following the paradigm-shifting studies that demonstrated the efficacy of endovascular mechanical thrombectomy for acute, large-vessel occlusion in 2015, timely and thorough revascularization in cases of large-vessel occlusions has become a tenet of acute ischemic stroke care. The modified TICI (mTICI) score has been the preferred grading system for completeness of reperfusion across major studies.1⇓⇓⇓⇓⇓⇓⇓-9 However, despite the clinical importance that reperfusion has shown for patients’ likelihood of an independent functional outcome, there has been limited investigation into the reliability of the mTICI score.10 We sought to investigate the reliability of the mTICI score among experienced neuroendovascular surgeons.

MATERIALS AND METHODS

Case Selection

Following institutional review board approval (IRB LU No. 210370), a retrospective review was conducted of all patients who underwent an endovascular mechanical thrombectomy for acute ischemic stroke at Loyola University Medical Center between January 2015 and March 2016. Patients were excluded for not having complete pre- and postprocedural anterior-posterior and lateral-projection DSAs of the entire intracranial cavity available for review. Data were gathered on the thrombus location and categorized as the following: ICA, first-segment middle cerebral artery (M1), second-segment middle cerebral artery (M2), or “other” site of vessel occlusions. We also recorded the proceduralists’ mTICI assessments when the procedures were performed, which we will refer to as the proceduralists’ score.

Simulated Core Laboratory Survey

DSAs were de-identified and uploaded onto a secure Web site supplied by the university in compliance with all research and legal regulations. Anterior-posterior and lateral views of the initial control DSA and the final recanalization DSA were viewable on a separate page for each patient. Each case was given a score by each rater according to the mTICI score, which was provided to the raters on an introductory slide defined as

0 = no reperfusion

1 = antegrade reperfusion past the initial occlusion, but limited distal branch filling with little-or-slow distal reperfusion

2a = antegrade reperfusion of less than half of the previously occluded target artery ischemic territory

2b = antegrade reperfusion of more than half of the previously occluded target artery ischemic territory

3 = complete antegrade reperfusion of the previously occluded target artery ischemic territory, with absence of visualized occlusion in all distal branches.

Four fellowship-trained endovascular neurosurgeons with 2–18 years of experience from 3 different institutions who perform mechanical thrombectomies in their current practice participated in the simulated core laboratory case review. Raters, as we will refer to them, had access to only the DSAs and were blinded to demographics, presentation, and outcomes. No rater had performed any of the procedures included in the study. The images were placed in random order for the first review. Unknown to the raters, they were asked again 1 month later to review the same DSAs in a different random order for intrarater reliability assessment. Raters were unable to access survey answers after submission.

Statistical Methods

This study was powered to detect κ = 0.80 agreement between pair-wise raters with the null hypothesis of chance agreement of .50. A sample size of 67 resulted in 92.6% power when α was set to .05. Overall agreement was defined as the binary proportion of pair-wise scores that matched. Pair-wise inter- and intrarater reliability was assessed with percentage agreement, and weighted and unweighted Cohen κ statistics. In addition, trends of the raters’ scores compared with the proceduralists’ TICI scores were assessed with pair-wise agreement and κ statistics. Overall interrater reliability was assessed using the overall Fleiss κ statistic.11 All interrater reliability statistics were assessed at the second time point. Agreement ranged from 0 (no agreement) to 1 (perfect agreement). κ statistics ranged from < 0 to 1. Landis and Koch12 guidelines were used to categorize levels of agreement for κ statistics: < 0, no agreement; > 0–0.2, slight agreement; > 0.2–0.4, fair agreement; > 0.4–0.6, moderate agreement; > 0.6–0.8, substantial agreement; and > 0.8–1, almost perfect agreement. Additional analyses compared reliability measures by occlusion location and by dichotomizing the TICI scores into poor recanalization (0, 1, 2a) and good recanalization (2b, 3). The Fisher exact test was used to compare percentage agreement measures among locations of occlusions. All analyses were conducted in SAS 9.4 (SAS Institute).

RESULTS

Of the 67 patients included in the study, 20 had ICA, 33 had M1, seven had M2, and 7 had other occlusions (3 of the vertebral/basilar artery, 1 posterior cerebral artery, 1 anterior cerebral artery, and 2 of the third-segment MCA). Pair-wise agreement between the raters ranged from 44.8% to 67.2%, the unweighted κ statistics ranged from 0.268 to 0.538, and the weighted κ statistics ranged from 0.417 to 0.703, indicating moderate-to-substantial interrater reliability. Higher weighted κ’s compared with unweighted κ’s indicated that many of the differences in agreement were small on the ordinal TICI scale. However, the overall κ for the 4 raters was 0.374 (H0: κ = 0, P < .001), suggesting that there was only fair overall agreement (On-line Table).

The Figure illustrates each of the raters’ scores for each individual patient at time 1. The patients are stacked vertically from most profusion (on average) to least profusion (on average). As shown by the weighted κ statistic, many of the disagreements were within 1 step of each other. However, there were only 17 patients (25%) for whom all raters were in complete agreement. Agreement and κ statistics were highest in the M1 and ICA occlusions and lowest in the M2 and other groups. Those with M1 occlusion had a significantly higher proportion of complete agreement (39%) followed by ICA occlusions (20%). There were no cases of complete agreement for those who had M2 or other occlusions (Table 1, P = .010).

FIGURE.
  • Download figure
  • Open in new tab
  • Download powerpoint
FIGURE.

TICI scores for each of the 67 patients from each of the raters and both time points. Each row represents 1 patient. Column 1 refers to rater 1, column 2 refers to rater 2, and so forth. The color legend shows how each rater classified the patient during his or her respective review. For example, patient 1 was classified as a 3 by all raters, illustrating 100% agreement among all raters. Patient 20 was classified as a 3 twice during time point 1 and as a 2b twice during time point 1, illustrating only 50% agreement among raters overall at time point 1. Patient 56 had different classifications by all raters showing only 25% agreement.

View this table:
  • View inline
  • View popup
Table 1:

Agreement by site of occlusion

Pair-wise interrater agreement for the dichotomous mTICI score ranged from 80.6% to 88.1%, and κ statistics ranged from 0.468 to 0.715, showing moderate-to-substantial agreement. The overall κ for our 4 raters for the dichotomized mTICI score was 0.582 (H0: κ = 0, P < .001) (On-line Table). The interrater reliability improved on the second survey for both the ordinal and dichotomized analyses (0.37–0.43 and 0.58–0.65, respectively).

Intrarater reliability was higher than interrater reliability. Pair-wise intrarater agreement ranged from 62.7% to 79.1%. Unweighted κ statistics ranged from 0.446 to 0.707 (Table 2), showing moderate-to-substantial agreement, while weighted κ’s ranged from 0.594 to 0.81, showing moderate-to-almost perfect agreement. When the outcome was dichotomized, agreement ranged from 86.6% to 92.5%, with κ statistics from 0.632 to 0.824 showing substantial-to-almost perfect intrarater reliability.

View this table:
  • View inline
  • View popup
Table 2:

Intrarater reliability for TICI scoresa

When we compared the simulated core lab raters’ scores with the proceduralists’ mTICI scores, pair-wise agreement ranged from 52.2% to 58.2%. Unweighted κ’s ranged from 0.163 to 0.388, and weighted κ’s ranged from 0.348 to 0.574, showing fair-to-moderate agreement. For dichotomized mTICI scores, κ’s ranged from 0.365 to 0.544, showing fair-to-moderate agreement. Of the 268 comparisons (4 raters’ scores each compared with 67 proceduralists’ score), 138 (51.5%) were in agreement and 130 (48.5%) were not in agreement. Of the 130 not in agreement, 100 (76.9%) proceduralists’ scores were higher than the raters’ scores, with only 30 (23.1%) with the proceduralists’ scores lower than the raters’ scores.

DISCUSSION

In the era of endovascular mechanical thrombectomy for acute ischemic stroke, a number of revascularization scores have been developed and some further modified. These scores aim to quantify the success of revascularization or reperfusion and have been important reporting and prognostic metrics.

In 1992, Mori et al13 were the first to re-purpose the Thrombolysis in Myocardial Infarction (TIMI) scale from the cardiac literature for cerebral revascularization. These investigators broke down the partial filling grade 2 of TIMI into grades 2 ( < 50% filling) and 3 ( > 50% filling).13 Subsequently, the TICI scale was proposed by Higashida et al,14 in 2003, which focused on the revascularization assessment of territory reperfusion compared with arterial recanalization and changed the partial reperfusion grades 2 and 3 into grades 2a (less than two-thirds territory filling) and 2b (slowed-but-complete territory filling), respectively. Higashida et al reserved grade 3 for complete reperfusion.15 The Interventional Management of Stroke (IMS) II investigators established the mTICI scale, which continued to focus on reperfusion, but simplified the scale to define 2a as < 50% territory filling and 2b as > 50% filling.10 The mTICI scale has been widely used in the most recent major mechanical thrombectomy trials.1⇓⇓⇓⇓⇓⇓⇓-9

A further gradation of the partial perfusion grade was suggested by Noser et al,16 with 2c representing near-complete territory filling with delayed contrast runoff, which is used at many centers but has not been universally adopted. Other revascularization scales have been proposed but have not found widespread use, including the Thrombolysis in Brain Ischemia (TIBI) scale that is based on transcranial duplex measurements, the Arterial Occlusion Lesion (AOL) scale that assesses recanalization, and the Qureshi scale that factors in the site of occlusion.14,15,17,18

Our study found that raters had fair overall interrater agreement when analyzing the entire mTICI scale, which improved to moderate agreement when the responses were dichotomized to either ≤2a or ≥2b. Five previous studies have researched interrater reliability of the cerebral conventional angiography revascularization score. Bar et al,19 in 2012, published the reliability of the TIMI scale applied to cerebral revascularization across 2 reviewers assessing 43 cases. They found a weighted κ = 0.4, which is nearly equivalent to our findings (κ = 0.374). Gaha et al,20 in 2014, published their reliability assessment of the original TICI scale, finding an overall κ = 0.45 across 9 observers, and when dichotomized, agreement increased, with κ = 0.62.

In 2013, Suh et al21 looked specifically at the effect of changing from a two-thirds territory to one-half territory threshold between 2a and 2b grades of the TICI and mTICI scales, respectively. Interobserver variability was assessed as good for the TICI and mTICI scales (intraclass correlation coefficient = 0.73 and 0.67, respectively). The TICI 2a–2b threshold variability led to different grading in ≈20% of cases, and the mTICI score (using the one-half territory threshold) was better at predicting clinical outcome. Volny et al,22 in 2017, assessed reliability using the addition of the 2c “near-complete reperfusion” to the mTICI scale. Sixty-one patients were assessed by 3 reviewers of different specialties and levels of training, who also compared different combinations of consensus grading with those of different specialties and levels of training. When compared against a criterion standard of a consensus grading between a neurointerventional fellow and attending, they found fair reliability for a stroke physician (κ = 0.36), moderate reliability for a neuroradiologist (κ = 0.48), and moderate reliability for a neurointerventional fellow (κ = 0.56). They also found that different combinations of reviewer consensus grading increased to almost perfect agreement and concluded that mTICI 2c is a feasible adjunct.22

The most recent mTICI reliability study by Fahed et al,23 in 2018, assessed 305 patients in the Contact Aspiration vs Stent Retriever for Successful Revascularization (ASTER) trial by 2 blinded neurointerventional radiologists, and these scores were also compared with those of the proceduralist who performed the procedure. Scores were analyzed both on an ordinal scale as well as dichotomized to ≤2a or ≥2b. They found moderate agreement for the nondichotomized mTICI score and substantial agreement with the dichotomized mTICI score.23 These findings largely mirror our findings.

We also found a trend of proceduralists’ scores being higher than independent raters’ scores, which was also found by multiple prior studies.23⇓⇓-26 For cases not in agreement, the proceduralists’ score was higher than the raters’ scores in 77% of cases. This speaks to a consistent bias that interventionalists must be aware of and attempt to overcome by rigorous objective assessment or internal blinded review.

Finally, we found that cases of M1 occlusions had the highest agreement, followed by ICA occlusions, while M2 and other vessel occlusions had poor agreement. These findings may be explained by an effort to score only the final cerebral reperfusion result, disregarding the initial perfusion findings. In fact, a posterior cerebral artery occlusion was the 1 case to be scored differently by all 4 raters. Although the scales explicitly use the initial area of the brain not receiving antegrade perfusion as the denominator to calculate the reperfusion result, it is a simpler process to always use an M1 occlusion area as the denominator by removing a step of interpretation (the determination of the initial nonperfusing brain area). Because M1 occlusions are the most common occlusion location requiring mechanical thrombectomy, many interventionalists may gravitate toward this standard consciously or subconsciously. Another explanation is that many descriptions of the mTICI scale use an M1 occlusion as an example, describing a 2b reperfusion result “eg, when greater than 50% of the MCA territory is filling.” Also, the best predictor of good outcome is a lower final infarct volume (regardless of how much brain was potentially at risk at the beginning of the case). Other explanations of this finding include branching variability of the MCA for M2 occlusion assessment, general variability of the posterior circulation, and difficulty in incorporating the anterior cerebral arteries into the scoring for ICA occlusion assessment (ie, an ICA terminus occlusion may still perfuse the ipsilateral anterior cerebral artery through the anterior communicating artery). Any of these may affect both intra- and interrater agreement. Nonocclusive thrombus may also be a challenge and account for some disagreement. Additionally, the evolution of grading scales and nomenclature may have had an effect on reliability because raters may have developed inherent biases based on timing and the institution of training. We chose to study the standard mTICI, given its widespread use throughout the large mechanical thrombectomy trials.

Our study is the first in the literature, to our knowledge, to assess intrarater reliability of the mTICI score. When raters were compared against themselves across the 2 time points, they had substantial agreement, higher than when raters were compared against each other, demonstrating a personal consistency in assessment. When answers were dichotomized to either ≤2a or ≥2b, intrarater reliability rose to substantial-to-almost perfect agreement. The interrater reliability also improved on the second survey for both the ordinal and dichotomized analyses. This outcome may be due to a learning curve for the survey platform or may be evidence of a further familiarity with the mTICI system. This possibility could suggest that standardized training for mTICI, similar to what is done for clinical stroke assessment, will improve reporting consistency. However, the importance of angiogram interpretation standardization is less than that of clinical stroke assessment because an angiogram is a static record that can always be adjudicated at a later date and a patient’s clinical state is fluid with the only record being that of the clinician’s assessment on the day of examination (assuming these are not video-recorded).

Limitations from our study include heterogenous occlusion locations with unequal representation of certain occlusion locations. Although the locations are heterogeneous and unequal, this situation occurs in practice. More education for raters by way of case examples, explanation of rating scales from the literature and trials, and tutorials on how to deal with nuances before their formal scoring on the Web-based platform would have set the stage for more standard results. However, a simple 1-page definition of scores does allow a better real-world assessment of interventionalists’ ratings, whereas heavy training would bias results away from the current state of practice and would be more of an assessment of how our training package standardizes results. We did not want to influence the scoring with our hypothesized biases.

Of the 67 individuals reviewed, reperfusion in 70.15%–83% of them was rated as 2b or 3, depending on the rater. The lack of heterogeneity in categories produces a high estimate of chance agreement, which produces a lower κ score. This is concordant with the HERMES collaboration reporting of the 5 thrombectomy trials published in 2015, which reported mTICI scores of 2b or 3 in 71% of cases. κ statistics could be artificially low, given that there was not enough representation of 0, 1, or 2a mTICI cases. Last, we compared the proceduralists’ mTICI assessment with that of our raters, but we have no knowledge of what the original proceduralists’ cutoffs for TICI grading were due to the retrospective nature of our study.

CONCLUSIONS

The mTICI score is a practical metric for assessing reperfusion after mechanical thrombectomy, though not without limitations. Agreement improved when scores were dichotomized around the clinically relevant threshold of successful revascularization. Interrater reliability improved with time; this feature suggests that formal training of interventionalists, similar to the design of our study, may improve reporting reliability. Agreement of the mTICI scale is highest with M1 and ICA occlusion and becomes less reliable with more distal or posterior circulation occlusions. These findings should be accounted for when developing research trials or with future modifications to stroke revascularization scores.

Acknowledgments

We would like to thank Ron Price, Greg Klitz, Virgilio Conanan, and Rahul Williamson for their technical assistance with image acquisition and creation of the secure survey Web site.

Footnotes

  • Disclosures: Joseph C. Serrone—UNRELATED: Payment for Lectures Including Service on Speakers Bureaus: Chicago Review Course, Comments: I speak annually at the Chicago Review Course in Neurosurgery and receive an honorarium of <$1000. It does not conflict with this article. Koji C. Ebersole—UNRELATED: Consultancy: Stryker Neurovascular, Comments: physician proctor and medical consultant. Andrew J. Ringer—UNRELATED: Consultancy: MicroVention, Comments: no payments in >2 years; Expert Testimony: Mayfield Brain & Spine, Comments: none relevant to this work.

References

  1. 1.↵
    1. Goyal M,
    2. Menon BK,
    3. van Zwam WH, et al
    ; HERMES Collaborators. Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet 2016;387:1723–31 doi:10.1016/S0140-6736(16)00163-X pmid:26898852
    CrossRefPubMed
  2. 2.↵
    1. Nogueira RG,
    2. Jadhav AP,
    3. Haussen DC, et al
    ; DAWN Trial Investigators. Thrombectomy 6 to 24 hours after stroke with a mismatch between deficit and infarct. N Engl J Med 2018;378:11–21 doi:10.1056/NEJMoa1706442 pmid:29129157
    CrossRefPubMed
  3. 3.↵
    1. Albers GW,
    2. Marks MP,
    3. Kemp S
    , et al. DEFUSE 3 Investigators. Thrombectomy for stroke at 6 to 16 hours with selection by perfusion imaging. N Engl J Med 2018;378:708–18 doi:10.1056/NEJMoa1713973 pmid:29364767
    CrossRefPubMed
  4. 4.↵
    1. Berkhemer OA,
    2. Fransen PS,
    3. Beumer D, et al
    ; MR CLEAN Investigators. A randomized trial of intraarterial treatment for acute ischemic stroke. N Engl J Med 2015;372:11–20 doi:10.1056/NEJMoa1411587 pmid:25517348
    CrossRefPubMed
  5. 5.↵
    1. Goyal M,
    2. Demchuk AM,
    3. Menon BK, et al
    ; ESCAPE Trial Investigators. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med 2015;372:1019–30 doi:10.1056/NEJMoa1414905 pmid:25671798
    CrossRefPubMed
  6. 6.↵
    1. Campbell BC,
    2. Mitchell PJ,
    3. Kleinig TJ, et al
    ; EXTEND-IA Investigators. Endovascular therapy for ischemic stroke with perfusion-imaging selection. N Engl J Med 2015;372:1009–18 doi:10.1056/NEJMoa1414792 pmid:25671797
    CrossRefPubMed
  7. 7.↵
    1. Saver JL,
    2. Goyal M,
    3. Bonafe A, et al
    ; SWIFT PRIME Investigators. Stent-retriever thrombectomy after intravenous t-PA vs. t-PA alone in stroke. N Engl J Med 2015;372:2285–95 doi:10.1056/NEJMoa1415061 pmid:25882376
    CrossRefPubMed
  8. 8.↵
    1. Jovin TG,
    2. Chamorro A,
    3. Cobo E, et al
    ; REVASCAT Trial investigators. Thrombectomy within 8 hours after symptom onset in ischemic stroke. N Engl J Med 2015;372:2296–2306 doi:10.1056/NEJMoa1503780 pmid:25882510
    CrossRefPubMed
  9. 9.↵
    1. Bracard S,
    2. Ducrocq X,
    3. Mas JL, et al
    ; THRACE Investigators. Mechanical thrombectomy after intravenous alteplase versus alteplase alone after stroke (THRACE): a randomised controlled trial. Lancet Neurol 2016;15:1138–47 doi:10.1016/S1474-4422(16)30177-6 pmid:27567239
    CrossRefPubMed
  10. 10.↵
    1. Tomsick T,
    2. Broderick J,
    3. Carrozella J, et al
    ; Interventional Management of Stroke II Investigators. Revascularization results in the Interventional Management of Stroke II trial. AJNR Am J Neuroradiol 2008;29:582–87 doi:10.3174/ajnr.A0843 pmid:18337393
    Abstract/FREE Full Text
  11. 11.↵
    1. Fleiss JL,
    2. Levin B,
    3. Paik MC
    . Statistical Methods for Rates and Proportions. Wiley; 2003
  12. 12.↵
    1. Landis JR,
    2. Koch GG
    . The measurement of observer agreement for categorical data. Biometrics 1977;33:159–74 pmid:843571
    CrossRefPubMed
  13. 13.↵
    1. Mori E,
    2. Yoneda Y,
    3. Tabuchi M, et al
    . Intravenous recombinant tissue plasminogen activator in acute carotid artery territory stroke. Neurology 1992;42:976–82 doi:10.1212/wnl.42.5.976 pmid:1579252
    Abstract/FREE Full Text
  14. 14.↵
    1. Higashida RT,
    2. Furlan AJ,
    3. Roberts H, et al
    ; Technology Assessment Committee of the American Society of Interventional and Therapeutic Neuroradiology; Technology Assessment Committee of the Society of Interventional Radiology. Trial design and reporting standards for intra-arterial cerebral thrombolysis for acute ischemic stroke. Stroke 2003;34:e109–37 doi:10.1161/01.STR.0000082721.62796.09 pmid:12869717
    Abstract/FREE Full Text
  15. 15.↵
    1. Khatri P,
    2. Neff J,
    3. Broderick JP, et al
    ; IMS-I Investigators. Revascularization end points in stroke interventional trials: recanalization versus reperfusion in IMS-I. Stroke 2005;36:2400–03 doi:10.1161/01.STR.0000185698.45720.58 pmid:16224088
    Abstract/FREE Full Text
  16. 16.↵
    1. Noser EA,
    2. Shaltoni HM,
    3. Hall CE, et al
    . Aggressive mechanical clot disruption: a safe adjunct to thrombolytic therapy in acute stroke? Stroke 2005;36:292–96 doi:10.1161/01.STR.0000152331.93770.18 pmid:15625300
    Abstract/FREE Full Text
  17. 17.↵
    1. Demchuk AM,
    2. Burgin WS,
    3. Christou I, et al
    . Thrombolysis in brain ischemia (TIBI) transcranial Doppler flow grades predict clinical severity, early recovery, and mortality in patients treated with intravenous tissue plasminogen activator. Stroke 2001;32:89–93 doi:10.1161/01.str.32.1.89 pmid:11136920
    Abstract/FREE Full Text
  18. 18.↵
    1. Qureshi AI
    . New grading system for angiographic evaluation of arterial occlusions and recanalization response to intra-arterial thrombolysis in acute ischemic stroke. Neurosurgery 2002;50:1405–14; discussion 1414–15 pmid:12015866
    CrossRefPubMed
  19. 19.↵
    1. Bar M,
    2. Mikulik R,
    3. Jonszta T, et al
    . Diagnosis of recanalization of the intracranial artery has poor inter-rater reliability. AJNR Am J Neuroradiol 2012;33:972–74 doi:10.3174/ajnr.A2896 pmid:22241381
    Abstract/FREE Full Text
  20. 20.↵
    1. Gaha M,
    2. Roy C,
    3. Estrade L, et al
    . Inter- and intraobserver agreement in scoring angiographic results of intra-arterial stroke therapy. AJNR Am J Neuroradiol 2014;35:1163–69 doi:10.3174/ajnr.A3828 pmid:24481332
    Abstract/FREE Full Text
  21. 21.↵
    1. Suh SH,
    2. Cloft HJ,
    3. Fugate JE, et al
    . Clarifying differences among thrombolysis in cerebral infarction scale variants: is the artery half open or half closed? Stroke 2013;44:1166–68 doi:10.1161/STROKEAHA.111.000399 pmid:23412375
    Abstract/FREE Full Text
  22. 22.↵
    1. Volny O,
    2. Cimflova P,
    3. Szeder V
    . Inter-rater reliability for thrombolysis in cerebral infarction with TICI 2c category. J Stroke Cerebrovasc Dis 2017;26:992–94 doi:10.1016/j.jstrokecerebrovasdis.2016.11.008 pmid:27919793
    CrossRefPubMed
  23. 23.↵
    1. Fahed R,
    2. Ben Maacha M,
    3. Ducroux C, et al
    ; ASTER Trial Investigators. Agreement between core laboratory and study investigators for imaging scores in a thrombectomy trial. J Neurointerv Surg 2018;10:e30 doi:10.1136/neurintsurg-2018-013867 pmid:29760012
    Abstract/FREE Full Text
  24. 24.↵
    1. Saver JL,
    2. Jahan R,
    3. Levy EI, et al
    ; SWIFT Trialists. Solitaire flow restoration device versus the Merci Retriever in patients with acute ischaemic stroke (SWIFT): a randomised, parallel-group, non-inferiority trial. Lancet 2012;380:1241–49 doi:10.1016/S0140-6736(12)61384-1 pmid:22932715
    CrossRefPubMed
  25. 25.↵
    1. Nogueira RG,
    2. Lutsep HL,
    3. Gupta R, et al
    ; TREVO 2 Trialists. Trevo versus Merci retrievers for thrombectomy revascularisation of large vessel occlusions in acute ischaemic stroke (TREVO 2): a randomised trial. Lancet 2012;380:1231–40 doi:10.1016/S0140-6736(12)61299-9 pmid:22932714
    CrossRefPubMed
  26. 26.↵
    1. Zhang G,
    2. Treurniet KM,
    3. Jansen IG, et al
    ; for the MR CLEAN Registry Investigators. Operator versus core lab adjudication of reperfusion after endovascular treatment of acute ischemic stroke. Stroke 2018;49:2376–82 doi:10.1161/STROKEAHA.118.022031 pmid:30355107
    CrossRefPubMed
  • Received March 9, 2020.
  • Accepted after revision May 18, 2020.
  • © 2020 by American Journal of Neuroradiology
View Abstract
PreviousNext
Back to top

In this issue

American Journal of Neuroradiology: 41 (8)
American Journal of Neuroradiology
Vol. 41, Issue 8
1 Aug 2020
  • Table of Contents
  • Index by author
  • Complete Issue (PDF)
Advertisement
Print
Download PDF
Email Article

Thank you for your interest in spreading the word on American Journal of Neuroradiology.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Reliability of the Modified TICI Score among Endovascular Neurosurgeons
(Your Name) has sent you a message from American Journal of Neuroradiology
(Your Name) thought you would like to see the American Journal of Neuroradiology web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Reliability of the Modified TICI Score among Endovascular Neurosurgeons
D.M. Heiferman, N.C. Pecoraro, A.W. Wozniak, K.C. Ebersole, L.M. Jimenez, M.R. Reynolds, A.J. Ringer, J.C. Serrone
American Journal of Neuroradiology Aug 2020, 41 (8) 1441-1446; DOI: 10.3174/ajnr.A6696

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Reliability of the Modified TICI Score among Endovascular Neurosurgeons
D.M. Heiferman, N.C. Pecoraro, A.W. Wozniak, K.C. Ebersole, L.M. Jimenez, M.R. Reynolds, A.J. Ringer, J.C. Serrone
American Journal of Neuroradiology Aug 2020, 41 (8) 1441-1446; DOI: 10.3174/ajnr.A6696
Reddit logo Twitter logo Facebook logo Mendeley logo
  • Tweet Widget
  • Facebook Like
  • Google Plus One
Purchase

Jump to section

  • Article
    • Abstract
    • ABBREVIATIONS:
    • MATERIALS AND METHODS
    • RESULTS
    • DISCUSSION
    • CONCLUSIONS
    • Acknowledgments
    • Footnotes
    • References
  • Figures & Data
  • Supplemental
  • Info & Metrics
  • References
  • PDF

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Crossref
  • Google Scholar

This article has not yet been cited by articles in journals that are participating in Crossref Cited-by Linking.

More in this TOC Section

  • Diagnostic Performance of High-Resolution Vessel Wall MR Imaging Combined with TOF-MRA in the Follow-up of Intracranial Vertebrobasilar Dissecting Aneurysms after Reconstructive Endovascular Treatment
  • Outcomes with Endovascular Treatment of Patients with M2 Segment MCA Occlusion in the Late Time Window
  • Direct Aspiration versus Combined Technique for Distal Medium-Vessel Occlusions: Comparison on a Human Placenta Model
Show more INTERVENTIONAL

Similar Articles

Advertisement

News and Updates

  • Lucien Levy Best Research Article Award
  • Thanks to our 2022 Distinguished Reviewers
  • Press Releases

Resources

  • Evidence-Based Medicine Level Guide
  • How to Participate in a Tweet Chat
  • AJNR Podcast Archive
  • Ideas for Publicizing Your Research
  • Librarian Resources
  • Terms and Conditions

Opportunities

  • Share Your Art in Perspectives
  • Get Peer Review Credit from Publons
  • Moderate a Tweet Chat

American Society of Neuroradiology

  • Neurographics
  • ASNR Annual Meeting
  • Fellowship Portal
  • Position Statements

© 2023 by the American Society of Neuroradiology | Print ISSN: 0195-6108 Online ISSN: 1936-959X

Powered by HighWire