Automated Segmentation of Intracranial Thrombus on NCCT and CTA in Patients with Acute Ischemic Stroke Using a Coarse-to-Fine Deep Learning Model ================================================================================================================================================= * K. Zhu * F. Bala * J. Zhang * F. Benali * P. Cimflova * B.J. Kim * R. McDonough * N. Singh * M.D. Hill * M. Goyal * A. Demchuk * B.K. Menon * W. Qiu ## Abstract **BACKGROUND AND PURPOSE:** Identifying the presence and extent of intracranial thrombi is crucial in selecting patients with acute ischemic stroke for treatment. This article aims to develop an automated approach to quantify thrombus on NCCT and CTA in patients with stroke. **MATERIALS AND METHODS:** A total of 499 patients with large-vessel occlusion from the Safety and Efficacy of Nerinetide in Subjects Undergoing Endovascular Thrombectomy for Stroke (ESCAPE-NA1) trial were included. All patients had thin-section NCCT and CTA images. Thrombi contoured manually were used as reference standard. A deep learning approach was developed to segment thrombi automatically. Of 499 patients, 263 and 66 patients were randomly selected to train and validate the deep learning model, respectively; the remaining 170 patients were independently used for testing. The deep learning model was quantitatively compared with the reference standard using the Dice coefficient and volumetric error. The proposed deep learning model was externally tested on 83 patients with and without large-vessel occlusion from another independent trial. **RESULTS:** The developed deep learning approach obtained a Dice coefficient of 70.7% (interquartile range, 58.0%–77.8%) in the internal cohort. The predicted thrombi length and volume were correlated with those of expert-contoured thrombi (*r* = 0.88 and 0.87, respectively; *P *< .001). When the derived deep learning model was applied to the external data set, the model obtained similar results in patients with large-vessel occlusion regarding the Dice coefficient (66.8%; interquartile range, 58.5%–74.6%), thrombus length (*r* = 0.73), and volume (*r* = 0.80). The model also obtained a sensitivity of 94.12% (32/34) and a specificity of 97.96% (48/49) in classifying large-vessel occlusion versus non-large-vessel occlusion. **CONCLUSIONS:** The proposed deep learning method can reliably detect and measure thrombi on NCCT and CTA in patients with acute ischemic stroke. ## ABBREVIATIONS: AIS : acute ischemic stroke ASSD : average symmetric surface distance DC : Dice coefficient DL : deep learning EVT : endovascular therapy HD95 : 95th percentile of the Hausdorff distance IQR : interquartile range LVO : large-vessel occlusion MeVO : medium-vessel occlusion STAPLE : simultaneous truth and performance level estimation Randomized controlled trials in patients with acute ischemic stroke (AIS) have demonstrated the efficacy and safety of endovascular therapy (EVT) compared with medical therapy in patients with large-vessel occlusion (LVO).1,2 Identifying the presence, location, and extent of thrombi on NCCT and CTA images is important when selecting patients with AIS for reperfusion therapy. Thrombus characteristics such as location, length, volume, and permeability are helpful in predicting recanalization after both thrombolysis and EVT.3,4 Recent studies have also shown that thrombus radiomics is able to predict recanalization with IV alteplase5 and first-attempt recanalization with thromboaspiration.6 Accurate segmentation of thrombi on baseline imaging is the first step in assessing thrombus characteristics. Manual delineation of the thrombus is still the criterion standard in assessing thrombus characteristics in clinical practice.7 It requires expertise in imaging interpretation and is observer-dependent. Semiautomated segmentation techniques use clinicians’ input to help with this task, but the variability introduced by user input is still a concern.8 A fully-automated thrombus segmentation approach readily available in the acute setting is, therefore, desirable. Automated segmentation of thrombi on NCCT or CTA is, however, challenging due to various reasons. These include the low signal-to-noise ratio on CT-based imaging, partial volume effects, CT image artifacts, and intracranial calcification, and so forth, all of which hinder accurate delineation of the thrombus. These challenges imply that the traditional model-based or thresholding-based segmentation methods may not be able to achieve accurate or acceptable results.9⇓⇓-12 To the best of our knowledge, there are very few established approaches to automatically segment intracranial thrombi on CT images. This study, therefore, aims to develop and externally validate an automated thrombus-segmentation approach on NCCT and CTA images in patients with acute stroke presenting with intracranial vessel occlusion. ## MATERIALS AND METHODS ### Study Participants Patients were retrospectively selected from the Safety and Efficacy of Nerinetide in Subjects Undergoing Endovascular Thrombectomy for Stroke (ESCAPE-NA1) randomized controlled trial (ClinicalTrials.gov: [NCT02930018](http://www.ajnr.org/lookup/external-ref?link_type=CLINTRIALGOV&access_num=NCT02930018&atom=%2Fajnr%2F44%2F6%2F641.atom)).13 Study approval was obtained from the ethics board at each site and the responsible regulatory authorities. Signed informed consent was obtained from the patients or their legally authorized representatives. Inclusion criteria for the main study were the following: 1) 18 years of age or older with LVO (intracranial ICA, MCA M1, or functional M1 [proximal occlusion of all M2 branches]), 2) NIHSS score of ≥5, 3) time from last seen well <12 hours, 4) pial collateral filling of ≥50% of the ischemic MCA territory, and 5) ASPECTS ≥ 5. For this study, we included only patients with available thin-section (≤2.5 mm) baseline NCCT and CTA images (single-phase or 1 phase of multiphase CTA). We excluded patients whose imaging showed the following: 1) irremediable coregistration errors (*n* = 13), 2) severe motion artifacts (*n* = 16), or 3) beam-hardening artifacts (*n* = 11). A total of 499 patients were included, of whom 329 were randomly selected for the training (*n* = 263) and internal validation (*n* = 66); the remaining 170 patients (independent of the derivation cohort) were used to internally test the derived model (Fig 1). ![FIG 1.](http://www.ajnr.org/http://www.ajnr.org/content/ajnr/44/6/641/F1.medium.gif) [FIG 1.](http://www.ajnr.org/content/44/6/641/F1) FIG 1. Flowchart of patient inclusion. An external validation set was also used to test the generalizability of the derived DL model. This data set comprised 83 randomly chosen patients with AIS with anterior circulation occlusions from the Precise and Rapid Assessment of Collaterals Using Multi-Phase CTA in the Triage of Patients with Acute Ischemic Stroke for IV or IA Therapy (PRoVe-IT) study.14,15 Of the 83 patients, 34 had LVO, 28 had medium-vessel occlusion (MeVO) (M2/M3/M4 segments of the MCA or A2/A3/A4 segments of the anterior cerebral artery), and 21 had no identifiable intracranial occlusion. ### Reference Standard: Manual Segmentation of Thrombi The thin-section NCCT images were automatically coregistered onto the CTA images (using the second phase if multiphase CTA was available) using rigid-body transformation (the SimpleITK packages in Python; [https://pypi.org/project/SimpleITK/](https://pypi.org/project/SimpleITK/)),16 followed by skull-stripping.17 An expert neuroradiologist visually inspected the registration results and performed manual corrections by using the 3D Slicer software (Version 4.1, [https://www.slicer.org/](https://www.slicer.org/)) when the coregistration was suboptimal.18 Four trained readers (3 neuroradiologists with >5 years’ experience in vascular imaging and 1 vascular neurologist with >10 years of stroke imaging experience) manually segmented intracranial thrombi section-by-section on NCCT images while referring to the coregistered CTA images using ITK-SNAP ([http://www.itksnap.org/](http://www.itksnap.org/)).19 Four readers were each responsible for one-fourth of the entire data set, and they were blinded to clinical information and follow-up imaging. All 4 readers segmented a subset of 10 patients randomly selected from the internal test set. An expectation-maximization algorithm for simultaneous truth and performance level estimation (STAPLE) algorithm was performed to generate a computational “golden reference standard” based on the 4 experts’ segmentations, which was used to assess the variability of manual segmentations.20 ### Deep Learning Model A 2-stage coarse-to-fine thrombus segmentation neural network was proposed on the basis of the U-net architecture.21 The proposed deep learning (DL) model used a multiscale training strategy with a deep-supervision mechanism. In particular, a channel and spatial attention block was designed to make the model focus more on the salient areas on images at different scales and obtain more conducive features.22 The spatial attention module generates a spatial attention map using the interspatial relationship of features. Different from channel attention, spatial attention focuses on where an informative part is, which is complementary to channel attention. To compute the spatial attention, we apply average-pooling and max-pooling operations along the channel axis first and concatenate them to generate an efficient feature descriptor.22 On the concatenated feature descriptor, we apply a convolution layer to generate a spatial attention map, which encodes where to emphasize or suppress. In this article, the patch size for spatial transform was ![Formula][1] voxels. To make full use of multiscale context information, we used a scale-aware pyramid fusion module, in which 3 parallel dilated convolutions with different dilation rates were used to capture information at different scales.23 The detailed architecture of the proposed model is shown in Fig 2, and the details around the model architecture and hyperparameter optimization are summarized as follows: The 3D kernel size for convolutions was 3 × 3 × 3. Feature numbers at each layer were 32, 64, 128, 256, and 320 (limited to 320 to ensure sufficient context aggregation). Batch normalization was used in the proposed network, which took a step toward reducing the internal covariate shift and, in doing so, dramatically accelerated the training of deep neural nets. The batch size of the networks was 2, to enable large patch sizes, and the leaky Rectified Linear Unit nonlinearity was implemented. Stochastic gradient descent with Nesterov momentum (µ = 0.99) was used as the optimizer. The initial learning rate, dampening, batch size, and decay weight were 0.01, 0, 2, and ![Formula][2] , respectively. The learning rate was decayed throughout the training following ![Formula][3] , where ![Formula][4] is 0.01 and ![Formula][5] is the maximum of the epoch. ![FIG 2.](http://www.ajnr.org/http://www.ajnr.org/content/ajnr/44/6/641/F2.medium.gif) [FIG 2.](http://www.ajnr.org/content/44/6/641/F2) FIG 2. The proposed coarse-to-fine DL architecture. A 2-stage coarse-to-fine thrombus segmentation neural network used a multiscale training strategy with a deep-supervision mechanism, which consisted of the channel and spatial attention blocks and the scale-aware pyramid fusion module. Specifically, NCCT images after skull-stripping were downsampled from the original spacing of ![Formula][6] (![Formula][7] voxels) to ![Formula][8] (![Formula][9] voxels) and passed into the coarse model to obtain maximal contextual information and localize thrombi candidates at the first coarse stage. The output of the prediction maps at the coarse stage was upsampled to the original resolution and fed into the fine stage together with the original images to obtain more detailed segmentation. In particular, the fused features of each layer at the coarse stage were upsampled and concatenated to the features of the corresponding layer at the fine stage to use both global contextual information and local detail information obtained at coarse and fine stages. Additionally, 5-fold cross-validation on the training data set was performed to select the optimal model at the coarse and fine stages. Spatial augmentations (rotation, scaling, low-resolution simulation, and so forth) were applied in 3D to increase the diversity of the training data. The combined Dice and cross-entropy were used as the loss function.24 At each level of deep supervision, the ground truth segmentation mask was correspondingly downsampled for loss computation on the basis of the size of the feature maps. The training objective was the sum of the losses ( L) at all resolutions, ![Formula][10] . Hereby, the weights ( W) were halved with each decrease in resolution, resulting in ![Formula][11] , ![Formula][12] , and so forth, and were normalized to sum 1. ### Statistical Methods Patient demographics, including clinical and imaging variables, were compared across the derivation and internal test sets using the χ2 and Student *t* tests as appropriate. The proposed segmentation method was quantitatively evaluated using the spatial overlap metric of the Dice coefficient (DC) and 2 boundary distance error metrics: average symmetric surface distance (ASSD) and 95th percentile of the Hausdorff Distance (HD95),25 compared with the reference standard of manual (expert) segmentation. The DC is a spatial overlap index ranging from 0 to 1, where 1 indicates a perfect overlap between the reference standard and the predicted segmentation and vice versa. The ASSD and HD95 represent the average and largest HD95 errors between the 2 surfaces derived from the segmented and reference objects in 3D space. For ASSD and HD95, 0 mm indicates perfect segmentation. The correlations regarding thrombus length and volume between the DL-derived model and manual measurements were analyzed using the Pearson correlation and Spearman correlation as appropriate to the data distribution.26 The correlation was considered excellent if ≥0.70 and good if between 0.5 and 0.7.26 Absolute and relative errors of thrombus volume and length were also calculated. These metrics were all calculated in 3D space at a patient level and applied onto both the internal data set (ESCAPE-NA1) and the external test data set (PRoVe-IT) for internal and external validation, respectively. On the basis of the segmentation results, the model predictions can be also used to distinguish the patients with LVO versus without LVO after localizing the segmented thrombus and thresholding thrombus volume. We further assessed the specificity and sensitivity of the DL model in classifying intracranial thrombi (LVO versus non-LVO and occlusion versus nonocclusion) in the external data set. All statistical analyses were performed using the SciPy package ([https://scipy.org/](https://scipy.org/)). All *P* values were 2-sided, and statistical significance was defined as *P *< .05. ## RESULTS ### Patient Characteristics Patient characteristics of the derivation and internal and external test data are summarized in Table 1. There were no statistically significant differences in baseline characteristics between the derivation and internal test data (all, *P *> .05, Table 1). The choice of the external test data, with different characteristics than the internal data, was deliberate. View this table: [Table 1:](http://www.ajnr.org/content/44/6/641/T1) Table 1: Patient characteristics in the derivation data and in the internal and external test dataa ### Internal Validation All patients had ICA or M1 segment MCA occlusions. Figure 3 shows 2 examples predicted by the proposed DL model compared with the reference standard. Quantitative results on the internal test data of 170 patients are shown in Table 2. The proposed DL model obtained a median DC of 70.7% (interquartile range [IQR], 58.0%–77.8%), a median ASSD of 0.38 mm (IQR, 0.24–0.77 mm), and a median HD95 of 1.31 mm (IQR, 0.79–3.83 mm). The median thrombus length measured by the DL model was 13.94 mm (IQR, 6.32–25.76 mm) and was strongly correlated with that of the expert segmented thrombi (*r* = 0.88, *P *< .001). The median difference ![Formula][13] and median absolute difference ![Formula][14] of thrombus length between the expert segmentation and algorithm predictions were −5.41 mm (IQR, −11.34 to −0.5mm) and 5.79 mm (IQR, 1.79–11.37 mm), respectively. The median thrombus volume of 71.9 mm³ (IQR, 39.25–126.15 mm³) obtained by the DL model also strongly correlated with that obtained by expert segmentation (*r* = 0.87, *P *< .001). The median volume difference ![Formula][15] and the median absolute volume difference ![Formula][16] between the expert segmentation and algorithm predictions were −0.9 mm³ (IQR, −3.41–0.33 mm³) and 1.76 mm³ (IQR, 0.71–4.23 mm³), respectively. ![FIG 3.](http://www.ajnr.org/http://www.ajnr.org/content/ajnr/44/6/641/F3.medium.gif) [FIG 3.](http://www.ajnr.org/content/44/6/641/F3) FIG 3. Two segmentation examples obtained by the proposed model. The images are shown as NCCT/CTA overlaid with the manually or algorithm-segmented thrombi in red. View this table: [Table 2:](http://www.ajnr.org/content/44/6/641/T2) Table 2: Quantitative evaluation of thrombus measurement in the internal test data (170 patients) and external validation data (34 patients with LVO) of PRoVe-ITa ### External Validation The prevalence of LVO, MeVo, and no occlusions in the external data was 34 (41%), 28 (33.7%), and 21 (25.3%), respectively. Quantitative results from the 34 patients with LVO in the external data are shown in Table 2. In these 34 patients with LVO, the proposed DL model obtained a median DC of 66.8% (IQR, 58.5%–74.6%), a median ASSD of 0.56 mm (IQR, 0.19–1.21 mm), and a median HD95 of 3.05 mm (IQR, 1.37–8.19 mm) compared with the reference standard. The median thrombus length measured by the proposed DL model was 9.0 mm (IQR, 3.4–21.74 mm), which correlated significantly with expert manual segmentation (*r* = 0.73, *P *< .001). The median difference ![Formula][17] and the median absolute difference ![Formula][18] of thrombus length between the expert segmentation and algorithm predictions were 0.0 mm (IQR, −6.12–8.2 mm) and 6.14 mm (IQR, 2.81–12.27 mm), respectively. The median thrombus volume of 58.14 mm³ (IQR, 32.96–104.68 mm³) obtained by the DL model strongly correlated with manual segmentation (*r* = 0.80, *P *< .001). The median volume difference ![Formula][19] and the median absolute volume difference ![Formula][20] between the expert segmentation and algorithm predictions were 0.59 mm³ (IQR, −0.17–4.53 mm³) and 1.47 mm³ (IQR, 0.5–4.62 mm³), respectively. The accuracy, specificity, and sensitivity of the DL model in classifying intracranial thrombi were further investigated in the external data. The DL model obtained a sensitivity of 94.12% (32/34) and a specificity of 97.96% (48/49) in classifying patients with LVO versus non-LVO (including patients with MeVO and no occlusion). The DL model obtained a sensitivity of 69.35% (43/62) and a specificity of 100% (21/21) in classifying patients with occlusion versus no occlusion. ### Analysis of Variability in Manual Segmentations The median thrombus length and volume derived from the 10 patients using the STAPLE algorithm were 20.53 mm (IQR, 18.05–42.17 mm) and 52.49 mm³ (IQR, 22.99–166.42 mm³), respectively. Compared with the criterion standard generated by the STAPLE algorithm, the median DCs were 54.4% (IQR, 49.4%–70.7%), 57.5% (IQR, 49.1%–64.6%), 82.9% (IQR, 39.9%–94.1%), and 88.3% (IQR, 58.6%–93.5%) for the 4 raters, respectively. The proposed DL model achieved a median DC of 64.7% (IQR, 45.7%–73.7%), approaching an average performance of the 4 experts’ manual contouring. Other metrics, ie, ASSD, HD95, and volume correlations, showed consistent results (Online Supplemental Data). ## DISCUSSION This study describes a fully automated DL model for intracranial thrombus segmentation on NCCT and CTA images in patients with AIS. This model used a coarse-to-fine DL network with multilevel and multiscale feature fusion and deep-supervision strategy. It was developed using a large data set of 329 patients and tested internally and externally for generalizability. Both internal and external validations demonstrate that the developed model can accurately detect and segment intracranial thrombi, especially in patients with LVO, compared with manual segmentation by experts. There are no well-established methods for automated thrombus segmentation, and only a few that use semiautomated methods.7⇓⇓⇓–11 Existing methods of thrombus segmentation rely on manual or semiautomated measurements of thrombus density on NCCT. This method of density assessment by using small ROIs is prone to interobserver variability due to the heterogeneity in thrombus composition and the small size of intracranial thrombi and is sensitive to partial volume effects, image noise, and the presence of vessel wall calcification.7 Santos et al27 developed a semiautomated region-growing segmentation method that was limited by a low observer agreement and variability in thrombus density. Qazi et al12 used linear regression to build statistical models to predict patient-specific optimal Hounsfield unit thresholds, which replaced a universal single Hounsfield unit threshold for thrombus segmentation favored by Riedel et al.28 However, these thrombus density threshold-based methods are subject to image-intensity variability, and their generalizability is a concern. Lucas et al29 proposed a cascaded neural network to segment thrombi. Unfortunately, this method was restricted to 2D images and limited to the MCA + ICA region, used fixed ROIs, and was developed using a small data set (the segmentation network was trained on only the 216 positive cases). Mojtahedi et al30 used dual-modality U-Net-based CNNs to detect the thrombus location and then limited the search area by creating a bounding box around the detected thrombus location, which would allow the first-level prediction errors to stack up later. To the best of our knowledge, our study represents the largest data set of automated intracranial thrombus segmentation on NCCT/CTA with internal and external validation. The proposed method can automatically segment small thrombi in 3D whole-brain NCCT images, which overcomes the limitations of segmentation methods such as intensity-based and fixed ROI annotations. Among the 170 patients with LVO in the internal validation, the DL model failed to detect thrombus in only 10 cases. Visual inspection showed that these false-negative cases could be attributed to one or a combination of reasons: 1) small thrombi (<30 mm³) (*n* = 4); 2) isodense (to surrounding tissue) thrombi (*n* = 7); and 3) the presence of severe beam-hardening artifacts on the thrombus (*n* = 5). Only 7.5% of training data had such imaging characteristics in the retrospective analysis. Including more sample images with such characteristics in the training data could have improved the performance of the derived DL model. The volumetric analyses regarding thrombus length and volume also show excellent internal and external validation. However, the difference in thrombus length and HD95 seems to be large, possibly explained by the challenges in segmenting thrombi in curved vessels. Nonetheless, this study reports HD95 values, 3.05 (range, 1.37–8.19), similar to those reported in the Multicenter Randomized Clinical Trial of Endovascular Treatment for Acute Ischemic Stroke in the Netherlands (MR CLEAN) study, 5.67 (range, 4.30–7.04).30 The median DC was 70.7% in internal validation in the LVO-only ESCAPE NA1 study and 66.8% in the 34 LVO cases in external validation in the PRoVe-IT study. This slight difference could be because patients in the ProVe-IT study had less severe stroke than patients in the ESCAPE-NA1 trial (NIHSS score 8 versus 16) and, therefore, less extensive thrombi. Indeed, the median thrombus volume of the patients with LVO in the PRoVe-IT data (37.51 mm³; IQR, 29.19–78.3 mm³) was much smaller than that in the internal data set of ESCAPE-NA1 (80.53 mm³; IQR, 49.92–155.39 mm³). Moreover, the DC of the proposed model in the external validation set was 66.8%, suggesting a good agreement between the predicted and the measured thrombi. Our DC is similar to the algorithm developed from the MR CLEAN data, which achieved a DC of 62%.30 Despite the smaller thrombus burden, the developed DL model obtained a high specificity in identifying the presence of thrombus in the external validation. The sensitivity of 77.42% (48/62) was comparably low because 14 of 28 MeVO cases were identified as having no occlusions by the model, which might be because the derived DL model was trained using only LVO cases. Including more patients with distal occlusions or without occlusions in the training data could have improved the accuracy of the model in detecting small thrombi. The results of our study have several implications in clinical practice. Automated segmentation can be used to extract radiologic thrombus characteristics, such as thrombus length and volume, which were shown to be associated with clinical outcomes and reperfusion success.31,32 Although not included in the output of our proposed model, thrombus density and permeability are also useful in predicting clinical and angiographic outcomes,31 thus justifying future work to automate their calculations. Physicians can use the output of our model to inform their decisions regarding bridging therapy; for instance, long and large thrombi might benefit more from adjunctive IV thrombolysis compared with smaller thrombi; however, this possibility needs to be validated in future work.33 Furthermore, information about the precise location and length of the thrombus is useful for neurointerventionalists to plan the EVT procedure and choose the best device to achieve fast and effective reperfusion. Last, automated segmentation can be applied on big databases to extract thrombus characteristics in a faster and easier manner compared with humans and, thus, could be used to improve the design of EVT devices. Detection and segmentation of thrombi on NCCT/CTA are tedious and time-consuming for physicians.5,27,34,35 Improvements in image quality, better training, and systematic assessments of thrombus characteristics (parameterization and morphology) are useful to help humans improve thrombus detection on NCCT and CTA. Regardless of these strategies, detecting thrombi on NCCT and CTA continues to be challenging for humans, especially with small thrombi. Furthermore, the results using the reference standard generated by the STAPLE algorithm show the variability of manual segmentations across different raters and thus highlight the need for an automated process to standardize the extraction of thrombus characteristics. Our study has several limitations. First, patients with unavailable thin-section NCCT and CTA images were excluded, therefore introducing selection bias; however, we chose to do so to decrease measurement error from thick-section scans. Second, 4 well-trained experts manually contoured the data for evaluation. Even though the reproducibility of manual segmentations in our experiments was acceptable, the variability introduced by cognitive biases and heuristics and image misalignment should be considered. The variability in the results is partly explained by the difference in experience and training among the 4 raters. Two raters were neuroradiologists (raters 1 and 3), one was a neuroradiology resident (rater 2), and one was a vascular neurologist (rater 4). The 2 neuroradiologists achieved the highest DCs. Moreover, intracranial thrombi are small and occur in curved vessels. Annotation of lesions that are small with curved shapes can also result in variability compared with larger-sized lesions where variability will be inherently less. Third, the internal data sets did not include MeVO occlusions, explaining the low model performance for these cases. Future studies focusing on this occlusion subgroup would improve detection and delineation of these thrombi. Fourth, the proposed model did not show good performance in small and isodense thrombi; however, we chose to keep these cases, contrary to a prior study, to increase the generalizability of our results. Including more studies with artifacts (beam-hardening and so forth) would also improve the generalizability. Fifth, the developed model can be applied only on thin-section NCCT and CTA images. The extension to a more widely used NCCT with 5-mm-thick slices should be investigated. ## CONCLUSIONS An automated method based on DL is capable of detecting and segmenting thrombi reliably, especially those causing LVOs, on NCCT and CTA images in patients with AIS. Extensive validations demonstrate the efficacy of the proposed technique compared with the reference standard (ie, manual segmentation). If translated into a clinical setting, this algorithm could help physicians in their decision-making for AIS. ## Footnotes * This work was supported by the Natural Science Basic Research Plan in Shaanxi Province of China (No. 2021JM-413), the Distinguished Young Scholars of the National Natural Science Foundation of China (Overseas), and the National Key Research and Development Program (No. 2022YFE0209900). * [Disclosure forms](https://www.ajnr.org/sites/default/files/additional-assets/Disclosures/June%202023/0866.pdf) provided by the authors are available with the full text and PDF of this article at [www.ajnr.org](http://www.ajnr.org). Indicates open access to non-subscribers at [www.ajnr.org](http://www.ajnr.org) ## References 1. 1.Goyal M, Menon BK, van Zwam WH, et al; HERMES Collaborators. Endovascular thrombectomy after large-vessel ischaemic stroke: a meta-analysis of individual patient data from five randomised trials. Lancet 2016;387:1723–31 doi:10.1016/S0140-6736(16)00163-X pmid:26898852 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/S0140-6736(16)00163-X&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=26898852&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 2. 2.Menon BK, Hill MD, Davalos A, et al. Efficacy of endovascular thrombectomy in patients with M2 segment middle cerebral artery occlusions: meta-analysis of data from the HERMES Collaboration. J Neurointerv Surg 2019;11:1065–69 doi:10.1136/neurintsurg-2018-014678 pmid:30975736 [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTE6Im5ldXJpbnRzdXJnIjtzOjU6InJlc2lkIjtzOjEwOiIxMS8xMS8xMDY1IjtzOjQ6ImF0b20iO3M6MTk6Ii9ham5yLzQ0LzYvNjQxLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 3. 3.Menon BK, Al-Ajlan FS, Najm M, et al; INTERRSeCT Study Investigators. Association of clinical, imaging, and thrombus characteristics with recanalization of visible intracranial occlusion in patients with acute ischemic stroke. JAMA 2018;320:1017–26 doi:10.1001/jama.2018.12498 pmid:30208455 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1001/jama.2018.12498&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=30208455&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 4. 4.Riedel CH, Zimmermann P, Jensen-Kondering U, et al. The importance of size: successful recanalization by intravenous thrombolysis in acute anterior stroke depends on thrombus length. Stroke 2011;42:1775–77 doi:10.1161/STROKEAHA.110.609693 pmid:21474810 [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToic3Ryb2tlYWhhIjtzOjU6InJlc2lkIjtzOjk6IjQyLzYvMTc3NSI7czo0OiJhdG9tIjtzOjE5OiIvYWpuci80NC82LzY0MS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 5. 5.Qiu W, Kuang H, Nair J, et al. Radiomics-based intracranial thrombus features on CT and CTA predict recanalization with intravenous alteplase in patients with acute ischemic stroke. AJNR Am J Neuroradiol 2019;40:39–44 doi:10.3174/ajnr.A5918 pmid:30573458 [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYWpuciI7czo1OiJyZXNpZCI7czo3OiI0MC8xLzM5IjtzOjQ6ImF0b20iO3M6MTk6Ii9ham5yLzQ0LzYvNjQxLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 6. 6.Hofmeister J, Bernava G, Rosi A, et al. Clot-based radiomics predict a mechanical thrombectomy strategy for successful recanalization in acute ischemic stroke. Stroke 2020;51:2488–94 doi:10.1161/STROKEAHA.120.030334 pmid:32684141 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1161/STROKEAHA.120.030334&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=32684141&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 7. 7.Santos EM, Yoo AJ, Beenen LF, et al; MR CLEAN Investigators. Observer variability of absolute and relative thrombus density measurements in patients with acute ischemic stroke. Neuroradiology 2016;58:133–39 doi:10.1007/s00234-015-1607-4 pmid:26494462 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1007/s00234-015-1607-4&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=26494462&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 8. 8.Lalys F, Yan V, Kaladji A, et al. Generic thrombus segmentation from pre- and post-operative CTA. Int J Comput Assist Radiol Surg 2017;12:1501–10 doi:10.1007/s11548-017-1591-8 pmid:28455765 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1007/s11548-017-1591-8&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=28455765&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 9. 9.Lee K, Johnson RK, Yin Y, et al. Three-dimensional thrombus segmentation in abdominal aortic aneurysms using graph search based on a triangular mesh. Comput Biol Med 2010;40:271–78 doi:10.1016/j.compbiomed.2009.12.002 pmid:20074719 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.compbiomed.2009.12.002&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=20074719&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 10. 10.Freiman M, Esses SJ, Joskowicz L, et al. An iterative model-constrained graph-cut algorithm for abdominal aortic aneurysm thrombus segmentation. In: *Proceedings of the 2010 IEEE International Conference on Biomedical Imaging: from Nano to Macro*, Rotterdam, the Netherlands. April 14, 2010:672–75 11. 11.Zhuge F, Rubin GD, Sun S, et al. An abdominal aortic aneurysm segmentation method: level set with region and statistical information. Med Phys 2006;33:1440–53 doi:10.1118/1.2193247 pmid:16752579 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1118/1.2193247&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=16752579&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 12. 12.Qazi S, Qazi E, Wilson AT, et al. Identifying thrombus on non-contrast CT in patients with acute ischemic stroke. Diagnostics (Basel) 2021;11:1919 doi:10.3390/diagnostics11101919 pmid:34679617 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.3390/diagnostics11101919&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=34679617&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 13. 13.Hill MD, Goyal M, Menon BK, et al; ESCAPE-NA1 Investigators. Efficacy and Safety of Nerinetide for the Treatment of Acute Ischaemic Stroke (ESCAPE-NA1): a multicentre, double-blind, randomised controlled trial. Lancet 2020;395:878–87 doi:10.1016/S0140-6736(20)30258-0 pmid:32087818 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/S0140-6736(20)30258-0&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=32087818&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 14. 14.Menon BK, d’Esterre CD, Qazi EM, et al. Multiphase CT angiography: a new tool for the imaging triage of patients with acute ischemic stroke. Radiology 2015;275:510–20 doi:10.1148/radiol.15142256 pmid:25633505 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1148/radiol.15142256&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=25633505&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 15. 15.Ospel JM, Volny O, Qiu W, et al. Impact of multiphase computed tomography angiography for endovascular treatment decision-making on outcomes in patients with acute ischemic stroke. J Stroke 2021;23:377–87 doi:10.5853/jos.2021.00619 pmid:34649382 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.5853/jos.2021.00619&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=34649382&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 16. 16.Beare R, Lowekamp B, Yaniv Z. Image segmentation, registration and characterization in R with SimpleITK. J Stat Soft 2018;86:8 doi:10.18637/jss.v086.i08 pmid:30288153 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.18637/jss.v086.i08&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=30288153&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 17. 17.Najm M, Kuang H, Federico A, et al. Automated brain extraction from head CT and CTA images using convex optimization with shape propagation. Comput Methods Programs Biomed 2019;176:1–8 doi:10.1016/j.cmpb.2019.04.030 pmid:31200897 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.cmpb.2019.04.030&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=31200897&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 18. 18.Fedorov A, Beichel R, Kalpathy-Cramer J, et al. 3D Slicer as an image computing platform for the Quantitative Imaging Network. Magn Reson Imaging 2012;30:1323–41 doi:10.1016/j.mri.2012.05.001 pmid:22770690 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.mri.2012.05.001&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=22770690&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000309946000013&link_type=ISI) 19. 19.Yushkevich PA, Piven J, Hazlett HC, et al. User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 2006;31:1116–28 doi:10.1016/j.neuroimage.2006.01.015 pmid:16545965 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.neuroimage.2006.01.015&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=16545965&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000238358500015&link_type=ISI) 20. 20.Warfield SK, Zou KH, Wells WM. Simultaneous truth and performance level estimation (STAPLE): an algorithm for the validation of image segmentation. IEEE Trans Med Imaging 2004;23:903–21 doi:10.1109/TMI.2004.828354 pmid:15250643 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1109/TMI.2004.828354&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=15250643&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000222428100013&link_type=ISI) 21. 21.1. Navab N, 2. Hornegger J, 3. Wells W Ronneberger O, Fischer P, Brox T. U-Net: Convolutional Networks for Biomedical Image Segmentation. In: Navab N, Hornegger J, Wells W, et al., eds. In: Medical Image Computing and Computer-Assisted Intervention, Munich, Germany. October 5–9, 2015 22. 22.Woo S, Park J, Lee JY, et al. CBAM: Convolutional Block Attention Module. arXiv July 17, 2018[. https://arxiv.org/pdf/1807.06521v1.pdf](https://arxiv.org/pdf/1807.06521v1.pdf). Accessed October 6, 2018 23. 23.Feng S, Zhao H, Shi F, et al. CPFNet: Context Pyramid Fusion Network for Medical Image Segmentation. IEEE Trans Med Imaging 2020;39:3008–18 doi:10.1109/TMI.2020.2983721 pmid:32224453 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1109/TMI.2020.2983721&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=32224453&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 24. 24.Ma J, Chen J, Ng M, et al. Loss odyssey in medical image segmentation. Med Image Anal 2021;71:102035 doi:10.1016/j.media.2021.102035 pmid:33813286 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.media.2021.102035&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=33813286&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 25. 25.Mourya GK, Gogoi M, Talbar SN, et al. Cascaded dilated deep residual network for volumetric liver segmentation from CT image. International Journal of E-Health and Medical Communications 2021;12:34–45 doi:10.4018/IJEHMC.2021010103 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.4018/IJEHMC.2021010103&link_type=DOI) 26. 26.Mukaka MM. Statistics corner: a guide to appropriate use of correlation coefficient in medical research. Malawi Med J 2012;24:69–71 pmid:23638278 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.4236/jwarp.2015.77047&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=23638278&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000309277200006&link_type=ISI) 27. 27.Santos EM, Marquering HA, Berkhemer OA, et al; MR CLEAN Investigators. Development and validation of intracranial thrombus segmentation on CT angiography in patients with acute ischemic stroke. PLoS One 2014;9:e101985 doi:10.1371/journal.pone.0101985 pmid:25032691 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1371/journal.pone.0101985&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=25032691&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 28. 28.Riedel CH, Jensen U, Rohr A, et al. Assessment of thrombus in acute middle cerebral artery occlusion using thin-slice nonenhanced computed tomography reconstructions. Stroke 2010;41:1659–64 doi:10.1161/STROKEAHA.110.580662 pmid:20595670 [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToic3Ryb2tlYWhhIjtzOjU6InJlc2lkIjtzOjk6IjQxLzgvMTY1OSI7czo0OiJhdG9tIjtzOjE5OiIvYWpuci80NC82LzY0MS5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 29. 29.Lucas C, Schöttler JJ, Kemmling A, et al. Automatic detection and segmentation of the acute vessel thrombus in cerebral CT. Informatik Aktuell Springer; 2019:74–79 doi:10.1007/978-3-658-25326-4_19 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1007/978-3-658-25326-4_19&link_type=DOI) 30. 30.Mojtahedi M, Kappelhof M, Ponomareva E, et al. Fully automated thrombus segmentation on CT images of patients with acute ischemic stroke. Diagnostics (Basel) 2022;12:698 doi:10.3390/diagnostics12030698 pmid:35328251 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.3390/diagnostics12030698&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=35328251&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 31. 31.Dutra BG, Tolhuisen ML, Alves HC; MR CLEAN Registry Investigators, et al. Thrombus imaging characteristics and outcomes in acute ischemic stroke patients undergoing endovascular treatment. Stroke 2019;50:2057–64 doi:10.1161/STROKEAHA.118.024247 pmid:31216961 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1161/STROKEAHA.118.024247&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=31216961&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 32. 32.Yoo J, Baek JH, Park H, et al. Thrombus volume as a predictor of nonrecanalization after intravenous thrombolysis in acute stroke. Stroke 2018;49:2108–15 doi:10.1161/STROKEAHA.118.021864 pmid:30354986 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1161/STROKEAHA.118.021864&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=30354986&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 33. 33.Campbell BC, Kappelhof M, Fischer U. Role of intravenous thrombolytics prior to endovascular thrombectomy. Stroke 2022;53:2085–92 doi:10.1161/STROKEAHA.122.036929 pmid:35354294 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1161/STROKEAHA.122.036929&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=35354294&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 34. 34.Huang C, Tian J, Yuan C, et al. Fully automated segmentation of lower extremity deep vein thrombosis using convolutional neural network. Biomed Res Int 2019;2019:3401683 doi:10.1155/2019/3401683 pmid:31281832 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1155/2019/3401683&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=31281832&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) 35. 35.Santos EM, Niessen WJ, Yoo AJ, et al; MR CLEAN Investigators. Automated entire thrombus density measurements for robust and comprehensive thrombus characterization in patients with acute ischemic stroke. PLoS One 2016;11:e0145641 doi:10.1371/journal.pone.0145641 pmid:26765847 [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1371/journal.pone.0145641&link_type=DOI) [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=26765847&link_type=MED&atom=%2Fajnr%2F44%2F6%2F641.atom) * Received October 18, 2022. * Accepted after revision April 20, 2023. * © 2023 by American Journal of Neuroradiology [1]: /embed/mml-math-1.gif [2]: /embed/mml-math-2.gif [3]: /embed/mml-math-3.gif [4]: /embed/mml-math-4.gif [5]: /embed/mml-math-5.gif [6]: /embed/mml-math-6.gif [7]: /embed/mml-math-7.gif [8]: /embed/mml-math-8.gif [9]: /embed/mml-math-9.gif [10]: /embed/mml-math-10.gif [11]: /embed/mml-math-11.gif [12]: /embed/mml-math-12.gif [13]: /embed/mml-math-13.gif [14]: /embed/mml-math-14.gif [15]: /embed/mml-math-15.gif [16]: /embed/mml-math-16.gif [17]: /embed/mml-math-23.gif [18]: /embed/mml-math-24.gif [19]: /embed/mml-math-25.gif [20]: /embed/mml-math-26.gif