MR Imaging of Brain Volumes: Evaluation of a Fully Automatic Software
=====================================================================

* K. Ambarki
* A. Wåhlin
* R. Birgander
* A. Eklund
* J. Malm

## Abstract

**BACKGROUND AND PURPOSE:** Automatic assessment of brain volumes is needed in research and clinical practice. Manual tracing is still the criterion standard but is time-consuming. It is important to validate the automatic tools to avoid the problems of clinical studies drawing conclusions on the basis of brain volumes estimated with methodologic errors. The objective of this study was to evaluate a new commercially available fully automatic software for MR imaging of brain volume assessment. Automatic and expert manual brain volumes were compared.

**MATERIALS AND METHODS:** MR imaging (3T, axial T2 and FLAIR) was performed in 41 healthy elderly volunteers (mean age, 70 ± 6 years) and 20 patients with hydrocephalus (mean age, 73 ± 7 years). The software QBrain was used to manually and automatically measure the following brain volumes: ICV, BTV, VV, and WMHV. The manual method has been previously validated and was used as the reference. Agreement between the manual and automatic methods was evaluated by using linear regression and Bland-Altman plots.

**RESULTS:** There were significant differences between the automatic and manual methods regarding all volumes. The mean differences were ICV = 49 ± 93 mL (mean ± 2SD, *n* = 61), BTV = 11 ± 70 mL, VV = −6 ± 10 mL, and WMHV = 2.4 ± 9 mL. The automatic calculations of brain volumes took approximately 2 minutes per investigation.

**CONCLUSIONS:** The automatic tool is promising and provides rapid assessment of brain volumes. However, the software needs improvement before it is incorporated into research or daily use. Manual segmentation remains the reference method.

## Abbreviations

A
:   automatic,
BTV
:   brain tissue volume
FLAIR
:   fluid-attenuated inversion recovery
ICV
:   intracranial volume
M
:   manual
MD
:   mean difference
MRD
:   mean relative difference
Obs1
:   observer 1
Obs2
:   observer 2
2SD
:   limits of agreement
SNIPER
:   Software for Neuro-Image Processing in Experimental Research
VV
:   ventricular volume
WMHV
:   white matter hyperintensity volume

Volume quantification of the intracranial compartments is important in several neurologic diseases. For example, hydrocephalus is defined according to the size of the ventricles.1 The degree and longitudinal evolution of white matter lesions reveal the clinical course of multiple sclerosis and vascular dementia.2,3 Brain atrophy is used for the diagnosis of Alzheimer disease, and volume changes of brain tumors may be used as markers of prognosis or treatment.4(#ref-5)(#ref-6)–7

Volumetric MR imaging was the first noninvasive in vivo technique to assess the volume of the intracranial compartments accurately.8,9 Today, the techniques of MR imaging volume quantification are mainly manual or semiautomatic. Manual segmentation is performed by an observer tracing the outer contour of a region of interest on each section. The semiautomatic techniques also require input and feedback from the observer. Both manual and semiautomatic techniques are time-consuming and thus expensive; therefore, volumetric estimations are seldom used in clinical routine.

It is important to develop tools to measure volumes fast and reliably. Different kinds of software have been developed to segment the brain volumes in a fully automatic way.10(#ref-11)(#ref-12)–13 These types of software are not commercially available and have only been validated and evaluated by the developers. FreeSurfer ([http://surfer.nmr.mgh.harvard.edu/fswiki](http://surfer.nmr.mgh.harvard.edu/fswiki)), a freely available software, has been evaluated against manual segmentation in a recent study, but the time needed for automatic computing of the brain volumes is too long for clinical use.14

A new automatic software, QBrain (Medis, Leiden, the Netherlands), has been developed to quantify BTV, ICV, brain VV, and WMHV. Using this software, the observer can perform the manual or the fully automatic segmentation of these brain volumes.

The fully automatic segmentation of QBrain is based on axial MR imaging sequences (FLAIR and T2-weighted); and by using a standard computer, the software automatically calculates the different volumes within a few minutes. This automatic software is promising, but it has not been validated yet.

In this study, we have selected the thorough manual segmentation of an experienced observer as the reference method. We believe that the manual method is the best possi ble estimate of the volumes, and this belief was also supported in a previous study using MR imaging volume phantoms, which showed that the manual segmentation tool of QBrain produces accurate and reproducible volume estimates.1 The aim of this study was to evaluate this new automatic software. In a group of 61 individuals, the QBrain manual protocol was used as the criterion standard and was compared with the QBrain automatic protocol.

## Materials and Methods

### MR Imaging Investigation

Subjects were studied with a 3T Achieva MR imaging scanner (Philips Healthcare, Best, the Netherlands) with an 8-channel head coil. Axial T2-weighted turbo spin-echo (TE = 80, TR = 3000 ms) and FLAIR (TE = 140, TR = 12000, and TI = 2850 ms) sequences were obtained. The section thickness was 3 mm, the intersection gap was 0.3 mm, and the matrix was 512 × 512 in both T2-weighted and FLAIR sequences. The voxel volume was 0.72 mm3 (0.4687 × 0.4687 × 3.3) in T2-weighted and 0.67 mm3 (0.4492 × 0.4492 × 3.3) in FLAIR sequences.

### Subjects

Sixty-one subjects were included. To obtain a large span of brain volumes, we chose 41 healthy elderly volunteers (mean age, 70 ± 6 years; 24 women) and 20 patients with ventriculomegaly due to possible or probable idiopathic normal pressure hydrocephalus (mean age, 73 ± 7 years; 9 women).15,16 The study was approved by the university ethics board.

### Volumetry

Volumetric MR imaging measurements were performed by using the image analysis software QBrain (Version 2.0). Volumes were calculated by using a standard computer (2.19 GHz, 1.96 GB of RAM). The volume quantifications were first performed with the manual segmentation and second with the fully automatic segmentation algorithms. Using the manual protocol, the observer segmented an area in each section by manually tracing the borders of the region of interest. The software estimates the volume in milliliters. ICV, BTV, VV, and WMHV were assessed. ICV was measured on T2 images; and BTV, VV, and WMH were measured on FLAIR images (Fig 1). The same brain volumes were measured by using automatic segmentation. The methodology of automatic segmentation was based on SNIPER (Leiden University Medical Center) and has been described previously.12

![Fig 1.](http://www.ajnr.org/https://www.ajnr.org/content/ajnr/32/2/408/F1.medium.gif)

[Fig 1.](http://www.ajnr.org/content/32/2/408/F1)

Fig 1. 
Manual segmentation of brain volumes.

### Manual Segmentation as the Reference Method

The manual method, used as the reference in this study, has been previously validated by using phantom models with well-defined volumes.1,17 The main observer in both studies (observer 1) was trained by a neuroradiologist and had 3 years' experience in brain volume segmentation. We further investigated the variability of the manual method by letting an additional observer measure brain volumes in 5 patients with hydrocephalus and in 5 healthy controls. The intraobserver variability was assessed by measuring the brain volumes twice by the same observer (observer 1). The time between the first and the second segmentation was always >1 month. For the interobserver variability, a second observer (observer 2) measured the brain volumes in the same 10 subjects and was blinded to the results of the first observer. Inter- and intraobserver variability was expressed as the MD between repeated brain volume measurements with the limits of agreement defined as 2 SD. MRD was also calculated.

![Fig 2.](http://www.ajnr.org/https://www.ajnr.org/content/ajnr/32/2/408/F2.medium.gif)

[Fig 2.](http://www.ajnr.org/content/32/2/408/F2)

Fig 2. 
Comparison between manual and automatic volumes. *A1* and *B1*, Plots of automatic versus manual for VV and ICV. The oblique dashed line represents the equality line. *A2* and *B2***,** The corresponding Bland-Altman plots for VV and ICV. The horizontal dashed lines are the confidence intervals of the difference between manual and automatic volumes.

### Statistics

The statistical analysis was performed with the Statistical Package for the Social Sciences software, Version 12.0 (SPSS, Chicago, Illinois). Correlations between the automatic and the manual brain volumes were investigated by using linear regression analysis. Bland-Altman plots were used. The Shapiro-Wilk test was used to test the normality. Differences between the means of repeated brain volume measurements were analyzed by using the paired *t* test or the Mann-Whitney test when appropriate. The duration to assess all volumes by using the fully automatic protocol was measured by using a stopwatch. *P* values < .05 were considered statistically significant.

## Results

The average brain volumes of the 61 subjects assessed by the manual and automatic methods are shown in Table 1. Comparisons between manual and automatic volume measurements are shown in Figs 2 and 3. The measurements were highly correlated (VV: *R* = 0.998, *P* < .01; ICV: *R* = 0.936, *P* < .01; BTV: *R* = 0.934, *P* < .01; WMHV: *R* = 0.961, *P* < .01).

![Fig 3.](http://www.ajnr.org/https://www.ajnr.org/content/ajnr/32/2/408/F3.medium.gif)

[Fig 3.](http://www.ajnr.org/content/32/2/408/F3)

Fig 3. 
Comparison between manual and automatic volumes. *A1* and *B1*, The plots of automatic versus manual for BTV and WMHV. The oblique dashed line represents the equality line. *A2* and *B2*, The corresponding Bland-Altman plots for BTV and WMHV. The horizontal dashed lines are the confidence intervals of the difference between manual and automatic volumes.

View this table:
[Table 1:](http://www.ajnr.org/content/32/2/408/T1)

Table 1: 
Brain volumes using the manual and the automatic tool QBraina

However, there were significant differences between the mean volumes calculated by the manual and the automatic methods for ICV, BTV, VV, and WMHV (ICV, *P* < .01; BTV, *P* = .02; VV, *P* < .01; WMHV, *P* < .01). As shown in Figs 2 *B1*, 3*A1*, and 3*B1*, the automatic method underestimated ICV, WMHV, and BTV. The systematic differences are displayed in Table 2 and also in the Bland-Altman plots (Figs 2*B2*, 3*A2*, and 3*B2*). There was a systematic overestimation of the VV by using the automatic segmentation (Fig 2*A2* and Table 2).

View this table:
[Table 2:](http://www.ajnr.org/content/32/2/408/T2)

Table 2: 
Brain volume variability

The Bland-Altman plots show a correlation between the mean and the difference of the automatic and manual methods for WMHV (*R* = 0.48, *P* < .01) and VV (*R* = 0.68, *P* = .01). This was not observed for BTV or ICV (Figs 2B1 and 3*B2*).

The variability of the reference method is summarized in Table 2. No significant differences were found for interobserver and intraobserver variability (WMHV, *P* > .2; VV, *P* > .08; ICV, *P* > .17; BTV, *P* > .06). From the same 10 subjects, the significant differences between the manual and the automatic methods were confirmed for all brain volumes (WMHV, *P* < .01; VV, *P* < .01; ICV, *P* = .03; BTV, *P* = .04). The manual-automatic limits of agreement were larger than the intraobserver and interobserver limits of agreement, except in the case of the interobserver manual VV method (Table 2).

The automatic algorithm automatically calculated the mean volumes in 127 ± 9 seconds.

## Discussion

In this study, a fully automatic commercially available software for the assessment of brain volumes was evaluated and found to be very fast and user-friendly. Automatic brain volumes correlated strongly to the manual brain volumes. However, there was a significant difference and variability between the automatic and reference methods. For ICV, BTV, and WMHV, the differences can be considered of clinically important magnitude; therefore, the automatic method requires improvement.

### Ventricular Volume

Despite the excellent correlation (*R* = 0.998) between automatic and manual VV, there was a systematic overestimation. Two main sources for the overestimation were observed.

First, the pixel-intensity threshold was systematically larger compared with the reference, causing an oversegmentation mainly localized at the lateral ventricles in all subjects (On-line supplemental Fig 3*C*). This may explain the significant correlation found between the means of automatic and manual VV and their differences (Fig 2*A2*). Second, the cisterna ambiens (which is the subarachnoid space between splenium of the corpus callosum and the superior aspect of cerebellum) contains difficult anatomic structures; VV was overestimated by the automatic tool (On-line supplemental Fig 3*F*). Furthermore, the automatic method did not recognize the cerebral aqueduct and the fourth ventricle as a part of the VV.

A recent study using a similar automatic software, FreeSurfer, found an excellent correlation (*R* > 0.98) between automatic and manual VV.14 As in our study, the authors found a significant difference in mean VV between the 2 methods, also with a systematic overestimation.

In this study, the agreement between repeated manual measurements with different observers was similar to the agreement between manual and automatic measurements (Table 2). If the threshold pixel intensity to assess VV automatically is adjusted, QBrain could be a reliable tool to assess VV rapidly; thus, it could replace the traditional linear indices, such as the Evans index.1,17,18

### Intracranial and Brain Tissue Volumes

A limitation of the automatic QBrain was that it calculates only the total brain tissue volume and does not differentiate the white matter and gray matter. In this study, we, therefore, reported only the results for total BTV.

Despite the high correlations between the automatic and manual protocols for ICV and BTV, there was a difference between the mean manual volume and the mean automatic volume. The main source of misclassification was localized at the top and base of the cranial cavity. The uppermost 5 sections were not perpendicular to the skull or brain parenchyma contour; this positioning increased the partial volume effects and thus complicated the automatic segmentation (On-line Figs *1C* and *2F*). Miscalculations were also observed at the middle and posterior fossae (On-line Figs 1*F* and 2*C*).

The results for QBrain were similar to findings in the recent evaluation of automatic FreeSurfer software,14 which overestimated ICV with a mean difference of 133 mL between the manual and the automatic methods. Another automatic software, SIENA (Oxford University; [http://www.fmrib.ox.ac.uk/analysis/research/siena/](http://www.fmrib.ox.ac.uk/analysis/research/siena/)), revealed a difference of 46 mL between the normalized mean manual BTV and the normalized mean automatic BTV.19

The automatic algorithm of QBrain is based on the SNIPER tool,12 which has been used in several clinical studies.20(#ref-21)–22 The capability of SNIPER to assess ICV and WMHV accurately has been validated in a previous study.12 However, the mean difference between automatic and manual ICV found in our study was much larger than that in this previous study (+49 mL compared with their +3 mL).12 A possible explanation could be that the automatic QBrain software has an interscanner variability similar to that in the automatic SPM5 software (Wellcome Department of Imaging Neuroscience, London, UK). In a recent study, 1 healthy subject was scanned with 6 different MR imaging scanners. ICV and BTV were estimated automatically with SPM5 and ranged from 1408 to 1515 mL and 1224 to 1363 mL, respectively.23

Irrespective of the dependency on MR imaging scanners, the manual ICV and BTV variability showed that the limits of agreement between the 2 methods (manual and automatic) were at least 2-fold larger due to inter-/intraobserver variability (Table 2); further improvement of the automatic algorithm is necessary.

### Automatic White Matter Hyperintensity Volume

In almost all subjects, the WMHV was underestimated by the automatic tool (Fig 3*B1* and On-line supplemental Fig 4). This finding is in agreement with the study using SNIPER.12 The authors found a slightly smaller systematic underestimation (approximately 1 mL compared with our 2 mL). Their 95% confidence interval of the difference was smaller than ours ([−4–5 mL] compared with ours [−6–11 mL]). We found a significant correlation between the means of automatic and manual WMHV and their differences as found in the evaluation study of SNIPER.12 Interscanner variability could also be a possible contributor to this discrepancy.

It is important also to discuss the manual segmentation protocols used to delineate the WMHV. We used FLAIR images, whereas the previous study used T2 images.12 We believe FLAIR images should be used because they seem to have a higher specificity and accuracy compared with T2 images, especially in the periventricular region.24,25

As to ICV and BTV, the limits of agreement between automatic and manual were larger compared with inter-/intraobserver limits of agreement.

Previous studies11,13 have attempted to validate their automatic WMHV tool against visual scales. We believe this is not a robust means of validation because visual and volume scales have different properties.21,26

While manual segmentation is, for many reasons, still considered a standard segmentation-validation method, objective approaches with realistic data for which the true volumes are known are needed for standardized method assessment. Thus, a previous study reported a comparison of different software packages by using simulated MR imaging, the data base BrainWeb (http://mouldy.bic.mni.mcgill.ca/brainweb).27,28 In our study, we have not used this approach because the BrainWeb data do not contain simulated FLAIR images. Without the FLAIR image sequence, the automatic calculation of brain volumes with QBrain software was not possible.

## Conclusions

According to our findings, similar automatic tools should undergo the same evaluation tests. It is important to validate the automatic tools because a number of clinical studies draw conclusions about brain volumes estimated with software that has not yet been validated. The automatic algorithm of the software QBrain needs improvement to be used by the neuroradiology and neuroscience communities. However, manual segmentation is still the criterion standard, and QBrain incorporates an excellent toolkit for this purpose.

## Footnotes

*   Indicates article with supplemental on-line tables.

*   The study was supported by the Swedish Foundation for Strategic Research, Swedish Research Council and Swedish Governmental Agency for Innovation Systems.

*   A free license for QBrain software was obtained from the manufacturer (Medis Medical Imaging Systems, Leiden, the Netherlands).

Indicates open access to non-subscribers at [www.ajnr.org](http://www.ajnr.org)

## References

1.  1. Ambarki K, Israelsson H, Wahlin A, et al. Brain ventricular size in healthy elderly: comparison between Evans index and volume measurement. Neurosurgery 67:94–99, discussion 99
    
    

2.  2. Yoshita M, Fletcher E, Harvey D, et al. Extent and distribution of white matter hyperintensities in normal aging, MCI, and AD. Neurology 2006;67:2192–98
    
    [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToibmV1cm9sb2d5IjtzOjU6InJlc2lkIjtzOjEwOiI2Ny8xMi8yMTkyIjtzOjQ6ImF0b20iO3M6MTk6Ii9ham5yLzMyLzIvNDA4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

3.  3. Zhao GJ, Li DK, Wolinsky JS, et al. Clinical and magnetic resonance imaging changes correlate in a clinical trial monitoring cyclosporine therapy for multiple sclerosis: the MS Study Group. J Neuroimaging 1997;7:1–7
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=9038425&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

4.  4. Desikan RS, Cabral HJ, Fischl B, et al. Temporoparietal MR imaging measures of atrophy in subjects with mild cognitive impairment that predict subsequent diagnosis of Alzheimer disease. AJNR Am J Neuroradiol 2009;30:532–38
    
    [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYWpuciI7czo1OiJyZXNpZCI7czo4OiIzMC8zLzUzMiI7czo0OiJhdG9tIjtzOjE5OiIvYWpuci8zMi8yLzQwOC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

5.  5. Fjell AM, Amlien IK, Westlye LT, et al. Mini-mental state examination is sensitive to brain atrophy in Alzheimer's disease. Dement Geriatr Cogn Disord 2009;28:252–58
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1159/000241878&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=19786777&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

6.  6. Henneman WJ, Sluimer JD, Barnes J, et al. Hippocampal atrophy rates in Alzheimer disease: added value over whole brain volume measures. Neurology 2009;72:999–1007
    
    [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToibmV1cm9sb2d5IjtzOjU6InJlc2lkIjtzOjk6IjcyLzExLzk5OSI7czo0OiJhdG9tIjtzOjE5OiIvYWpuci8zMi8yLzQwOC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

7.  7. Zeidman LA, Ankenbrandt WJ, Du H, et al. Growth rate of non-operated meningiomas. J Neurol 2008;255:891–95
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1007/s00415-008-0801-2&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=18350353&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

8.  8. Condon B, Patterson J, Wyper D, et al. Use of magnetic resonance imaging to measure intracranial cerebrospinal fluid volume. Lancet 1986;1:1355–57
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/S0140-6736(86)91666-1&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=2872473&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 
    
    [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=A1986C726700006&link_type=ISI) 

9.  9. Kohn MI, Tanna NK, Herman GT, et al. Analysis of brain and cerebrospinal fluid volumes with MR imaging. Part I. Methods, reliability, and validation. Radiology 1991;178:115–22
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=1984289&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 
    
    [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=A1991EP11700022&link_type=ISI) 

10. 10. Anbeek P, Vincken KL, van Osch MJ, et al. Automatic segmentation of different-sized white matter lesions by voxel probability estimation. Med Image Anal 2004;8:205–15
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.media.2004.06.019&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=15450216&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

11. 11. Wen W, Sachdev P. The topography of white matter hyperintensities on brain MRI in healthy 60- to 64-year-old individuals. Neuroimage 2004;22:144–54
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.neuroimage.2003.12.027&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=15110004&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 
    
    [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000221190200013&link_type=ISI) 

12. 12. Admiraal-Behloul F, van den Heuvel DM, Olofsen H, et al. Fully automatic segmentation of white matter hyperintensities in MR images of the elderly. Neuroimage 2005;28:607–17
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.neuroimage.2005.06.061&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=16129626&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

13. 13. Maillard P, Delcroix N, Crivello F, et al. An automated procedure for the assessment of white matter hyperintensities by multispectral (T1, T2, PD) MRI and an evaluation of its between-centre reproducibility based on two large community databases. Neuroradiology 2008;50:31–42
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1007/s00234-007-0312-3&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=17938898&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 
    
    [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000251899500005&link_type=ISI) 

14. 14. Lehmann M, Douiri A, Kim LG, et al. Atrophy patterns in Alzheimer's disease and semantic dementia: a comparison of FreeSurfer and manual volumetric measurements. Neuroimage 2010;49:2264–74 Epub 2009 Oct 27
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.neuroimage.2009.10.056&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=19874902&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

15. 15. Relkin N, Marmarou A, Klinge P, et al. Diagnosing idiopathic normal-pressure hydrocephalus. Neurosurgery 2005;57:S4–16 discussion ii-v
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=16160425&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

16. 16. Malm J, Eklund A. Idiopathic normal pressure hydrocephalus. Pract Neurol 2006;6:14–27
    
    [FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MTE6InByYWN0bmV1cm9sIjtzOjU6InJlc2lkIjtzOjY6IjYvMS8xNCI7czo0OiJhdG9tIjtzOjE5OiIvYWpuci8zMi8yLzQwOC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

17. 17. Ambarki K, Israelsson H, Wåhlin A, et al. Brain ventricular size in healthy elderly: comparison between Evans index and volume measurement. Neurosurgery 2010;67:94–99 discussion 99
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1227/01.NEU.0000370939.30003.D1&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=20559096&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

18. 18. Evans W. An encephalographic ratio for estimating ventricular enlargement and cerebral atrophy. Arch Neurol Psychiatry 1942;47:931–37
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1001/archneurpsyc.1942.02290060069004&link_type=DOI) 
    
    [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000201569300004&link_type=ISI) 

19. 19. Jasperse B, Valsasina P, Neacsu V, et al. Intercenter agreement of brain atrophy measurement in multiple sclerosis patients using manually-edited SIENA and SIENAX. J Magn Reson Imaging 2007;26:881–85
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1002/jmri.21101&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=17896359&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 
    
    [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000249898800007&link_type=ISI) 

20. 20. Palm WM, Walchenbach R, Bruinsma B, et al. Intracranial compartment volumes in normal pressure hydrocephalus: volumetric assessment versus outcome. AJNR Am J Neuroradiol 2006;27:76–79
    
    [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYWpuciI7czo1OiJyZXNpZCI7czo3OiIyNy8xLzc2IjtzOjQ6ImF0b20iO3M6MTk6Ii9ham5yLzMyLzIvNDA4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

21. 21. van den Heuvel DM, ten Dam VH, de Craen AJ, et al. Measuring longitudinal white matter changes: comparison of a visual rating scale with a volumetric measurement. AJNR Am J Neuroradiol 2006;27:875–78
    
    [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYWpuciI7czo1OiJyZXNpZCI7czo4OiIyNy80Lzg3NSI7czo0OiJhdG9tIjtzOjE5OiIvYWpuci8zMi8yLzQwOC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

22. 22. Palm WM, Saczynski JS, van der Grond J, et al. Ventricular dilation: association with gait and cognition. Ann Neurol 2009;66:485–93
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1002/ana.21739&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=19847895&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

23. 23. Huppertz HJ, Kroll-Seger J, Kloppel S, et al. Intra- and interscanner variability of automated voxel-based volumetry based on a 3D probabilistic atlas of human cerebral structures. Neuroimage 2010;49:2216–24 Epub 2009 Oct 28
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1016/j.neuroimage.2009.10.066&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=19878722&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

24. 24. Barkhof F, Scheltens P. Imaging of white matter lesions. Cerebrovasc Dis 2002;13(suppl 2):21–30
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=11810006&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 
    
    [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000173588700004&link_type=ISI) 

25. 25. Piguet O, Ridley LJ, Grayson DA, et al. Comparing white matter lesions on T2 and FLAIR MRI in the Sydney Older Persons Study. Eur J Neurol 2005;12:399–402
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1111/j.1468-1331.2004.00972.x&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=15804273&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 

26. 26. van Straaten EC, Fazekas F, Rostrup E, et al. Impact of white matter hyperintensities scoring method on correlations with clinical data: the LADIS study. Stroke 2006;37:836–40 Epub 2006 Jan 26
    
    [Abstract/FREE Full Text](http://www.ajnr.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToic3Ryb2tlYWhhIjtzOjU6InJlc2lkIjtzOjg6IjM3LzMvODM2IjtzOjQ6ImF0b20iO3M6MTk6Ii9ham5yLzMyLzIvNDA4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

27. 27. Klauschen F, Goldman A, Barra V, et al. Evaluation of automated brain MR image segmentation and volumetry methods. Hum Brain Mapp 2009;30:1310–27
    
    [CrossRef](http://www.ajnr.org/lookup/external-ref?access_num=10.1002/hbm.20599&link_type=DOI) 
    
    [PubMed](http://www.ajnr.org/lookup/external-ref?access_num=18537111&link_type=MED&atom=%2Fajnr%2F32%2F2%2F408.atom) 
    
    [Web of Science](http://www.ajnr.org/lookup/external-ref?access_num=000264696300023&link_type=ISI) 

28. 28. Cocosco C, Kollokian V, Kwan R-S, et al. BrainWeb: online interface to a 3D MRI simulated brain database. In: Proceedings of the Third International Conference on Functional Mapping of the Human Brain. Copenhagen, Denmark. May 19–23, 1997
    
    

*   Received May 19, 2010.
*   Accepted after revision July 2, 2010.


*   Copyright © American Society of Neuroradiology