Abstract
BACKGROUND AND PURPOSE: Standard neuroimaging fails in defining the anatomy of the substantia nigra and has a marginal role in the diagnosis of Parkinson disease. Recently 7T MR target imaging of the substantia nigra has been useful in diagnosing Parkinson disease. We performed a comparative study to evaluate whether susceptibility-weighted angiography can diagnose Parkinson disease with a 3T scanner.
MATERIALS AND METHODS: Fourteen patients with Parkinson disease and 13 healthy subjects underwent MR imaging examination at 3T and 7T by using susceptibility-weighted angiography. Two expert blinded observers and 1 neuroradiology fellow evaluated the 3T and 7T images of the sample to identify substantia nigra abnormalities indicative of Parkinson disease. Diagnostic accuracy and intra- and interobserver agreement were calculated separately for 3T and 7T acquisitions.
RESULTS: Susceptibility-weighted angiography 7T MR imaging can diagnose Parkinson disease with a mean sensitivity of 93%, specificity of 100%, and diagnostic accuracy of 96%. 3T MR imaging diagnosed Parkinson disease with a mean sensitivity of 79%, specificity of 94%, and diagnostic accuracy of 86%. Intraobserver and interobserver agreement was excellent at 7T. At 3T, intraobserver agreement was excellent for experts, and interobserver agreement ranged between good and excellent. The less expert reader obtained a diagnostic accuracy of 89% at 3T.
CONCLUSIONS: Susceptibility-weighted angiography images obtained at 3T and 7T differentiate controls from patients with Parkinson disease with a higher diagnostic accuracy at 7T. The capability of 3T in diagnosing Parkinson disease might encourage its use in clinical practice. The use of the more accurate 7T should be supported by a dedicated cost-effectiveness study.
ABBREVIATIONS:
- HS
- healthy subjects
- PD
- Parkinson disease
- SN
- substantia nigra
- SWAN
- susceptibility-weighted angiography
- UHF
- ultra-high-field
Parkinson disease (PD) is a common neurodegenerative disease whose pathologic substrate is nigrostriatal dopaminergic degeneration due to the neuronal loss in the pars compacta of the substantia nigra (SN).1
On the basis of the correlation between MR signal intensity at conventional field strengths and Perls staining for iron distribution, the medial portion of the midbrain with lower MR signal is attributed to the pars reticulata of the substantia nigra, and the lateral region (with higher MR signal), to the substantia nigra pars compacta.2 However, Perls staining and T2WI signal hypointensity do not match precisely,3 and the hypointense area on T2WI does not match the substantia nigra pars reticulata.4 Moreover, conventional MR imaging techniques, including segmented inversion recovery ratio imaging,5 fail to distinguish the inner structure of the substantia nigra.6 More advanced and recently proposed SN-derived biomarkers such as relaxometry,7,8 DTI,9 and neuromelanin imaging10 are currently not yet accepted in evaluating patients with PD in clinical practice.11
Recently, by using high-resolution 3D susceptibility-weighted angiography (SWAN),12 the ultra-high-field (UHF) anatomy of the SN with its inner organization has been described13 as a 3-layer structure of different signal intensities along the posterior-anterior axis of the midbrain, resembling the dorsal and ventral components of the substantia nigra pars compacta and the substantia nigra pars reticulata, respectively. By using calbindin immunostaining, one can distinguish calbindin-positive (matrix) and calbindin-negative structures (nigrosomes)14 within the substantia nigra. In a recent MR imaging study at 7T,15 nigrosome 1, the largest and highly attenuated cluster of calbindin-negative neurons within the substantia nigra pars compacta ventralis, corresponded to the round hyperintense area observed in the intermediate and lateral portion of the substantia nigra pars compacta.16
In patients with PD the 3-layer organization and the hyperintense lateral spot within the SN (nigrosome 1) are lost, and this radiologic sign distinguishes patients with PD from healthy subjects (HS) on an individual basis with high accuracy.13
The diagnostic gain provided by 7T imaging is a prerequisite for the clinical acceptance of UHF, but until now, 7T MR imaging examinations have been confined to the research environment. The neuroimaging-based diagnosis of PD might constitute an important addition to the clinical diagnosis of extrapyramidal disorders. Therefore, the diagnostic role of SWI performed with a clinical MR imaging scanner at 3T has been tested recently,17,18 with promising results. A direct comparison of 3T and 7T evaluation of the SN is mentioned in a pilot experience including 2 patients with PD.15
Here, we describe a comparative study with a case control design that prospectively evaluates the diagnostic accuracy of SWAN at 3T and 7T.
Materials and Methods
Subjects
Fourteen patients with PD according to the clinical criteria for probable PD of the UK Parkinson's Disease Society Brain Bank19 were consecutively enrolled from a tertiary movement disorder center.
Patients (6 women and 8 men; mean age, 57.4 years; range, 39–69 years) had a disease mean duration at the moment of enrollment of 58 months (range, 6–120 months); the range of Hoehn and Yahr Scale20 was 1–2, and the motor part of the Unified Parkinson Disease Rating Scale21 was 18.3 (range, 9–37).
Thirteen right-handed HS (4 women and 9 men; mean age, 54.8 years; range, 41–66 years) were enrolled to test the diagnostic accuracy of the SN MR imaging examination in discriminating patients with PD from controls. All HS were volunteers and had no personal or family history of psychiatric and neurologic disorders; their general and neurologic examination findings were unremarkable.
All patients and controls gave their informed consent to the enrollment and diagnostic procedures on the basis of the adherence to an experimental protocol called “Clinical Impact of Ultra-High-Field MRI in Neurodegenerative Diseases Diagnosis,” RF-2009-1546281, approved and funded by the Italian Ministry of Health and co-funded by the Health Service of Tuscany. The local competent ethics committee approved the study.
MR Imaging Acquisition
MR imaging examinations were performed in patients and controls by using a Discovery MR 950 7T imaging scanner (GE Healthcare, Milwaukee, Wisconsin) equipped with a 2CH-TX/32CH-RX head coil (Nova Medical, Wilmington, Massachusetts) and a Discovery MR 750 3T scanner (GE Healthcare) equipped with an 8-channel head coil. Patients and controls underwent both 7T and 3T examination in a random order but within 1 month of recruitment.
The same technicians optimized the 3D multiecho gradient-recalled sequence (SWAN) at 7T and 3T.
The MR imaging parameters at 7T were TE = 5.57, 10.7, 15.84, 20.97, 26.1, 31.23, 36.36, 41.5 ms; TR = 55.7 ms; flip angle = 8°; NEX = 0.67; in-plane resolution = 312 μm; thickness = 1.2 mm; 18 partitions; receiver bandwidth = 67 KHz.
The MR imaging parameters at 3T were TE = 13, 17.96, 22.93, 27.89, 32.86, 37.82, 42.78, 47.75, 52.71, 57.68, 62.64 ms; TR = 67.2 ms; flip angle = 15°; NEX = 0.68; in-plane resolution = 394 μm; thickness = 1.2 mm; 18 partitions; receiver bandwidth = 62.5 KHz.
The SWAN acquisitions on both MR imaging systems targeted the midbrain and were oriented perpendicularly to the fourth ventricle floor.
The final output image was reconstructed into a 512 × 512 × 18 matrix by averaging the images obtained for each single echo. The SWAN acquisition time was 4 minutes 2 seconds at 7T and 4 minutes 20 seconds at 3T.
Image Analysis
According to the methodology of a previous study,13 the SN anatomy was evaluated along the rostrocaudal axis at the level of the inferior third of the red nucleus (level I) and at the level of the superior cerebellar peduncle decussation (level II), where the signal changes were more informative for diagnosing PD. Anatomy was considered normal if the SN at level I was characterized by a medial homogeneous hypointense region and by a lateral hyperintense spot between 2 hypointense layers and if a trilaminar organization characterized by a central hyperintense layer between 2 hypointense laminae was detectable at level II.
The criteria for abnormal SN anatomy were the loss of the hyperintense lateral spot at level I or/and the loss of the 3-layer organization at level II on at least 1 side of the midbrain.
Two experienced neuroradiologists were invited to identify “abnormal” SN in SWAN-targeted images acquired in the sample of patients and controls. Images acquired at 7T and 3T were separately loaded into a data base and presented in a blinded and randomized fashion. This process ensured that the readers were unaware of the clinical diagnosis. Readers were asked to identify patients with PD according to the “abnormal” appearance of the SN. Images of each subject were presented twice after an interval of 7 days to calculate intra- and interrater reliability separately for 7T and 3T imaging. Intra- and interobserver reliability of responses from each reader were cross-tabulated to enable the calculation of agreement and the Cohen κ statistic.22 The strength of agreement was considered low for κ values of 0.21–0.40, moderate for κ values of 0.41–0.60, good for κ values of 0.61–0.80, and excellent for κ values of ≥0.81. Sensitivity, specificity, positive predictive value, negative predictive value, and diagnostic accuracy with respect to the clinical diagnosis were calculated.
To test the role of radiologic signs in diagnosing PD and to reduce the bias of previous experiences at high and ultra-high-field strength magnets, we presented the entire data base of patients and controls to a third blinded observer with 5 years' experience in radiology at our university and whose experience in the neuroradiology unit included CT and 1.5T MR imaging studies of patients with neurodegenerative and movement disorders but not with acquisitions on 3T or 7T MR imaging systems. The third rater was invited to study the SN anatomy and its changes according to the most recent literature13,15 regarding the semiology of the SN in PD. A dataset consisting of 8 midbrain images at 3T (4 HS) and at 7T (4 HS) was used for training purposes. The images belonging to this training dataset were not included in the rest of this study. After training, the third rater evaluated all the 3T and 7T midbrain images previously presented to the 2 experienced neuroradiologists in a blinded and randomized fashion at 2 different times to calculate sensitivity, specificity, accuracy, and intraobserver agreement for 3T and 7T acquisitions.
Results
The diagnostic accuracy, sensitivity, specificity, positive predictive value, and negative predictive value for each rater in each reviewing session are separately reported in the Table. In the next 2 paragraphs, the diagnostic parameters are reported as the mean value obtained by the 2 expert raters in the 2 reviewing sessions.
Sensitivity, specificity, PPV and NPV, diagnostic accuracy, and true-positive/true-negative results for each reader in each reading session
7T MR Imaging of the SN
Sensitivity, specificity, positive predictive value, and negative predictive value for the diagnosis of PD were 93%, 100%, 100%, and 93%, respectively. Diagnostic accuracy was 96%. Intraobserver agreement (κ = 1) and interobserver agreement (κ = 1) were excellent.
3T MR Imaging of the SN
Sensitivity, specificity, positive predictive value, and negative predictive value for the diagnosis of PD were 79%, 94%, 94%, and 81%, respectively. Diagnostic accuracy was 86%. At 3T, intraobserver agreement was excellent for both raters (κ = 0.924 for rater 1 and κ = 0.851 for rater 2) and interobserver agreement was good for the first reviewing session (κ = 0.773) and excellent for the second reviewing session (κ = 0.851).
Performance of the Third, Less Expert Rater
For the third rater, sensitivity, specificity, positive predictive value, negative predictive value, and accuracy were 82%, 100%, 100%, 84%, and 89% at 7T and 79%, 100%, 100%, 81%, and 89% at 3T, respectively. Intraobserver agreement was good (κ = 0.773) at 7T and excellent (κ = 1) at 3T.
Examples of 3T correct, false-positive, and false-negative readings as classified by rater 2 are shown respectively in Figs 1⇓–3.
SWAN-targeted axial image of the midbrain in a healthy subject evaluated at 3T (right column) and at 7T (left column). The trilaminar organization of the SN at level II (upper row) and the nigrosome formation at level I (lower row) are clearly shown with 3T and 7T magnets. Levels I and II of image acquisition are represented by white and gray lines in the scout image. On 7T images, we overlaid a diagram of the trilaminar structure of the SN derived by anatomic atlases.41 The diagnostic accuracy is elevated for both high- and ultra-high-field-strength magnets. cp indicates cerebral peduncle; PBN, parabrachial nucleus; RRF, retrorubral field; scp, superior cerebellar peduncle; SNcv, substantia nigra pars compacta ventralis; SNcd, substantia nigra pars compacta dorsalis; SNr, substantia nigra pars reticularis; VTA, ventral tegmental area; R, red nucleus.
SWAN-targeted axial image of the midbrain in a healthy subject evaluated at 3T (right) and 7T (left). The nigrosome formation appreciable at 7T is interpreted as lost at 3T, generating a false-positive.
SWAN-targeted axial image of the midbrain in a patient with PD evaluated at 3T (right) and 7T (left). The nigrosome formation seems recognizable in the left SN. On the right SN, the nigrosome formation is lost at 7T, while at 3T the slight hyperintense component (arrow) has been erroneously interpreted as a nigrosome, leading to a false-negative finding.
Discussion
Our results confirm the capability of 7T MR imaging to reveal, through visual inspection of SWAN images, the loss of the 3-layer organization13 and of the lateral bright spot of the SN13,15,16 in patients with PD, allowing high diagnostic accuracy.
MR imaging at 7T is being tested in different clinical conditions23 to assess its clinical importance for specific situations.24 UHF MR imaging examinations provide encouraging results in terms of tolerability and acceptance.25,26 At present, around the world, there are approximately 40 UHF MR imaging systems that are still confined to the research environment. In this study, we transferred the semiology adopted at 7T in diagnosing PD to 3T and verified that the diagnostic gain permitted by UHF could be extended, at least to some relevant extent, to a clinical scanner that is more easily accessible for patient care (Fig 1).
With high-resolution target imaging at 3T, we detected a partition of the SN in HS and identified patients with PD as reported in other recent experiences.17,18 Nevertheless as demonstrated by the lower intra- and interobserver agreement at 3T, the confidence in revealing the inner structure of the SN was inferior to that of 7T. The loss of the 3-layer organization of the SN or the loss of the hyperintense spot in the lateral component of the intermediate tier of the SN is less evident at 3T and leaves some uncertainty in defining the pathologic aspect of the SN in PD. As demonstrated by the higher number of false-positives and false-negatives at 3T, identifying the hyperintense central component of the normal SN (Fig 2) is more difficult, and the raters tended to overestimate subtle SN hyperintensities, which were misinterpreted as normal (Fig 3). The global effect is the reduction of the diagnostic accuracy of SWAN sequences at 3T with respect to 7T.
Because the MR imaging signal increases quadratically with the field strength while noise increases only linearly, the SNR is theoretically more than double at 7T with respect to 3T, and this difference can be exploited to increase the spatial resolution.27 In our protocol, the 7T and 3T images have a similar spatial resolution (312 μm at 7T versus 364 μm at 3T); therefore, this is unlikely to be the reason for the better performance of 7T. The superior imaging performance of 7T is more likely from the increased T2* contrast and magnetic susceptibility effects of paramagnetic substances, which are enhanced at higher magnetic fields.28⇓–30 The magnetic susceptibility effects of iron contained in the SN scale linearly with magnetic field strength. At 7T, the larger susceptibility effect compared with 3T results in more informative images of the midbrain with an increased contrast between the 2 hypointense iron-containing components of the SN and the intermediate hyperintense part that is preserved in HS (On-line Figure).
From a clinical point of view, a diagnostic error occurs in 10%–25% of patients with parkinsonism; and 20% of patients with PD coming to medical attention are not diagnosed as such.31 These diagnoses result in delayed or inappropriate therapy initiation.32 The accuracy of the clinical diagnosis of PD is 90% in a 5-year observation period,33 and the rate of re-diagnosis from PD to an alternative disease is 5.9%.34 The most frequent wrong differential diagnosis is related to atypical parkinsonism35 but also to nondegenerative movement disorders such as essential tremor, dystonic tremor, and vascular pseudoparkinsonism.36 More rare but crucial misdiagnoses are normal pressure hydrocephalus37 and neoplastic lesions.38 The total annual cost of anti-Parkinson medication for these misdiagnosed patients has been estimated at £13,400 (US $21,722).34 The potential role of MR imaging would be to provide an earlier and more accurate diagnosis than the standard clinical assessment, improving the cost-effectiveness. The diagnostic accuracy of SWAN imaging at 3T is lower than that at 7T but is still high enough to suggest a role in a clinical setting. Because the sensitivity of the clinical evaluation is high (96%) and the specificity of the 3T MR imaging is higher than that of the clinical evaluation in a 5-year period (82%),36 3T MR imaging can be used in clinical practice as a confirmatory method. In a population with a clinical suspicion of PD, the high specificity of 3T MR imaging allows identifying true-negative subjects, similar to nuclear medicine with radiotracers for dopamine transporters.39 Because MR imaging is a fundamental step in excluding pseudoparkinsonism or atypical parkinsonism,40 the use of a 3T clinical scanner, including the imaging of the SN, seems to be justified in extrapyramidal disorders.
Unfortunately SN imaging at 3T is less effective than at 7T in identifying true-positive cases, attenuating its impact. We hypothesize that patients with high clinical suspicion of PD and negative imaging findings of the SN at 3T might benefit from an evaluation at 7T. A dedicated study would be necessary to calculate whether the use of the more accurate diagnosis obtained with 7T MR imaging is cost-effective compared with to the use of 3T MR imaging only.
Regarding the results of the less expert rater unbiased by previous UHF MR imaging experiences, the high diagnostic accuracy and intrarater reproducibility at 7T and 3T confirm the robustness of the radiologic semiology consisting of simple and reproducible signs.17
The diagnostic accuracy is inferior at 3T in both expert and less expert raters, indicating that the confidence in expressing a diagnostic judgment depends more on the magnetic field strength than on the rater's ability.
Some major limitations should be taken into account. First, the number of enrolled patients is limited mostly due to the limited number of patients available for evaluation at 7T. Patients and controls are not perfectly matched, though they do not differ significantly. The sequence parameters (TE and flip angle) slightly differ between the 2 MR imaging scanners. TEs are automatically determined by the software and cannot be set by the operators, while the flip angle at 7T is reduced to limit the signal drop related to the T2 relaxation time shortening at UHF. Finally, although images were randomly presented, the quality of images obtained at 7T and 3T is clearly different, and the 2 datasets can be clearly recognized by the readers, who therefore cannot be considered blinded with respect to the scanner but only with respect to the subject's condition.
Conclusions
The experience acquired in the research environment by using 7T systems allowed us to develop and refine targeted MR imaging acquisitions for 3T scanners, improving the role of imaging in the diagnosis of PD at a single-subject level in clinical practice. However if the higher diagnostic accuracy of SWAN at 7T with respect to 3T could justify the use of the 7T in clinical practice, a cost-effectiveness study to support this possibility should be performed.
Acknowledgments
We wish to acknowledge the help provided by Mark Symms.
Footnotes
Disclosures: Ubaldo Bonuccelli—UNRELATED: Grants/Grants Pending: Regione Toscana Health Authority, for a Parkinson disease study (€200,000 [US $253,165])*; Payment for Lectures (including service on Speakers Bureaus): Lundbeck, Chiesi, GlaxoSmithKline, Novartis, Comments: For speeches at meetings (€2000 [US $2530]); Travel/Accommodations/Meeting Expenses Unrelated to Activities Listed: Lundbeck, Chiesi,* GlaxoSmithKline,* Novartis,* Comments: for participation at neurology meetings (€2000 [US $2530]). *Money paid to the institution.
The study is part of an experimental protocol named “Clinical Impact of Ultra-High-Field MRI in Neurodegenerative Diseases Diagnosis,” RF-2009-1546281, approved and funded by Italian Ministry of Health and co-funded by the Health Service of Tuscany.
Indicates open access to non-subscribers at www.ajnr.org
REFERENCES
- Received May 31, 2014.
- Accepted after revision August 29, 2014.
- © 2015 by American Journal of Neuroradiology
Jump to section
Related Articles
Cited By...
- Determining the Degree of Dopaminergic Denervation Based on the Loss of Nigral Hyperintensity on SMWI in Parkinsonism
- Reply:
- Visualization of Nigrosome 1 from the Viewpoint of Anatomic Structure
- Comparative Study of MRI Biomarkers in the Substantia Nigra to Discriminate Idiopathic Parkinson Disease
- Protocol of a single group prospective observational study on the diagnostic value of 3T susceptibility weighted MRI of nigrosome-1 in patients with parkinsonian symptoms: the N3iPD study (nigrosomal iron imaging in Parkinsons disease)
- MRI of the Swallow Tail Sign: A Useful Marker in the Diagnosis of Lewy Body Dementia?
- Nigrosome 1 Detection at 3T MRI for the Diagnosis of Early-Stage Idiopathic Parkinson Disease: Assessment of Diagnostic Accuracy and Agreement on Imaging Asymmetry and Clinical Laterality