| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Stroke. 2008;39:2237.)
© 2008 American Heart Association, Inc.
Original Contributions |
From the Stroke Neuroscience Unit (S.M.D., V.L.W., H.Y., J.K.L., A.E.B.), National Institute of Neurological Diseases and Stroke, National Institutes of Health, Bethesda, MD; and Boston University School of Dental Medicine (S.J.J.), Boston, Mass, USA and HUG Hôpital Cantonal, Geneva, Switzerland.
Correspondence to Alison E. Baird, FRACP, PhD, Professor of Neurology, Physiology and Pharmacology, and, Director of the Division of Cerebrovascular Disease and Stroke, SUNY Downstate Medical Center, 450 Clarkson Avenue, Box 1213, Brooklyn, NY 11203. E-mail alison.baird{at}downstate.edu
| Abstract |
|---|
|
|
|---|
70% to 99%) ICA stenoses; (2) ICA occlusions; (3) moderately severe (50% to 69%) ICA stenoses; and (4) compare the overall accuracy of the 2 MRA techniques. Methods— The medical literature on MRA and the diagnosis of ICA steno-occlusive disease was reviewed through the PubMed, EMBASE, and SCOPUS databases. All publication years were included through to November 2006. Studies were eligible for inclusion if they compared the accuracy of TOF or CE MRA for the detection of ICA disease against intra-arterial angiography and reported sufficient data.
Results— The overall sensitivity of TOF MRA for the detection of
70% to 99% ICA stenoses was 91.2% (95% CI: 88.9% to 93.1%) with a specificity of 88.3% (86.7% to 89.7%), whereas the sensitivity of CE MRA was 94.6% (92.4% to 96.4%) with a specificity of 91.9% (90.3% to 93.4%). For the detection of ICA occlusions, the sensitivity of TOF MRA was 94.5% (91.2% to 96.8%) and the specificity was 99.3% (98.9% to 99.6%), whereas the sensitivity and specificity values for CE MRA were 99.4% (96.8% to 100%) and 99.6% (99.2% to 99.9%), respectively. For moderately severe (50% to 69%) stenoses, TOF MRA had a sensitivity of only 37.9% (29.3% to 47.1%) and a specificity of 92.1% (89.6% to 94.1%); for CE MRA, the pooled sensitivity value was somewhat better at 65.9% (57.0% to 74.0%), whereas the specificity was 93.5% (91.3% to 95.3%).
Conclusions— TOF MRA and CE MRA showed high accuracy for the detection of high-grade ICA stenoses and occlusions with CE MRA having the edge over TOF MRA, but had only poor (TOF MRA) to fair (CE MRA) sensitivity for the detection of moderately severe stenoses.
Key Words: carotid arteries carotid artery stenosis magnetic resonance angiography angiography contrast-enhanced magnetic resonance angiography
| Introduction |
|---|
|
|
|---|
The accurate diagnosis of stenotic and occlusive ICAD is essential for determining which surgical or medical interventions should be used for primary and secondary stroke prevention. Carotid endarterectomy (CEA) is the most commonly performed surgery for the treatment of atherosclerotic ICAD with over 660 000 surgeries performed between 2000 and 2005 in nonfederal US hospitals.2 In patients with symptomatic high-grade (70% to 99%) internal carotid artery (ICA) stenoses, the North American Symptomatic Carotid Endarterectomy Trial (NASCET) reported an absolute reduction in the risk of stroke at 2 years of 17% after CEA relative to medical therapy; the European Carotid Surgery Trial (ECST) reported an 11.6% absolute risk reduction at 5 years in patients with moderate and high-grade stenoses.3–5 In the NASCET trial, there was also some benefit of CEA in patients with moderate (50% to 69%) stenoses: symptomatic patients with 50% to 69% ICA stenoses had an absolute risk reduction of stroke of 4.6% at 5 years.3 Furthermore, in the Asymptomatic Carotid Atherosclerosis Study, asymptomatic patients with 60% to 99% stenoses showed a modest benefit from CEA.6 Similar results were obtained in patients with asymptomatic 60% to 99% stenoses randomized to either immediate or deferred CEA.7 Based on these figures, CEA is recommended for the secondary prevention of stroke in patients with high-grade stenoses and after consideration of other clinical factors for many with moderate-grade stenoses and also some with asymptomatic disease.8,9 Carotid artery stenting may be an alternative to CEA in patients who are at very high surgical risk.10–13
Intra-arterial angiography (IAA), most commonly performed using digital subtraction angiography (DSA), is considered the gold standard technique for evaluating the presence and extent of ICAD. The stenosis grades used in the NASCET and ECST trials were determined by IAA. However, IAA is invasive, costly, and has risks that include an approximate 4% risk of transient ischemic attack and a 1% risk of disabling stroke or death.14 Because of these risks, there have been increasing calls for noninvasive screening methods for ICAD. In many hospitals, noninvasive imaging methods such as ultrasound, magnetic resonance angiography (MRA) and computed tomography angiography, either alone or in combination, are already being used to screen and select patients for CEA.15 Ultrasound is affordable and readily available, but the images produced by ultrasound are often lower in quality than that of computed tomography angiography or MRA and the accuracy is highly operator-dependent.
MRA has become widely used as a noninvasive diagnostic imaging modality for ICAD. It avoids the radiation and iodinated contrast exposure associated with computed tomography angiography. The first MRA method, phase-contrast MRA, was developed in the 1980s and was quickly followed by 2-dimensional (2D) and 3-dimensional (3D) time-of-flight (TOF) MRA. TOF MRA has been widely adopted for an array of clinical indications but is relatively insensitive to slow flow and is associated with long scan times and signal voids, all of which can lead to poor-quality imaging and overestimation of stenoses. More recently, contrast-enhanced (CE) MRA has been introduced. CE MRA produces high-quality images in a very short period of time and may alleviate some of the drawbacks associated with TOF MRA.16 Yet, to be a useful method for studying ICAD, the accuracy of MRA is imperative, because decisions regarding optimum stroke prevention depend on the results obtained. Of particular importance are the potential overcall of stenosis grade and the differentiation of high-grade stenosis from occlusion (occlusions not usually being amenable to surgery) and the accurate diagnosis of moderate-grade (50% to 69%) stenosis for the patient to receive optimal management.
Despite the rapid technological advances in MRA and a large radiological literature, there has been little systematic evaluation of its diagnostic accuracy.17–21 The one prior meta-analysis included a select population of symptomatic patients studied up to April 2004, and data for moderate-grade stenoses were available in a very small number of patients only.22 Our purpose was to provide an update and determine the sensitivity and specificity of TOF MRA and CE MRA for the detection of (1) high-grade (70% to 99%) ICA stenoses; (2) ICA occlusions; (3) moderately severe (50% to 69%) ICA stenoses; and (4) to compare the overall accuracies of the 2 MRA techniques using IAA as the gold standard.
| Materials and Methods |
|---|
|
|
|---|
The medical subject headings terms were carotid arteries, carotid stenosis, magnetic resonance angiography, and angiography. The key words were carotid artery, carotid artery stenosis, magnetic resonance angiography, contrast-enhanced magnetic resonance angiography, and angiography. Although other search terms exist in Embase and Scopus, it was found that the terms used were thorough and sufficient, due to the large quantity of results, in addition to the high overlap of papers found using different search terms. Hand searches of relevant journals resulted in complete concordance with the online databases, thereby validating these database searches as comprehensive and complete. During the initial search strategy, over 11 000 papers (duplicates included) were identified using 3 online databases (8231 with PubMed, 1209 with EMBASE, and 2119 with SCOPUS). The titles of all articles obtained were screened, and all abstracts of possible articles were further screened. Papers with abstracts that clearly fitted into a category for exclusion or diagnostic tests for medical conditions unrelated to cerebrovascular disease were eliminated at this level of the search before a full text was printed. After search completion, independent readers checked for agreement. On identification of a possible abstract for inclusion, the full text of the article was read and assessed for inclusion. In our search, there were no possible abstracts lacking full text versions. Any disagreements over article inclusion were solved by discussion. The search protocol is provided in Figure 1.
|
Study Selection
Inclusion Criteria
Studies were eligible for inclusion if they (1) evaluated the accuracy of 2D and/or 3D TOF MRA and/or CE MRA for the diagnosis of ICA stenosis (with or without data on occlusion) against the gold standard of IAA; (2) reported sufficient data to construct a 2x2 table of test performance; (3) conformed to the Standards for Reporting of Diagnostic Accuracy criteria23; and (4) had image evaluations performed by blinded observers. Due to the limited number of studies published on this topic, all study designs were included (Tables 1 and 2
). Papers that included only symptomatic patients were included and evaluated separately in the subgroup analyses. The QUADAS tool for evaluating the quality of included studies was used as a reference as well; however, 3 of the 14 items of the QUADAS tool were not entirely applicable to this particular diagnostic meta analysis.24 For instance, the spectrum of subjects being screened for ICAD was not necessarily the same as those patients receiving the test in practice, which would potentially include only symptomatic or "high-risk" patients. However, it was necessary in this analysis to include studies that examined a range of healthy and ill subjects to determine the accuracy of these imaging techniques across a large spectrum. Additionally, the clinical data available to radiologists during image interpretation for these studies was not the same as would be available when the test is used in practice, and uninterpretable test results in many studies were often not discussed in great detail.
|
|
Exclusion Criteria
Exclusion criteria were lack of comparison with angiography as the gold standard or lack of data for a 2x2 table. Where data were insufficient, efforts were made to contact the study authors, but if there was no response, the papers were excluded. Studies that used duplicate data were excluded.
Data Extraction
Measurement of Stenosis
In the majority of the studies after 1995, the degree of ICA stenosis was measured using either NASCET guidelines (in which the grade of the stenotic lesion is determined relative to a segment of distal disease-free ICA) or ECST guidelines (where the grade of the stenotic lesion is compared relative to what the original ICA arterial outline would have been at the point of maximum stenosis); a 70% ECST stenosis is approximately equivalent to a 50% NASCET stenosis. The ECST measurements in this meta-analysis were not corrected to NASCET measurements; therefore, because this contributes to heterogeneity in the study, a subgroup analysis was performed in which the ECST papers were excluded. After final selection of included papers, data were extracted to form 2x2 tables of diseased and nondiseased vessels as seen on MRA using conventional angiography as the gold standard. The following comparisons of stenosis grades were performed: (1) to evaluate high-grade stenoses, patients with
70% to 99% ICA stenosis (ie, operative candidates) were compared with those with 0% to 69% stenosis and 100% stenosis (ie, occlusions); (2) to evaluate ICA occlusion (nonoperative), patients with occlusion were compared with those with 0% to 99% stenosis; and (3) to evaluate moderate-grade ICA stenosis (potential operative candidates), patients with 50% to 69% stenosis were compared with those with 0% to 49% and 70% to 100% stenosis.
Study Quality
Study quality was evaluated by examining the following criteria: duration of time between imaging procedures, prospective/retrospective design, number of subjects involved, the number of symptomatic versus asymptomatic patients, setting of study, blinding of readers, and whether subjects were consecutive (ie, as opposed to sporadic).
Data Synthesis
The diagnostic accuracy of MRA in comparison to IAA was assessed by sensitivity and specificity values, receiver operator characteristic (ROC) curves, and positive and negative likelihood ratios. Meta-DiSC software25 was used to generate pooled sensitivities and specificities and summary ROC plots. In this fixed effects modeling approach, each study was assigned a weight dependent on the number of arteries analyzed in that study. The degree of heterogeneity between studies was reported using the Cochran
2 (Cochrane Q) statistic. When this value was divided by the degrees of freedom (number of studies minus 1), a value of greater than 1 is indicative of heterogeneity. When this value was found to be statistically significant, causes of heterogeneity were examined; sources of heterogeneity were also explored when Q/degrees of freedom was found to be greater than 1 but not statistically significant. In interpreting the ROC plots, an ROC curve for an inconclusive test will have a flatter slope and will lie close to the diagonal line as it rises, whereas the ROC line of a perfect diagnostic test will have a very steep ascent, because both sensitivity and specificity are equal to 100%. In clinical practice, it is suggested that a positive likelihood ratio of greater than 10 or a negative likelihood ratio less than 0.1 support high diagnostic accuracy for the respective test. Because likelihood ratios, diagnostic ORs, and summary ROC curves take into account both the sensitivity and specificity data, and therefore illustrate any tradeoffs that may occur, these values are considered to be more valuable in terms of diagnostic accuracy than a pooled, weighted value for sensitivity and specificity.
| Results |
|---|
|
|
|---|
50 subjects. Of the 37 TOF papers, 26 defined high-grade stenosis as 70% to 99%, 5 as 60% to 99%, 2 as 75% to 99%, and 4 as 80% to 99% (Table 1). Of the 21 CE MRA papers included in this analysis, 18 defined high-grade stenosis as 70% to 99% (Table 2), whereas one measured stenosis of 80% to 99%, one of 66% to 99%, and the last 50% to 99%.
Detection of
70% to 99% Internal Carotid Artery Stenoses
The results for 70% to 99% stenosis include the 32 of 37 TOF MRA and 19 of 21 CE MRA papers that reported results for
70% to 99% stenoses, because these patients are operative candidates (Table 3). The results for pooled sensitivities and specificities for
70% to 99% ICA stenosis are depicted in Figure 2A–D. The pooled sensitivities for TOF MRA and CE MRA for the detection of
70% to 99% stenosis were 91.2% (95% CI: 88.9% to 93.1%) and 94.6% (92.4% to 96.5%), respectively. The results for specificity were 88.3% (86.7% to 89.7%) for TOF MRA and 91.9% (90.3% to 93.4%) for CE MRA (Table 3). Summary ROC results are presented in Figure 3A–B.
|
|
|
In addition to pooled sensitivity and specificity plots, positive and negative likelihood ratios and diagnostic ORs were also calculated. For TOF MRA, the positive and negative likelihood ratios were 7.53 (5.75 to 9.87) and 0.13 (0.10 to 0.16), respectively, whereas for CE MRA, the values were 12.26 (8.00 to 18.8) and 0.07 (0.05 to 0.11). Although the diagnostic accuracy for both MRA types was high, a difference between TOF MRA and CE MRA does exist, CE MRA being the more accurate and proven to be more robust in the likelihood ratio data than in the pooled sensitivity and specificity data.
Detection of Internal Carotid Artery Occlusions
Occlusion data were available in 29 of 37 TOF MRA studies and 18 of 21 CE MRA studies (Table 3). The sensitivity of TOF MRA for the detection of ICA occlusions was 94.5% (91.2% to 96.8%) with a specificity of 99.3% (98.9% to 99.6%), whereas the sensitivity of CE MRA was 99.4% (95% CI: 96.8% to 100%) with a specificity of 99.6% (99.2% to 99.9%). The positive and negative likelihood ratios of TOF MRA were 56.24 (38.87 to 81.36) and 0.12 (0.07 to 0.19). For CE MRA, these values were 80.5 (48.16 to 134.70) and 0.07 (0.04 to 0.13), respectively, again supporting a superior accuracy of CE MRA over TOF MRA for the detection of ICA occlusion. The corresponding summary ROC curves are shown in Figure 3C–D.
Detection of Moderate-Grade Internal Carotid Artery Stenoses 50% to 69%
Although it has been shown that CEA can be effective in symptomatic patients with 50% to 69% stenosis, very few papers published data on this level of stenosis. Only 7 of 37 TOF MRA and 8 of 21 CE MRA papers presented these data (Table 3; Figure 4). The 7 TOF papers resulted in a pooled sensitivity of only 37.9% (29.3% to 47.1%) and a pooled specificity of 92.1% (89.7% to 94.1%). The 8 CE MRA papers had a pooled sensitivity of 65.9% (57.0% to 74.0%) and a pooled specificity of 93.5% (91.3% to 95.3%).
|
Studies Comparing Time-of-Flight Magnetic Resonance Angiography and Contrast-Enhanced Magnetic Resonance Angiography in the Same Patients for the Detection of High-Grade Internal Carotid Artery Stenoses
Only 5 studies assessed both TOF MRA and CE MRA in the same subjects (n=172) for the detection of high-grade stenoses.26,27,33,35,37 CE MRA was more accurate than TOF MRA with a higher sensitivity and a similar specificity to TOF MRA (Table 3). TOF MRA produced a pooled sensitivity of 89.6% (82.2% to 94.7%) and a pooled specificity of 92.7% (88.5% to 95.7%), whereas CE MRA produced a pooled sensitivity of 96.2% (90.5% to 99.0%) and a pooled specificity of 92.7% (88.6% to 95.7%).
Subgroup Analyses
To study the robustness of the results, a number of subgroups were analyzed in a sensitivity analysis. When the analyses were broadened to include the data from all of the included studies, according to each papers definition of "high-grade" stenosis, the results were very similar (Table 4) to those for
70% to 99% stenosis. In case overcall of occlusion by MRA was not being detected in these analyses, a separate analysis was performed in patients with angiographic stenoses of 70% to 100%, but this gave essentially the same results (Table 4).
|
The other sections of the sensitivity analyses include papers that studied high-grade stenosis detection in only symptomatic subjects as opposed to a population of symptomatic and asymptomatic patients and papers published after 2003 (Table 4). Both methods showed high accuracy for the detection of high-grade stenosis in symptomatic patients. Results for both MRA methods for high-grade stenosis were highly accurate for papers published after 2003.
As shown in Tables 1 and 2
, some papers did not report the method of stenosis measurement. To decipher whether these studies, as well as the few studies that used ECST instead of NASCET methods, contributed to heterogeneous results, a sensitivity analysis was completed, including only those papers that explicitly stated the NASCET protocol was followed. Results for this subgroup were nearly identical to the overall analysis results for high-grade stenosis.
| Discussion |
|---|
|
|
|---|
70% to 99% stenosis would be detected on CE MRA that was missed on TOF MRA. Similarly, for every 20 MRA studies, an ICA occlusion would be detected on CE MRA that was missed on TOF MRA. Variations in study design and reporting are significant sources of heterogeneity in a meta-analysis of this kind. Five major potential sources of heterogeneity were identified: (1) The lack of data in unselected populations is felt to be a major limitation of the studies in this meta-analysis. Many studies were restricted to patients with symptomatic ICA disease or those found to have a stenosis on screening with ultrasound. Optimal technology assessment, however, requires inclusion of individuals without the disease (ie, patients who are not symptomatic and those who do not have ICAD). (2) Two further major sources of heterogeneity were the variation in (a) the methods used to measure stenosis grade, and (b) the number and types of stenosis grades that were reported as evidenced by the lack of data on moderate-grade stenoses. Evaluation of varying degrees of stenosis can result in suboptimal positive predictive values as evidenced in a recent study.76 The use of varying stenosis grade may explain why Wright et al16 was an outlier; this study also used a head and neck coil and hence evaluated ICA stenoses in a much wider field of view. (3) Although it was necessary to compare data from both CE MRA and TOF studies, the majority of the included TOF papers were published earlier than those investigating the accuracy of CE MRA. Approximately 76% of the CE MRA papers were published in the last 4 years compared with only 16% of the TOF papers. MRA is a relatively new technology with first reports of its clinical use being less than 25 years old and the rate of improvement in technological advancements and user reliability has been marked. Although it was believed that the dates of the studies would be a serious source of heterogeneity, the data proved otherwise with surprisingly high rates of sensitivity and specificity for TOF MRA over 10 years ago. (4) This apparent high degree of accuracy raises the question as to whether some of the earlier TOF MRA images were dropped from analysis due to poor imaging quality, thus giving the potential for selection bias in the TOF MRA studies, resulting in the overprojection of its accuracy. This issue was frequently discussed in the early MRA literature, because poor imaging quality, due to a variety of factors including patient movement, artifact, and slow flow, were common concerns with TOF MRA. In later years, technology and imaging technique improvements led to a decrease in these difficulties. The raw data in the 2x2 tables do not show this dilemma, because images graded as "nondiagnostic" quality are simply removed from the analysis before being compared with the corresponding IAA images. This was not as common an occurrence in the CE MRA studies; in the cases of blurred images due to patient motion or artifact, these images were more often included in the analyses. Other papers stated that the precise definition of stenosis was not always feasible with the TOF images due to flow voids or signal dropout. In these cases, a signal dropout was usually identified in these papers as a severe stenosis, which would alter the data dramatically on the topic of differentiating high-grade stenosis from occlusion. Signal dropout can be the result of many factors, including turbulent flow, patient movement, and other technical difficulties and may actually not be due to a high-grade stenosis. Regardless, imaging failure and the reporting of signal voids as a high-grade stenosis are limitations in early TOF studies and must be taken into account in the comparison of TOF MRA and CE MRA data in this meta-analysis. (5) The majority of TOF MRA studies used 3D TOF MRA; however, there are several studies that incorporated both 2D and 3D techniques. Although 3D is often considered a stronger diagnostic technique due to improved signal-to-noise ratio, in areas of slow flow it may be advantageous to use 2D instead of 3D TOF. Studies using both forms may be more complete, because transverse 2D images are more sensitive to slow flow and can therefore discriminate between critical stenosis (ie, >95%) and occlusion. As can be seen from both the forest plots of sensitivity and specificity, as well as the ROC curves, more heterogeneity exists in the TOF MRA data than in the CE MRA data for high-grade stenosis. In particular, the CE MRA sensitivity plot shows very little heterogeneity. This could be due to a variety of factors and is most likely the result of similar study designs across these papers.
It should also be noted that publication bias may be a source of heterogeneity. It is possible that studies demonstrating poor accuracy of MRA as compared with IAA may not have been published. The accuracy of imaging results depends on the instruments and technology used as well as the experience of the operator and radiologist. Studies showing excellent concordance between MRA and IAA are most often performed in academic radiology departments. Therefore, results from centers with decreased quality control may be less optimistic and perhaps less likely to be published.
Differences in diagnostic threshold could potentially have contributed to heterogeneity in this analysis. It has been stated previously that differences in study design, including NASCET/ECST measurements and varying definitions of "high-grade" stenosis contribute to heterogeneity. However, it is possible for differences in diagnostic threshold to exist despite the use of the same diagnostic threshold such as defining 70% to 99% stenosis as severe. If a threshold effect is present, it can be visually interpreted through the ROC plots. Sensitivity will increase with decreasing specificity or vice versa. This is illustrated on the corresponding ROC plots, which, in this case, show weak evidence of diagnostic threshold, because both sensitivity and specificity increase simultaneously.
Only limited data were available for 50% to 69% stenoses; sometimes 30% to 69% stenosis data were reported, although such a large range of data is not useful for CEA decision-making.8 At present, many, but not all, patients with moderate-grade stenosis are referred for surgery after consideration of a number of clinical factors; patients with the best operative outcomes are male, those with hemispheric stroke or transient ischemic attack (as opposed to retinal ischemia), and those who do not have contralateral ICA occlusion. In cases of endovascular angioplasty or stenting, the results of noninvasive imaging will be de facto confirmed or rejected by IAA. Even with the limited data available, both CE MRA and especially TOF MRA appear to be poor diagnostic tools for moderate ICA stenosis. Their higher specificities only show that MRA is somewhat more accurate in ruling out the presence of a moderate stenosis. The cause of the reduced sensitivity may relate to image resolution. It is quite possible that some patients assessed as having high-grade stenosis on MRA, in fact, only have moderate-grade disease and vice versa, patients with moderate-grade disease may have high-grade disease. The potential clinical impact of these findings is most important for good clinical practice and will need to be considered and investigated as a matter of urgency.
This new information updates results obtained in the prior systematic reviews. MRA techniques have shown a continued evolution and improvement in their accuracy for the assessment of ICA stenoses. It is clear that many research centers and hospitals have already made the transition to noninvasive MRA as a sole imaging modality and determinant for CEA despite some reports that may demonstrate that MRA does not meet the threshold of diagnostic quality that would allow its independent use in all clinical settings.77 MRA has the advantages of being less expensive, less time-consuming, and noninvasive as compared with DSA. It is also capable of imaging vessels with unusual pathologies and produces stronger images of vessels not normally imaged with traditional noninvasive imaging, including the vertebral and subclavian arteries. Although the data for TOF MRA and CE MRA are fairly similar in this meta-analysis, especially for high-grade ICA stenoses and occlusions, there are other factors that must be taken into account. For instance, CE MRA unquestionably provides clearer, more defined images than TOF MRA. Also, because CE MRA is flow-independent, there is not a risk of signal void due to turbulent flow. Because TOF MRA appears to be in the process of being phased out in some centers, some studies have only looked at issues such as patient preference with CE MRA versus DSA. It has been found in a recent study that patients appear to prefer CE MRA over DSA. According to U-King-Im et al, 67% of subjects were willing to have a repeat MRA versus 41% for DSA.78
In conclusion, from this meta-analysis, the current change to the use of MRA to detect high-grade ICA stenoses and occlusions appears justified with CE MRA having the edge over TOF MRA. However, the accuracy of MRA has yet to be proven for the detection of moderate-grade stenoses, and it is recommended that a second noninvasive study be obtained to confirm the grade of ICA disease at this time before treatment decisions are made. A complimentary diagnostic tool such as ultrasound or computed tomography angiography or DSA is necessary in these cases for decision-making regarding potential carotid endarterectomy or stenting. With over 660 000 CEAs performed in the United States over the past 5 years, there is a need for larger studies including both symptomatic and asymptomatic subjects with tighter study guidelines to address the serious problem of heterogeneity and reporting of age data. Future studies should include patients with varying degrees of ICA stenosis severity, including mild stenoses. This work is also needed to confirm that the more expensive CE MRA, which the literature has shown to be largely replacing TOF MRA in recent studies, is truly a better diagnostic tool. It is essential that these studies be completed in a prospective and blinded fashion to fully answer the questions arising from this meta-analysis and systematic review and to ensure that each patient receives optimal care.
| Acknowledgments |
|---|
This research was supported in part by the Intramural Research Program of the NIH, NINDS. S.D.J. is supported by the National Scientist Development Grant from the American Heart Association.
Disclosures
None.
Received November 12, 2007; revision received December 27, 2007; accepted January 14, 2008.
| References |
|---|
|
|
|---|
2. National Hospital Discharge Survey. Available at: www.cdc.gov/nchs/about/major/hdasd/nhds.htm. Accessed November 12, 2007.
3. Barnett HJ, Taylor DW, Eliasziw M. Benefit of carotid endarterectomy in patients with symptomatic moderate or severe stenosis. North American Symptomatic Carotid Endarterectomy Trial Collaborators. N Engl J Med. 1998; 339: 1415–1425.
4. North American Symptomatic Carotid Endarterectomy Trial Collaborators. Beneficial effect of carotid endarterectomy in symptomatic patients with high-grade carotid stenosis. North American Symptomatic Carotid Endarterectomy Trial Collaborators. N Engl J Med. 1991; 325: 445–453.[Abstract]
5. MRC European Carotid Surgery Trial: interim results for symptomatic patients with severe (70–99%) or with mild (0–29%) carotid stenosis. European Carotid Surgery Trialists Collaborative Group. Lancet. 1991; 337: 1235–1243.[CrossRef][Medline] [Order article via Infotrieve]
6. Executive Committee for the Asymptomatic Carotid Atherosclerosis Study. Endarterectomy for asymptomatic carotid artery stenosis. JAMA. 1995; 273: 1421–1428.
7. Halliday A, Mansfield A, Marro J, Peto C, Peto R, Potter J, Thomas D; MRC Asymptomatic Carotid Surgery Trial (ACST) Collaborative Group. Prevention of disabling and fatal strokes by successful carotid endarterectomy in patients without recent neurological symptoms: randomised controlled trial. Lancet. 2004; 363: 1491–1502. Erratum in Lancet. 2004;364:416.[CrossRef][Medline] [Order article via Infotrieve]
8. Chaturvedi S, Bruno A, Feasby T, Holloway R, Benavente O, Cohen SN, Cote R, Hess D, Saver J, Spence JD, Stern B, Wilterdink J. Carotid endarterectomy- an evidence-based review: report of the therapeutics and technology assessment subcommittee of the American Academy of Neurology. Neurology. 2005; 65: 794–801.
9. Mohammed N, Anand SS. Prevention of disabling and fatal strokes by successful carotid endarterectomy in patients without recent neurological symptoms: randomized controlled trial. MRC Asymptomatic Carotid Surgery Trial (ACST) collaborative group. Vasc Med. 2004; 10: 77–78.[CrossRef]
10. Kastrup A, Gröschel K, Krapf H, Brehm BR, Dichgans J, Schulz JB. Early outcome of carotid angioplasty and stenting with and without cerebral protection devices: a systematic review of the literature. Stroke. 2003; 34: 813–819.
11. Yadav JS, Wholey MH, Kuntz RE, Fayad P, Katzen BT, Mishkel GJ, Bajwa TK, Whitlow P, Strickman NE, Jaff MR, Popma JJ, Snead DB, Cutlip DE, Firth BG, Ouriel K. Stenting and Angioplasty with Protection in Patients at High Risk for Endarterectomy Investigators. Protected carotid-artery stenting versus endarterectomy in high-risk patients. N Engl J Med. 2004; 351: 1493–1501.
12. Mas JL, Chatellier G, Beyssen B, Branchereau A, Moulin T, Becquemin JP, Larrue V, Lievre M, Leys D, Bonneville JF, Watelet J, Pruvo JP, Albucher JF, Viguier A, Piquet P, Garnier P, Viader F, Touze E, Giroud M, Hosseini H, Pillet JC, Favrole P, Neau JP, Ducrocq X; EVA-3S Investigators. Endarterectomy versus stenting in patients with symptomatic severe carotid stenosis. N Engl J Med. 2006; 355: 1660–1671.
13. Furlan AJ. Carotid-artery stenting—case open or closed? N Engl J Med. 2006; 355: 1726–1729. Erratum in N Engl J Med. 2006;355:2712.
14. Willinsky RA, Taylor SM, TerBrugge K, Farb RI, Tomlinson G, Montanera W. Neurologic complications of cerebral angiography: prospective analysis of 2,899 procedures and review of the literature. Radiology. 2003; 227: 522–528.
15. Barth A, Arnold M, Mattle HP, Schroth G, Remonda L. Contrast-enhanced 3-D MRA in decision making for carotid endarterectomy: a 6-year experience. Cerebrovasc Dis. 2006; 21: 393–400.[CrossRef][Medline] [Order article via Infotrieve]
16. Wright VL, Olan W, Dick B, Yu H, Alberts-Grill N, Latour LL, Baird AE. Assessment of CE-MRA for the rapid detection of supra-aortic vascular disease. Neurology. 2005; 65: 27–32.
17. Patel MR, Kuntz KM, Klufas RA, Kim D, Kramer K, Polak JF, Skillman JJ, Whittemore AD, Edelman RR, Kent KC. Preoperative assessment of the carotid bifurcation. Stroke. 1995; 26: 1753–1758.
18. Elgersma OEH, Wust AFJ, Buijs PC, van der Graaf Y, Eikelboom BC, Mali WPTM. Multidirectional depiction of the internal carotid arterial stenosis: three-dimensional time-of-flight MR angiography versus rotational and conventional digital subtraction angiography. Radiology. 2000; 216: 511–516.
19. Kallmes DF, Omary RA, Dix JE, Evans AJ, Hillman BJ. Specificity of MR angiography as a confirmatory test of carotid artery stenosis. AJNR Am J Neuroradiol. 1996; 17: 1501–1506.[Abstract]
20. Nederkoorn PJ, van der Graaf Y, Hunink MG. Duplex ultrasound and magnetic resonance angiography compared with digital subtraction angiography in carotid artery stenosis: a systematic review. Stroke. 2003; 34: 1324–1332.
21. Westwood ME, Kelly S, Berry E, Bamford JM, Gough MJ, Airey CM, Meaney JF, Davies LM, Cullingworth J, Smith MA. Use of magnetic resonance angiography to select candidates with recently symptomatic carotid stenosis for surgery: systematic review. BMJ. 2002; 324: 198–203.
22. Wardlaw JM, Chappell FM, Best JJ, Wartolowska K, Berry E. Non-invasive imaging compared with intra-arterial angiography in the diagnosis of symptomatic carotid stenosis: a meta-analysis. Lancet. 2006; 367: 1503–1512.[CrossRef][Medline] [Order article via Infotrieve]
23. Bossuyt PM, Reitsma JB, Bruns DE, Gatsonis CA, Glasziou PP, Irwig LM, Lijmer JG, Moher D, Rennie D, de Vet HC. Standards for Reporting of Diagnostic Accuracy. Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative. Clin Chem. 2003; 49: 1–6.
24. Whiting P, Rutjes AWS, Reitsma JB, Bossuyt PMM, Kleijnen J. The development of QUADAS: a tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Med Res Methodol. 2003; 3: 25.[CrossRef][Medline] [Order article via Infotrieve]
25. Zamora J, Abraira V, Muriel A, Khan KS, Coomarasamy A. Meta-DiSc: a software for meta-analysis of test accuracy data. BMC Med Res Methodol. 2006; 6: 31.[CrossRef][Medline] [Order article via Infotrieve]
26. Anzalone N, Scomazzoni F, Castellano R, Strada L, Righi C, Politi LS, Kirchin MA, Chiesa R, Scotti G. Carotid artery stenosis: intraindividual correlations of 3D time-of-flight MR angiography, contrast-enhanced MR angiography, and conventional DSA, and rotational angiography for detection and grading. Radiology. 2005; 236: 204–213.
27. Fellner C, Lang W, Janka R, Wutke R, Bautz W, Felner FA. Magnetic resonance angiography of the carotid arteries using three different techniques: accuracy compared with intraarterial x-ray angiography and endarterectomy specimens. J Magn Reson Imaging. 2005; 21: 424–431.[CrossRef][Medline] [Order article via Infotrieve]
28. DeMarco JK, Huston J, Bernstein MA. Evaluation of classic 2D time-of-flight MR angiography in the depiction of severe carotid stenosis. AJR Am J Roentgenol. 2004; 183: 787–793.
29. Scarabino T, Fossaceca R, Carra L, Florio F, Marano G, Carriero A. Actual role of unenhanced magnetic resonance angiography (MRA TOF 3D) in the study of stenosis and occlusion of extracranial carotid artery. Radiol Med. 2003; 106: 497–503.[Medline] [Order article via Infotrieve]
30. Nederkoorn PJ, Elgersma OEH, Mali WPTM, Eikelboom BC, Kappelle LJ, van der Graaf Y. Overestimation of carotid artery stenosis with magnetic resonance angiography compared with digital subtraction angiography. J Vasc Surg. 2002; 36: 806–813.[Medline] [Order article via Infotrieve]
31. Patel SG, Collie DA, Wardlaw JM, Lewis SC, Wright AR, Gibson RJ, Sellar RJ. Outcome, observer reliability, and patient preferences if CTA, MRA, or Doppler ultrasound were used, individually or together, instead of digital subtraction angiography before carotid endarterectomy. J Neurol Neurosurg Psychiatry. 2002; 73: 21–28.
32. Binaghi S, Maeder P, Uske A, Meuwly JY, Devuyst G, Meuli RA. Three-dimensional computed tomography angiography and magnetic resonance angiography of carotid bifurcation stenosis. Eur Neurol. 2001; 46: 25–34.[CrossRef][Medline] [Order article via Infotrieve]
33. Johnson MB, Wilkinson ID, Wattam J, Venables GS, Griffiths PD. Comparison of Doppler ultrasound, magnetic resonance angiographic techniques and catheter angiography in evaluation of carotid stenosis. Clin Radiol. 2000; 55: 912–920.[CrossRef][Medline] [Order article via Infotrieve]
34. Back MR, Wilson JS, Rushing G, Stordahl N, Linden C, Johnson BL, Bandyk DF. Magnetic resonance angiography is an accurate imaging adjunct to duplex ultrasound scan in patient selection for carotid endarterectomy. J Vasc Surg. 2000; 32: 429–440.[CrossRef][Medline] [Order article via Infotrieve]
35. Serfaty JM, Chirossel P, Chevallier JM, Ecochard R, Froment JC, Douek PC. Accuracy of three-dimensional gadolinium-enhanced magnetic resonance angiography in the assessment of extracranial carotid artery disease. AJR Am J Roentgenol. 2000; 175: 455–463.
36. Modaresi KB, Cox TCS, Summers PE, Jarosz JM, Verma H, Taylor PR, Padayachee TS. Comparison of intra-arterial digital subtraction angiography, magnetic resonance angiography and duplex ultrasonography for measuring carotid artery stenosis. Br J Surg. 1999; 86: 1422–1426.[CrossRef][Medline] [Order article via Infotrieve]
37. Sardanelli F, Zandrino F, Parodi RC, De Caro G. Accuracy of three-dimensional gadolinium-enhanced MR angiography in the assessment of extracranial carotid artery disease. J Comput Assist Tomogr. 1999; 23: 208–215.[CrossRef][Medline] [Order article via Infotrieve]
38. Ozaki CK, Irwin PB, Flynn TC, Huber TS, Seeger JM. Surgical decision making for carotid endarterectomy and contemporary magnetic resonance angiography. Am J Surg. 1999; 178: 183–184.
39. Scarabino T, Carriero A, Magarelli N, Florio F, Giannatempo GM, Bonomo L, Salvolini U. MR angiography in carotid stenosis: a comparison of three techniques. Eur J Radiol. 1998; 28: 117–125.[CrossRef][Medline] [Order article via Infotrieve]
40. Magarelli N, Scarabino T, Simeone AL, Florio F, Carriero A, Salvolini U, Bonomo L. Carotid stenosis: a comparison between MR and spiral CT angiography. Neuroradiology. 1998; 40: 367–373.[CrossRef][Medline] [Order article via Infotrieve]
41. Jackson MR, Chang AS, Robles HA, Gillespie DL, Olsen SB, Kaiser WJ, Goff JM, O-Donnell SD, Rich NM. Determination of 60% or greater carotid stenosis: a prospective comparison of magnetic resonance angiography and duplex ultrasound with conventional angiography. Ann Vasc Surg. 1998; 12: 236–243.[CrossRef][Medline] [Order article via Infotrieve]
42. Strotzer M, Fellner F, Fraunhofer S, Gmeinwieser J, Albrich H, Seitz J, Feuerbach S. Dedicated head-neck coil in MR angiography of the supra-aoritc arteries from the aortic arch to the circle of Willis. Acta Radiol. 1998; 39: 249–256.[Medline] [Order article via Infotrieve]
43. Huston J, Nichols DA, Luetmer PH, Rydberg CH, Lewis BD, Meyer FB, Brown RD, Schleck CD. MR angiographic and sonographic indications for endarterectomy. AJNR Am J Neuroradiol. 1998; 19: 309–315.[Abstract]
44. Fellner C, Strotzer M, Fraunhofer S, Held P, Spies V, Seitz J, Fellner F. MR angiography of the supra-aortic arteries using a dedicated head and neck coil: image quality and assessment of stenoses. Neuroradiology. 1997; 39: 763–771.[CrossRef][Medline] [Order article via Infotrieve]
45. Nicholas GG, Osborne MA, Jaffe JW, Reed JF. Carotid artery stenosis: preoperative noninvasive evaluation in a community hospital. J Vasc Surg. 1995; 22: 9–16.[CrossRef][Medline] [Order article via Infotrieve]
46. Dadachanji MC, Shroff MM, Modi D, Jankharia BG. Comparison of MR angiography with contrast angiography for the diagnosis of carotid artery stenosis. J Assoc Physicians India. 1995; 43: 92–95.[Medline] [Order article via Infotrieve]
47. Vanninen RL, Manninen HI, Partanen PLK, Vainio PA, Soimakallio S. Carotid artery stenosis: clinical efficacy of MR phase-contrast flow quantification as an adjunct to MR angiography. Radiology. 1995; 194: 459–467.
48. Young GR, Humphrey PRD, Shaw MDM, Nixon TE, Smith ETS. Comparison of magnetic resonance angiography, duplex ultrasound, and digital subtraction angiography in assessment of extracranial internal carotid stenosis. J Neurol Neurosurg Psychiatry. 1994; 57: 1466–1478.
49. De Marco JK, Nesbit GM, Wesbey GE, Richardson D. Prospective evaluation of extracranial carotid stenosis: MR angiography with maximum-intensity projections and multiplanar reformation compared with conventional angiography. AJR Am J Roentgenol. 1994; 163: 1205–1212.
50. White JE, Russell WL, Greer MS, Whittle MT. Efficacy of screening MR angiography and Doppler ultrasonography in the evaluation of carotid artery stenosis. Am Surg. 1994; 60: 340–348.[Medline] [Order article via Infotrieve]
51. Mittl RL, Broderick M, Carpenter JP, Goldberg HI, Listerud J, Mishkin MM, Berkowitz HD, Atlas SW. Blinded-reader comparison of magnetic resonance angiography and duplex ultrasonography for carotid artery bifurcation stenosis. Stroke. 1994; 25: 4–10.[Abstract]
52. Sitzer M, Furst G, Fischer H, Siebler M, Fehlings T, Kleinschmidt A, Kahn T, Steinmetz H. Between-method correlation in quantifying internal carotid stenosis. Stroke. 1993; 24: 1513–1518.
53. Turnipseed WD, Kennell TW, Turski PA, Acher CW, Hoch JR. Magnetic resonance angiography and duplex imaging: noninvasive tests for selecting symptomatic carotid endarterectomy candidates. Surgery. 1993; 114: 643–649.[Medline] [Order article via Infotrieve]
54. Chiesa R, Melissano G, Castellano R, Triulzi F, Anzalone N, Veglia F, Scotti G, Grossi A. Three dimensional time-of-flight magnetic resonance angiography in carotid artery surgery: a comparison with digital subtraction angiography. Eur J Vasc Surg. 1993; 7: 171–176.[CrossRef][Medline] [Order article via Infotrieve]
55. Huston J, Lewis BD, Wiebers DO, Meyer FB, Riederer SJ, Weaver AL. Carotid artery: prospective blinded comparison of two-dimensional time-of-flight MR angiography with conventional angiography and duplex US. Radiology. 1993; 186: 339–344.
56. Anson JA, Heiserman JE, Drayer BP, Spetzler RF. Surgical decisions on the basis of magnetic resonance angiography of the carotid arteries. Neurosurgery. 1993; 32: 335–343.[CrossRef][Medline] [Order article via Infotrieve]
57. Pan XM, Anderson CM, Reilly LM, Saloner D, Lee RE, Perez S, Krupski WC, Rapp JH. Magnetic resonance angiography of the carotid artery combining two- and three-dimensional acquisitions. J Vasc Surg. 1992; 16: 609–618.[CrossRef][Medline] [Order article via Infotrieve]
58. Furuya Y, Isoda H, Hasegawa S, Takahashi M, Kaneko M, Uemura K. Magnetic resonance angiography of extracranial carotid and vertebral arteries, including their origins: comparison with digital subtraction angiography. Neuroradiology. 1992; 35: 42–45.[CrossRef][Medline] [Order article via Infotrieve]
59. Mattle HP, Kent KC, Edelman RR, Atkinson DJ, Skillman JJ. Evaluation of the extracranial carotid arteries: correlation of magnetic resonance angiography, duplex ultrasonography, and conventional angiography. J Vasc Surg. 1991; 13: 838–845.[CrossRef][Medline] [Order article via Infotrieve]
60. Kido DK, Panzer RJ, Szumowski J, Hollander J, Ketonen LM, Monajati A, Ouriel K, Manzione JV, Dumoulin CL, Souza SP, Katz JL, Rothenberg BM. Clinical evaluation of stenosis of the carotid bifurcation with magnetic resonance angiographic techniques. Arch Neurol. 1991; 48: 484–489.
61. Randoux B, Marro B, Koskas F, Chiras J, Dormont D, Marsault C. Proximal great vessels of aortic arch: comparison of three-dimensional gadolinium-enhanced MR angiography and digital subtraction angiography. Radiology. 2003; 229: 697–702.
62. Alvarez-Linera J, Benito-Leon J, Escribano J, Campollo J, Gesto R. Prospective evaluation of carotid artery stenosis: elliptic centric contrast-enhanced MR angiography and spiral CT angiography compared with digital subtraction angiography. AJNR Am J Neuroradiol. 2003; 24: 1012–1019.
63. Cosottini M, Pingitore A, Puglioli M, Michelassi MC, Lupi G, Abbruzzese A, Calabrese R, Lombardi M, Parenti G, Bartolozzi C. Contrast-enhanced three-dimensional magnetic resonance angiography of atherosclerotic internal carotid stenosis as the noninvasive imaging modality in revascularization decision making. Stroke. 2003; 34: 660–664.
64. Willinek WA, von Falkenhausen M, Born M, Gieseke J, Holler T, Klockgether T, Textor HJ, Schild HH, Urbach H. Noninvasive detection of steno-occlusive disease of the supra-aortic arteries with three-dimensional contrast-enhanced magnetic resonance angiography: a prospective, intra-individual comparative analysis with digital subtraction angiography. Stroke. 2005; 36: 38–43.
65. Lenhart M, Framme N, Volk M, Strotzer M, Manke C, Nitz WR, Finkenzeller T, Feuerbach S, Link J. Time-resolved contrast-enhanced magnetic resonance angiography of the carotid arteries: diagnostic accuracy and inter-observer variability compared with selective catheter angiography. Invest Radiol. 2002; 37: 535–541.[CrossRef][Medline] [Order article via Infotrieve]
66. Sundgren PC, Sunden P, Lindgren A, Lanke J, Holtas S, Larsson EM. Carotid artery stenosis: contrast-enhanced MR angiography with two different scan times compared with digital subtraction angiography. Neuroradiology. 2002; 44: 592–599.[CrossRef][Medline] [Order article via Infotrieve]
67. Wutke R, Lang W, Fellner C, Janka R, Denzel C, Lell M, Bautz W, Fellner FA. High-resolution, contrast-enhanced magnetic resonance angiography with elliptical centric k-space ordering of supra-aortic arteries compared with selective x-ray angiography. Stroke. 2002; 33: 1522–1529.
68. Remonda L, Senn P, Barth A, Arnold M, Lovblad KO, Schroth G. Contrast-enhanced 3D MR angiography of the carotid artery: comparison with conventional digital subtraction angiography. AJNR Am J Neuroradiol. 2002; 23: 213–219.
69. Remonda L, Heid O, Schroth G. Carotid artery stenosis, occlusion, and pseudo-occlusion: first-pass, gadolinium-enhanced, three-dimensional MR angiography—preliminary study. Radiology. 1998; 209: 95–102.
70. Borisch I, Horn M, Butz B, Zorger N, Draganski B, Hoelscher T, Bogdahn U, Link J. Preoperative evaluation of carotid artery stenosis: comparison of contrast-enhanced MR angiography and duplex sonography with digital subtraction angiography. AJNR Am J Neuroradiol. 2003; 24: 1117–1122.
71. U-King-Im JM, Trivedi RA, Graves MJ, Higgins NJ, Cross JJ, Tom BD, Hollingworth W, Eales H, Warburton EA, Kirkpatrick PJ, Antoun NM, Gillard JH. Contrast-enhanced MR angiography for carotid disease. Neurology. 2004; 62: 1282–1290.
72. Randoux B, Marro B, Koskas F, Duyme M, Sahel M, Zouaoui A, Marsault C. Carotid artery stenosis: prospective comparison of CT, three-dimensional gadolinium-enhanced MR, and conventional angiography. Radiology. 2001; 220: 179–185.
73. Scarabino T, Carriero A, Giannatempo GM, Marano R, De Matthaeis P, Bonomo L, Salvolini U. Contrast-enhanced MR angiography (CE MRA) in the study of the carotid stenosis: comparison with digital subtraction angiography (DSA). J Neuroradiol. 1999; 26: 87–91.[Medline] [Order article via Infotrieve]
74. Yang CW, Carr JC, Futterer SF, Morasch MD, Yang BP, Shors SM, Finn JP. Contrast-enhanced MR angiography of the carotid and vertebrobasilar circulations. AJNR Am J Neuroradiol. 2005; 26: 2095–2101.
75. Butz B, Dorenbeck U, Borisch I, Zorger N, Lenhart M, Feuerbach S, Link J. High-resolution contrast-enhanced magnetic resonance angiography of the carotid arteries using fluoroscopic monitoring of contrast arrival: diagnostic accuracy and interobserver variability. Acta Radiol. 2004; 45: 164–170.[CrossRef][Medline] [Order article via Infotrieve]
76. Feldmann E, Wilterdink JL, Kosinski A, Lynn M, Chimowitz MI, Sarafin J, Smith HH, Nichols F, Rogg J, Cloft HJ, Wechsler L, Saver J, Levine SR, Tegeler C, Adams R, Sloan M. The Stroke Outcomes and Neuroimaging of Intracranial Atherosclerosis (SONIA) Trial. Neurology. 2007; 68: 2099–2106.
77. Gluf WM, O'Neill B, Couldwell WT. False-negative magnetic resonance angiography with extracranial internal carotid artery stenosis: a report of two cases and review of the literature. Neurosurg Rev. 2005; 28: 154–158.[CrossRef][Medline] [Order article via Infotrieve]
78. U-King-Im JM, Trivedi R, Cross J, Higgins N, Graves M, Kirkpatrick P, Antoun N, Gillard JH. Conventional digital subtraction x-ray angiography versus magnetic resonance angiography in the evaluation of carotid disease: patient satisfaction and preferences. Clin Radiol. 2004; 59: 358–363.[CrossRef][Medline] [Order article via Infotrieve]
This article has been cited by other articles:
![]() |
P. J. Nederkoorn and Y. van der Graaf MRA for Carotid Artery Stenosis Stroke, March 1, 2009; 40(3): e77 - e77. [Full Text] [PDF] |
||||
![]() |
S. M. Debrey and A. E. Baird Response to Letter by Nederkoorn and van der Graaf Stroke, March 1, 2009; 40(3): e78 - e78. [Full Text] [PDF] |
||||
![]() |
M. O. Py and C. Andre Accuracy of Magnetic Resonance Angiography for Internal Carotid Artery Disease Stroke, January 1, 2009; 40(1): e1 - e1. [Full Text] [PDF] |
||||
![]() |
S. M. Debrey and A. E. Baird Response to Letter by Py and Andre Stroke, January 1, 2009; 40(1): e2 - e2. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2008 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |