(Stroke. 2001;32:2292.)
© 2001 American Heart Association, Inc.
Original Contributions |
From the Divisions of Anesthesiology, Neuroanesthesia Unit (C.L., M.R.T.), and Surgical Intensive Care (B.W.), Department APSIC, and the Division of Clinical Epidemiology (M.C.C.), Geneva University Hospitals, Geneva, Switzerland.
Correspondence to Christopher Lysakowski, MD, Neuroanesthesia Unit, Division of Anesthesiology, Department APSIC, Rue Micheli du Crest 24, CH1211 Geneva 14, Switzerland. E-mail christopher.lysakowski{at}hcuge.ch
| Abstract |
|---|
|
|
|---|
Methods A search (MEDLINE, EMBASE, Cochrane Library, bibliographies, hand searching, any language, through January 31, 2001) was performed for studies comparing TCD with angiography. Data were critically appraised using a modified published 10-point score and were combined using a random-effects model.
Results Twenty-six reports compared TCD with angiography. Median validity score was 4.5 (range 1 to 8). Meta-analyses could be performed with data from 7 trials. For the middle cerebral artery (5 trials, 317 tests), sensitivity was 67% (95% CI 48% to 87%), specificity was 99% (98% to 100%), positive predictive value (PPV) was 97% (95% to 98%), and negative predictive value (NPV) was 78% (65% to 91%). For the anterior cerebral artery (3 trials, 171 tests), sensitivity was 42% (11% to 72%), specificity was 76% (53% to 100%), PPV was 56% (27% to 84%), and NPV was 69% (43% to 95%). Three of these 7 studies reported on the same patients, each on another artery, and for 4, data recycling could not be disproved. Other arteries were tested in only 1 trial each.
Conclusions For the middle cerebral artery, TCD is not likely to indicate a spasm when angiography does not show one (high specificity), and TCD may be used to identify patients with a spasm (high PPV). For all other situations and arteries, there is either lack of evidence of accuracy or of any usefulness of TCD. Most of these data are of low methodological quality, bias cannot not be ruled out, and data reporting is often uncritical.
Key Words: angiography diagnostic imaging meta-analysis
| Introduction |
|---|
|
|
|---|
The aim of this systematic review was, first, to test the accuracy of TCD compared with angiography for the diagnosis of cerebral vasospasm after subarachnoid hemorrhage due to a ruptured aneurysm; second, to test the usefulness of TCD as a screening method in this setting; and third, to evaluate the validity of the published data.
| Methods |
|---|
|
|
|---|
Search Strategy
Electronic searches were carried out using MEDLINE (Data Star, PubMed, and KnowledgeFinder 4.19, from 1966 through January 31, 2001), EMBASE (from 1984 through January 31, 2001), and the Central Trials Register of the Cochrane Library (issue 1, 2001). Key words used were "subarachnoid hemorrhage," "intracranial aneurysm," "cerebral vasospasm," "cerebral angiography," "transcranial Doppler," and "blood flow velocity." Reference lists of retrieved reports and of relevant review articles8,1215 were checked. No language restriction was applied. Data from abstracts, letters, and animal studies were not considered, manufacturers were not contacted, and unpublished data were not searched. Authors were contacted when there was ambiguity about the reported data.
Study Selection, Validity Assessment, and Data Extraction
Two authors (C.L., B.W.) screened all retrieved reports. Papers that did not clearly meet inclusion criteria were excluded at this stage. Three authors (C.L., B.W., M.R.T.) then read independently the remaining papers and scored them for methodological quality, using an 8-point validity score for diagnostic tests (Table 1). 16 We added 2 further criteria for the purpose of this study, homogeneity of the study population and reporting of clinical outcome (Table 1). For each fulfilled criterion, 1 point was given. If the criterion was not fulfilled or if the answer was unclear, no point was given. Thus, the lowest possible score for an included study was 0, and the highest score was 10. All authors entered the results of their individual validity assessment into a standardized working sheet. Authors then met to agree consensus; disagreements were resolved by discussion.
|
One author (C.L.) extracted separately for different arteries dichotomous diagnostic data (ie, true- and false-positives, and true- and false-negatives) to create conventional 2x2 cross-classification tables (Figure 1). This was done only for trials that compared both tests in all patients. Two other authors (B.W., M.R.T.) cross-checked the data. Disagreement was resolved by discussion. Definitions of "positive" TCD (increasing of flow velocity) and "positive" angiography (narrowing of arteries) were taken as reported in the original studies.
|
There was a pre hoc decision to test the accuracy of TCD as a diagnostic tool compared with angiography. Thus, TCD would be regarded as a useful diagnostic tool if it proved to detect most patients who had a positive angiography (high sensitivity), and if it proved to exclude most patients without a positive angiography (high specificity).17 There was also a pre hoc decision to assess the potential usefulness of TCD as a screening method in patients who may have a vasospasm. This was done in 2 ways. First, TCD would be regarded as a useful screening method if a positive TCD usually indicated that a angiographic vasospasm was present (positive predictive value [PPV]), and a negative TCD indicated that there was none (negative predictive value [NPV]).17 These latter measures need to be interpreted with some caution however, because the samples of patients in the various studies under review most probably were not representative of the relevant target patient populations at large. And second, we calculated the likelihood ratio for a positive test (ie, the ratio that indicates how much more likely a positive TCD is found in a patient with a vasospasm than in a patient without it), and the likelihood ratio for a negative test (ie, the ratio that indicates how much more likely a negative TCD is found in a patient without a vasospasm than in a patient with it).17
Meta-Analyses
Quantitative meta-analyses were done only when there was evidence of complete verification of both tests in a trial (ie, all patients who had a TCD measurement of an artery also had an angiography of that artery, and vice versa). When combined data on different arteries were reported and the data could not be separated, we did not further analyze those data. Sensitivity, specificity, PPVs, NPVs, and likelihood ratios were calculated for each valid study, together with 95% CIs.18 A random-effects model that takes into account both within and between study variation was used to generate summary measures.19 Random-effects models produce conservatively wider CIs than fixed effect models which do not account for between study variation. When one of the cells in a 2x2 table was zero, 0.5 was added to all cells before computing the summary measure.
| Results |
|---|
|
|
|---|
|
Validity Assessment
None of the included reports fulfilled all ten methodological criteria (Table 2). The median score was 4.5 (range 1 to 8); one trial scored 1, four scored 2, three scored 3, five scored 4, five scored 5, two scored 6, five scored 7, and one scored 8. Study design was comparative in 24 trials (92%), patient selection was consecutive in 15 (58%), data collection was prospective in 3 (12%), observers were blinded in 8 (31%), sufficient details on both TCD and angiography were reported in 8 (31%), complete verification of both diagnostic tests was done in ten (38%), data reporting on diagnostic performance was adequate in 9 (35%), details of the study population were described in 19 (73%), study populations were homogenous in 14 (54%), and long-term outcomes were reported in 8 (31%). Three studies reported on the same patients, each on another artery.21,35,40 Data recycling (ie, reuse of some already published data in subsequent studies) could not be disproved for 4 studies.10,11,23,28
|
|
Diagnostic Performance
Dichotomous diagnostic data for 2x2 tables could be extracted from 9 trials4,11,21,2729,34,35,40. In 2 of those, however, verification of tests was incomplete.4,11 Of the remaining 7, 2 reported on data per artery,21,29 and in 1 trial, several tests were performed in all patients but only one result was reported.27 In 2 trials, there were some inconsistencies in the reporting of data.21,35 Often it was unclear on what grounds patients had been excluded from the analysis. For instance, in 3 trials false-negatives were reported to be due to operator inexperience or technical failures of the TCD, but these data seemed to have been included in the analyses.21,34,40 In 2 studies, some patients were excluded by the original trialists when there were unfavorable anatomic conditions to perform the TCD.29,35 Often, we had to assume that patients were recruited only when their angiography was positive. In 5 trials, for instance, there were no or only very few false-positives.21,2729,34
The cut off for a positive TCD was defined as a flow velocity in the middle cerebral artery of 120 cm/s in 5 studies,21,27,34,35,40 of 130 cm/sec in 1,28 and of 140 cm/s in 1.29 The cut off for a positive angiography was defined as a lumen reduction in any artery of at least 25% in 5 studies,21,27,28,35,40 of at least 30% in 1,34 and no definition was provided in 1 study.29 Five trials (198 patients, 317 tests) reported on the middle cerebral artery, and dichotomous diagnostic data could be extracted and combined (Table 3).21,2729,34 Three trials (108 patients, 171 tests) reported on the anterior cerebral artery, and dichotomous diagnostic data could be extracted and combined (Table 3).27,29,40 The internal carotid artery,21 posterior cerebral artery,40 basilar cerebral artery,35 and vertebral artery35 were tested in only 1 trial each, with a limited number of patients.
|
| Discussion |
|---|
|
|
|---|
Because sensitivity and specificity do not inform us on the usefulness of a test as a screening method among patients in the general population, we calculated PPVs, NPVs, and likelihood ratios. For the middle cerebral artery, these measures suggested that most patients in whom TCD indicated a spasm did have an angiographic spasm, and that TCD was actually 17 times more likely to indicate the presence of a spasm in a patient who had a spasm than in a patient who had none. However, in patients in whom TCD does not indicate a spasm of the middle cerebral artery, one cannot be sure that there is none (low NPV and low likelihood ratio for a negative test). For the anterior cerebral artery, the data from the 3 trials that could be analyzed suggested that TCD is of no use as a screening method. For all the other arteries, again the data came from no more than a single trial each.
This meta-analysis has several limitations. First, patient samples were small, and were from a limited number of analyzable published studies. Thus, even if all the studies were of high methodological quality, the problem of low statistical power for validating null results remains. In fact, the majority of these studies were of low methodological quality, several biases could not be ruled out, and data reporting was often uncritical. None of the reports fulfilled all 10 criteria of the validity score; only one achieved 8 points,31 and 50% of all studies had a score of <5. In one third of trials only, the observers were blinded to the results of the angiography or the TCD, respectively. In some trials, there were very few false-positives (1% of all tests for the middle cerebral artery). It cannot be ruled out that, in the absence of adequate blinding, the observers may have consciously or subconsciously influenced the TCD results in patients who had a positive angiography, or that patients were recruited only when their angiography was positive. This is known as expectation bias.17 Second, the representativeness of some of the patient samples was (at best) doubtful. For instance, in many trials, most patients were among true negatives (67% of all tests for the middle cerebral artery). This suggests that these trials investigated low-risk populations. False-negatives were reported to be caused by operator inexperience or technical failures of the TCD, and sometimes patients were excluded when there were unfavorable anatomic conditions to perform the TCD. Thus, operators skills and experience with the TCD devices may have influenced the results. Third, often it was difficult to identify original data in these studies. There was duplication of data, some trials reported on the same patients, and for some, data recycling could not be ruled out. Finally, we had to rely on the original authors definitions of vasospasm (ie, in most trials a flow velocity of >120 cm/s and an angiographic narrowing of an artery of >25%21,27,28,34,35,40). These, however, may not necessarily be correlated with important endpoints, for instance, delayed ischemia. It has also been suggested that by coupling the patients vital neurological data with trends of blood flow velocity, a health care provider could anticipate the onset or worsening of vasospasm.42 Thus, in future trials, correlation coefficients rather than 2x2 tables based on arbitrary cutoffs would be more useful, and long-term outcomes should be studied.
If these data from the literature are valid, and we assume that the results from an angiography are always correct in this setting, we may draw three conclusions. First, if TCD of the middle cerebral artery in a patient who may have a spasm of that artery indicates the presence of a spasm, it is indeed likely that this patient has a spasm. Second, if in the same patient, TCD does not suggest a spasm of that artery, the operator does not know for sure that there is none. Finally, there is no evidence for any usefulness of TCD as a diagnostic tool for spasms of other cerebral arteries. Thus, at best it can be said that, based on the evidence (or lack thereof) today, TCD cannot be recommended as a screening method in patients with possible cerebral vasospasm due to ruptured aneurysms.
| Acknowledgments |
|---|
Received May 14, 2001; revision received June 26, 2001; accepted June 28, 2001.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
N. U. Ko, P. Rajendran, H. Kim, M. Rutkowski, L. Pawlikowska, P.-Y. Kwok, R. T. Higashida, M. T. Lawton, W. S. Smith, J. G. Zaroff, et al. Endothelial Nitric Oxide Synthase Polymorphism (-786T->C) and Increased Risk of Angiographic Vasospasm After Aneurysmal Subarachnoid Hemorrhage Stroke, April 1, 2008; 39(4): 1103 - 1108. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Rigamonti, A. Ackery, and A. J. Baker Transcranial Doppler monitoring in subarachnoid hemorrhage: a critical tool in critical care: [Monitorage par Doppler transcranien lors d'une hemorragie sous-arachnoidienne : un outil indispensable aux soins intensifs] Can J Anesth, February 1, 2008; 55(2): 112 - 123. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Krejza, W. Rudzinski, M.A. Pawlak, M. Tomaszewski, R. Ichord, J. Kwiatkowski, D. Gor, and E.R. Melhem Angle-Corrected Imaging Transcranial Doppler Sonography versus Imaging and Nonimaging Transcranial Doppler Sonography in Children with Sickle Cell Disease AJNR Am. J. Neuroradiol., September 1, 2007; 28(8): 1613 - 1618. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Pham, A. Johnson, A. J. Bartsch, C. Lindner, W. Mullges, K. Roosen, L. Solymosi, and M. Bendszus CT perfusion predicts secondary cerebral infarction after aneurysmal subarachnoid hemorrhage Neurology, August 21, 2007; 69(8): 762 - 765. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. S. Ross, J. M. Hennessy, and S. C. Nelson Subarachnoid Hemorrhage in a Young Child With Sickle Cell Disease: Is Transcranial Doppler Helpful? Pediatrics, June 1, 2007; 119(6): 1249 - 1250. [Full Text] [PDF] |
||||
![]() |
S. Binaghi, M.L. Colleoni, P. Maeder, A. Uske, L. Regli, A. R. Dehdashti, P. Schnyder, and R. Meuli CT Angiography and Perfusion CT in Cerebral Vasospasm after Subarachnoid Hemorrhage AJNR Am. J. Neuroradiol., April 1, 2007; 28(4): 750 - 758. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. A. Frontera, T. Rundek, J. M. Schmidt, J. Claassen, A. Parra, K. E. Wartenberg, R. E. Temes, S. A. Mayer, J. P. Mohr, and R. S. Marshall Cerebrovascular reactivity and vasospasm after subarachnoid hemorrhage: A pilot study Neurology, March 14, 2006; 66(5): 727 - 729. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. A. Blissitt, P. H. Mitchell, D. W. Newell, S. L. Woods, and B. Belza Cerebrovascular Dynamics With Head-of-Bed Elevation in Patients With Mild or Moderate Vasospasm After Aneurysmal Subarachnoid Hemorrhage Am. J. Crit. Care., March 1, 2006; 15(2): 206 - 216. [Abstract] [Full Text] [PDF] |
||||
![]() |
D.Y. Yoon, C.S. Choi, K.H. Kim, and B.-M. Cho Multidetector-Row CT Angiography of Cerebral Vasospasm after Aneurysmal Subarachnoid Hemorrhage: Comparison of Volume-Rendered Images and Digital Subtraction Angiography. AJNR Am. J. Neuroradiol., February 1, 2006; 27(2): 370 - 377. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. R. Lynch, H. Wang, M. J. McGirt, J. Floyd, A. H. Friedman, A. L. Coon, R. Blessing, M. J. Alexander, C. Graffagnino, D. S. Warner, et al. Simvastatin Reduces Vasospasm After Aneurysmal Subarachnoid Hemorrhage: Results of a Pilot Randomized Clinical Trial Stroke, September 1, 2005; 36(9): 2024 - 2026. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Krejza, J. Kochanowicz, Z. Mariak, J. Lewko, and E. R. Melhem Middle Cerebral Artery Spasm after Subarachnoid Hemorrhage: Detection with Transcranial Color-coded Duplex US Radiology, August 1, 2005; 236(2): 621 - 629. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Krejza, P. Szydlik, D. S. Liebeskind, J. Kochanowicz, O. Bronov, Z. Mariak, and E. R. Melhem Age and Sex Variability and Normal Reference Values for the VMCA/VICA Index AJNR Am. J. Neuroradiol., April 1, 2005; 26(4): 730 - 735. [Abstract] [Full Text] [PDF] |
||||
![]() |
I. K. Moppett and R. P. Mahajan Transcranial Doppler ultrasonography in anaesthesia and intensive care Br. J. Anaesth., November 1, 2004; 93(5): 710 - 724. [Full Text] [PDF] |
||||
![]() |
M. Soehle, M. Czosnyka, J. D. Pickard, and P. J. Kirkpatrick Critical Closing Pressure in Subarachnoid Hemorrhage: Effect of Cerebral Vasospasm and Limitations of a Transcranial Doppler-Derived Estimation Stroke, June 1, 2004; 35(6): 1393 - 1398. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. A. Sloan, A. V. Alexandrov, C. H. Tegeler, M. P. Spencer, L. R. Caplan, E. Feldmann, L. R. Wechsler, D. W. Newell, C. R. Gomez, V. L. Babikian, et al. Assessment: Transcranial Doppler ultrasonography: Report of the Therapeutics and Technology Assessment Subcommittee of the American Academy of Neurology Neurology, May 11, 2004; 62(9): 1468 - 1481. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Soehle, M. Czosnyka, J. D. Pickard, and P. J. Kirkpatrick Continuous Assessment of Cerebral Autoregulation in Subarachnoid Hemorrhage Anesth. Analg., April 1, 2004; 98(4): 1133 - 1139. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. L. Macdonald Advances in Vascular Surgery Stroke, February 1, 2004; 35(2): 375 - 380. [Full Text] [PDF] |
||||
![]() |
J. Krejza, Z. Mariak, and J. Lewko Standardization of Flow Velocities with Respect to Age and Sex Improves the Accuracy of Transcranial Color Doppler Sonography of Middle Cerebral Artery Spasm Am. J. Roentgenol., July 1, 2003; 181(1): 245 - 252. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Ohkuma, S. Suzuki, K. Kudo, S. Islam, and T. Kikkawa Cortical Blood Flow during Cerebral Vasospasm after Aneurysmal Subarachnoid Hemorrhage: Three-Dimensional N-Isopropyl-p-[123I]Iodoamphetamine Single Photon Emission CT Findings AJNR Am. J. Neuroradiol., March 1, 2003; 24(3): 444 - 450. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. A. Sloan and J. F. Soustiel Diagnosis of Basilar Artery Vasospasm * Response Stroke, July 1, 2002; 33(7): 1746 - 1747. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||