(Stroke. 2000;31:1667.)
© 2000 American Heart Association, Inc.
Original Contributions |
From the Scripps Clinic (M.A.K.), Division of Neurology, La Jolla, Calif, and the Emergency Medicine Center (D.L.S., S.S.), UCLA School of Medicine, the Department of Neurology (J.L.S.), and the Stroke Center (J.L.S., S.S.), University of California at Los Angeles.
Correspondence to Mary A. Kalafut, MD, 10666 N Torrey Pines Rd, MS 313, La Jolla, CA 92037. E-mail mkalafut{at}scrippsclinic.com
| Abstract |
|---|
|
|
|---|
MethodsWe presented 25 scans (normals, acute infarctions, and old infarctions) to 3 academic neuroradiologists. A scoring sheet based on Alteplase Thrombolysis for Acute Noninterventional Therapy in Ischemic Stroke (ATLANTIS)/CT Summit criteria was used to determine >1/3 MCA territory involvement. Nine of the 25 scans were presented again to assess intrarater reliability. We recalculated results of our previous study in which physicians interpreted infarction scans, now designating the scans as >1/3 MCA, <1/3 MCA, or normal, as determined by the neuroradiologists.
ResultsAll 3 neuroradiologists agreed on no infarction, <1/3 MCA, and >1/3 MCA on 64% of the scans. Neuroradiologist test-retest agreement was 96% for >1/3 MCA territory. Overall sensitivity for emergency physicians, neurologists, and general radiologists for detecting the presence of infarction in scans rated as >1/3 MCA was 78%.
ConclusionsNeuroradiologists can achieve moderate agreement in detecting >1/3 MCA infarction. The emergency physicians, neurologists, and general radiologists tested were reasonably skilled at detecting >1/3 MCA acute infarction. However, their performance did not reliably identify all patients who have early CT infarct signs that place them at increased risk for cerebral hemorrhage after thrombolytic therapy.
Key Words: middle cerebral artery stroke, acute thrombolytic therapy tomography, x-ray computed
| Introduction |
|---|
|
|
|---|
Results from the ECASS I and the NINDS tPA trials provided the background for national recommendations regarding the use of early CT signs of major infarction as a relative or an absolute exclusion criterion. Food and Drug Administration labeling and the National Stroke Association consensus statement regarding tPA in acute ischemic stroke urges caution in administering tPA to patients with CT signs of early infarction.9 National guidelines from the American Heart Association and the American Academy of Neurology state that thrombolysis should be avoided if early signs of major infarction are identified on CT.10 11 However, these recommendations are not universally agreed on.6 12
For the exclusion criteria of early signs of involvement of >1/3 MCA territory to be useful in clinical practice, physicians must be able to reliably identify scans with this finding. Two published studies and 1 abstract have examined neuroradiologists agreement on a common operational definition of major infarction, ie, infarction involving >1/3 of the MCA territory.13 14 15 These studies found 72% to 86% agreement among neuroradiologists with regard to whether <1/3 MCA or >1/3 MCA territory was involved in patients scanned within 6 hours of stroke onset. A recent study has examined the ability of neuroradiologists and other physicians to identify signs of early infarction by using the images from the ECASS I trial, but this study did not restrict their sample to scans exhibiting >1/3 MCA territory involvement.16 The ability of nonneuroradiologists to reliably detect CT findings of >1/3 MCA infarctions has not been characterized.
We previously reported on physicians abilities to identify signs of early infarction and hemorrhage.17 In that study, we classified acute infarction scans as easy, intermediate, or difficult to interpret on the basis of our collective judgment of lesion conspicuity. Conspicuity was defined as how hard the lesion was to visualize by making a global assessment of many factors, including the degree of hypodensity and tissue contrast, the amount of sulcal effacement, mass effect, and the size of the lesion. Overall sensitivity for acute infarction scans according to the conspicuity of the lesion was 90% for easy scans, 69% for intermediate scans, and 30% for difficult scans. Because of the growing consensus regarding the importance of recognizing infarction involving >1/3 MCA territory, the present study was performed to reclassify each acute infarction scan as >1/3 MCA, <1/3 MCA, or no infarction and to calculate each subjects performance on infarcts classified by this scheme. Thus, the present study has 2 components: (1) determination of the interrater agreement of neuroradiologists identifying >1/3 MCA territory infarctions and (2) the sensitivity of nonneuroradiologists for detecting acute infarctions of >1/3 MCA territory on CT.
| Materials and Methods |
|---|
|
|
|---|
For the present experiment, we asked 3 academic neuroradiologists
to classify scans regarding the presence and size of acute infarction.
In individual sessions, each neuroradiologist was presented all
19 acute infarctions, 3 old infarctions, and 3 normal scans from the
aforementioned 54-scan library. To facilitate consistent
interpretation and optimize performance, we designed a
worksheet incorporating Alteplase Thrombolysis for Acute
Noninterventional Therapy in Ischemic Stroke (ATLANTIS)/CT
Summit criteria8 for involvement of >1/3 MCA territory
(Figure 1
).1
Although there is no proof that such a worksheet improves the reading
of CTs, research indicates that breaking a complex problem into a
series of simpler problems improves decision making, as does the
provision of structured worksheets.18 The ATLANTIS
criteria define >1/3 MCA territory as substantial involvement of
2
of the following 4 areas: frontal, parietal, temporal, or both basal
ganglia and insula. "Substantial" was not defined in the
ATLANTIS/CT Summit criteria and was therefore left up to the
neuroradiologists discretion. For every scan, each neuroradiologist
rated 10 areas (5 regionsx2 hemispheres) as substantial,
nonsubstantial, or no infarction. Scans were categorized as exhibiting
early signs of major infarction if at least 2 of the 3
neuroradiologists agreed that
2 areas had substantial involvement.
Scans were categorized as normal if at least 2 of the 3
neuroradiologists agreed that there were no signs of acute infarction.
All remaining scans were categorized as <1/3 MCA involvement.
|
To assess intrarater (test-retest) reliability, the same neuroradiologists were shown for a second time 6 acute infarction scans that evoked disagreement during the first round of interpretation and 3 normal scans. Unlike the first round, in this round, the 3 neuroradiologists were told which side of the body was symptomatic before completing the CT interpretation worksheet. Having reclassified each infarction according to the ATLANTIS criteria, we used the results from our original study to recalculate the sensitivity of the emergency physicians, neurologists, and radiologists for detection of >1/3 MCA and <1/3 MCA acute infarctions.
Interrater and test-retest reliability are expressed as percent
agreement. We chose not to present
values because individual
raters were not aware of the correct marginal totals and therefore
percentage agreement is both simpler and more appropriate. CIs are
calculated by using the robust clustered logistic regression procedure
in STATA 6.0 (Stata Corp), with the subject used as the clustering
variable, to account for the potential nonindependence of the
readings of each subject.19
| Results |
|---|
|
|
|---|
|
|
Test-retest agreement regarding the presence of >1/3 MCA infarction was 96% (26 of 27, from 3 neuroradiologists reading 9 scans). One neuroradiologist changed the rating of a single scan from <1/3 to >1/3 MCA territory involvement, but this did not change the rating of the scan because it had already been deemed >1/3 by the other raters. For individual regions (frontal, parietal, temporal, insula and basal ganglia), judgments of the magnitude of involvement of acute infarction were the same on retesting for 93% (252 of 270, from 3 neuroradiologists reading 10 individual regions of 9 scans) of the readings. All 18 of these changes occurred on 4 scans. Of the 18 individual regions that changed, 3 (1%) were a decrease in the magnitude of involvement of the region (from substantial to nonsubstantial involvement or nonsubstantial involvement to no infarct), whereas 15 (5%) were an increase in the magnitude of involvement of the region. For the 19 acute infarction scans, unanimous agreement occurred in 47% of parietal, 53% of basal ganglia, 58% of frontal, 63% of temporal, and 89% of insular regions.
Sensitivity for the detection of >1/3 MCA acute infarctions, based on
282 readings of 9 scans, was 78% (CI 71% to 83%). Emergency
physicians had a sensitivity of 62% (CI 50% to 72%); neurologists,
89% (CI 80% to 94%); and general radiologists, 86% (CI 77% to
92%) (Table 2
). Each physician read
between 1 and 4 scans with >1/3 MCA infarction. Sensitivity of the
individual physicians ranged from 0% to 100%.
|
| Discussion |
|---|
|
|
|---|
Overall, physicians achieved a sensitivity of 78% for identifying the signs of early infarction of >1/3 MCA territory. This finding is consistent with a study by Grotta et al,20 which examined NINDS trial investigators, neurologists, emergency physicians, radiologist fellows, and stroke fellows agreement on acute infarctions involving >1/3 MCA territory. This study found a range of agreement from 68% to 85%, with an average of 77% agreement.20 This level of performance suggests that although a majority of the patients at increased risk of hemorrhage from this risk factor would be identified, a significant proportion would not be detected. Improving physicians abilities to recognize early signs of major infarction could enhance our ability to provide advice regarding the risk of hemorrhagic complications. A recent study by Wardlaw et al16 also showed that a significant number of acute infarctions are not identified by practitioners involved in the care of stroke patients. In fact, only 45% of patients were correctly identified as exhibiting >1/3 MCA involvement. Although our results identify deficiencies in identifying >1/3 MCA territory involvement, they cannot be directly compared because of different testing methods, different physician groups, and even different severity of ischemic changes exhibited on CT scans.16
The interrater agreement among the 3 neuroradiologists was 64% overall, but it was 86% for identifying >1/3 MCA infarcts. The latter number is comparable to that found in previous studies involving neuroradiologists reading of >1/3 MCA. von Kummer et al13 examined the readings of 3 neuroradiologists for >1/3 MCA involvement and found 86% agreement, whereas Marks et al14 also tested the readings of 3 neuroradiologists and found 72% agreement.
It is unclear to what extent the structured form based on ATLANTIS/CT
Summit criteria (Figure 1
) improved or hindered the uniform
interpretation of the scans. Test-retest reliability for
neuroradiologists was excellent, with only 1 neuroradiologist changing
a reading on a single scan from <1/3 MCA to >1/3 MCA involvement.
Even judgments of individual regions exhibited a high degree of
stability between readings for each neuroradiologist. Providing the
side of the patients deficit to this sample of neuroradiologists at
the second reading did not change their original interpretation of
scans exhibiting >1/3 MCA involvement. However, providing the side of
the patients deficit resulted in an increase in the detection of
minor signs of early infarction (<1/3 MCA involvement). This effect of
lateralization information likely reflects both an increase in the
attention of the neuroradiologists to the hemisphere in question and
the facilitation of interpretation of ambiguous areas.
There was a suggestion that the overall conspicuity of lesions and the amount of MCA territory involved influenced the identification of acute infarction differently among the 3 specialty physician-interpreter groups. Lesion conspicuity most strongly influenced the ratings of emergency physicians and moderately influenced the ratings of neurologists and radiologists. Lesion size modestly affected the ratings of emergency physicians and neurologists but did not affect the ratings of radiologists. We speculate that these differences by physician specialty may reflect differing scan-reading strategies. Interpreters who primarily use a global-gestalt recognition strategy (eg, emergency physicians) would likely be more vulnerable to size influences than interpreters who use a strategy involving serial inspection of individual signs (eg, radiologists).
Our convenience sampling method is the main threat to the external validity of the study. The physicians tested may not be representative of all physicians who treat stroke patients, and it could be argued that they are likely better than the typical reader.17 The scans chosen for the library were representative scans exhibiting early infarctions of differing severity. This selection allowed us to survey physicians abilities to detect early signs of infarction with a broad range of findings. Because of the composition of our scan library, we cannot precisely answer how our subjects would perform on scans confined to within 3 hours of symptom onset. However, it would be reasonable to extrapolate that the performance would be similar to the readings of scans rated as "difficult" acute infarction, because these images generally exhibited a minimal amount of tissue hypoattenuation typical of hyperacute CT studies.
Our previous study17 demonstrated that physicians who are involved in providing acute stroke care (ie, emergency physicians, neurologists, and general radiologists) attained a sensitivity of 82% for recognizing hemorrhage on CT. The present study shows that the sensitivity of these physicians for identifying acute infarction involving >1/3 MCA territory is 78%. Both studies support the concept that typical practicing physicians do not achieve near-perfect sensitivity for CT contraindications to thrombolysis. Interpretation of acute CT scans may be improved by providing additional training to physicians involved in acute stroke care,21 including the use of structured worksheets or web-based educational programs, by using teleradiology or other systems that permit immediate scan interpretation by expert readers, or by developing new modalities for selecting patients who will most benefit from thrombolytic agents.
| Acknowledgments |
|---|
| Footnotes |
|---|
Received December 15, 1999; revision received April 26, 2000; accepted April 26, 2000.
| References |
|---|
|
|
|---|
2.
Hacke W, Kaste M, Fieschi C, Toni D, Lesaffre E, von
Kummer R, Boysen G, Bluhmki E, Hoxter G, Mahagne M.
Intravenous thrombolysis with recombinant
tissue plasminogen activator for acute
hemispheric stroke. JAMA. 1995;274:10171025.
3. Hacke W, Kaste M, Fieschi C, von Kummer R, Davalos A, Meier D, Larrue V, Bluhmki E, Davis S, Donnan G, et al. Randomised double-blind placebo-controlled trial of thrombolytic therapy with intravenous alteplase in acute ischaemic stroke. Lancet. 1998;352:12451251.[Medline] [Order article via Infotrieve]
4.
The Multicenter Acute Stroke Trial-Europe Study Group.
Thrombolytic therapy with streptokinase in acute
ischemic stroke. N Engl J Med. 1996;335:145150.
5.
Larrue V, von Kummer R, del Zoppo G, Bluhmki E.
Hemorrhagic transformation in acute ischemic stroke: potential
contributing factors in the European Cooperative Acute Stroke
Study. Stroke. 1997;28:957960.
6.
The NINDS t-PA Stroke Study Group.
Intracerebral hemorrhage after
intravenous t-PA therapy for ischemic stroke.
Stroke. 1997;28:21092118.
7.
Furlan A, Higashida R, Wechsler L, Gent M, Rowley H,
Kase C, Pessin M, Ahuja A, Callahan F, Clark WM, et al.
Intra-arterial Prourokinase for Acute Ischemic
Stroke: the PROACT II Study: a randomized controlled trial.
JAMA. 1999;282:20032011.
8.
Clark WM, Wissman S, Albers GW, Jhamandas JH, Madden
KP, Hamilton S. Recombinant tissue-type plasminogen
activator (alteplase) for ischemic stroke 3 to 5
hours after symptom onset: the ATLANTIS Study: a randomized controlled
trial. JAMA. 1999;282:20192026.
9. National Stroke Association Consensus Statement. Stroke: the first hours: emergency evaluation and treatment guidelines. In: Stroke Clinical Updates. Englewood, Colo: National Stroke Association; 1997:114.
10.
Quality Standards Subcommittee of the American Academy
of Neurology. Practice advisory: thrombolytic therapy
for acute ischemic stroke. Neurology. 1996;47:835839.
11. Adams HP, Brott T, Furlan A, Gomez C, Grotta J, Helgason C, Kwiatkowski T, Lyden P, Marler J, Torner J, et al. Guidelines for Thrombolytic Therapy for Acute Stroke: a Supplement to the Guidelines for the Management of Patients with Acute Ischemic Stroke: a statement for healthcare professionals from a Special Writing Group of the Stroke Council, American Heart Association. Stroke. 1996;27:17111718.
12.
The NINDS t-PA Stroke Study Group. Generalized efficacy
of t-PA for acute stroke: subgroup analysis of the NINDS t-PA
Stroke Trial. Stroke. 1997;28:21192125.
13.
von Kummer R, Allen KL, Holle R, Bozzao L, Bastianello
S, Manelfe C, Bluhmki E, Ringleb P, Meier DH, Hacke W. Acute stroke:
usefulness of early CT findings before thrombolytic
therapy. Radiology. 1997;205:327333.
14.
Marks MP, Holmgren E, Fox A, Patel S, von Kummer R,
Froehlich J. Evaluation of early computed tomographic findings in acute
ischemic stroke. Stroke. 1999;30:389392.
15. Marks MP, Lansberg MG, Howard AI, Albers GW. Comparison of CT and DWI for detection of early infarct signs. Neurology. 1999;52:A453. Abstract.
16.
Wardlaw JM, Dorman PJ, Lewis SC, Sandercock PA. Can
stroke physicians and neuroradiologists identify signs of early
cerebral infarction on CT? J Neurol Neurosurg
Psychiatry. 1999;67:651653.
17.
Schriger D, Kalafut M, Starkman S, Krueger M, Saver J.
Cranial computed tomography interpretation in acute stroke: physician
accuracy in determining eligibility for thrombolytic
therapy. JAMA. 1998;279:12931297.
18. de Dombal FT, Dallos V, McAdam WA. Can computer aided teaching packages improve clinical care in patients with acute abdominal pain? BMJ. 1991;302:14951497.
19. Stata Corp. 1999 Stata Statistical Software: Release 6.0. College Station, Tex: Stata Corp; 1999.
20.
Grotta JC, Chiu D, Lu M, et al. Agreement and
variability in the interpretation of early CT changes in stroke
patients qualifying for intravenous rtPA therapy. Stroke.. 1999;30:15281533.
21.
von Kummer R. Effect of training in reading CT scans on
patient selection for ECASS II. Neurology. 1998;51:S50S52.
This article has been cited by other articles:
![]() |
L Derex and N Nighoghossian Intracerebral haemorrhage after thrombolysis for acute ischaemic stroke: an update J. Neurol. Neurosurg. Psychiatry, October 1, 2008; 79(10): 1093 - 1099. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. W. Youn, J. H. Kim, Y.-C. Weon, S. H. Kim, M.-K. Han, and H.-J. Bae Perfusion CT of the Brain Using 40-mm-Wide Detector and Toggling Table Technique for Initial Imaging of Acute Stroke Am. J. Roentgenol., September 1, 2008; 191(3): W120 - W126. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. P. Adams Jr, G. del Zoppo, M. J. Alberts, D. L. Bhatt, L. Brass, A. Furlan, R. L. Grubb, R. T. Higashida, E. C. Jauch, C. Kidwell, et al. Guidelines for the Early Management of Adults With Ischemic Stroke: A Guideline From the American Heart Association/American Stroke Association Stroke Council, Clinical Cardiology Council, Cardiovascular Radiology and Intervention Council, and the Atherosclerotic Peripheral Vascular Disease and Quality of Care Outcomes in Research Interdisciplinary Working Groups: The American Academy of Neurology affirms the value of this guideline as an educational tool for neurologists. Circulation, May 22, 2007; 115(20): e478 - e534. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. P. Adams Jr, G. del Zoppo, M. J. Alberts, D. L. Bhatt, L. Brass, A. Furlan, R. L. Grubb, R. T. Higashida, E. C. Jauch, C. Kidwell, et al. Guidelines for the Early Management of Adults With Ischemic Stroke: A Guideline From the American Heart Association/ American Stroke Association Stroke Council, Clinical Cardiology Council, Cardiovascular Radiology and Intervention Council, and the Atherosclerotic Peripheral Vascular Disease and Quality of Care Outcomes in Research Interdisciplinary Working Groups: The American Academy of Neurology affirms the value of this guideline as an educational tool for neurologists Stroke, May 1, 2007; 38(5): 1655 - 1711. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Tanaka, T. Ueguchi, E. Shimosegawa, N. Sasaki, T. Johkoh, H. Nakamura, and J. Hatazawa Effect of CT Acquisition Parameters in the Detection of Subtle Hypoattenuation in Acute Cerebral Infarction: A Phantom Study AJNR Am. J. Neuroradiol., January 1, 2006; 27(1): 40 - 45. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. M. Wardlaw and O. Mielke Early Signs of Brain Infarction at CT: Observer Reliability and Outcome after Thrombolytic Treatment--Systematic Review Radiology, May 1, 2005; 235(2): 444 - 453. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Wintermark, N. J. Fischbein, W. S. Smith, N. U. Ko, M. Quist, and W. P. Dillon Accuracy of Dynamic Perfusion CT with Deconvolution in Detecting Acute Hemispheric Stroke AJNR Am. J. Neuroradiol., January 1, 2005; 26(1): 104 - 112. [Abstract] [Full Text] [PDF] |
||||
![]() |
J M Wardlaw and A J Farrall Diagnosis of stroke on neuroimaging BMJ, March 20, 2004; 328(7441): 655 - 656. [Full Text] [PDF] |
||||
![]() |
M. C. Leary, C. S. Kidwell, J. P. Villablanca, S. Starkman, R. Jahan, G. R. Duckwiler, Y. P. Gobin, S. Sykes, K. J. Gough, K. Ferguson, et al. Validation of Computed Tomographic Middle Cerebral Artery """Dot""" Sign: An Angiographic Correlation Study Stroke, November 1, 2003; 34(11): 2636 - 2640. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. F. Tomandl, E. Klotz, R. Handschu, B. Stemper, F. Reinhardt, W. J. Huk, K.E. Eberhardt, and S. Fateh-Moghadam Comprehensive Imaging of Ischemic Stroke with Multisection CT RadioGraphics, May 1, 2003; 23(3): 565 - 592. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. K.F. Mak, K. K.W. Yau, P.-L. Khong, A. S.C. Ching, P.-W. Cheng, P. K.M. Au-Yeung, P. K.M. Pang, K. C.W. Wong, and B. P.L. Chan Hypodensity of >1/3 Middle Cerebral Artery Territory Versus Alberta Stroke Programme Early CT Score (ASPECTS): Comparison of Two Methods of Quantitative Evaluation of Early CT Changes in Hyperacute Ischemic Stroke in the Community Setting Stroke, May 1, 2003; 34(5): 1194 - 1196. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. P. Adams Jr, R. J. Adams, T. Brott, G. J. del Zoppo, A. Furlan, L. B. Goldstein, R. L. Grubb, R. Higashida, C. Kidwell, T. G. Kwiatkowski, et al. Guidelines for the Early Management of Patients With Ischemic Stroke: A Scientific Statement From the Stroke Council of the American Stroke Association Stroke, April 1, 2003; 34(4): 1056 - 1083. [Full Text] [PDF] |
||||
![]() |
M. A. Ezzeddine, M. H. Lev, C. T. McDonald, G. Rordorf, J. Oliveira-Filho, F. G. Aksoy, J. Farkas, A. Z. Segal, L. H. Schwamm, R. G. Gonzalez, et al. CT Angiography With Whole Brain Perfused Blood Volume Imaging: Added Clinical Value in the Assessment of Acute Stroke Stroke, April 1, 2002; 33(4): 959 - 966. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. S. Kidwell, J. L. Saver, J. Carneado, J. Sayre, S. Starkman, G. Duckwiler, Y.P. Gobin, R. Jahan, P. Vespa, J.P. Villablanca, et al. Predictors of Hemorrhagic Transformation in Patients Receiving Intra-Arterial Thrombolysis * Editorial Comment Stroke, March 1, 2002; 33(3): 717 - 724. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. L. Cucchiara and S. E. Kasner Graduating neurology residents' experience with IV tPA for acute stroke Neurology, November 13, 2001; 57(9): 1729 - 1730. [Full Text] [PDF] |
||||
![]() |
M. H. Lev, A. Z. Segal, J. Farkas, S. T. Hossain, C. Putman, G. J. Hunter, R. Budzik, G. J. Harris, F. S. Buonanno, M. A. Ezzeddine, et al. Utility of Perfusion-Weighted CT Imaging in Acute Middle Cerebral Artery Stroke Treated With Intra-Arterial Thrombolysis:: Prediction of Final Infarct Volume and Clinical Outcome Editorial Comment: Prediction of Final Infarct Volume and Clinical Outcome Stroke, September 1, 2001; 32(9): 2021 - 2028. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2000 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |