(Stroke. 1999;30:769-772.)
© 1999 American Heart Association, Inc.
Original Contributions |
Association of Hyperdense Middle Cerebral Artery Sign With Clinical Outcome in Patients Treated With Tissue Plasminogen Activator
From the Departments of Neuroradiology (C.M.) and Neurology (V.L.), University of Toulouse, France; the Department of Neuroradiology (R. v K.), University of Dresden, Germany; the Department of Neuroradiology (L.B., S.B.), University of Rome, Italy; the Department of Neurology (P.R.), University of Heidelberg, Germany; and the Biostatistical Center for Clinical Trials (F.I., E.L.), University of Leuven, Belgium.
Correspondence to Vincent Larrue, MD, Department of Neurology, Rangueil Hospital, 1 Avenue Jean Pouilhès, 31403 Toulouse, France. E-mail larrue.v{at}chu-toulouse.fr
 |
Abstract |
|---|
 Top Abstract IntroductionSubjects and MethodsResultsDiscussionReferences |
|---|
Background and Purpose—The hyperdense middle cerebral artery sign (HMCAS) is a marker of thrombus in the middle cerebral artery. The aim of our study was to find out the frequency of the HMCAS, its association with initial neurological severity and early parenchymal ischemic changes on CT, its relevance to clinical outcome, and the efficacy of intravenous recombinant tissue plasminogen activator (rtPA) in patients with the HMCAS.
Methods—Secondary analysis of the data from 620 patients who received either rtPA or placebo in the European Cooperative Acute Stroke Study I (ECASS I), a double-blind, randomized, multicenter trial. The baseline CT scans were obtained within 6 hours from the onset of symptoms. Functional and neurological outcomes were assessed using the modified Rankin Scale and the Scandinavian Stroke Scale at day 90.
Results—We found an HMCAS in 107 patients(17.7%). The initial neurological deficit was more severe in patients with the HMCAS than in those lacking this sign (P<0.0001). Early cerebral edema and mass effect were also more common in patients with the HMCAS (P<0.0001). The HMCAS was related to the risk of poor functional outcome (grade of 3 to 6 on the modified Rankin Scale) on univariate analysis: 90 patients (84%) with the HMCAS and 310 patients (62%) lacking this sign were dependent or dead at day 90 (P<0.0001). However, this association was no longer significant in a logistic model accounting for the effect of age, sex, treatment with rtPA, initial severity of neurological deficit and early parenchymal ischemic changes on CT. Patients with the HMCAS who were given rtPA had better neurological recovery than those who received placebo (P=0.0297).
Conclusions—The HMCAS is associated with severe brain ischemia and poor functional outcome. However, it has no significant independent prognostic value when accounting for the effect of initial severity of neurological deficit and of early parenchymal ischemic changes on CT. Patients with the HMCAS may benefit from intravenous rtPA.
Key Words: stroke assessment • stroke outcome • stroke, acute • thrombolytic therapy • tomography, x-ray computed
|
Introduction |
|---|
|
TopAbstractIntroductionSubjects and MethodsResultsDiscussionReferences |
|---|
The hyperdense middle cerebral artery sign (HMCAS) is a marker of thrombus in the middle cerebral artery (MCA).1 The specificity of the HMCAS for MCA occlusion approaches 100%, whereas its sensitivity is low. False-positive HMCASs have been noted in asymptomatic patients with a high hematocrit or calcified atherosclerotic disease, but in these cases the HMCAS is usually bilateral.2 3 4 5 Previous studies have suggested that the HMCAS is a common finding when CT is performed within a few hours from the onset of symptoms.3 5 6 7 The HMCAS has been associated with severe neurological deficit, extensive brain damage, and poor clinical outcome.3 8 9 10 11 However, studies demonstrating these associations included small numbers of patients, and the independent prognostic value of the HMCAS remains uncertain.6 7
We report our findings in a large number of patients who participated in a multicenter trial of thrombolytic treatment of acute ischemic stroke. The purpose of our study was to find out the frequency of the HMCAS, its relationship to initial neurological severity and early parenchymal ischemic changes on CT scan, its relevance to clinical outcome, and the efficacy of rtPA in patients with the HMCAS.
|
Subjects and Methods |
|---|
|
TopAbstractIntroductionSubjects and MethodsResultsDiscussionReferences |
|---|
The design and the primary results of the ECASS I have been previously reported.12 In short, ECASS I was a double-blind, placebo-controlled, randomized trial with eligibility based on clinical symptoms and CT, performed between December 1992 and March 1994 at 75 centers in 14 European countries. Six hundred twenty patients with a moderate to severe acute hemispheric ischemic stroke received either rtPA (1.1 mg/kg IV) or placebo within 6 hours after onset of symptoms.
All patients had a pretreatment noncontrast CT (baseline or day 0), a second CT at 24±12 hours (day 1 CT), and a third between days 6 and 8 (day 7 CT). The CT scans were performed according to guidelines of the study protocol. Section thickness was 3 to 5 mm for the base of the brain, including the chiasmal cistern region, and 8 to 10 mm for the upper brain. Window width levels were those used in conventional brain studies. Patients with spontaneous intracranial hemorrhage and those with major early infarct signs on CT such as diffuse swelling of the affected hemisphere, parenchymal hypodensity, and/or effacement of cerebral sulci in more than 33% of the MCA territory had to be excluded.
All CT scans were reviewed by an independent CT reading panel.
The 3 neuroradiologists on the panel (R. v .K., C.M., and L.B.) were
blinded to clinical data and to treatment groups but not to follow-up
CT scans. A CT scan was defined as "not readable" when gray and
white matter attenuation could not be differentiated. A CT scan was
defined as "poor" when gray and white matter could be
differentiated with difficulty because the CT window was too large or
because of the presence of motion artifacts. CT scans with some motion
or beam-hardening artifacts but with good contrast between gray and
white matter attenuation were considered to be of "moderate"
quality. All remaining CT scans were defined as "good." Each CT
scan was evaluated for parenchymal hypodensity and mass effect
(effacement of cortical sulci or ventricular compression)
as a percentage of the MCA territory in 3 categories (none; 
33%;
>33%). Parenchymal hypodensities in the territory of the anterior,
posterior, and choroidal cerebral arteries were assessed
separately.
The HMCAS was defined as an MCA denser than its counterpart and
denser than any other visualized artery or vein. The HMCAS was
categorized according to its location and extent as "proximal" (MCA
trunk or basal M1 segment), "distal" (beyond MCA bifurcation or M2
and M3 segments) or both (Figure
). The
HMCAS was interpreted as "present" or "absent," and
doubtful cases were considered to be absent HMCASs. When the panelists
disagreed with each other, they came to a final judgment during a
consensus meeting.
|
The neurological severity of stroke was graded by use of the Scandinavian Stroke Scale.13 The functional outcome at day 90 was assessed with the modified Rankin Scale. Poor outcome was defined as grades 3 to 6 on this scale.
Statistical analysis of categorical data was performed
with Fisher's exact test or a 
2 test when
appropriate. For continuous data, we used a t test and ANOVA
tables. A Wilcoxon (or Kruskal-Wallis) test was used to test
differences between subgroups. Finally, to assess the independent
contribution of the HMCAS to the risk of poor outcome at day 90, we
used logistic regression analysis. Treatment with rtPA, age,
and sex were forced into the model. Results are expressed as adjusted
odds ratio and corresponding 95% confidence intervals. Significance
was set at P<0.05. All tests were 2-sided and computed with
the software SAS upgrade 6.11 and 6.12 (SAS Institute, Inc).
|
Results |
|---|
|
TopAbstractIntroductionSubjects and MethodsResultsDiscussionReferences |
|---|
According to the judgment of the CT reading panel, good-quality CT scans were obtained in 166 patients (27%), moderate-quality scans were obtained in 314 patients (51%), and poor-quality scans were obtained in 123 patients (20%). Poor-quality CT scans were mainly due to motion artifacts and/or inappropriate window setting. CT scans were unreadable in 8 patients and were not available in 9 other patients. Fifty-two patients with major early infarct signs, erroneously included in the trial, were kept in the analysis. Thus, 603 patients remained for analysis with a complete set of CT scans.
An HMCAS was found on baseline CT scan in 107 patients (17.7%).
The hyperdensity was proximal in 36 patients (33.6%), distal in 14
(13.1%), and present in both segments in 57 (53.3%). The HMCAS
was seen in 61 patients who received placebo and in 46 patients who
were given rtPA. The HMCAS subsisted in 58 of 106 patients on the day 1
CT scan (55%) and in only 22 of 86 patients on the day 7 CT scan
(26%). Patients with the HMCAS had a more severe neurological deficit
at entry. Cerebral edema or mass effect were also more common on
baseline CT scan in these patients (Table 1).
|
An HMCAS on baseline CT scan was significantly associated with
poor clinical outcome at day 90 on univariate
analysis: 90 patients with the HMCAS (84%) and 310 patients
lacking this sign (62%) were dependent or dead (Rankin grade s3 to 6)
at that time (P<0.0001). Table 2 describes the results of the logistic
regression. There was a small but significant association of poor
outcome with increasing age. Also, a lower baseline score on the
Scandinavian Stroke Scale was significantly associated with poor
outcome. The existence of a cerebral edema or mass effect on the
baseline CT scan was significantly associated with poor outcome,
whereas the HMCAS per se was not.
|
Among patients with the HMCAS, those who were given rtPA had
better neurological recovery than those who received placebo. Mortality
at day 90 was not significantly increased in the rtPA-group (Table 3).
|
|
Discussion |
|---|
|
TopAbstractIntroductionSubjects and MethodsResultsDiscussionReferences |
|---|
We found a lower proportion of patients with the HMCAS than in previous studies.3 5 6 7 The difference may be explained by some methodological reasons. Patients with very severe stroke, in whom the HMCAS might have been more common, were excluded from ECASS I.12 Furthermore, most patients who participated in ECASS I were enrolled between 3 and 6 hours from the onset of symptoms.12 This may have decreased the apparent frequency of the HMCAS, because previous studies and our own data have demonstrated the vanishing nature of the HMCAS.3 6 Finally, the quality of some CT scans in ECASS I may have been insufficient to detect the HMCAS in some cases. More specifically, previous studies have demonstrated that reduction of section thickness improves the detectability of a clot within the MCA by reducing partial volume averaging that would make the evaluation of an HMCAS difficult.14 15
We cannot exclude the possibility that the members of the CT reading panel were biased because of knowledge of the follow-up scans when they assessed the baseline scans. This may have increased the frequency of the HMCAS if one admits that parenchymal edema on follow-up scans may have stimulated the readers to look for the HMCAS on baseline scans. On the other hand, doubtful cases may have been classified as absent HMCAS if the follow-up scans were normal. Thus, the setting of the ECASS I CT reading panel was different from that in real life when a stroke has just occurred and only the first CT scan has been obtained.
We found that the HMCAS was significantly related to initial neurological severity and to early parenchymal ischemic changes on CT. These relationships reflect the specificity of the HMCAS for MCA occlusion and the heterogeneity of vascular occlusive processes in patients lacking this sign, who may only have distal branch occlusion or even no detectable arterial occlusion at all.4
The relationship of the HMCAS to functional outcome has been disputed.6 7 Using a logistic model including neurological severity and early parenchymal changes on CT as explanatory variables, we failed to find a significant independent effect of the HMCAS on functional outcome. It should be noted that only 87 patients were enrolled in the ECASS within 3 hours from the onset of symptoms.12 Therefore, the possibility remains that the HMCAS could have independent prognostic value in patients who are seen very early, before parenchymal changes develop.16 With this limitation borne in mind, our findings suggest that the HMCAS is significantly related to the severity of brain ischemia but does not by itself indicate an increased risk of poor clinical outcome.
The efficacy of intravenous thrombolytic treatment in patients with the HMCAS has been questioned.16 A study using cerebral angiography before and after intravenous rtPA has documented immediate recanalization in only 23 (38%) of 60 MCA stems or divisions (M1 or M2) compared with 8 (47%) of 17 recanalizations of MCA branches.4 More aggressive approaches, such as intra-arterial administration of the thrombolytic drug or mechanical dissolution of the clot have been proposed for these patients.7 In ECASS I, patients with the HMCAS who where given rtPA had better neurological recovery than those who received placebo. The benefit did not occur at the expense of increased mortality. This result should be viewed with caution, owing to the small sample size and to the retrospective nature of our analysis. It suggests, however,that intravenous rtPA is worthwhile in patients with the HMCAS.
In conclusion, in the setting of a multicenter trial, the HMCAS was an infrequent finding. It was associated with severe brain ischemia and poor functional outcome. It had, however, no independent prognostic value when accounting for the effect of initial neurological severity and early parenchymal ischemic changes on CT. Patients with the HMCAS who were given rtPA had better neurological recovery than those who received placebo.
|
Acknowledgments |
|---|
ECASS 1 was supported exclusively by Dr Karl Thomae, GmbH, a member of Boehringer Ingelheim, Biberach, Germany.
|
Footnotes |
|---|
All authors were involved in the ECASS trial. They have received fees or expenses from Boehringer Ingleheim.
Received November 17, 1998; revision received January 8, 1999; accepted January 18, 1999.
|
References |
|---|
|
TopAbstractIntroductionSubjects and MethodsResultsDiscussionReferences |
|---|
1. Gacs G, Fox AJ, Barnett HJM, Vinuela F. CT visualization of intracranial arterial thromboembolism. Stroke. 1983;14:756–762.
2. Tomsick TA, Brott TG, Olinger CP, Barsan W, Spilker J, Eberle R, Adams H. Hyperdense middle cerebral artery: incidence and quantitative significance. Neuroradiology. 1989;31:312–315.[Medline] [Order article via Infotrieve]
3. Bastianello S, Pierallini A, Colonnese C, Brughitta G, Angeloni U, Antonelli M, Fantozzi LM, Fieschi C, Bozzao L. Hyperdense middle cerebral artery CT sign: comparison with angiography in the acute phase of ischemic supratentorial infarction. Neuroradiology. 1991;33:207–211.[Medline] [Order article via Infotrieve]
4. Wolpert SM, Bruckmann H, Greenlee R, Wechsler L, Pessin MS, del Zoppo GJ, and the rt-PA Acute Stroke Study Group. Neuroradiologic evaluation of patients with acute stroke treated with recombinant tissue plasminogen activator. AJNR Am J Neuroradiol. 1993;14:3–13.[Abstract]
5. Von Kummer R, Meyding-Lamade U, Forsting M, Rosin L, Rieke K, Hacke W, Sartor K. Sensitivity and prognostic value of early CT in occlusion of the middle cerebral artery trunk. AJNR Am J Neuroradiol. 1994;15:9–15.[Abstract]
6.
Leys D, Pruvo JP, Godefroy O, Rondepierre PH, Leclerc
X. Prevalence and significance of hyperdense middle cerebral artery in
acute stroke. Stroke. 1992;23:317–324.
7. Tomsick TA, Brott T, Barsan W, Broderick J, Clarke-Haley E, Spilker J, Khoury J. Prognostic value of the hyperdense middle cerebral artery sign and stroke scale score before ultraearly thrombolytic therapy. AJNR Am J Neuroradiol. 1996;17:79–85.[Abstract]
8.
Launes J, Ketonen L. Dense middle cerebral artery
sign: an indicator of poor outcome in middle cerebral artery area
infarction. J Neurol Neurosurg Psychiatry.. 1987;50:1550–1552.
9. Ricci S, Caputo N, Aisa G, Celani MG, Chiurulla C, Mercuri M, Guercini G, Scaroni R, Senin U, Signorini E. Prognostic value of the dense middle cerebral artery sign in patients with acute ischemic stroke. Ital J Neurol Sci. 1991;12:45–47.
10. Zorzon M, Mase g, Pozzi-Mucelli F, Biasutti E, Antonutti L, Iona L, Cazzato G. Increased density in the middle cerebral artery by nonenhanced computed tomography: prognostic value in acute cerebral infarction. Eur Neurol. 1993;33:256–259.[Medline] [Order article via Infotrieve]
11.
Moulin T, Cattin F, Crépin-Leblond T, Tatu L,
Chavot D, Piotin M, Viel JF, Rumbach L, Bonneville JF. Early CT signs
in acute middle cerebral artery infarction: predictive value for
subsequent infarct locations and outcome. Neurology. 1996;47:366–375.
12.
Hacke W, Kaste M, Fieschi C, Toni D, Lesaffre E,
von Kummer R, Boysen G, Bluhmki E, Höxter G, Mahagne MH,
Hennerici MG, for the ECASS Study Group. Intravenous
thrombolysis with recombinant tissue
plasminogen activator for acute
ischemic stroke: the European Cooperative Acute Stroke Study
(ECASS). JAMA. 1995;274:1017–1025.
13.
Scandinavian Stroke Study Group. Multicenter Trial of
Hemodilution in Ischemic Stroke: background and study protocol.
Stroke. 1995;16:885–890.
14. Pressman BD, Tourje EJ, Thompson JR. An early sign of ischemic infarction: increased density in a cerebral artery. AJNR Am J Neuroradiol. 1987;8:645–648.
15. Schuierer G, Huk W. The unilateral hyperdense middle cerebral artery: an early CT sign of embolism or thrombosis. Neuroradiology. 1988;30:120–122.[Medline] [Order article via Infotrieve]
16. Tomsick TA. Sensitivity and prognostic value of early CT in occlusion of the middle cerebral artery trunk. AJNR Am J Neuroradiol. 1994;15:16–18.
This article has been cited by other articles:
 |
|
 |
|
  T Kharitonova, M Thoren, N Ahmed, J M Wardlaw, R von Kummer, L Thomassen, N Wahlgren, and for the SITS investigators Disappearing hyperdense middle cerebral artery sign in ischaemic stroke patients treated with intravenous thrombolysis: clinical course and prognostic significance J. Neurol. Neurosurg. Psychiatry, March 1, 2009; 80(3): 273 - 278. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 I.Y.L. Tan, A.M. Demchuk, J. Hopyan, L. Zhang, D. Gladstone, K. Wong, M. Martin, S.P. Symons, A.J. Fox, and R.I. Aviv CT Angiography Clot Burden Score and Collateral Score: Correlation with Clinical and Radiologic Outcomes in Acute Middle Cerebral Artery Infarct AJNR Am. J. Neuroradiol., March 1, 2009; 30(3): 525 - 531. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D Manawadu and K Butcher Evolving hyperdense middle cerebral artery sign J. Neurol. Neurosurg. Psychiatry, October 1, 2008; 79(10): 1106 - 1106. [Full Text] [PDF]
|
|
|
|
 |
|
 O. Ozdemir, A. Leung, M. Bussiere, V. Hachinski, and D. Pelz Hyperdense Internal Carotid Artery Sign: A CT Sign of Acute Ischemia Stroke, July 1, 2008; 39(7): 2011 - 2016. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E.Y. Kim, E. Yoo, H.Y. Choi, J.W. Lee, and J.H. Heo Thrombus Volume Comparison between Patients with and without Hyperattenuated Artery Sign on CT AJNR Am. J. Neuroradiol., February 1, 2008; 29(2): 359 - 362. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. P. Mattle, M. Arnold, D. Georgiadis, C. Baumann, K. Nedeltchev, D. Benninger, L. Remonda, C. von Budingen, A. Diana, A. Pangalu, et al. Comparison of Intraarterial and Intravenous Thrombolysis for Ischemic Stroke With Hyperdense Middle Cerebral Artery Sign Stroke, February 1, 2008; 39(2): 379 - 383. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. K. Shetty The MCA Dot Sign Radiology, October 1, 2006; 241(1): 315 - 318. [Full Text] [PDF]
|
|
|
|
|
|
T. Krings, D. Noelchen, M. Mull, K. Willmes, I. G. Meister, P. Reinacher, R. Toepper, and A. K. Thron The Hyperdense Posterior Cerebral Artery Sign: A Computed Tomography Marker of Acute Ischemia in the Posterior Cerebral Artery Territory Stroke, February 1, 2006; 37(2): 399 - 403. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E. Y. Kim, S.-K. Lee, D. J. Kim, S.-H. Suh, J. Kim, J. H. Heo, and D. I. Kim Detection of Thrombus in Acute Ischemic Stroke: Value of Thin-Section Noncontrast-Computed Tomography Stroke, December 1, 2005; 36(12): 2745 - 2747. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. M. Wardlaw and O. Mielke Early Signs of Brain Infarction at CT: Observer Reliability and Outcome after Thrombolytic Treatment--Systematic Review Radiology, May 1, 2005; 235(2): 444 - 453. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P A Barber, A M Demchuk, M D Hill, J H W. Pexman, M E Hudon, R Frayne, and A M Buchan The probability of middle cerebral artery MRA flow signal abnormality with quantified CT ischaemic change: targets for future therapeutic studies J. Neurol. Neurosurg. Psychiatry, October 1, 2004; 75(10): 1426 - 1430. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. L. Brown, K. C. Johnston, D. P. Wagner, and E. C. Haley Jr Predicting Major Neurological Improvement With Intravenous Recombinant Tissue Plasminogen Activator Treatment of Stroke Stroke, January 1, 2004; 35(1): 147 - 150. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. C. Leary, C. S. Kidwell, J. P. Villablanca, S. Starkman, R. Jahan, G. R. Duckwiler, Y. P. Gobin, S. Sykes, K. J. Gough, K. Ferguson, et al. Validation of Computed Tomographic Middle Cerebral Artery """Dot""" Sign: An Angiographic Correlation Study Stroke, November 1, 2003; 34(11): 2636 - 2640. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 B. F. Tomandl, E. Klotz, R. Handschu, B. Stemper, F. Reinhardt, W. J. Huk, K.E. Eberhardt, and S. Fateh-Moghadam Comprehensive Imaging of Ischemic Stroke with Multisection CT RadioGraphics, May 1, 2003; 23(3): 565 - 592. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J M Wardlaw, T M West, P A G Sandercock, S C Lewis, and O Mielke Visible infarction on computed tomography is an independent predictor of poor functional outcome after stroke, and not of haemorrhagic transformation J. Neurol. Neurosurg. Psychiatry, April 1, 2003; 74(4): 452 - 458. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. M. Manno, D. A. Nichols, J. R. Fulgham, and E. F. M. Wijdicks Computed Tomographic Determinants of Neurologic Deterioration in Patients With Large Middle Cerebral Artery Infarctions Mayo Clin. Proc., February 1, 2003; 78(2): 156 - 160. [Abstract] [PDF]
|
|
|
|
|
|
D. M. Somford, P. J. Nederkoorn, D. R. Rutgers, L. J. Kappelle, W. P. T. M. Mali, and J. van der Grond Proximal and Distal Hyperattenuating Middle Cerebral Artery Signs at CT: Different Prognostic Implications Radiology, June 1, 2002; 223(3): 667 - 671. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. A. Barber, A. M. Demchuk, M. E. Hudon, J.H. W. Pexman, M. D. Hill, and A. M. Buchan Hyperdense Sylvian Fissure MCA "Dot" Sign : A CT Marker of Acute Ischemia Stroke, January 1, 2001; 32(1): 84 - 88. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
C. Baracchini, R. Manara, M. Ermani, and G. Meneghetti The Quest for Early Predictors of Stroke Evolution : Can TCD Be a Guiding Light? Stroke, December 1, 2000; 31(12): 2942 - 2947. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. A. Barber, D. G. Darby, P. M. Desmond, R. P. Gerraty, Q. Yang, T. Li, D. Jolley, G. A. Donnan, B. M. Tress, and S. M. Davis Identification of Major Ischemic Change : Diffusion-Weighted Imaging Versus Computed Tomography Stroke, October 1, 1999; 30(10): 2059 - 2065. [Abstract] [Full Text] [PDF]
|
|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||