Donate Help Contact The AHA Sign In Home
American Heart Association
Stroke
Search: search_blue_button Advanced Search
Stroke. 2007;38:1812-1819
Published online before print April 26, 2007, doi: 10.1161/STROKEAHA.106.479139
Free Article
This Article
Free upon publication Free Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
38/6/1812    most recent
STROKEAHA.106.479139v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow Request Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Touzé, E.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Touzé, E.
Right arrowPubmed/NCBI databases
Medline Plus Health Information
*Carotid Artery Disease
Related Collections
Right arrow CT and MRI
Right arrow Other arteriosclerosis
Right arrow Carotid Stenosis
Right arrow Imaging
Right arrow Computerized tomography and Magnetic Resonance Imaging

(Stroke. 2007;38:1812.)
© 2007 American Heart Association, Inc.


Original Contributions

Reproducibility of High-Resolution MRI for the Identification and the Quantification of Carotid Atherosclerotic Plaque Components

Consequences for Prognosis Studies and Therapeutic Trials

Emmanuel Touzé, MD, PhD; Jean-François Toussaint, MD, PhD; Joël Coste, MD, PhD; Emmanuelle Schmitt, MD; Fabrice Bonneville, MD; Pierre Vandermarcq, MD; Jean-Yves Gauvrit, MD, PhD; Françoise Douvrin, MD; Jean-François Meder, MD, PhD; Jean-Louis Mas, MD; Catherine Oppenheim, MD, PhD for the HIgh-Resolution magnetic resonance Imaging in atherosclerotic Stenosis of the Carotid artery (HIRISC) study group

From the Faculté de Médecine Paris-Descartes, Departments of Neurology (E.T., J.L.M.) and Neuroradiology (J.F.M., C.O.), EA 4055 Centre Hospitalier Sainte-Anne, Paris, France; the Department of Radiology and Physiology (J.F.T.), Hôtel-Dieu, APHP, INSERM U652; the Department of Biostatistics (J.C.), Hôpital Cochin, APHP; the Department of Neuroradiology (E.S.), Hôpital Neurologique, CHRU Nancy, France; Groupe Hospitalier Pitié-Salpêtrière (F.B.), Paris, France; Hôpital La Milétrie, CHRU Poitiers, France (P.V.); Hôpital R Salengro, CHRU Lille, France (J.Y.G.); and CHU de Rouen, France (F.D.).

Correspondence to Emmanuel Touzé, MD, Department of Neurology, Centre Hospitalier Sainte-Anne, 1 rue Cabanis, 75674 Paris Cedex 14, France. E-mail e.touze{at}ch-sainte-anne.fr


*    Abstract
up arrowTop
*Abstract
down arrowIntroduction
down arrowMethods
down arrowResults
down arrowDiscussion
down arrowAppendix
down arrowReferences
 
Background and Purpose— Although MRI is increasingly proposed to investigate composition of carotid atherosclerosis, its reproducibility has rarely been addressed. We assessed the reproducibility of MRI for the identification and quantification of carotid atherosclerotic plaque components.

Methods— Using published criteria, 2 readers independently analyzed the carotid MRI (1.5-T MR units with a 4-channel phased-array surface coil, Machnet) of 85 consecutive patients with symptomatic (40% to 69% according to NASCET method) or asymptomatic (60% or greater) carotid artery stenosis enrolled in an ongoing prognostic study. One reader reevaluated all images. Fibrous cap was also secondarily identified independently on T2-weighted and time-of-flight (TOF) images.

Results— Intraobserver agreement was substantial for the identification of calcifications (kappa [{kappa}]=0.70; 95% CI: 0.54 to 0.86) and lipid-rich/necrotic core (LR/NC) ({kappa}=0.69; 0.31 to 0.86), almost perfect for hemorrhages ({kappa}=0.82; 0.68 to 0.96), and moderate ({kappa}=0.58; 0.27 to 0.88) and fair ({kappa}=0.33; 0.09 to 0.56) for fibrous cap identification on T2-weighted and TOF images, respectively. Interobserver agreement was substantial for the identification of calcifications ({kappa}=0.74; 0.59 to 0.89) and hemorrhages ({kappa}=0.62; 0.43 to 0.81), and moderate for LR/NC ({kappa}=0.58; 0.20 to 0.95). Agreement was fair for fibrous cap identification on both T2-weighted ({kappa}=0.28; –0.03 to 0.59) and on TOF images ({kappa}=0.26; 0.04 to 0.48). Agreement between T2 and TOF images for fibrous cap identification was slight ({kappa}=0.16; 0.01 to 0.31). Intra- and interobserver reproducibility for quantitative area measurements of vessel, lumen, plaque, LR/NC, and fibrous components was high with intraclass correlation coefficients ranging from 0.73 to 0.99. However, for the LR/NC, the interval delimited by the Bland-Altman graphs was wide in comparison to the mean.

Conclusions— Vessel and plaque quantification is reproducible. Reproducibility of MRI for identifying and quantifying carotid plaque components is overall acceptable, but there is still significant variability that should be taken into account in the design of prognosis studies and clinical trials. Reproducibility for fibrous cap identification needs to be improved.


Key Words: atherosclerosis • carotid stenosis • MRI • reproducibility • stroke


*    Introduction
up arrowTop
up arrowAbstract
*Introduction
down arrowMethods
down arrowResults
down arrowDiscussion
down arrowAppendix
down arrowReferences
 
In vivo high-resolution MRI has emerged as a tool capable of measuring the volume of atherosclerotic carotid plaques1,2 and characterizing their components, including hemorrhages, calcifications, lipid component (ie, lipid-rich/necrotic core [LR/NC]),3,4 and fibrous tissue.5–7 By measuring atherosclerosis burden and plaque instability, MRI could potentially identify high-risk patients requiring more intensive treatments,8 monitor the effect of treatments,9 and help with understanding atherosclerosis pathophysiology. However, reproducibility of MRI for characterizing plaque components and measuring plaque volumes has rarely been addressed. Intra- and interobserver reproducibility of MRI for quantitative measurements of the wall, lumen, and different plaque components has been evaluated in histological correlation studies,1,10,11 but reproducibility of qualitative in vivo MR measurements has never been assessed. These previous histological studies relied on small samples of selected patients with severe carotid atherosclerosis scheduled for endarterectomy. Furthermore, in the analyses, all arterial locations were pooled together, which could lead to inaccurate estimations. Finally, there is still some controversy about the best way to identify the fibrous cap. Some authors define it as a hypointense area on native 3-dimensional time-of-flight (TOF) images,12 whereas others regard it as a high signal area adjacent to the lumen on T2-weighted sequences.3,6,13–16

We assessed the intra- and interobserver reproducibility of high-resolution MRI for the identification and quantification of carotid atherosclerotic plaque components in 85 consecutive patients enrolled in an ongoing prospective prognostic study.


*    Methods
up arrowTop
up arrowAbstract
up arrowIntroduction
*Methods
down arrowResults
down arrowDiscussion
down arrowAppendix
down arrowReferences
 
Population
HIgh-Resolution magnetic resonance Imaging in atherosclerotic Stenosis of the Carotid artery (HIRISC) is an ongoing multicenter prospective study assessing the prognostic value of carotid plaque vulnerability, as defined on MRI, for the prediction of cerebrovascular events (participants are listed in the Appendix). Patients were eligible for the study if 1) they had symptomatic (40% to 69% according to the NASCET method17) or asymptomatic (60% or greater NASCET) stenosis of the internal carotid artery bifurcation; 2) they were not scheduled for endarterectomy within the next 6 months; and 3) they did not have any other major cause of stroke. The decision not to operate was jointly reached with the neurologists and the patient after having the benefits and risks of carotid surgery explained. Patients were considered symptomatic if they have had a recent (12 or less months) transient ischemic attack or a nondisabling (Rankin score 3 or less) ischemic stroke in the territory of the qualifying carotid stenosis. The degree of stenosis was obtained from carotid duplex ultrasound and at least one of the following techniques: MR angiography, CT angiography, or digitized catheter angiography. The study was approved by the local ethics committee and all patients signed an informed consent.

MRI Protocol
All patients were imaged in 1.5-T MR units using the same 4-channel phased-array surface coil (Machnet). Before starting the study, MR protocol and acquisition parameters were standardized across platforms; a fast gradient echo pulse sequence was used in axial, sagittal, and coronal planes as a localizer. The median sagittal image was used to plan a 2-dimensional TOF gradient echo sequence. Twenty to 30 slices with a thickness of 4 mm were set to cover the neck area using the phased array coil. The z-axis coordinates of the qualifying carotid bifurcation on the 2-dimensional TOF images were used to position the 4 following pulse sequences: 3-dimensional TOF, T1-weighted (T1w), proton density-weighted (PDw), and T2-weighted (T2w). The field of view (130x130 mm) was identical for all 4 sequences. T1w, T2w, and PDw images were obtained with double-inversion recovery (ie, black blood) fast spin echo sequences with electrocardiographic gating during free breathing using 8 axial sections (3-mm thick, 0.3-mm gap) centered on the qualifying carotid stenosis. PDw and T2w parameters were: repetition time: 2 RR intervals; effective echo time: 16 to 20 ms for PDw and 50 ms for T2w; acquisition matrix: 256x512 with zero filling (acquired in plane resolution 508x508 µm interpolated to 254x254 µm by zero-filling in K-space); signal averaged: 2; fat suppression. T1w parameters were: repetition time: 1 RR interval; echo time: 9 to 10 ms; acquisition matrix: 352x256, 512 with zero filling (acquired in plane resolution 451x508 µm, interpolated to 254x254 µm by zero-filling in K-space); signal averaged: 3. The 3-dimensional TOF sequence used a gradient echo pulse sequence with repetition time: 30 ms; echo time: 6.9 ms; flip angle: 20°, acquisition matrix: 288x224, 512 zero filling (acquired in plane resolution 451x580 µm interpolated to 254x254 µm by zero-filling in K-space); number of signal averaged: 2; 20 slices of 2.2-mm thickness, one slab. Total acquisition time was approximately 25 minutes. Images were provided in a DICOM format for analysis.

Image Review
After a period of joint working to standardize the methods of assessment and recording, 2 independent readers blind to baseline and follow-up clinical data examined all MR images of the qualifying carotid artery using a standardized form and published criteria (see subsequently).1,4,16,18 Three months after the first reading session, one observer reevaluated all images, which were presented in a different order. For each location, the 4 MR sequences (PDw, T2w, T1w, TOF) were reviewed together. Image quality was assessed by each observer using a 4-point scale (excellent, good, average, poor, this latter category being excluded from our analyses) based on the signal quality and on the motion artifacts.

Tissue Components (qualitative assessment)
All signal intensities were compared with the adjacent sternocleidomastoid muscle.1,4 Calcifications were defined as areas of hypointensity on all 4 sequences. Recent and fresh intraplaque hemorrhages were considered together as hyperintensities on T1w and TOF images. LR/NC and fibrous components share the same signal on PDw images, ie, a signal iso- or slightly hyperintense to the sternocleidomastoid muscle. PDw and T2w images were compared so as to discriminate between LR/NC and fibrous component as follows: LR/NC was identified as an area in which the signal dropped on T2w when compared with PDw images, whereas fibrous component corresponded to a relatively high signal area on both sequences (Figures 1 and 2Down).1,4,16,18 Calcifications, hemorrhages, and LR/NC were considered present if they were observed on one slice at least. Fibrous cap was defined as a high signal area adjacent to the lumen on T2w images.16,18 On TOF images, fibrous cap was identified as a hyposignal band adjacent to the lumen on the plaque surface.12 Readers had to indicate the presence of a fibrous cap on each sequence independently of the finding on the other sequence. The reproducibility of MRI for the identification of the fibrous cap on T2 and TOF images was assessed on one randomly selected location per patient. In the absence of LR/NC, fibrous cap cannot be distinguished from the fibrous component on T2w images. Therefore, locations where no LR/NC was identified by both readers (n=6) were excluded from this analysis.


Figure 1479139
View larger version (88K):
[in this window]
[in a new window]

 
Figure 1. Moderate carotid stenosis as seen on contrast enhanced MR angiography (MRA) along with high-resolution axial images taken 1 cm distal to the bifurcation (arrow). Calcifications correspond to the area of hypointensity on T1w, TOF, PDw, and T2w sequences. A large LR/NC area, corresponding to the area in which signal dropped on T2w when compared with the PDw image, is delineated on the T2w image. The fibrous cap can be seen on TOF (hyposignal band between the smooth lumen boundary and the plaque) and on the T2w image (hyperintensity between the lumen and the LR/NC area).


Figure 2479139
View larger version (104K):
[in this window]
[in a new window]

 
Figure 2. Moderate carotid stenosis as seen on contrast enhanced MR angiography (MRA) along with high-resolution cross-sectional MR images taken immediately distal to the bifurcation (arrow). Measurements of the vessel and lumen areas are obtained by manually tracing their boundaries on PDw. The LR/NC area, delineated on the T2w image, corresponded to the area in which the signal dropped on T2w when compared with the PDw image. No fibrous cap is visible on TOF images, whereas a high signal, adjacent to the lumen, is visible on T2w. Of note, this linear T2w hyperintensity is discontinuous.

Quantitative Measurements
Area measurements of vessel, lumen, plaque, LR/NC, and hemorrhages were obtained for each location by manually tracing the boundaries of each component (Figures 1 and 2Up). Calcification areas were not quantified because of their usual small size and for the various susceptibility artifacts they induce. Vessel and lumen areas were calculated on PDw images and plaque and LR/NC areas on T2w images.12 Fibrous component area was calculated by subtracting LR/NC and hemorrhage from plaque area. Mean areas per artery were calculated by dividing the sum of areas from each cross-sectional location by the number of cross-sectional locations analyzed. Because the absolute values of the LR/NC area do not provide any information on the relative size of the lipid core compared with the vessel (which is a potential marker of plaque instability), we also calculated the ratio of LR/NC to wall (ie, vessel minus lumen) areas for each patient and classified it into 4 categories: less than 10%, 10% to 19%, 20% to 29%, and 30% or greater. These categories covered the range of ratios observed in our study sample (0% to 45%).

Statistical Analyses
We calculated the sample size required to detect kappa values significantly superior to 0.40 with a power of 0.80 assuming that the prevalences of the calcifications and hemorrhages would range between 30% and 50% and kappa values between 0.70 and 0.80. According to Donner and Eliasziw,19 50 to 80 patients were required. For each patient, the carotid artery qualifying for the study was analyzed. Agreements were assessed by calculating kappa ({kappa}) for nominal (dichotomous) data and weighted (quadratic weighting) {kappa} for statistic ranked ordinal data,20 and intraclass correlation coefficients with a 2-way random effect for continuous variables.21 For all agreement parameters, 95% CIs were calculated. According to Landis and Koch,22 values of {kappa} between 0.8 and 1 indicate almost perfect agreement, 0.6 to 0.8 substantial agreement, 0.4 to 0.6 moderate agreement, 0.2 to 0.4 fair agreement, 0.0 to 0.2 slight agreement, and –1.0 to 0.0 poor agreement. Values of intraclass correlation coefficient more than 0.80 were considered excellent agreement.21 Finally, we plotted the mean differences between 2 measurements against the mean of 2 measurements according to the method described by Bland and Altman.23 This method allows judging whether agreement of quantitative measurements varies across the range of values, quantifying the bias between observers, and calculating the precision of the estimated limits of agreement.


*    Results
up arrowTop
up arrowAbstract
up arrowIntroduction
up arrowMethods
*Results
down arrowDiscussion
down arrowAppendix
down arrowReferences
 
MRI examinations of the first 90 patients enrolled in the HIgh-Resolution magnetic resonance Imaging in atherosclerotic Stenosis of the Carotid artery study were selected for this reproducibility analysis. Five (6%) patients were excluded because of poor image quality (n=4) or incomplete MR examination (n=1). Therefore, 85 patients (mean age 69.4±9.9 years; 71% of men) were finally included. Fifty-four patients were asymptomatic, 12 had a transient ischemic attack (including one amaurosis fugax), and 19 a minor stroke. The median number of locations per patient evaluated by both readers (ie, with significant plaque allowing areas measurements) was 3 (one to 5) with a total of 245 locations. The number of patients with images the quality of which was considered average by both readers was small: PDw: 0, TOF: one, T2w: 2, and T1w: 8. Only one patient had 2 average quality sequences according to both readers (excluding this patient did not change our results).

Intraobserver agreement (Table 1) was substantial for the identification of calcifications and LR/NC and almost perfect for hemorrhages. Percentage of agreement was 91% for the identification of a fibrous cap on T2w images but, because the prevalence of fibrous cap was high on this sequence, agreement assessed by {kappa} was only moderate ({kappa}=0.58; 0.27 to 0.88). Intraobserver agreement was fair for the identification of a fibrous cap on TOF images. Intraobserver reproducibility was excellent for quantitative areas measurements (Table 1).


View this table:
[in this window]
[in a new window]

 
TABLE 1. Intraobserver Reproducibility

As shown in Table 2, interobserver agreements were substantial for calcifications ({kappa}=0.74; 0.59 to 0.89) and hemorrhages ({kappa}=0.62; 0.43 to 0.81) but moderate for LR/NC ({kappa}=0.58; 0.20 to 0.95). When average quality T1w images were excluded from the analyses, {kappa} value reached 0.72 (0.54 to 0.90) for hemorrhages. Despite a high agreement (86%), there was a small {kappa} value for the identification of a fibrous cap on T2w images ({kappa}=0.28; –0.03 to 0.59). Of note, this {kappa} value slightly improved when images with hemorrhages (ie, identified by at least one observer) were excluded ({kappa}=0.35; 0.004 to 0.71) or when images with calcifications were excluded ({kappa}=0.44; 0.0 to 0.89), and reached 0.78 (0.36 to 1.0) when those with both hemorrhages and calcifications were excluded. On TOF images, fibrous cap was more seldom identified with a percentage of agreement of 69% and a {kappa} value of 0.26 (0.04 to 0.48). In contrast to findings on T2w images, the exclusion of images with hemorrhage and calcifications did not change the interobserver agreement on TOF images ({kappa}=0.20; –0.16 to 0.56). Finally, given this low reproducibility, 2 months after the first readings, one observer examined a random location (ie, a location different from that used in the first analysis) from each patient on T2w images only. Then, 4 weeks later, he analyzed the same locations on TOF images only (presented in a different order). In this analysis, agreement between T2w and TOF images for the identification of a fibrous cap was slight ({kappa}=0.16; 0.01 to 0.31).


View this table:
[in this window]
[in a new window]

 
TABLE 2. Interobserver Reproducibility of MRI in Identifying the Different Plaque Components

Interobserver reproducibility for quantitative areas measurements was high: intraclass correlation coefficient was 0.96 (0.95 to 0.97) for the vessel, 0.98 (0.98 to 0.99) for the lumen, 0.94 (0.92 to 0.96) for the plaque, 0.73 (0.66 to 0.80) for the LR/NC, and 0.84 (0.79 to 0.88) for the fibrous component. In plaques in which both readers agreed on the presence of hemorrhages, intraclass correlation coefficient was 0.60 (0.37 to 0.81) for hemorrhagic areas. Bland and Altman plots (Figure 3) showed that the absolute differences in measurements were small (ranging from –3.0 to 0.9 mm2 depending on the component) and that there was no relation between differences and means. However, the interval of agreement (mean of differences ±2 SDs) for the LR/NC was wide (–9.8 to 8.2 mm2) compared with the mean which ranged from 0 to 30 mm2 (mean, 10.1 mm2). Consequently, as shown in Table 3, the agreement for the classification of plaques according to the ratio LR/NC to wall areas was only substantial (weighted {kappa}=0.61; 0.48 to 0.74). Findings regarding LR/NC quantification were unchanged when patients with hemorrhage or calcifications were excluded.


View this table:
[in this window]
[in a new window]

 
TABLE 3. Interobserver Agreement for the Classification of the Ratio LR-NC/Wall Areas

All results related to interobserver reproducibility for qualitative (Table 2) and quantitative (data not shown) measurements were similar when the second observer 1 readings were used or when patients with at least one average quality sequence (n=10) were excluded (data not shown). Our findings were also similar for symptomatic and asymptomatic patients (data not shown).


*    Discussion
up arrowTop
up arrowAbstract
up arrowIntroduction
up arrowMethods
up arrowResults
*Discussion
down arrowAppendix
down arrowReferences
 
We have shown that the interobserver reproducibility of high-resolution MRI for the in vivo identification of hemorrhages, calcifications, and LR/NC was moderate to substantial. The reproducibility was excellent for the quantification of vessel and plaque areas but not perfect for the quantification of hemorrhages and LR/NC. We have also shown that fibrous cap cannot be reliably identified. As expected, intraobserver reproducibility was better than interobserver reproducibility. Although there are published data on reproducibility of MRI for the quantification of different plaque components,1,10,11 to our knowledge, intra- and interobserver reproducibility of MRI for the identification of different plaque components and fibrous caps had never specifically been assessed so far.

In our study, intra- and interobserver agreements were not perfect for most of the components. However, the reproducibility found here was very similar to that observed in a recent histological carotid plaque study24 and was at least as good as that of different carotid imaging techniques.25–27 Our findings of a good reproducibility of MRI in quantifying vessel, lumen, and plaque areas are in keeping with those of previous smaller studies, which included patients scheduled for carotid endarterectomy.1,11 Taken together, these results mean that MRI can be used quite confidently in clinical studies addressing whether the risk of stroke is correlated to atherosclerosis burden and in studies addressing the effect of drugs on the size of atherosclerosis plaques. However, the quantification of the LR/NC was not perfect. Although intraclass correlation coefficient (0.73) and {kappa} coefficient for the lipids/wall ratio (0.61) suggested a relatively good agreement, Bland and Altman plot showed a relatively wide interval of agreement compared with the mean. This indicated that there could be discrepancies between 2 readers. This result highlights the technical limitations of the intraclass correlation coefficient in addressing the agreement between measurements of continuous variables28 and the need to carefully analyze Bland and Altman plots.23 Similarly, we found a slightly lower interobserver reproducibility for quantifying hemorrhages than that found in a previous study.1 The usual small size of hemorrhagic areas along with their frequent blurred edges on MRI and the heterogeneity of their signal are likely to explain the result.24,29

We found that fibrous cap was more often identified on T2w than on TOF images, but reproducibility was overall poor for both methods and there was no agreement between both methods. On T2w images, the {kappa} value, although low, was better in plaques without calcifications and hemorrhages. These difficulties in distinguishing fibrous cap from LR/NC in plaques with hemorrhages and calcifications have been previously noticed.6 An overlap between the signal intensity of hemorrhages, which varies according to their age and the signal of the other components, could explain these difficulties. Given the relative high prevalence of these components, this potential explanation has no implications for the practice but could direct future research. Another plausible explanation could be that calcifications are sometimes adjacent to the lumen and disrupt the signal. Considering these difficulties in identifying fibrous cap reliably, we decided not to carry out further analyzes on the fibrous cap status. The discrimination between LR/NC and fibrous cap on T2w images is based on differences in spectroscopic properties between these both components and has been well documented in both in vitro and in vivo studies.3,6,13–16 Conversely, the diagnostic value of TOF sequences has been less documented and,12 so far, findings have not been replicated. In a recent study addressing whether plaque vulnerability defined on MRI predicted cerebrovascular events, fibrous cap was defined after having several readers reach a consensus.8 Nevertheless, although T2w fibrous cap was identified more frequently on T2w than on TOF sequences, our results highlight that much remains to be done to improve the ability of MRI to identify fibrous cap confidently. The use of gadolinium contrast agent has been shown to improve the distinction between fibrous cap and LR/NC and could help with more accurate measurements of the fibrous cap.30 However, to our knowledge, reproducibility of postcontrast assessments has not been studied yet.

There are several potential shortcomings to our study. First, we included patients who were not scheduled for endarterectomy and it might therefore be argued that our population did not cover the whole spectrum of the disease severity, which could question the generalizability of our results. However, patients included in this study are those for whom the benefit of endarterectomy is still controversial and for whom much is to be expected from noninvasive techniques. As a consequence, no pathologic confirmation data were available in our study and we may have found good agreement despite that both readers misinterpreted images. However, we carefully used previously published criteria.1,4,16,18 Moreover, agreement studies do not require a reference standard,31 and methods that are not reproducible are useless in clinical practice although they are accurate. In addition, there are some data on MRI reproducibility in patients with more severe carotid stenosis, which are consistent with our results.1 Second, testing interobserver reproducibility with 2 readers and intraobserver reproducibility with one observer only may also question the generalizability of our results. However, testing intraobserver reproducibility is mainly useful to make sure that interobserver reproducibility is interpretable. In addition, there is no reason to believe that our results would have been very different with other readers provided they use the same strict criteria and have a training period. Third, in contrast to some studies, we did not use an automatic imaging analyzing tool for quantitative measurements.1 However, such tools have not thoroughly been validated for the detection and the measurement of all plaque components.32 Fourth, like some previous studies, we used a 3-mm slice thickness,3,6,9 but others used a 2-mm slice thickness.2,11 This greater thickness may have increased partial volume effects and potentially accounted for part of the variability observed. However, for a given acquisition time and magnetic field, decreasing the slice thickness by one third would have resulted in a loss of signal and contrast. In addition, a recent randomized study assessing effects of statins on carotid plaques used a 3-mm slice thickness.9 Finally, there are several well-described limitations to the use of the {kappa} statistic that could influence the interpretation of our results.31 Very high (or low) prevalence results in high levels of expected agreement and consequently, the {kappa} value is often low despite nearly perfect agreement as we observed for the LR/NC and the fibrous cap on T2w images. Observer bias, in the sense of a systematic difference between 2 observers in the image interpretation, is a form of disagreement with important practical implications, but it is not separately identified by the {kappa} statistic. Despite the use of standardized and strict criteria defined during the period of joint working, such a bias could be suspected for the first readings on TOF (fibrous cap identification). However, there was no such bias during the second readings, and because observer bias tends to overestimate the {kappa} value, the true value of the first readings {kappa} value would have been even smaller ({kappa}=0.16; –0.08 to 0.40) after adjustment using the bias index.33

Our results have several practical implications for future research. First, MRI is reproducible for the quantification of vessel and plaque areas and can be used confidently in future studies, which require measuring plaque size. Second, there is still significant interobserver variability for the identification and quantification of different plaque components. This variability should be taken into account in the design of prognostic studies and therapeutic trials, because it can attenuate the correlations between MRI findings and clinical outcomes and consequently increase the required sample sizes.20 We would also recommend that all future studies publish the reproducibility of their own assessment unless the final decision is reached by consensus. Third, much remains to be done to improve the ability of MRI to identify fibrous cap reliably and to better understand the influence of hemorrhages and calcifications on the analysis of the other components. These important questions could potentially be answered by carrying out larger well-designed histological–radiological correlation studies34 using contrast agents and/or new MRI sequences,2,6,35 developing automatic images analyzing tools,36,37 and using higher magnetic fields.38,39


Figure 3479139
View larger version (22K):
[in this window]
[in a new window]

 
Figure 3. Bland and Altman plots (interobserver reproducibility). This figure shows the mean differences between 2 measurements against the mean of 2 measurements (interobserver agreement). Areas are expressed in millimeters squared and correspond to the sum of areas from each cross-sectional location divided by the number of cross-sectional locations analyzed. Y-scales are the same except for lumen areas. On each graph, dotted lines represent the value of the mean bias ±1.96 SDs (difference between the 2 observers’ measurements). There was no variation of agreement across the range of values. The 95% CIs of mean biases were narrow compared with the mean values of measurements except for lipid component areas in which the 95% CI of the mean bias (–9.8 to 8.2) was relatively broad compared with the mean of all lipid areas (10.1 mm2).


*    Appendix
up arrowTop
up arrowAbstract
up arrowIntroduction
up arrowMethods
up arrowResults
up arrowDiscussion
*Appendix
down arrowReferences
 
List of Investigators
Paris (Sainte-Anne): D. Calvet, V. Domigo, C. Lamy, C. Arquizan, E. Touzé, M. Zuber, J. L. Mas (neurologist), O. Naggara, F. Brami, C. Oppenheim, J. F. Meder (radiologist); Nancy: J. C. Lacour, X. Ducrocq (neurologist), E. Schmitt, S. Bracard (radiologist); Paris (Pitié-Salpêtrière): S. Crozier, Y. Samson (neurologist), F. Bonneville, D. Dormont (radiologist); Poitiers: C. Paquet, G. Godenèche, J. P. Neau (neurologist), P. Vandermarck (radiologist); Lille: H. Hénon, C. Lefebvre, C. Lucas, D. Leys (neurologist), J. Y. Gauvrit, R. Henda, X. Leclerc, J. P. Pruvo (radiologist); Rouen: A. Triquenot-Bagan, E. Guégan-Massardier, B. Mihout (neurologist), F. Douvrin, E. Gérardin, J. Thiébot (radiologist); Compiègne: T. Hussein, R. Roos-Weill (neurologist), J. M. Coulet, F. Langevin (radiologist).


*    Acknowledgments
 
We thank the manufacturer engineers who helped with determining the MR acquisition protocols: Thierry Munier and Guillaume Calmon (General Electric Health Care), Stéphane Breil (Philips & Siemens), Gwenael Herigault (Philips). We also thank Sandra Mahamadaly and all other staff and collaborators of the Unité de Recherche Clinique, Hôpital Cochin, Paris. Study concept and design: Oppenheim, Touzé, Mas, Meder, and Coste. Acquisition of data: Touzé, Toussaint, Oppenheim, Schmitt, Bonneville, Vandermarcq, and Douvrin. Analysis and interpretation of data: Touzé, Oppenheim, and Toussaint. Drafting of the manuscript: Touzé, Toussaint, and Oppenheim. Critical revision of the manuscript for important intellectual content: Mas, Meder, and Coste. Statistical analysis: Touzé and Coste. Obtained funding: Oppenheim, Touzé, Mas, and Meder.

Sources of Funding

Supported by a grant from the Programme Hospitalier de Recherche Clinique of the French Ministry of Health (No. AOR 02 009) and a grant from the Institut de l’Athérothrombose (Sanofi-Aventis & Bristol-Myers-Squibb Pharmaceuticals).

Disclosures

None.

Received November 30, 2006; accepted January 5, 2007.


*    References
up arrowTop
up arrowAbstract
up arrowIntroduction
up arrowMethods
up arrowResults
up arrowDiscussion
up arrowAppendix
*References
 

  1. Saam T, Ferguson MS, Yarnykh VL, Takaya N, Xu D, Polissar NL, Hatsukami TS, Yuan C. Quantitative evaluation of carotid plaque composition by in vivo MRI. Arterioscler Thromb Vasc Biol. 2005; 25: 234–239.[Abstract/Free Full Text]
  2. Wasserman BA, Smith WI, Trout HH III, Cannon RO III, Balaban RS, Arai AE. Carotid artery atherosclerosis: in vivo morphologic characterization with gadolinium-enhanced double-oblique MR imaging initial results. Radiology. 2002; 223: 566–573.[Abstract/Free Full Text]
  3. Toussaint JF, LaMuraglia GM, Southern JF, Fuster V, Kantor HL. Magnetic resonance images lipid, fibrous, calcified, hemorrhagic, and thrombotic components of human atherosclerosis in vivo. Circulation. 1996; 94: 932–938.[Abstract/Free Full Text]
  4. Yuan C, Mitsumori LM, Ferguson MS, Polissar NL, Echelard D, Ortiz G, Small R, Davies JW, Kerwin WS, Hatsukami TS. In vivo accuracy of multispectral magnetic resonance imaging for identifying lipid-rich necrotic cores and intraplaque hemorrhage in advanced human carotid plaques. Circulation. 2001; 104: 2051–2056.[Abstract/Free Full Text]
  5. Toussaint JF, Southern JF, Fuster V, Kantor HL. Water diffusion properties of human atherosclerosis and thrombosis measured by pulse field gradient nuclear magnetic resonance. Arterioscler Thromb Vasc Biol. 1997; 17: 542–546.[Abstract/Free Full Text]
  6. Trivedi RA, King-Im JM, Graves MJ, Horsley J, Goddard M, Kirkpatrick PJ, Gillard JH. MRI-derived measurements of fibrous-cap and lipid-core thickness: the potential for identifying vulnerable carotid plaques in vivo. Neuroradiology. 2004; 46: 738–743.[CrossRef][Medline] [Order article via Infotrieve]
  7. Yuan C, Zhang SX, Polissar NL, Echelard D, Ortiz G, Davis JW, Ellington E, Ferguson MS, Hatsukami TS. Identification of fibrous cap rupture with magnetic resonance imaging is highly associated with recent transient ischemic attack or stroke. Circulation. 2002; 105: 181–185.[Abstract/Free Full Text]
  8. Takaya N, Yuan C, Chu B, Saam T, Underhill H, Cai J, Tran N, Polissar NL, Isaac C, Ferguson MS, Garden GA, Cramer SC, Maravilla KR, Hashimoto B, Hatsukami TS. Association between carotid plaque characteristics and subsequent ischemic cerebrovascular events: a prospective assessment with MRI—initial results. Stroke. 2006; 37: 818–823.[Abstract/Free Full Text]
  9. Corti R, Fuster V, Fayad ZA, Worthley SG, Helft G, Chaplin WF, Muntwyler J, Viles-Gonzalez JF, Weinberger J, Smith DA, Mizsei G, Badimon JJ. Effects of aggressive versus conventional lipid-lowering therapy by simvastatin on human atherosclerotic lesions: a prospective, randomized, double-blind trial with high-resolution magnetic resonance imaging. J Am Coll Cardiol. 2005; 46: 106–112.[Abstract/Free Full Text]
  10. Yuan C, Beach KW, Smith LH Jr, Hatsukami TS. Measurement of atherosclerotic carotid plaque size in vivo using high resolution magnetic resonance imaging. Circulation. 1998; 98: 2666–2671.[Abstract/Free Full Text]
  11. Cai J, Hatsukami TS, Ferguson MS, Kerwin WS, Saam T, Chu B, Takaya N, Polissar NL, Yuan C. In vivo quantitative measurement of intact fibrous cap and lipid-rich necrotic core size in atherosclerotic carotid plaque: comparison of high-resolution, contrast-enhanced magnetic resonance imaging and histology. Circulation. 2005; 112: 3437–3444.[Abstract/Free Full Text]
  12. Hatsukami TS, Ross R, Polissar NL, Tuan C. Visualization of fibrous cap thickness and rupture in human atherosclerotic carotid plaque in vivo with high-resolution magnetic resonance imaging. Circulation. 2000; 102: 959–964.[Abstract/Free Full Text]
  13. Coombs BD, Rapp JH, Ursell PC, Reilly LM, Saloner D. Structure of plaque at carotid bifurcation: high-resolution MRI with histological correlation. Stroke. 2001; 32: 2516–2521.[Abstract/Free Full Text]
  14. Serfaty JM, Chaabane L, Tabib A, Chevallier JM, Briguet A, Douek PC. Atherosclerotic plaques: classification and characterization with T2-weighted high-spatial-resolution MR imaging—an in vitro study. Radiology. 2001; 219: 403–410.[Abstract/Free Full Text]
  15. Shinnar M, Fallon JT, Wehrli S, Levin M, Dalmacy D, Fayad ZA, Badimon JJ, Harrington M, Harrington E, Fuster V. The diagnostic accuracy of ex vivo MRI for human atherosclerotic plaque characterization. Arterioscler Thromb Vasc Biol. 1999; 19: 2756–2761.[Abstract/Free Full Text]
  16. Winn WB, Schmiedl UP, Reichenbach DD, Beach KW, Nghiem H, Dimas C, Daniel E, Maravilla KR, Yuan C. Detection and characterization of atherosclerotic fibrous caps with T2-weighted MR. AJNR Am J Neuroradiol. 1998; 19: 129–134.[Abstract]
  17. Rothwell PM, Gibson RJ, Slattery J, Sellar RJ, Warlow CP. Equivalence of measurements of carotid stenosis. A comparison of three methods on 1001 angiograms. European Carotid Surgery Trialists’ Collaborative Group. Stroke. 1994; 25: 2435–2439.[Abstract]
  18. Toussaint JF, Southern JF, Fuster V, Kantor HL. T2-weighted contrast for NMR characterization of human atherosclerosis. Arterioscler Thromb Vasc Biol. 1995; 15: 1533–1542.[Medline] [Order article via Infotrieve]
  19. Donner A, Eliasziw M. A goodness-of-fit approach ro inference procedures for the kappa statistic: confidence interval construction, significance-testing and sample size estimation. Stat Med. 1992; 11: 1511–1519.[Medline] [Order article via Infotrieve]
  20. Fleiss JL, Levin B, Paik M. Statistical Methods for Rates and Proportion, 3rd ed. Hoboken, NJ: Wiley-Interscience; 2002.
  21. Shrout PE, Fleiss J. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86: 420–428.[CrossRef]
  22. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977; 33: 159–174.[CrossRef][Medline] [Order article via Infotrieve]
  23. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986; 1: 307–310.[CrossRef][Medline] [Order article via Infotrieve]
  24. Lovett JK, Gallagher PJ, Rothwell PM. Reproducibility of histological assessment of carotid plaque: implications for studies of carotid imaging. Cerebrovasc Dis. 2004; 18: 117–123.[CrossRef][Medline] [Order article via Infotrieve]
  25. Arnold JAC, Modaresi KB, Thomas N, Taylor PR, Padayachee TS. Carotid plaque characterization by duplex scanning: observer error may undermine current clinical trials. Stroke. 1999; 30: 61–65.[Abstract/Free Full Text]
  26. Eliasziw M, Streifler JY, Fox J. Significance of plaque ulceration in symptomatic patients with high grade carotid stenosis. Stroke. 1993; 25: 304–308.
  27. Rothwell PM, Gibson RJ, Slattery J, Warlow CP. Prognostic value and reproducibility of measurements of carotid stenosis. A comparison of three methods on 1001 angiograms. European Carotid Surgery Trialists’ Collaborative Group. Stroke. 1994; 25: 2440–2444.[Abstract]
  28. Müller R, Büttner P. A critical discussion of intraclass correlation coefficient. Stat Med. 1994; 13: 2465–2476.[Medline] [Order article via Infotrieve]
  29. Redgrave JN, Lovett JK, Gallagher PJ, Rothwell PM. Histological assessment of 526 symptomatic carotid plaques in relation to the nature and timing of ischemic symptoms: the Oxford Plaque Study. Circulation. 2006; 113: 2320–2328.[Abstract/Free Full Text]
  30. Cai JM, Hatsukami TS, Ferguson MS, Small R, Polissar NL, Yuan C. Classification of human carotid atherosclerotic lesions with in vivo multicontrast magnetic resonance imaging. Circulation. 2002; 106: 1368–1373.[Abstract/Free Full Text]
  31. Crewson PE. Fundamentals of clinical research for radiologists. Reader agreement studies. AJR Am J Roentgenol. 2005; 184: 1391–1397.[Free Full Text]
  32. Yuan C, Lin E, Millard J, Hwang JN. Closed contour edge detection of blood vessel lumen and outer wall boundaries in black-blood MR images. Magn Reson Imaging. 1999; 17: 257–266.[CrossRef][Medline] [Order article via Infotrieve]
  33. Byrt T, Bishop J, Carlin JB. Bias, prevalence and kappa. J Clin Epidemiol. 1993; 46: 423–429.[CrossRef][Medline] [Order article via Infotrieve]
  34. Lovett JK, Redgrave JN, Rothwell PM. A critical appraisal of the performance, reporting, and interpretation of studies comparing carotid plaque imaging with histology. Stroke. 2005; 36: 1091–1097.[Medline] [Order article via Infotrieve]
  35. Zhang S, Cai J, Luo Y, Han C, Polissar NL, Hatsukami TS, Yuan C. Measurement of carotid wall volume and maximum area with contrast-enhanced 3D MR imaging: initial observations. Radiology. 2003; 228: 200–205.[Abstract/Free Full Text]
  36. Clarke SE, Beletsky V, Hammond RR, Hegele RA, Rutt BK. Validation of automatically classified magnetic resonance images for carotid plaque compositional analysis. Stroke. 2006; 37: 93–97.[Abstract/Free Full Text]
  37. Itskovich VV, Samber DD, Mani V, Aguinaldo JG, Fallon JT, Tang CY, Fuster V, Fayad ZA. Quantification of human atherosclerotic plaques using spatially enhanced cluster analysis of multicontrast-weighted magnetic resonance images. Magn Reson Med. 2004; 52: 515–523.[CrossRef][Medline] [Order article via Infotrieve]
  38. Raynaud JS, Bridal SL, Toussaint JF, Fornes P, Lebon V, Berger G, Leroy-Willig A. Characterization of atherosclerotic plaque components by high resolution quantitative MR and US imaging. J Magn Reson Imaging. 1998; 8: 622–629.[Medline] [Order article via Infotrieve]
  39. Yarnykh VL, Terashima M, Hayes CE, Shimakawa A, Takaya N, Nguyen PK, Brittain JH, McConnell MV, Yuan C. Multicontrast black-blood MRI of carotid arteries: comparison between 1.5 and 3 tesla magnetic field strengths. J Magn Reson Imaging. 2006; 23: 691–698.[CrossRef][Medline] [Order article via Infotrieve]



This article has been cited by other articles:


Home page
J. Neurol. Neurosurg. PsychiatryHome page
J M U-King-Im, T Y Tang, A Patterson, M J Graves, S Howarth, Z-Y Li, R Trivedi, D Bowden, P J Kirkpatrick, M E Gaunt, et al.
Characterisation of carotid atheroma in symptomatic and asymptomatic patients using high resolution MRI
J. Neurol. Neurosurg. Psychiatry, August 1, 2008; 79(8): 905 - 912.
[Abstract] [Full Text] [PDF]


Home page
NeurologyHome page
R. M. Kwee, R. J. van Oostenbrugge, L. Hofstra, G. J. Teule, J.M.A. van Engelshoven, W. H. Mess, and M. E. Kooi
Identifying vulnerable carotid plaques by noninvasive imaging
Neurology, June 10, 2008; 70(24_Part_2): 2401 - 2409.
[Abstract] [Full Text] [PDF]


Home page
StrokeHome page
J. N. Redgrave, P. Gallagher, J. K. Lovett, and P. M. Rothwell
Critical Cap Thickness and Rupture in Symptomatic Carotid Plaques: The Oxford Plaque Study
Stroke, June 1, 2008; 39(6): 1722 - 1729.
[Abstract] [Full Text] [PDF]


This Article
Free upon publication Free Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
38/6/1812    most recent
STROKEAHA.106.479139v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow Request Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Touzé, E.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Touzé, E.
Right arrowPubmed/NCBI databases
Medline Plus Health Information
*Carotid Artery Disease
Related Collections
Right arrow CT and MRI
Right arrow Other arteriosclerosis
Right arrow Carotid Stenosis
Right arrow Imaging
Right arrow Computerized tomography and Magnetic Resonance Imaging