| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Stroke. 2004;35:864.)
© 2004 American Heart Association, Inc.
Original Contributions |
From the Imaging Research Laboratories, Robarts Research Institute, London, Ontario, Canada.
Correspondence to Aaron Fenster, PhD, Imaging Research Laboratories, Robarts Research Institute, PO Box 5015, 100 Perth Dr, London, Ontario, N6A 5K8, Canada. E-mail afenster{at}imaging.robarts.ca
| Abstract |
|---|
|
|
|---|
Materials and Methods Forty 3D US patient images of plaques (range, 37.43 to 604.1 mm3) were measured by manual planimetry. We applied ANOVA to determine plaque volume measurement variability and reliability. Plaque volumes were measured with 9 ISDs to determine the effect of ISD on measurement variability. Additional plaque volumes were also measured from multiple 3D US scans to investigate repeated scan acquisition variability.
Results Intraobserver and interobserver measurement reliabilities were 94% and 93.2%, respectively. Plaque volume measurement variability decreased with increasing plaque volume (range, 27.1% to 2.2%). Measurement precision was constant for ISDs between 1.0 and 3.0 mm, whereas plaque volume measurement variability increased with ISD. Repeated 3D US scan measurements were not different from single-scan measurements (P=0.867).
Conclusions The coefficient of variation in the measurement of plaque volume decreased with plaque size. The volumetric change that must be observed to establish with 95% confidence that a plaque has undergone change is
20% to 35% for plaques <100 mm3 and
10% to 20% for plaques >100 mm3. Measurement precision was unchanged for ISDs <3.0 mm, whereas measurement variability increased with ISD. Repeated 3D US scans did not affect plaque volume measurement variability.
Key Words: ultrasonography carotid arteries carotid artery diseases carotid artery plaque carotid stenosis
| Introduction |
|---|
|
|
|---|
Conventional 2-dimensional (2D) ultrasound (US) has been useful in qualitative and quantitative assessments of plaque progression, morphology, and composition.1,5 Moreover, it has been shown that carotid plaque area and progression of plaque identified high-risk patients.1 However, accurate assessment of plaque changes with 2D US is difficult because of the variability in the traditional 2D US examination.11 Using conventional techniques, clinicians must localize a 2D US image plane in the body that is difficult to reproduce, thereby making detailed monitoring of plaque changes with 2D US difficult.
Improved US techniques are required for accurate and reproducible monitoring of plaque changes. Improvements that hold promise are compound imaging,12 which improves the definition of the plaque surface, and 3-dimensional (3D) US techniques, which improve 3D visualization and quantification of pathology.11 3D US has the potential to allow quantitative monitoring of plaque volume changes, which can provide accurate and reliable information about plaque response to therapy.610,1318 Because carotid plaque progression is not limited to changes in 1 or 2 directions, measurements of plaque volume have the potential to be more sensitive to change than do measurements of plaque area, intima-media thickness, and carotid stenosis. For this reason, sample sizes required to test the effects of new therapies might be smaller for measurements of plaque volume than for traditional 2D measurements. With improved strategies to treat atherosclerosis nonsurgically, sensitive, noninvasive, 3D imaging techniques allowing direct plaque visualization and quantification of plaque features are becoming more important in serial monitoring of disease progression or regression.8 Furthermore, studies of 3D plaque volume measurement allow for the possibility of investigating volume changes that occur in multiple dimensions, such as plaque surface morphology, plaque geometry, and plaque distribution.
In this article, we report on the intraobserver and interobserver variability in the measurement of carotid plaque volume by 3D US. We also explore the reliability and reproducibility of our experimental results and report on the effect of interslice distance (ISD) on the precision of our measurement technique. Finally, we investigate the variability in the measurement of plaque volume introduced from repeated 3D US scans.
| Materials and Methods |
|---|
|
|
|---|
Five or 6 3D US scans were performed of both the left and right carotid arteries of each patient, and the best 3D US images were selected for the study, based on optimal image quality (imaging artifacts, shadows, contrast, easily identifiable plaques, etc) and whether the plaques were contained entirely within the 3D US scan. Plaques were identified on the basis of visible changes in morphology where the local thickening of the intimal layer exceeded 1.0 mm. Plaques were also selected for the study to maximize the range of plaque volumes measured. Plaque geometry and distribution were not selection criteria for inclusion in the study.
Image Acquisition, Reconstruction, and Display
The 3D US images were acquired with a mechanical linear 3D scanning system (LIS Inc).11 To produce 3D images, a transducer (50 mm; L125, Philips) was translated along the neck of the patient for
8 seconds for an approximate distance of 4.0 cm while video frames from an US machine (ATL HDI 5000, Philips) were digitized and saved to a computer workstation. The resulting transverse 2D images were parallel to each other, with a mean spatial interval (0.15 mm) and constant transducer angle (
=0°). The 3D images were displayed using intersecting orthogonal planes by means of a reconstructed 3D volume that was available for viewing immediately after the scan.11 Figure 1 shows carotid plaque images obtained by 3D US that have been sliced to reveal the plaque in multiple planes.
|
Plaque Volume by Manual Planimetry
Five observers were trained to identify and measure plaque volume with the 3D US images. Before making measurements, observers were instructed to manipulate the 3D US image in multiple orientations to familiarize themselves with the overall geometry and distribution of the plaque within the carotid vessel.
The 3D US images of plaque volumes were measured by manual planimetry, a method that has been investigated on test phantoms19 and patient anatomy.14,15 Each observer sliced the 3D image with an ISD of 1.0 mm from 1 end of the plaque to the other (along the vessel axis in the scan direction) and traced the individual plaque boundaries on the image plane by using a mouse-driven cross-hair cursor. The areas measured in each slice were summed and multiplied by the ISD (ie, slice thickness) to calculate total plaque volume. After measuring a plaque, each observer reviewed the 3D image to ensure that the set of measured plaque boundaries matched the plaque volume. Mismatches were adjusted by dragging the boundary to fit the correct contour. The outlining of a typical plaque, consisting of 10 to 30 slices, required <8 minutes. Figure 2 shows the process of volume determination by manual planimetry.
|
Study Protocol
Each observer was trained during several tutorial sessions to identify and measure plaque volume on 3D US images of carotid plaque. Subsequently, 3 studies (summarized in Table 1) were performed.
|
First we conducted a multiple-observer study to investigate observer variability in the measurement of plaque volume. Each of the 5 observers measured the volume of 40 plaques (range, 37.43 to 604.10 mm3) 5 times by using an ISD of 1.0 mm (multiple-observer study, Table 1). Second, we investigated the effects of ISD on the relative accuracy and variability of our plaque volume measurement technique. For this study, a single observer measured the volume of 5 plaques (range, 42.15 to 604.10 mm3) 5 times by using 9 ISDs ranging from 1.0 mm to 5.0 mm in 0.5-mm increments (single-observer Study, Table 1). Third, we investigated plaque volume measurement variability from repeated 3D US scans. In this study, the carotid arteries of 5 patients were each scanned 5 times, and a single observer measured the volume of each plaque (range, 23.90 to 522.50 mm3) 10 times by using an ISD of 1.0 mm (repeated scan study, Table 1). To avoid measurement bias that might result from plaque familiarity, the plaques investigated in all 3 studies were randomized and measured 2 to 3 weeks apart.
Statistical Analysis: Multiple Observer Study
With methods described by Eliasziw et al,20 a 2-way, random-effects ANOVA was performed on the plaque volume measurements from the multiple-observer study. For the entire data set of measured plaque volumes as well as for subsets of the plaques (grouped by volume), we determined the standard errors of measurement (SEM), the minimum detectable changes in plaque volume (
V=Za
2SEM) detectable at the 95% confidence level (
=0.05, Za=1.96), and the coefficients of reliability (
) for intraobserver and interobserver measurements of plaque volume.
| Results |
|---|
|
|
|---|
|
CV Versus Average Plaque Volume
Figure 3 is a plot of the intraobserver coefficient of variation (CV) (SD divided by the mean) in the measurement of plaque volume as a function of mean plaque volume for the 40 plaque volumes measured in the multiple-observer study (triangle). Figure 3 shows that as plaque volume increased, the CV in the measurement of plaque volume decreased. For the plaque volumes measured in this study (range, 37.43 to 604.10 mm3), the values for the intraobserver CV ranged from 19.2% to 1.9%. For the same range of plaque volumes, the interobserver CV ranged between 24.1% and 2.2%.
|
Variability of Repeated 3D US Scan Acquisitions
Figure 3 also shows the CV for the measurements of plaque volume made by repeated 3D US scans (open diamond). For the range of plaque volumes measured in the repeated scan study (range, 23.90 to 522.50 mm3), the CV ranged from 15.1% to 3.9% for the smallest to the largest plaque volumes measured. Measurements made from repeated 3D US scans were not different from measurements made from a single scan (P=0.867).
Effects of ISD
To investigate the effect of ISD on relative plaque volume measurements, the mean measured volume of each plaque (as determined by the multiple-observer study) was used as a reference volume to normalize the plaque volumes of the single-observer study. Figure 4 shows that the relative plaque volume remained unchanged for ISDs between 1.0 and 3.0 mm and then decreased to 0.83 for increased ISDs up to 5.0 mm. The error bars in Figure 4 show that plaque volume measurement variability increased with ISD.
|
| Discussion |
|---|
|
|
|---|
Plaque progression is yet another distinct phenotype. Spence et al5 have shown that progression of plaque area is affected by different risk factors from baseline plaque and that these differences are more sensitive in evaluating genetic factors in atherosclerosis, because age, which accounts for half the variation in plaque explained in the regression model, does not explain progression. Spence et al1 have explored the efficacy of tracking plaque regression and progression with 2D US by monitoring the sum of longitudinal cross-sectional areas of all plaques observed in the common, external, and internal carotid arteries on both sides (total plaque area). 3D US studies have also been undertaken to monitor the progression and regression of plaque. Hennerici et al22 performed serial prospective 3D US examinations of 4 flat and 17 soft carotid plaques during an average of 17 months in 7 patients with heterozygous hypercholesterolemia during heparin-induced extracorporeal LDL elimination on precipitation from plasma. By means of a quantitative 3D US analysis, significant plaque volume reduction was reported in all subjects, along with a marked reduction in total and LDL cholesterol and fibrinogen serum levels. Furthermore, Schminke et al8 sought to establish an in vivo method for visualizing structural changes in the carotid plaques in a prospective study involving 32 patients. After a mean of 18.9 months, carotid artery plaque progression had occurred in 15% of plaques, with plaque volume increasing by 59% in these cases. Plaque volume remained constant in 85% of cases.
Because carotid plaque progression is not limited to changes in 1 direction, it is important to measure progression in 3D. Barnett et al2 have shown that plaque cross-sectional area increases 2.4 times faster than does plaque thickness. This phenomenon probably occurs because of the effects of arterial flow on plaque growth.23 For this reason, sample sizes required to show effects of therapy are smaller for measurements of plaque area than for measurements of thickness, such as intima-media thickening.6 Therefore, it is very likely that measurement of plaque volume will be even more sensitive to change, because plaques grow and regress circumferentially as well as in length and thickness.
We have determined the observer variability in the measurement of plaque volume as a function of mean volume. Our values of 6.5% and 6.9% obtained for the intraobserver and interobserver measurement variability of the plaques investigated are comparable to the corresponding variability reported by Delcker et al,1416 as well as the results obtained in vitro on plaque phantoms.19 In addition, coefficients of reliability in our study were similar to those reported by other investigators and very close to unity (see Table 2) for intraobserver and interobserver measurements, suggesting clinical utility.17 Although other investigators have measured plaque volume spanning a similar range as ours,17,18 our study differs in that we have reported the intraobserver and interobserver variabilities as a function of plaque volume.
We have also investigated the effect of ISD on plaque volume accuracy and variability. Figure 4 shows that relative plaque volume measurement remained unchanged for ISDs between 1.0 and 3.0 mm but then decreased for ISDs from 3.0 to 5.0 mm. In addition, we have found that measurement variability increased with ISD. In a previous article, we determined that the plaque volume measurement variability was dominated by variability in the determination of the initial and final slice locations (plaque edges).19 The initial slice location and the variability in the plaque boundary for each slice are not dependent on selection of the ISD. Therefore, the nonlinear relation between measurement accuracy and ISD (Figure 4) is a result of the inaccurate determination of the final edge of the plaque for ISDs >3.0 mm. Thus, our measurement technique systematically underestimates the plaque volume as the ISD exceeds 3.0 mm. Moreover, most 3D US images are formed by reconstructing a series of 2D image planes of known position. However, it must be noted that in many commercial and experimental 3D US systems, the 2D image planes are digitized by a frame grabber at a constant rate, which is independent of the rate of image acquisition, by the US machine. This approach might lead to decreased resolution in the reconstructed images.24 Thus, the choice of spacing between consecutive images planes is important. If the spaces are large, resolution will suffer. However, narrowly spaced planes require more image planes, resulting in increased scan times. Because the acquired plane spacing was 0.15 mm, the resolution in the 3D US scan direction was not affected.24
We have investigated the variability in the measurement of plaque volume by using repeated 3D US scans and found that the CVs determined from the measurement of plaque volume were not different for repeated 3D US scans than for measurements made from a single 3D US scan (P=0.867).
Using the results from Figure 3 and Table 2, we can quantify the change in plaque volume that must be observed to confidently determine whether a plaque has undergone change. For example, for a plaque with a volume of 250 mm3, we must measure a volume change of
14% (Table 2) in a follow-up measurement to establish, with 95% confidence, that the plaque has undergone change and that the difference in measurement is not a result of observer variability. For the smaller plaques investigated in this study (volume <100 mm3), a volume change of
20% to 35% must be measured to reliably determine that a plaque has undergone change. Thus, longer time periods will be required to observe changes in individual plaques.
Potential Contributions to Variability
Dropouts and shadowing, which are present owing to attenuation of the US beam, might be present in the reconstructed 3D US images. Thus, the plaque boundaries in the 3D US images of some of the plaques might not be well defined. This problem appears to be minimized by the Sono-CT capability of the equipment used, which includes views from several planes around the artery. Furthermore, in some instances, determining the location of the plaque boundary in contact with the vessel wall is difficult. Therefore, the exact selection of the boundary in the images varied, depending on the perception of each observer during the measurement process.
Although every effort was made to maintain a consistent measurement protocol among all observers, there might have been variability introduced by identification of the plaque itself. We have defined plaque as a measurable change in the vessel surface morphology when the intimal thickening exceeds 1.0 mm. This definition proved to be useful but did not overcome all of the plaque identification problems encountered. In some cases, it was difficult to determine the extent of the plaque in the vessel wall. Plaque identification at the carotid bifurcation and in areas of poor image resolution or in shadow also created some difficulty in plaque identification. Although the observers in this study were trained to follow the same measurement techniques, minor differences in plaque outlining strategies were still observed.
The variability of measurement can be partially influenced by carefully selecting operator-controlled parameters, such as the number of slices and the initial and final slice locations. However, the measurement process becomes more tedious. Outlining a plaque consisting of multiple slices takes
5 to 7 minutes. This process could be simplified by implementing algorithms for an automated or semiautomated segmentation of plaque volume.25,26 Our manual technique and the related theoretical description of plaque volume measurement variability19 could be used to investigate and refine the effectiveness of an automated or semiautomated technique.
| Conclusions |
|---|
|
|
|---|
20% to 35% for plaques <100 mm3 and
10% to 20% for plaques >100 mm3. Plaque volume measurement precision is unchanged for ISDs <3.0 mm, whereas plaque volume measurement variability increased with ISD. Furthermore, measurements made on repeated 3D US scans were not different from measurements made on a single 3D US scan (P=0.867). | Acknowledgments |
|---|
Received October 23, 2003; revision received December 22, 2003; accepted December 24, 2003.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
L. R. Caplan A 70-Year-Old Man With a Transient Ischemic Attack: Review of Internal Carotid Artery Stenosis JAMA, July 2, 2008; 300(1): 81 - 90. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. O. Stumpe, E. Agabiti-Rosei, T. Zielinski, D. Schremmer, J. Scholze, P. Laeis, P. Schwandt, and M. Ludwig Original Research: Carotid intima-media thickness and plaque volume changes following 2-year angiotensin II-receptor blockade. The Multicentre Olmesartan atherosclerosis Regression Evaluation (MORE) study Therapeutic Advances in Cardiovascular Disease, December 1, 2007; 1(2): 97 - 106. [Abstract] [PDF] |
||||
![]() |
A. Lyshchik, S. B. Hobbs, A. C. Fleischer, D. Khabele, D.-S. Son, J. C. Gore, and R. R. Price Ovarian Volume Measurements in Mice With High-Resolution Ultrasonography J. Ultrasound Med., October 1, 2007; 26(10): 1419 - 1425. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. A. Hegele, K. Z. Al-Shali, A. A. House, A. J.G. Hanley, S. B. Harris, M. Mamakeesick, A. Fenster, B. Zinman, H. Cao, and J. D. Spence Disparate Associations of a Functional Promoter Polymorphism in PCK1 With Carotid Wall Ultrasound Traits Stroke, December 1, 2005; 36(12): 2566 - 2570. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. D. Ainsworth, C. C. Blake, A. Tamayo, V. Beletsky, A. Fenster, and J. D. Spence 3D Ultrasound Measurement of Change in Carotid Plaque Volume: A Tool for Rapid Evaluation of New Therapies Stroke, September 1, 2005; 36(9): 1904 - 1909. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. D. Spence, R. A. Hegele, T. Manolio, E. Boerwinkle, C. O'Donnell, and A. F. Wilson Noninvasive Phenotypes of Atherosclerosis Arterioscler. Thromb. Vasc. Biol., November 1, 2004; 24(11): e188 - e189. [Full Text] [PDF] |
||||
![]() |
K. Z. Al-Shali, A. A. House, A. J.G. Hanley, H. M.R. Khan, S. B. Harris, B. Zinman, M. Mamakeesick, A. Fenster, J. D. Spence, and R. A. Hegele Genetic Variation in PPARG Encoding Peroxisome Proliferator-Activated Receptor {gamma} Associated With Carotid Atherosclerosis Stroke, September 1, 2004; 35(9): 2036 - 2040. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2004 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |