(Stroke. 2001;32:2803.)
© 2001 American Heart Association, Inc.
Original Contributions |
From the Department of Neurology, CHUV (G. Devuyst, V.K., P.R., P.-A.D., J.B.), the Signal Processing Laboratory, Swiss Federal Institute of Technology (G.A.D., J.-M.V.), and the Department of Applied Physics, UNIL (C.L., G. Dietler), Lausanne, and the Department of Neurology, HCUG (R.S.), Geneva, Switzerland; the Department of Neurology, University Hospital, Münster, Germany (M.R., D.W.D., E.B.R.); and the Department of Neurology, University Hospital, Barcelona (C.M.), and the Department of Neurology, University Hospital, Girona (J.S.), Spain.
Correspondence to Gérald Devuyst, Department of Neurology, CHUV, rue du Bugnon 15, 1011 Lausanne, Switzerland. E-mail gerald.devuyst{at}chuv.hospvd.ch or Georges Darbellay, Signal Processing Laboratory, Swiss Federal Institute of Technology, 1015 Lausanne, Switzerland. E-mail georges.darbellay@epfl.ch
| Abstract |
|---|
|
|
|---|
Methods We studied 600 HITS in vivo, including 200 artifacts from normal subjects, 200 solid emboli from patients with symptomatic internal carotid artery stenosis, and 200 gaseous emboli in stroke patients with patent foramen ovale. The study was 2-fold, each part involving 300 HITS (100 of each type). The first 300 HITS (learning set) were used to construct an automated classification algorithm. The remaining 300 HITS (validation set) were used to check the validity of this algorithm. To classify HITS, we combined dual-gate TCD with a wavelet representation and compared it with the current "gold standard," the human experts.
Results A combination of the peak frequency of HITS and the time delay makes it possible to separate artifacts from emboli. On the validation set, we achieved a sensitivity of 97%, a specificity of 98%, a positive predictive value (PPV) of 99%, and a negative predictive value (NPV) of 94%. To distinguish between solid and gaseous emboli, where positive refers now to the solid emboli, we used the peak frequency, the relative power, and the envelope symmetry of HITS. On the validation set, we achieved a sensitivity of 89%, a specificity of 86%, a conditional PPV of 89%, and a conditional NPV of 89%.
Conclusions An automated wavelet representation combined with dual-gate TCD can reliably reject artifacts from emboli. From a clinical standpoint, however, this approach has only a fair accuracy in differentiating between solid and gaseous emboli.
Key Words: HITS solid/gaseous emboli automated system dual-gate TCD wavelets
| Introduction |
|---|
|
|
|---|
Previous attempts at producing an automated system for classifying HITS into artifacts or emboli have failed to achieve the same level of sensitivity (embolus detection) and specificity (artifact rejection) as the human expert, considered the current "gold standard."1324 Without an automated embolic signal detection system that is as effective as the human expert in terms of sensitivity and specificity, embolus detection remains a time-consuming process, restricted to research studies and unsuitable for clinical practice.25 To separate artifacts from emboli, the best compromise is dual-gate TCD, which consists of tracing the embolus at 2 different depths in the same artery (time delay) (Figure 1). Lately, Cullinane et al21 have shown that the use of a frequency-filtering approach improves the differentiation of artifacts from emboli and that the performance of an online automated system is only slightly below the mean performance of that of a panel of human experts.21,24 Automated systems that can distinguish between solid and gaseous emboli are currently being developed.26,27
|
In the present study, we describe the evaluation of a new automated system for the classification of HITS into artifacts or solid or gaseous emboli, based on HITS time-frequency distribution and dual-gate TCD. The rationale for our approach is based on increasing evidence that the fast Fourier transform (FFT), universally used in Doppler devices for spectral analysis of Doppler signals, has notable drawbacks, especially in terms of its poor time-frequency resolution and the large variation in the Doppler spectrum in clinical practice.24,25,28 Consequently, several authors have argued that new time-frequency techniques that avoid the limitations of FFT are needed, especially in the field of embolus detection and classification.24,28,29 In addition, recent pilot studies have suggested that wavelet approaches20,26,27 are particularly well suited to the analysis of short-duration transient signals, such as HITS, and that these new techniques are better than FFT in describing embolic signals. On the basis of our previous pilot study,27 we have tested one such new approach on a large number of HITS in 2 different clinical situations, while a series of artifacts was produced in normal subjects.
| Subjects and Methods |
|---|
|
|
|---|
Role of Human Experts
The experienced observers offline analysis of HITS was taken as a standard reference, because the human expert is currently the "gold standard" for embolus detection.1324 In our study, the signals were reviewed by 2 observers, and for inclusion, both observers had to agree that the signal was a true embolic signal. The following definition for embolic signals was used: (1) typical visible, (2) short duration, (3) high-intensity signal, (4) within the Doppler spectrum, and (5) occurring at random within the cardiac cycle. In addition,6 the observers analyzed and assessed the time delay provided by the dual-gate Doppler to the signal of interest. For the differentiation between gaseous and solid emboli, the situation is different: because no expert can decide on the gaseous or solid nature of Doppler signals, we had to preselect patients to know the nature of embolic signals, solid emboli being obtained from high-grade symptomatic internal carotid artery (ICA) stenosis patients and gaseous emboli being collected during the diagnosis of a patent foramen ovale in stroke patients.
Patients and Subjects
Artifacts
Two hundred artifacts were recorded in 2 normal subjects (44±4 years old) who showed normal color Duplex flow imaging (CDFI) of their carotid arteries and MCAs. They did not have cardiac or cerebrovascular disease. In them, we performed a 6-minute series of provoked artifacts,16 including movement of the probe, coughing, sneezing, and head rotation.
Gaseous Emboli
Two hundred gaseous emboli were recorded in 4 patients admitted to our department (CHUV, Lausanne) for stroke associated with a patent foramen ovale. These 4 patients (49±7 years old) had normal carotid arteries and MCAs by both CDFI and MR angiography and had no thrombus lodged in the heart on transesophageal echocardiography. All were taking aspirin at the time of contrast TCD, which was performed 1 month after the stroke to evaluate the size of the patent foramen ovale. The contrast used was 1 mL of air vigorously mixed with 9 mL of saline solution and rapidly injected into an antecubital vein via a 3-way stopcock immediately after contrast preparation.30
Solid Emboli
A pure source of solid emboli was obtained from patients with high-grade symptomatic ICA stenosis without any other disclosed source of embolism. The emboli originating from ICA stenoses are all particulate by default, because no air is able to enter the arterial system.17,19,21,3133 Two hundred solid emboli were recorded in 24 patients (67±9 years old) admitted to the 5 neurology departments for stroke attributed to a severe ICA stenosis (>70% lumen narrowing) diagnosed by both CDFI and MR angiography, in whom no coexisting cause of stroke was found after a complete diagnostic examination, including transesophageal echocardiography. At the time of TCD embolus detection, they were taking aspirin.
All patients had given informed consent.
Automated HITS Analysis
In signal processing, one often reconstructs a signal as a sum of certain elementary functions, called the basis functions. The aim is to represent a fairly complex signal as the sum of just a few basis functions, so as to retain the most relevant parts of the signals and reject superfluous details. Usually, a set of nonredundant basis functions is chosen a priori. Pursuit algorithms are an attempt to free ourselves from this a priori choice and proceed by selecting the elementary functions from redundant dictionaries of time-frequency atoms.34,35 These techniques are sufficiently flexible to build compact representations of complex signals, such as music recordings or biomedical signals.
Selection of HITS
From the recordings, 600 pairs of signals were selected by 2 human experts (the use of the dual-gate technique means that a pair of signals is associated with every HITS). Because of our experimental setup (see the section on patients), it is clear that the selection consisted only of eliminating artifacts from the recordings of patients with circulating emboli. We took care to include a wide variety of signals, ranging from noisy to high-intensity signals. In quantitative terms, the relative intensity (also known as the relative power), expressed in decibels (dB), ranged from 2 to 34 (Table 1). We used the classic definition of relative intensity as 10 log10(mean power of the embolus part of the signal/mean power of the part of the signal without embolus), rather than 10 log10(peak power of the embolus part of the signal/mean power of the part of the signal without embolus). The classic definition is more robust. Its use explains why we have observed HITS intensity of <9 dB (Table 1).
|
Distinction Between Artifacts and Emboli
To distinguish between artifacts and emboli, we used 2 features: the time delay and the peak frequency. It is widely accepted that the time delay provides useful information but is not absolutely reliable.16,22,23,33 From our extensive experience with TCD signals, we have learned that artifacts usually have lower frequencies than emboli, and we therefore decided to use a novel time-frequency method to calculate the time delay and the main frequency of the signal pairs. For this, we chose to use the matching pursuit performed on a dictionary of Gabor functions. Matching pursuit is related to the now famous wavelet transform34,35 and provides a remarkably compact time-frequency description of a signal. It has a better time-frequency compromise than FFT, ie, it produces a better joint estimate of time and frequency. Gabor functions or atoms are localized sinusoidal waveforms with a symmetrical Gaussian envelope. We found that 4 Gabor atoms were sufficient to represent a signal (Figure 2). To characterize the frequency of artifacts or emboli, we used the frequency of the first Gabor atom. This is a way of estimating what is called the main frequency or peak frequency, ie, the frequency when the signal reaches its peak. For each pair of signals, we then calculated the average peak frequency by averaging over the 2 channels.
|
Distinction Between Gaseous and Solid Emboli
The distinction between gaseous and solid emboli is more challenging. The criteria used in a preliminary study with a small data set, namely the instantaneous frequency variation index and envelope variation index,27 did not produce sufficiently good results. We then considered 3 new features: the peak frequency (as above), the relative power (as above), and the envelope symmetry index; in all 3 cases, the value used was the average of the 2 signals forming a pair. The envelope was obtained with a moving window in the time domain. To get the envelope symmetry index, we calculated the average difference between the positive and negative parts of the envelope and then divided this number by the difference between the positive and negative peaks.
Data Analysis
The 600 pairs of signals were divided into 2 sets of 300, each consisting of 100 artifacts, 100 gaseous emboli, and 100 solid emboli. The first data set was used in the elaboration of our classification model, and the second was used to test the adequacy of our model; this division of a data set into a learning set and a validation set is standard statistical practice. The goal of this double-set approach is to prevent overfitting of the model to a "small world," the learning set. As the term implies, "overfitting" of a model is a sure recipe for a disappointing performance outside the learning set. Another way of understanding this important point is to realize that the purpose of our model is to predict the nature of future events, ie, events never seen before, so a prediction model must be tested on new examples, in our case, the validation test. The
values were determined to measure the level of agreement between the human experts and the automated Doppler system in terms of the classification of HITS into artifacts or gaseous or solid emboli. The
values were calculated with the formula
=(observed agreement-expected agreement)/(1-expected agreement).
| Results |
|---|
|
|
|---|
values for the learning set are shown in Table 2, and those for the validation set in Table 3. The latter table shows that 98% of artifacts were recognized as artifacts, which means that the specificity is 98% (Table 4). The sensitivity is 194/200=97% (Table 4). The positive predictive value (PPV) is 194/196=99%, where positive refers to the emboli, and the negative predictive value (NPV) is 98/104=94% (Table 4).
|
|
|
|
Distinction Between Gaseous and Solid Emboli
In general, gaseous emboli tend to have a higher relative power and a higher frequency. We thus divided the plane defined by the peak frequency and the relative power into 3 regions. The high-frequency (>1600 Hz) or high-relative-power (>18 dB) region was associated with gaseous emboli, and the low-frequency (<1600 Hz) and low-relative-power (<14 dB) region was associated with solid emboli. The nature of points falling into the third region was decided as follows. If the envelope asymmetry was high (>2%), the corresponding point was classified as belonging to a gaseous embolus, whereas if the asymmetry was low (<1%), it was classified as belonging to a solid embolus; points with an intermediate symmetry were classified as undefined. Again, the critical values (1600 Hz, 14 dB, 18 dB, 1%, and 2%) were chosen by human judgment over some reasonable range (see Figure 4 for peak frequency/relative power and <5% for envelope asymmetry) so as to achieve the best possible differentiation on the learning set before applying them in the validation set. On the validation set, as shown in Table 4, the sensitivity is 89% and the specificity 86%, where the sensitivity is the probability that a solid embolus is declared as such. Conditional on their being classified as emboli, the predictive value for solid emboli (PPV) is 89% and the predictive value for gaseous emboli (NPV) is 89% (for calculating these last 2 numbers, we regarded the outcome "undefined" as "gaseous"). The
values for the entire table are 0.84 with 89% agreement (P<0.0001), again on the validation set (Table 3). The results on the validation set, ie, on examples that were not used in building the model, are only slightly worse than those on the learning set (Table 2). This shows that the model is not overfitted to the examples of the learning set.
|
| Discussion |
|---|
|
|
|---|
value >0.8, P<0.0001).
|
To distinguish between artifacts and emboli, our automated system uses only 2 characteristic features, the peak frequency and the time delay (Figure 5), and achieved an excellent correct classification rate of 98% compared with human experts. With a sensitivity of 97% and a specificity of 98% for emboli, the level of artifact elimination obtained is on the order of that required if automated analysis is to replace the trained human observer in the detection of embolic signals. To distinguish between gaseous and solid emboli, our automated system uses 3 features: the peak frequency, the relative power, and the symmetry of the signal envelope (Figure 5). Given the large variability of TCD signals, it is clear that a combination of features is necessary, and this is all the more true for the distinction between gaseous and solid emboli. From a statistical perspective, however, excessive multiplication of features should be resisted,21 because it leads to overfitting. In this initial attempt at building an offline automated system for the classification of HITS into solid and gaseous emboli, we achieved correct classification rates of 87% for solid emboli and 83% for gaseous emboli in the validation set. To discriminate solid emboli from gaseous emboli, we obtained a sensitivity of 89% and a specificity of 86% for solid emboli. Although these results are promising, this performance in discriminating between solid and gaseous emboli can still be improved, but it seems evident that this latter task is more difficult than the separation of emboli from artifacts.17,27
To distinguish between gaseous and solid emboli, we introduced a novel feature, envelope symmetry. One may ask why the envelope of weak gaseous emboli should be less symmetrical than that of strong solid emboli ("weak" and "strong" refer to the intensity of the embolic signals). We offer the following explanation for this empirical observation, an example of which is shown in Figure 1. The attenuation of the incident and reflected ultrasound waves through the tissues is a complex process. If attenuation is strong, the operator will try to compensate for it by increasing the acoustic pressure, and if this is not small relative to the nondisturbed pressure of the medium, nonlinear propagation will occur, resulting in distortion of the pulsed waveforms, including envelope asymmetry.36,37 This distortion is likely to occur with weak emboli, whether gaseous or solid. Fortunately, gaseous emboli have a higher relative power than solid emboli, and overlap in relative power is therefore seen only between weak gaseous signals and strong solid signals, hence the relevance of the envelope symmetry in this overlap region.
In conclusion, our study shows that an automated system combining a time-frequency technique and dual-gate TCD and using only 4 features can classify HITS into artifacts or solid or gaseous emboli. It also demonstrates that the solid/gas classification is more challenging than the embolus/artifact classification.
Received May 21, 2001; revision received August 24, 2001; accepted August 28, 2001.
| References |
|---|
|
|
|---|
2.
Levi CR, OMalley HM, Fell G, Roberts AK, Hoare MC, Royle JP, Chan A, Beiles BC, Chambers BR, Bladin CF, Donnan GA. Transcranial Doppler detected cerebral microembolism following carotid endarterectomy: high microembolic signals loads predict postoperative cerebral ischemia. Brain. 1997; 120: 621629.
3.
Ackerstaff RG, Moons KG, van de Vlasakker CJ, Moll FL, Vermeulen FE, Algra A, Spencer MP. Association of intraoperative transcranial Doppler monitoring variables with stroke from carotid endarterectomy. Stroke. 2000; 31: 18171823.
4.
Gallagher EG, Pearson DT. Ultrasonic identification of sources of gaseous microemboli during open heart surgery. Thorax. 1973; 28: 295305.
5. Markus H. Doppler embolus detection: stroke treatment and prevention.In: Neurosonology. New York, NY: Mosby; 1996: 239251.
6.
Molloy J, Markus HS. Asymptomatic embolization predicts stroke and TIA risk in patients with carotid artery stenosis. Stroke. 1999; 30: 14401443.
7.
Siebler M, Nachtmann A, Sitzer M, Rose G, Kleischmidt A, Rademacher J, Steinmetz H. Cerebral microembolism and the risk of ischemia in asymptomatic high-grade internal carotid artery stenosis. Stroke. 1995; 26: 21842186.
8.
Valton L, Larrue V, Pavy le Traon A, Massabuau P, Geraud G. Microembolic signals and risk of early recurrence in patients with stroke or transient ischemic attack. Stroke. 1998; 29: 21252128.
9.
Sitzer M, Muller W, Siebler M, Hort W, Kniemeyer HW, Jancke L, Steinmetz H. Plaque ulceration and lumen thrombus are the main source of cerebral microemboli in high-grade internal carotid artery stenosis. Stroke. 1995; 26: 12311233.
10. Sitzer M, Siebler M, Steinmetz H. Silent emboli and their relation to clinical symptoms in extracranial carotid artery disease. Cerebrovasc Dis. 1995; 5: 121123.
11. Ries S, Schminke U, Daffertshofer M, Hennerici M. High intensity transient signals and carotid artery disease. Cerebrovasc Dis. 1995; 5: 124127.
12.
Babikian VL, Cantelmo NL. Cerebrovascular monitoring during carotid endarterectomy. Stroke. 2000; 31: 17991801.
13.
Siebler M, Rose G, Sitzer M, Bender A, Steinmetz H. Real-time identification of cerebral microemboli with US feature detection by a neural network. Radiology. 1994; 192: 739742.
14.
Van Zuilen EV, Mess WH, Jansen C, Van Der Tweel I, Van Gijn J, Ackerstaff RGA. Automatic embolus detection compared with human experts: a Doppler ultrasound study. Stroke. 1996; 27: 18401843.
15.
Markus HS, Ackerstaff R, Babikian V, Bladin C, Droste D, Grosset D, Levi C, Russel D, Siebler M, Tegeler C. Intercenter agreement in reading Doppler embolic signals: a multicenter international study. Stroke. 1997; 28: 13071310.
16.
Droste DW, Hagedorn G, Notzold A, Siemens HJ, Sievers HH, Kaps M. Bigated transcranial Doppler for the detection of clinically silent circulating emboli in normal persons and patients with prosthetic cardiac valves. Stroke. 1997; 28: 588592.
17.
Smith J, Evans DH, Bell PRF, Naylor R. A comparison of four methods for distinguishing Doppler signals from gaseous and particulate emboli. Stroke. 1998; 29: 11331138.
18.
Kemény V, Droste DW, Hermes S, Nabavi DG, Schulte-Altedorneburg G, Siebler M, Ringelstein EB. Automatic embolus detection by a neural network. Stroke. 1999; 30: 807810.
19. Markus HS, Reid G. Frequency filtering improves ultrasonic embolic signal detection. Ultrasound Med Biol. 1999; 25: 857860.[Medline] [Order article via Infotrieve]
20. Aydin N, Padayachee S, Markus HS. The use of the wavelet transform to describe embolic signals. Ultrasound Med Biol. 1999; 25: 953958.[Medline] [Order article via Infotrieve]
21.
Cullinane M, Reid G, Dittrich R, Kaposzta Z, Ackerstaff R, Babikian V, Droste DW, Grosset D, Siebler M, Valton L, Markus HS. Evaluation of new online automated embolic signal detection algorithm, including comparison with panel of international experts. Stroke. 2000; 31: 13351341.
22. Mess WH, Titulaer BM, Ackerstaff RG. Discrimination and characterization of emboli: old and new aspects.In: Klingelhöfer J, ed. New Trends in Cerebral Hemodynamics and Neurosonology. New York, NY: Elsevier Science; 1997: 355363.
23. Mess WH, Titulaer BM, Ackerstaff RGA. A new algorithm for on-line automated emboli detection based on the pseudo-Wigner distribution and the dual gate TCD technique. Ultrasound Med Biol. 2000; 26: 413418.[Medline] [Order article via Infotrieve]
24.
Markus H, Culliname M, Reid G. Improved automated detection of embolic signals using a novel frequency filtering approach. Stroke. 1999; 30: 16101615.
25.
Markus HS. Monitoring embolism in real time. Circulation. 2000; 102: 826828.
26. Brucher R, Russell D. Improved discrimination of microembolic events by combining dual frequency Doppler with wavelet transformation. Cerebrovasc Dis. 1999; 9: 55.Abstract.
27. Devuyst G, Vesin J-M, Despland P-A, Bogousslavsky J. The matching pursuit: a new method of characterizing microembolic signals? Ultrasound Med Biol. 2000; 6: 10511056.
28. Evans DH. Doppler signal analysis. Ultrasound Med Biol. 2000; S1: S13S15.
29.
Ringelstein EB, Droste DW, Babikian VL, Evans DH, Grosset DJ, Kaps M, Markus HS, Russell D, Siebler M. Consensus on microembolus detection by TCD. Stroke. 1998; 29: 725729.
30.
Teague SM, Sharma MK. Detection of paradoxical cerebral echo contrast embolization by transcranial Doppler ultrasound. Stroke. 1991; 22: 740745.
31. Georgiadis D, Mackay TG, Kelman AW, Grosset DG, Wheatley DJ, Lees KR. Differentiation between gaseous and formed embolic materials in vivo: application in prosthetic heart valve patients. Stroke. 1994; 25: 15591563.[Abstract]
32. Markus SH, Tegeler CH. Experimental aspects of high-intensity transient signals in the detection of emboli. J Clin Ultrasound. 1995; 23: 8187.[Medline] [Order article via Infotrieve]
33.
Molloy J, Markus HS. Multigated Doppler ultrasound in the detection of emboli in a flow model and embolic signals in patients. Stroke. 1996; 27: 15481552.
34. Mallat S, Zhang Z. Matching pursuit with time-frequency dictionaries. IEEE Trans Signal Processing. 1993; SP-41: 33973415.
35. Mallat S. A wavelet tour of signal processing. San Diego, Calif: Academic Press; 1998.
36. Evans DH, McDicken WN. Doppler Ultrasound: Physics, Instrumentation and Signal Processing. 2nd ed. New York, NY: Wiley; 2000.
37. Jensen JA. Estimation of Blood Velocities Using Ultrasound: A Signal Processing Approach. Cambridge, UK: Cambridge University Press; 1996.
This article has been cited by other articles:
![]() |
J. Lynch and J. Riley Microemboli detection on extracorporeal bypass circuitsa Perfusion, January 1, 2008; 23(1): 23 - 32. [Abstract] [PDF] |
||||
![]() |
M. Saqqur, N. Dean, M. Schebel, M. D. Hill, A. Salam, A. Shuaib, and A. M. Demchuk Improved Detection of Microbubble Signals Using Power M-Mode Doppler Stroke, January 1, 2004; 35 (1): e14 - e17. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Brucher and D. Russell Automatic Online Embolus Detection and Artifact Rejection With the First Multifrequency Transcranial Doppler Stroke, August 1, 2002; 33(8): 1969 - 1974. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Russell and R. Brucher Online Automatic Discrimination Between Solid and Gaseous Cerebral Microemboli With the First Multifrequency Transcranial Doppler Stroke, August 1, 2002; 33(8): 1975 - 1980. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2001 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |