| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Stroke. 2007;38:1973.)
© 2007 American Heart Association, Inc.
Comments, Opinions, and Reviews |
From Stroke Clinical Research Unit, Department of Neurology (B.W., M.L., H.L., W.L., S.T., S.Z., Y.F.), Key Laboratory of Human Disease Biotherapy of the State and Ministry of Education (M.L.), West China Hospital, Sichuan University, China.
Correspondence to Professor Ming Liu, Stroke Clinical Research Unit, Department of Neurology, West China Hospital, Sichuan University, No 37, Guo Xue Xiang, Chengdu, 610041, Sichuan Province, PR China. E-mail wyplmh{at}hotmail.com
| Abstract |
|---|
|
|
|---|
Methods— We identified all TCPM that were listed in the Chinese National Essential Drug list of 2004 and those commonly used TCPM in current clinical practice for ischemic stroke. Fifty-nine TCPM were identified for further evaluation. We applied Cochrane systematic review methods. We searched for reports of randomized controlled trials and controlled clinical trials on any of the 59 TCPM for ischemic stroke comparing one TCPM with control. Primary outcomes included death or dependency at the end of follow-up (at least 3 months) and adverse events. Effects on neurological impairments were a secondary outcome.
Results— One-hundred ninety-one trials (19 338 patients) on 22 TCPM were available and included, of which 120 were definite or possible randomized controlled trials and 71 were controlled clinical trials. The methodological quality of included trials was generally "poor." Few trials reported methods of randomization. Three trials were randomized, double blind, and placebo-controlled. Primary outcomes: one trial on Puerarin and one trial on Shenmai injection assessed death or dependency at the end of long-term follow-up (at least 3 months) and found no statistically significant difference between 2 groups. The reported adverse events including allergic reaction, headache, nausea, diarrhea, bellyache, blood pressure change, and subcutaneous ecchymosis. Most of the adverse events were not severe. Secondary outcomes: analysis of the secondary outcome, "marked improvement in neurological deficit," showed apparent benefits of about the same magnitude for all the TCPM studied. Of the 22 TCPM, 8 drugs (Milk vetch, Mailuoning, Ginkgo biloba, Ligustrazine, Danshen agents, Xuesetong, Puerarin, and Acanthopanax) had relatively more studies and patient numbers.
Conclusions— There was insufficient good quality evidence on the effects of TCPM in ischemic stroke on the primary outcome (death or dependency). We considered the apparent benefit on neurological impairment was as likely to be attributable to bias from poor methodology as to a real treatment effect. However, because the agents assessed appeared potentially beneficial and nontoxic, further randomized controlled trials are justified. Eight drugs could be further research priorities.
Key Words: ischemic stroke meta-analysis systematic review traditional Chinese patent medicine
| Introduction |
|---|
|
|
|---|
Pharmacological studies indicated that some TCPM can be used for dilating the cardiocerebral vessels, suppressing the aggregation of platelets, improving circulation, removing blood stasis, protecting against ischemic reperfusion injury, and enhancing the tolerance of ischemic tissue to hypoxia.10 The most commonly used formulations of TCPM for stroke include injections and tablets. It is uncertain whether there is robust evidence on the clinical effects of TCPM and whether TCPM can be recommended either for routine treatment or considered as a standard treatment in the control group in clinical trials. We are aware of some relevant trials reported in China.
The aim of this study was therefore to assess the quantity, quality and overall strength of the evidence on TCPM in the treatment of ischemic stroke and to identify whether any TCPM appeared sufficiently promising to justify further large-scale randomized trials.
| Materials and Methods |
|---|
|
|
|---|
Study Identification
Six researchers (B.W., H.L., W.L., S.T., S.Z., Y.F.) independently identified studies on the 59 TCPM through searches of the Cochrane Library (issue 1, 2005), MEDLINE (1966 to March 2005), EMBASE (1980 to March 2005), and the China Biological Medicine Database (CBM-disc 1979 to March 2005), which is a database of Chinese biomedical research literature.
The reference lists of all relevant articles were searched for further studies and the pharmaceutical company manufacturing TCPM was contacted to identify further published and unpublished studies.
Study Selection
Definite or possible randomized controlled trials (RCTs; trials with clear method of randomization were defined as definite RCTs; those allegedly "RCTs" but with unknown methodology were defined as possible RCTs) and controlled clinical trials (studies evaluating a treatment that included an intervention and a control group, in which treatment allocation was not necessarily randomized) on any of the 59 TCPM for ischemic stroke comparing one TCPM with control were eligible.
Trials that included patients of any age or sex with ischemic stroke were eligible. Ischemic stroke was defined if the patients met the World Health Organization or the similar Chinese National criteria (demanding a CT/MRI scan as confirmation) of stroke11,12 and hemorrhagic stroke was excluded by CT/MRI scanning. Possible ischemic stroke in which CT/MRI were not performed were also to be included.
Trials evaluating any formulation of TCPM (injection or tablet) were included regardless of length of treatment period and dosage of treatment. The primary outcome measures were death or dependency at the end of long-term follow-up (at least 3 months) and adverse events. The secondary outcome measures were neurological deficit improvement after treatment, death from any cause, and quality of life.
Data Extraction
Six reviewers (B.W., H.L., W.L., S.T., S.Z., Y.F.) independently selected those trials that met the inclusion criteria and extracted details of randomization, allocation concealment, blinding, intention to treat analysis, number lost to follow-up, data on patients, methods, interventions, outcomes, and results. Missing data were obtained from the authors whenever possible.
Data Analysis
Heterogeneity between trials results was tested using a standard
2 test. The results were reported as Peto ORs with corresponding 95% CI for dichotomous data.13 If continuous data were available, weighted mean difference or standardized mean difference was to be calculated. The figures were obtained from the statistical software provided by the Cochrane Collaboration (RevMan 4.2).
| Results |
|---|
|
|
|---|
|
The age of patients in the included studies ranged from 18 to 90 years. Each trial included more males (56% to 72%) than females. All included trials applied standard western medicine diagnostic criteria for ischemic stroke although many trials used TCM criteria in addition. All studies reported the need for all patients to have had CT/MRI scanning to confirm the diagnosis.
The timing of the start of treatment after stroke onset was within 14 days in 118 trials. The patients received the treatment within 30 days of stroke onset in the remaining trials. The total duration of treatment with TCPM varied from 14 to 60 days.
Only 2 trials14,15 assessed ability of daily living through Barthel Index at 3 months or at 6 months after stroke onset. The remaining 189 trials measured neurological deficit, of which 2 trials used the European Stroke Scale, 1 trial the Canadian Neurological Scale, 186 trials the Modified Edinburgh-Scandinavian Stroke Scale, which was recommended at the Second and revised at the Fourth National Cerebrovascular Diseases Conference in China.12
Injection and tablet were studied in these included trials. Only 3 trials were randomized, double blind, placebo-controlled.16–18 The remaining 188 trials were designed comparing TCPM plus other treatment in trial group with the same other treatment in control group.
Study Quality
The methodological quality of most included trials was generally "poor." Few trials reported the method of randomization. Three trials were randomized, double blind, placebo-controlled.16–18 One trial on Puerarin14 and one trial on Shenmai15 had grade A level of adequate concealment of randomization because it allocated patients according to random numbers sealed in the opaque envelopes. The remaining 115 possible RCTs did not describe the methods of randomization. Four trials blinded the assessment of outcome.16–19 Only one trial on Puerarin reported the number of patients lost to follow-up and whether they had used intention to treat analysis.14 The remaining trials did not mention blinding or intention to treat analysis.
Primary Outcomes
Death or Dependency
One trial on Puerarin (98 patients) assessed death or dependency through Barthel Index at 6 months after stroke onset.14 Dependency was defined as Barthel Index scored 60 or less. There was no statistically significant difference between 2 groups (Peto OR, 0.86; 95% CI, 0.35 to 2.11). One trial on Shenmai (50 patients) injection also assessed death or dependency at 3 months after stroke onset.15 It recorded the mean score and the standard deviation before and after treatment by using Barthel Index. No statistically significant difference was found between the 2 groups (weighted mean difference, 11.58; 95% CI, –9.04 to 32.20). No deaths occurred in these 2 trials.
Adverse Events
No obvious adverse events occurred in 96 trials. Fifty-seven trials did not mention adverse events. Thirty-eight trials on 14 TCPM reported adverse events. It included allergic reaction, headache, nausea, diarrhea, bellyache, blood pressure change, and subcutaneous ecchymosis. Most of the adverse events were not severe. They disappeared without special treatment. The adverse events in trial group were higher than that of in control group on Ginkgo biloba (Peto OR, 5.70; 95% CI, 2.17 to 14.98), Ligustrazine (Peto OR, 2.30; 95% CI, 1.40 to 3.78), Mailuoning (Peto OR, 5.76; 95% CI, 1.40 to 23.74), Puerarin (Peto OR, 4.58; 95% CI, 1.78 to 11.80), Sheng Mai (Peto OR, 7.81; 95% CI, 1.07 to 56.97), and Xue Shuan Xin Mai Ling (Peto OR, 7.55; 95% CI, 1.03 to 55.24). There was no statistically significant difference between 2 groups on the remaining 8 TCPM (Figure 1).
|
Secondary Outcomes
Neurological Deficit Improvement After Treatment
One-hundred eighty-nine trials (19 190 patients) measured neurological deficit, of which 2 trials used the European Stroke Scale,20,21 1 trial the Canadian Neurological Scale,22 and 186 trials the Modified Edinburgh-Scandinavian Stroke Scale.12 The latter classifies effect on neurological deficit into six categories of "cure," "significant improvement," "improvement," "no improvement," "deterioration," and "death" in terms of the change of score before and after the treatment.12 To permit at least some overall analysis, we converted these outcomes into dichotomous data. We grouped together "cure," "significant improvement," and "improvement" as "effective" and "no improvement," "deterioration," and "death" as "ineffective." There was no significant heterogeneity among trials on every TCPM (P=0.18 to 0.97). Meta-analysis of these trials showed that the improvement of neurological deficit at the end of treatment between the 2 groups was significantly increased with TCPM except for Da Huo Luo (Peto OR, 1.37; 95% CI, 0.29 to 6.56). Eight drugs, Milk vetch, Mailuoning, Ligustrazine, Ginkgo biloba, Xuesetong, Danshen agents, Puerarin, and Acanthopanax, had more studies and >1000 patients, respectively (Figure 2).
|
Death From Any Cause
Deaths were reported in only 10 trials.14,23–31 No death occurred in the remaining trials. Two trials on Qingkailing injection reported death at the end of treatment,23,24 and treatment was associated with a substantial reduction in the odds of death, although the numbers of events was very small (Peto OR, 0.24; 95% CI, 0.06 to 0.91). No statistically significant difference was found between 2 groups in 1 trial on Acanthopanax (Peto OR, 0.13; 95% CI, 0.01 to 2.15),25 1 trial on Xuesetong injection (Peto OR, 0.13; 95% CI, 0.00 to 6.39),26 1 trial on Ligustrazine (Peto OR, 0.48; 95% CI, 0.05 to 4.74),27 2 trials on Compound Dan Shen injection (Peto OR, 0.63; 95% CI, 0.11 to 3.67),28,29 1 trial on Puerarin14 (Peto OR, 1.04; 95% CI, 0.25 to 4.41), and 2 trials on Milk vetch30,31 (Peto OR, 0.66; 95% CI, 0.11 to 3.83; Figure 3).
|
Quality of Life
No trial assessed quality of life.
| Discussion |
|---|
|
|
|---|
In this systematic review, there was very limited evidence from RCTs on the effect of TCPM on the primary efficacy outcome (death or dependency); there were just 2 truly randomized controlled trials (of Puerarin and Shenmai injection) that assessed long-term outcome after stroke onset. No definite conclusion can be drawn because of the limited numbers of patients in these 2 trials. Nonetheless, they demonstrate that TCPM can be evaluated with RCT. Furthermore, for the other primary outcome, adverse effects, the data were reassuring. Although adverse events in the intervention groups were generally higher than in controls for 6 TCPM, the adverse reactions were mild and needed no further treatment.
The most striking finding in this review was that the estimate of effect on the secondary outcome, "neurological deficit improvement," for all the TCPM was similar. This size of effect could be real or could just be attributable to bias, because lack of randomization or allocation concealment in a trial of a truly ineffective compound could yield similar estimates. Publication bias could also be a factor. However, because the methodological details for many of these trials were lacking, we tried to contact authors to get further information by telephone, letter, or e-mail. Unfortunately, we got replies from only 8 investigators (on trials of Milk vetch, Mailuoning, Dan Shen agents, Ginkgo biloba, and Puerarin). This extra data allowed us to reclassify 8 "allegedly" randomized studies as quasi-RCTs or controlled clinical trials. We inferred that the remaining trials were unlikely to be true RCT, although there was also no definite evidence to confirm this inference. Therefore, the results should be interpreted cautiously because of the unclear methodology of these trials. Similarly, no definite conclusion can be drawn from these trials. At this level of outcome measure, 8 drugs (Milk vetch, Mailuoning, Ginkgo biloba, Ligustrazine, Danshen agents, Xuesetong, Puerarin, and Acanthopanax) had relatively more studies and patients number (>1000 patients) and perhaps were worthy of further research.
Another striking finding was the very low case fatality rate. Death occurred in only 10 trials. There are a number of possible explanations: a truly low case fatality rate for stroke in China; the patients with severe stroke were not sent to hospitals (admission bias); a reluctance on the part of Chinese stroke physicians to include severe strokes in research studies (selection bias); or failure to report major outcome events (reporting bias) and only trials with low mortality rates submitted their results for publication (publication bias). We were unable to determine which of these factors pertained. We did not regard the evidence on the effects on death in the small number of trials that reported deaths as reliable. The observed positive results on death might be attributable to lack of true randomization and/or chance. However, based on these 2 uncertain findings on neurological deficit improvement and low case fatality rates, the general lack of reporting of methodology in these trials publication is not consistent with the CONSORT statement on the reporting of the results of randomized trials (http://www.consort-statement.org/); this requirement is being highlighted in many journals around the world but clearly needs additional emphasis in China.
Although some TCPM fell outside of our selection criteria, this review provided the current status on the evidence for the approved TCPM for ischemic stroke in China. The methodological quality of most included trials was generally "poor" because they did not describe their methods in detail. However, because we sought to report on overall quality, we did not arbitrarily simply exclude them. The limitations of most trials were as follows. In the majority, we could not be sure that treatment allocation was truly randomized and well concealed, or not (this could have led to selection bias); measures at the level of activities of daily living were our primary outcome and the preferred primary outcomes for stroke trials, yet most trials were focused on effects on neurological deficit and impairment (our secondary outcome measure); it was unclear whether most trials had used a blinded method to assess outcome; and, finally, some trials did not report the frequency of adverse events.
In conclusion, a definite conclusion on efficacy and adverse events associated with TCPM cannot be drawn from this review because of the unclear methodological quality of these identified trials. We found no evidence of a beneficial effect on the primary measure of efficacy to support the routine use of TCPM for ischemic stroke. However, the agents appeared to be relatively free of major adverse effects and if the apparently beneficial effects on neurological impairment were confirmed in methodologically rigorous trials, they would lead to many useful treatments for stroke being identified and used outside China. Therefore, further high-quality, large-scale, randomized trials of TCPM for stroke are justified to confirm or refute the effects reported here. We suggest Milk vetch, Mailuoning, Ginkgo biloba, Ligustrazine, Danshen agents, Xuesetong, Puerarin, and Acanthopanax had relatively more studies and patient numbers should be priorities for further research. Future trials should overcome the limitations of the trials presented in this review; in particular, they should assure adequate concealment of allocation, blinding of outcome assessors, and use functional outcome as the primary outcome measured at long-term follow-up. Reports of the trials should conform to the recommendations of the CONSORT statement. If such RCTs designed reliably confirmed that certain TCPM are beneficial for ischemic stroke, this would contribute greatly to the treatment of ischemic stroke worldwide. However, if RCTs did not provide evidence of benefit, this would challenge the whole concept of TCPM. We hope this article will stimulate proper evaluation of TCPM.
| Acknowledgments |
|---|
Sources of Funding
This research supported by Sichuan Provincial Administration Bureau for Traditional Chinese Medicine (grant 200203).
Disclosures
None.
Received September 15, 2006; revision received December 16, 2006; accepted December 22, 2006.
| References |
|---|
|
|
|---|
2. Sze FK-H, Yeung FF, Wong E, Lau J. Does Danshen improve disability after acute ischaemic stroke? Acta Neurol Scand. 2005; 111: 118–125.[CrossRef][Medline] [Order article via Infotrieve]
3. Zhang SH, Liu M, Asplund K, Li L. Acupuncture for Acute Stroke. Stroke. 2005; 36: 2327–2328.
4. Sze FK, Wong E, Or KK, Lau J, Woo J. Does acupuncture improve motor recovery after stroke? A meta-analysis of randomized controlled trials. Stroke. 2002; 33: 2604–2619.
5. Park J, Hopwood V, White AR, Ernst E. Effectiveness of acupuncture for stroke: a systematic review. J Neurol. 2001; 248: 558–563.[CrossRef][Medline] [Order article via Infotrieve]
6. Wu B, Liu M, Zhang S. Dan Shen agents for acute ischaemic stroke. The Cochrane Database of Systematic Reviews 2004, Issue 4. Art. No.: CD004295.pub2. DOI:10.1002/14651858.CD004295.pub2.
7. Zeng XR, Liu M, Yang YS, Li Y, Asplund K. Ginkgo Biloba for Acute Ischemic Stroke. Stroke. 2006; 37: 574–575.
8. Jin HM. Clinical uses and studies of the mechanism of Dan Shen. J Chin Med. 1978; 3: 180–183.
9. Adams HP Jr, Adams RJ, Brott T, del Zoppo GJ, Furlan A, Goldstein LB, Grubb RL, Higashida R, Kidwell C, Kwiatkowski TG, Marler JR, Hademenos GJ. Guidelines for the early management of patients with ischemic stroke: a scientific statement from the Stroke Council of the American Stroke Association. Stroke. 2003; 34: 1056–1083.
10. Liu QY, Song J, Chen KJ. Research Progress on Chinese Herbal Medicine for Ischemic Stroke. Chin J Integrated Traditional Western Med. 2000; 20: 309–312.
11. Hatano S. Experience from a multicenter stroke register: a preliminary report. Bull WHO. 1976; 54: 541–553.[Medline] [Order article via Infotrieve]
12. Chen QT. Diagnostic criteria and levels on and evaluation of neurological impairment for stroke patients. Chin J Neurol. 1996; 29: 376–383.
13. Antiplatelet Trialists Collaboration. Collaborative overview of randomized trials of antiplatelet therapy-1: prevention of death, myocardial infarction, and stroke by prolonged antiplatelet therapy in various categories of patients. BMJ. 1994; 308: 81–106.
14. Chao JX, Ye M. Clinical study on Purerain for acute ischemic stroke. Guangdong Med J. 2004; 14: 38–39.
15. Wang Y, Zou QY. Shenmai injection for cerebral infarction. Chin Traditional Med Liaoning. 2002; 29: 333.
16. Kang YL. Clinical research on Xiaoshuantongluo for cerebral infarction. J Ningxia Med. 2001; 23: 421–422.
17. Tang Q. Milk vetch for cerebral infarction. J Jiangsu University (Medicine Edition). 2003; 13: 366–367.
18. Zhang Y, Liu JL, Li F. Milk vetch and Ligustrazine for ischemic stroke. Chin J Info Traditional Chin Med. 2003; 10: 53.
19. Zhang YY, Chen RX. Milk vetch and Dan Shen injection for acute ischemic stroke. Chin J New Drugs Clin Remedies. 2000; 19: 30–32.
20. Liu HL, Zhang XH, Zhou XJ. Mailuoning and Ligustrazine for cerebral infarction. Clin Rehabil Tissue Engineering Res. 2002; 6: 421, 430.
21. Chen JH, Guo HB. Mailuoning and Naofukang for cerebral infarction. Henan Med Info. 2002; 10: 59–60.
22. Zhao LH. Milk vetch and Xuesetong injection for acute ischemic stroke. Nei Mongol J Traditional Chin Med. 2001; 20 (suppl): 7.
23. Yu BR, Liao YX. Qingkailing for cerebral infarction. Chin J Rehabil. 1999; 14: 102–103.
24. Huo Q. Qingkailing, Naofukang and Ligustrazine for acute ischemic stroke. Shaanxi J Traditional Chin Med. 2004; 25: 151–152.
25. Kuang XK, Zhang XG, Han JZ. Acanthopanax for cerebral infarction. Henan J Pract Nerv Dis. 2001; 4: 55–56.
26. Yuan L. Xuesetong injection for acute cerebral infarction. J Emerg Traditional Chin Med. 2003; 12: 133–145.
27. Gu YK, Ai QY, Zhang ZS. Defibrase and Ligustrazine for acute cerebral infarction. J Emerg Traditional Chin Med. 2002; 11: 249–250.
28. Pan CH, Chen NT, Huo JL. 187 cases of compound Dan Shen injection and snake venom for cerebral infarction. Chin Traditional Med Shangxi. 1992; 13: 157–158.
29. Geng ZB, Yao JY. Compound Dan Shen for acute ischemic stroke. Res Traditional Chin Med. 2000; 16: 30–31.
30. Tang YY, Jiang XJ. Milk vetch injection for acute cerebral infarction. Chin J Pract Chin Mod Med. 2000; 13: 1390–1391.
31. Zhou YS, Liu J. Therapeutic effects of Milk vetch injection for treatment of 60 cases of acute cerebral infarction. J Xinxiang Med Coll. 2003; 20: 357–358.
Related Article:
Stroke 2007 38: 1734-1736.
This article has been cited by other articles:
![]() |
B. Wu and M. Liu How to Improve the Quality of a Clinical Trial on Traditional Chinese Medicine for Stroke Stroke, November 1, 2009; 40(11): e641 - e642. [Full Text] [PDF] |
||||
![]() |
H. Goto, N. Satoh, Y. Hayashi, H. Hikiami, Y. Nagata, R. Obi, and Y. Shimada A Chinese Herbal Medicine, Tokishakuyakusan, Reduces the Worsening of Impairments and Independence After Stroke: A 1-year Randomized, Controlled Trial Evid. Based Complement. Altern. Med., March 30, 2009; (2009) nep026v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Chen, N. Venketasubramanian, R. N. Gan, C. Lambert, D. Picard, B. P.L. Chan, E. Chan, M. G. Bousser, and S. Xuemin Danqi Piantang Jiaonang (DJ), a Traditional Chinese Medicine, in Poststroke Recovery Stroke, March 1, 2009; 40(3): 859 - 863. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Bereczki The Seven Wonders of China in Stroke Therapy: Fact or Illusion? Stroke, November 1, 2007; 38(11): e142 - e142. [Full Text] [PDF] |
||||
![]() |
B. Wu, M. Liu, and Y. Fang Response to Letter by Bereczki Stroke, November 1, 2007; 38(11): e143 - e143. [Full Text] [PDF] |
||||
![]() |
V. L. Feigin Herbal Medicine in Stroke: Does It Have a Future? Stroke, June 1, 2007; 38(6): 1734 - 1736. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2007 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |