| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Stroke. 2004;35:147.)
© 2004 American Heart Association, Inc.
Original Contributions |
From the Department of Neurology, University of Virginia Health System (D.L.B., K.C.J., E.C.H.), and Department of Health Evaluation Sciences, University of Virginia (K.C.J., D.P.W.), Charlottesville.
Correspondence to Devin L. Brown, MD, TC 1920/0316, 1500 E Medical Center Dr, Ann Arbor, MI 48109. E-mail devinb{at}umich.edu
| Abstract |
|---|
|
|
|---|
Methods Data from 312 rtPA-treated patients from the NINDS trial were used to assess the ability of MNI to predict favorable outcome at 3 months as defined by a modified Rankin Scale score of 0 to 1. Next, a multivariable predictive model was developed for MNI within the same data set. Clinical variables examined included age, time to treatment (TTT), diabetes, pretreatment glucose, baseline National Institutes of Health Stroke Scale score, pretreatment blood pressure, history of atrial fibrillation, weight >100 kg, and a dense artery sign. Finally, this model was used to forecast into the placebo group of the NINDS trial to assess the uniqueness of the predictors in the rtPA-treated group.
Results MNI had a positive predictive value and negative predictive value of 0.70 for predicting favorable 3-month outcome. Only age [odds ratio (OR), 0.68; 95% confidence interval (CI), 0.47 to 0.99] and TTT (OR, 0.56; 95% CI, 0.34 to 0.91) appear to be independently associated with MNI. The model performed only moderately well (area under the receiver-operating characteristic curve, 0.66). Age (OR, 0.67; 95% CI, 0.45 to 0.99) but not TTT was associated with MNI in the placebo group.
Conclusions MNI may be a useful surrogate for thrombolytic activity and is predictive of favorable 3-month outcome. When rates of MNI in different populations of stroke patients treated with thrombolysis are compared, adjustments for age and TTT may be necessary.
Key Words: forecasting thrombolytic therapy tissue plasminogen activator treatment outcome
| Introduction |
|---|
|
|
|---|
5 points on the NIHSS) at 24 hours were observed significantly (P<0.05) more often in rtPA-treated patients than placebo-treated patients.5 This finding suggests that dramatic early improvement may be a marker of recanalization. The purpose of this study was 2-fold. First, the relationship between the occurrence of major neurological improvement within 24 hours and 3-month outcome was examined, reasoning that if the relationship is sufficiently strong, then dramatic early improvement could potentially be used as an early surrogate marker for clinical activity in new trials of thrombolytic therapy for stroke. Second, clinical predictors of major neurological improvement within 24 hours after rtPA treatment were sought. The hypotheses to be tested were (1) that clinical factors identified at baseline were significantly associated with major neurological improvement at 24 hours, (2) that these factors were different from the factors previously described as being associated with favorable 3-month outcome, and (3) that these factors would be unique to the rtPA-treated group. Although previous studies assessed predictors of deterioration in neurological status at 24 hours, previous data regarding predictors of favorable 24-hour outcome are limited.
| Subjects and Methods |
|---|
|
|
|---|
8 points or an NIHSS score of 0 at 24 hours. This was chosen on the basis of a secondary analysis by the NINDS investigators in which an 8-point difference in 24-hour NIHSS score was found to discriminate between the treatment and placebo groups without overlap in confidence intervals (CIs).5 The ability of MNI to predict favorable outcome at 3 months, as defined by a modified Rankin Scale (mRS) score of 0 or 1, was examined. This dichotomized mRS score was used as a primary outcome measure in the NINDS trial, defining patients who had no or minimal symptoms at follow-up (excellent outcome). A 2x2 table was used to examine the relationship between MNI and excellent functional outcome by calculating the positive and negative predictive values. Using the binomial distribution, we estimated 95% CIs around these values using S-Plus 6.1 (Insightful Corp, 2002).
Next, multivariable logistic regression techniques were used to design a model to predict MNI. Clinical independent variables examined were prespecified on the basis of the literature and clinical judgment of the authors and included age,6 time from onset to treatment,7 diabetes,8 pretreatment glucose,9 pretreatment mean arterial pressure (MAP),10 history of atrial fibrillation,11 weight >100 kg, and a dense artery sign on baseline CT scan.12,13 Age, time to treatment, glucose, and baseline NIHSS scores were used as continuous variables. Diabetes, atrial fibrillation, weight >100 kg, and the presence of a dense artery sign were used as dichotomized variables. To avoid assumptions of linearity for the 4 continuous variables, restricted cubic splines with 3 knots each were used.14 This yielded a total of 13 df in the model as a whole. The clinical variables to be examined were selected on the basis of a biologically or clinically plausible relationship with either recanalization or MNI. Using S-plus 6.1, we estimated odds ratios (ORs) with 95% CIs for each variable in the multivariable model. The CIs of the predictive variables were assessed with bootstrapping. This procedure was used to generate conservative estimates of the CIs by iteratively sampling from the original sample 150 times with replacement.14 If the CIs did not include 1, a statistically significant association was inferred.
The predictive value of the model as a whole was assessed by calculating the area under the receiver-operating characteristic curve. The role of each independent variable in predicting MNI in the placebo group was determined with the identical model used in the rtPA group. S-Plus 6.1 software was used for the analysis.
| Results |
|---|
|
|
|---|
2=42.65, P<0.0001). There were 63 patients who had a favorable outcome at 3 months without having achieved MNI. Their median NIHSS score at 24 hours was 4 (range, 1 to 19; 25th percentile, 2; 75th percentile, 7). Of the 311 rtPA-treated patients with available data on 24-hour outcome, 26 were missing a baseline variable used in the multivariable predictive model, leaving 285 patients for analysis. Eighty-nine of these patients (31%) had MNI.Table 1 shows the number of patients with each baseline variable and the number of patients for whom data on that variable was present. The only 2 variables independently and significantly related to MNI were age and time from onset to treatment (Table 2 and theFigure). Shorter time from onset to treatment and lower age were positively associated with MNI. The model in its entirety was only a moderate predictor of MNI in the rtPA-treated group with an area under the receiver-operating characteristic curve of 0.66.
|
|
|
There were 312 patients in the placebo group. Twelve were omitted because of missing data. Fifty-two (17%) had MNI. When the model was used to forecast into the placebo group, age, but not time from onset to treatment, was significantly related to MNI (Table 2). Baseline NIHSS score and glucose were also predictors of MNI in the placebo group.
| Discussion |
|---|
|
|
|---|
8-point improvement in NIHSS score or an NIHSS score of 0 at 24 hours. Overall, the model performed only moderately well in predicting MNI, suggesting the possibility that other variables not captured in our model may also affect outcome. Time from onset to treatment was not predictive of MNI in the placebo group, suggesting that the association in the treatment group may be biologically based. Age was related to MNI in the placebo group, suggesting that age is an important predictor not unique to rtPA treatment.
Our definition for MNI of
8-point improvement or NIHSS score of 0 at 24 hours was selected to reflect the type of dramatic early improvement that would be associated with arterial recanalization, as has been reported in angiographically controlled studies of both intravenous and intra-arterial thrombolytic therapy for stroke.3,15,16 Despite a statistically significant difference in median 24-hour NIHSS scores in part I of the NINDS trial, a 4-point improvement in 24-hour NIHSS score was not a sensitive enough discriminator to differentiate between the rtPA treatment and placebo groups because it was too easily achieved. Using an 8-point difference between baseline and 24-hour NIHSS scores in the NINDS data set, however, allows adequate discrimination between the placebo and rtPA treatment groups without overlap of CIs (P=0.007).5 The higher rate of MNI found in the rtPA-treated group likely reflects the higher recanalization rates in this group compared with the placebo group, suggesting that MNI can be used as a surrogate for recanalization. Others have used
10-point improvement at the end of tPA infusion to define dramatic improvement in other studies17,18; however, using the
8-point cutoff yields a higher number of subjects for analysis.5 Transcranial Doppler studies have also supported the association between early clinical improvement and early recanalization in patients with large-vessel occlusions treated with intravenous tPA.1821
In the current analysis, the presence of MNI, suggesting successful recanalization, was found to be a marker for favorable 3-month outcome. The positive and negative predictive values achieved support a predictive relationship between MNI and favorable 3-month outcome, which is consistent with the previous suggestion that NIHSS scores after 2 hours from stroke onset correlate with 3-month outcome.22 Additionally, a recent study demonstrated that early recanalization of the middle cerebral artery after thrombolysis, as demonstrated by transcranial Doppler, is associated with a favorable 3-month outcome.17
One of the predictor variables, baseline NIHSS score, was confounded in both the placebo- and rtPA-treated group for mathematical reasons. The dependent variable in the logistic regression predictive model, MNI, was determined by a calculation that included baseline NIHSS score, thereby creating a definition of the dependent variable that involved an independent variable. Therefore, although baseline NIHSS score appeared to be predictive of favorable outcome in the placebo group and had a similar OR in the rtPA group, these findings are difficult to interpret.
As hypothesized, clinical factors identified at baseline were associated with MNI in the rtPA group, specifically age and time to treatment. Earlier time to treatment with thrombolysis has been shown to be associated with a greater chance of favorable 3-month outcome.7 The association between time to treatment and MNI seems biologically plausible because earlier treatment should result in earlier recanalization and a greater salvage of tissue at risk of infarction.3 As would be expected if the effect were related to recanalization, the association between time to treatment and MNI was unique to the rtPA-treated group.
Age was predictive of MNI in both the rtPA- and placebo-treated groups. This relationship is likely a biological effect, as supported by previous findings that age is related to long-term outcome in patients with and without thrombolytic treatment.6,23
Glucose was found to be a predictor of MNI in the placebo group but not in the rtPA-treated group. Given the plausibility of this finding based on basic science research and previous clinical studies, this may represent a biological effect.9,2426 It may be that glucose has a differential effect on reperfused and nonreperfused tissue. If this was the case, there may be an effect of glucose in the placebo group that is not evident in the rtPA group given the higher rates of presumed recanalization in the latter group.
There were significant differences in the factors that predicted 24-hour favorable outcome in this study and those known to predict 3-month favorable outcome. Many of the factors known to predict 3-month outcome did not predict 24-hour outcome in this analysis. In the final multivariable model of the NINDS trial, treatment with rtPA, diabetes, age-byNIHSS score, admission MAPby-age, and thrombus or hypodensity/mass effect on baseline CT scan were independently associated with 3-month favorable outcome in both rtPA- and placebo-treated patients.23 Age and time from onset to treatment are therefore predictors of both MNI at 24 hours and 3-month favorable outcome in rtPA-treated patients.
This study has several limitations. The analysis was an exploratory post hoc analysis that was intended to be hypothesis generating. There were small numbers of subjects in each of the predictive variable subgroups, lowering the power to detect predictive relationships with MNI. Although we used 13 rather than 9 df, as would be suggested by the rule of 10 (which requires at least 10 least-frequent outcomes for each 1 df used in the model),14 this minimal excess was considered permissible, given the exploratory nature of this analysis. The use of restricted cubic splines, allowing the possibility of nonlinear relationships, increased explanatory power somewhat but not enough to compensate for the extra degrees of freedom. Given the limited degrees of freedom available for use, only a limited number of prespecified variables could be used. Because the overall model worked only moderately well as a predictor of MNI, it is possible that important variables that would have added to the value of the model were not included. In a larger data set, more variables could have been explored.
Given the few extra degrees of freedom used, it is possible that our model was overfit. Traditional validation techniques could validate the model as a whole but would not specifically validate the relationship between particular variables and MNI. Because the purpose of this exploratory analysis was to identify baseline characteristics that may affect 24-hour outcome, not to develop a model to be used for future predictions, we did not validate the model as a whole. In an attempt to avoid finding spurious associations, CIs were estimated very conservatively with bootstrapping, limiting assumptions made about the underlying distribution of our data. Additionally, the original model was forecasted into the placebo group to see whether the predictors of MNI found were unique to the rtPA-treated group. Despite these methods to reduce the likelihood of finding spurious relationships, these data need to be validated in an outside data set of patients treated with intravenous thrombolytics within 3 hours of stroke onset.
To estimate the thrombolytic activity of a novel agent, consideration of risk adjustment, especially in small data sets, is important. This study suggests that it may be necessary to adjust for age and time from stroke onset to treatment. Although this study did not demonstrate other baseline characteristics that predicted MNI with statistical significance, further studies may demonstrate other baseline characteristics for which adjustments should be made when different populations of stroke patients treated with intravenous thrombolytics within a 3-hour window are compared.
| Acknowledgments |
|---|
| Footnotes |
|---|
Received May 21, 2003; revision received August 1, 2003; accepted September 2, 2003.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
S. Prabhakaran and M. S.V. Elkind Vive la difference!: On potential sex differences in response to thrombolysis Neurology, September 30, 2008; 71(14): 1048 - 1049. [Full Text] [PDF] |
||||
![]() |
W. S. Smith, G. Sung, J. Saver, R. Budzik, G. Duckwiler, D. S. Liebeskind, H. L. Lutsep, M. M. Rymer, R. T. Higashida, S. Starkman, et al. Mechanical Thrombectomy for Acute Ischemic Stroke: Final Results of the Multi MERCI Trial Stroke, April 1, 2008; 39(4): 1205 - 1212. [Abstract] [Full Text] [PDF] |
||||
![]() |
R.I. Aviv, J. Mandelcorn, S. Chakraborty, D. Gladstone, S. Malham, G. Tomlinson, A.J. Fox, and S. Symons Alberta Stroke Program Early CT Scoring of CT Perfusion in Early Stroke Visualization and Assessment AJNR Am. J. Neuroradiol., November 1, 2007; 28(10): 1975 - 1980. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Mikulik, M. Ribo, M. D. Hill, J. C. Grotta, M. Malkoff, C. Molina, M. Rubiera, R. Delgado-Mederos, J. Alvarez-Sabin, A. V. Alexandrov, et al. Accuracy of Serial National Institutes of Health Stroke Scale Scores to Identify Artery Status in Acute Ischemic Stroke Circulation, May 22, 2007; 115(20): 2660 - 2665. [Abstract] [Full Text] [PDF] |
||||
![]() |
M.S.V. Elkind, S. Prabhakaran, J. Pittman, W. Koroshetz, M. Jacoby, K. C. Johnston, and for the GAIN Americas Investigators Sex as a predictor of outcomes in patients treated with thrombolysis for acute stroke Neurology, March 13, 2007; 68(11): 842 - 848. [Abstract] [Full Text] [PDF] |
||||
![]() |
O. Y. Bang, J. L. Saver, D. S. Liebeskind, S. Starkman, P. Villablanca, N. Salamon, B. Buck, L. Ali, L. Restrepo, F. Vinuela, et al. Cholesterol level and symptomatic hemorrhagic transformation after ischemic stroke thrombolysis Neurology, March 6, 2007; 68(10): 737 - 742. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. H. Shah, D. S. Liebeskind, J. L. Saver, S. Starkman, F. Vinuela, G. Duckwiler, R. Jahan, D. Kim, N. Sanossian, P. Vespa, et al. Influence of gender on outcomes after intra-arterial thrombolysis for acute ischemic stroke Neurology, June 13, 2006; 66(11): 1745 - 1746. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Bruno, C. Saha, and L. S. Williams Using Change in the National Institutes of Health Stroke Scale to Measure Treatment Effect in Acute Stroke Trials Stroke, March 1, 2006; 37(3): 920 - 921. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Yong, H.-C. Diener, M. Kaste, and J. Mau Characteristics of Blood Pressure Profiles as Predictors of Long-Term Outcome After Acute Ischemic Stroke Stroke, December 1, 2005; 36(12): 2619 - 2625. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Saposnik, S. Di Legge, F. Webster, and V. Hachinski Predictors of major neurologic improvement after thrombolysis in acute stroke Neurology, October 25, 2005; 65(8): 1169 - 1174. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Marti-Fabregas, M. Borrell, D. Cocho, R. Belvis, M. Castellanos, J. Montaner, J. Pagonabarraga, A. Aleu, L. Molina-Porcel, J. Diaz-Manera, et al. Hemostatic markers of recanalization in patients with ischemic stroke treated with rt-PA Neurology, August 9, 2005; 65(3): 366 - 370. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Ovbiagele and J. L. Saver The smoking-thrombolysis paradox and acute ischemic stroke Neurology, July 26, 2005; 65(2): 293 - 295. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. B. Goldstein and D. L. Simel Is This Patient Having a Stroke? JAMA, May 18, 2005; 293(19): 2391 - 2402. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. C. Haley Jr, P. D. Lyden, K. C. Johnston, T. M. Hemmen, and the TNK in Stroke Investigators A Pilot Dose-Escalation Safety Study of Tenecteplase in Acute Ischemic Stroke Stroke, March 1, 2005; 36(3): 607 - 612. [Abstract] [Full Text] [PDF] |
||||
![]() |
G. Saposnik, B. Young, B. Silver, S. Di Legge, F. Webster, V. Beletsky, V. Jain, Y. Nilanont, and V. Hachinski Lack of Improvement in Patients With Acute Stroke After Treatment With Thrombolytic Therapy: Predictors and Association With Outcome JAMA, October 20, 2004; 292(15): 1839 - 1844. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2004 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |