Donate Help Contact The AHA Sign In Home
American Heart Association
Stroke
Search: search_blue_button Advanced Search
Stroke. 2009;40:1803-1810
Published online before print March 12, 2009, doi: 10.1161/STROKEAHA.108.532820
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
40/5/1803    most recent
STROKEAHA.108.532820v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrowRequest Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Mandava, P.
Right arrow Articles by Kent, T. A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Mandava, P.
Right arrow Articles by Kent, T. A.
Right arrowPubmed/NCBI databases
Medline Plus Health Information
*Clinical Trials
*Stroke
Related Collections
Right arrow Acute Cerebral Infarction
Right arrow Emergency treatment of Stroke
Right arrow Neuroprotectors
Right arrow Thrombolysis
Right arrow Other Stroke Treatment - Medical
Right arrowRelated Article

(Stroke. 2009;40:1803.)
© 2009 American Heart Association, Inc.


Original Contributions

A Method to Determine Stroke Trial Success Using Multidimensional Pooled Control Functions

Pitchaiah Mandava, MD, PhD, MSEE Thomas A. Kent, MD

From the Michael E. DeBakey VA Medical Center Stroke Program and The Department of Neurology, Baylor College of Medicine, Houston, Texas.

Correspondence to Pitchaiah Mandava, MD, PhD, MSEE, MEDVAMC/Baylor College of Medicine, Department of Neurology, 2002 Holcombe Boulevard (127), Houston, TX 770303. E-mail pmandava{at}bcm.tmc.edu


*    Abstract
up arrowTop
*Abstract
down arrowIntroduction
down arrowMethods
down arrowResults
down arrowDiscussion
down arrowReferences
 
Background and Purpose— Many early phase trials in stroke have not been subsequently confirmed. Randomization balance in baseline factors that influence outcome are difficult to achieve and may be partly responsible for misleading early results. We hypothesized that comparison with an outcome function derived from a large number of pooled control arms would mitigate these randomization problems and provide a reliable predictor for decision-making before proceeding to later phase trials. We developed such a model and added a novel feature of generation of multidimensional 95% prediction surfaces by which individual studies could be compared. We performed a proof-of-principle study with published clinical trials, determining whether our method correctly identified known outcomes.

Methods— The control arms from all randomized, controlled trials for acute stroke with ≥10 subjects, including baseline National Institute of Health Stroke Scale, age, and 3-month outcomes published between 1994 and May 2008, were identified. A Matlab program (PPREDICTS) was written to generate outcome functions based on these parameters. Published treatment trials were compared with these 95% intervals to determine whether it successfully identified positive and negative trials.

Results— Models of mortality and functional outcome were successfully generated (mortality: R2=0.69; functional outcome, modified Rankin Scale 0 to 2: R2=0.81; both P<0.0001). The National Institute of Neurological Diseases and Stroke intravenous recombinant tissue plasminogen activator trial and 3 studies yet to be subjected to Phase III study had modified Rankin Scale 0 to 2 outcomes above the 95% prediction interval. Sixteen treatment arm outcomes fell within prediction surface bounds. This group included 2 major trials, Stroke-Acute Ischemic NXY Treatment and Abciximab Emergent Stroke Treatment Trial, that initially appeared promising but went on to negative Phase III results.

Conclusion— This proof-of-principle analysis confirmed all positive and negative clinical stroke trial results and identified some promising therapies. The use of a pooled standard treatment group function combined with statistical bounds may improve selection of early studies for further study. This method may be applicable to any condition in which baseline factors influence outcome and at any stage of the development process.


Key Words: acute stroke • cerebrovascular accident • clinical trials • drug trials • outcomes


*    Introduction
up arrowTop
up arrowAbstract
*Introduction
down arrowMethods
down arrowResults
down arrowDiscussion
down arrowReferences
 
Acute ischemic stroke remains a leading cause of death and disability. Therapeutic options to treat an acute stroke are limited and over 100 randomized clinical trials have taken place1 with only one US Food and Drug Administration-approved acute treatment resulting in intravenous recombinant tissue plasminogen activator that occurred over a decade ago.2 Several early clinical trials such as Abciximab Emergent Stroke Treatment Trial (AbESTT)3 and Stroke-Acute Ischemic NXY Treatment (SAINT) I4 were considered promising only to be proven later to be no better than placebo (AbESTT-II,5 SAINT-II6). This early apparent success and the failure of many trials may be due to a number of reasons.2,7,8 Among the reasons not widely considered include an imbalance in randomization of baseline factors that influence outcome9 or an unrepresentative sample in earlier trials.

We hypothesized that comparison to a pooled standard treatment function could minimize randomization errors that frequently occur in small series and provide a broad stroke population with which to compare outcomes. This method could also mitigate the need to compare individual noncontrolled trials with prior published case series despite dissimilar baseline characteristics.10

We previously used a pooled control sample in assessing benefit from the aggregate of intra-arterial therapy results by comparison with a 3-dimensional model of mortality, including age and baseline National Institutes of Health Stroke Scale (NIHSS) as predictors developed by Uchino et al.10,11 Here, we extend this prior approach by surveying a much larger number of studies. This new method differs in an important way by the addition of the novel feature of 3-dimensional 95% prediction intervals, thus providing a means to assess the likelihood a given study is different from the pooled sample. We test the feasibility of this analytic concept and the usefulness of comparing an individual study’s outcomes against the model predictions at comparable baseline variables. We analyzed how studies fared compared with our functions including those with large follow-up trials as well as early results yet to be confirmed.


*    Methods
up arrowTop
up arrowAbstract
up arrowIntroduction
*Methods
down arrowResults
down arrowDiscussion
down arrowReferences
 
The overall design of the model had 3 phases: (1) literature search and database creation; (2) model development; and (3) testing individual studies against the model.

Literature Search and Database Creation
Medline databases were searched for the words "acute ischemic (or ischaemic) stroke." All studies with at least 10 patients in each arm that included baseline median NIHSS and age and mortality and/or modified Rankin Score (mRS) outcomes at 3 months and beyond were selected for further scrutiny. Corresponding authors were contacted for clarification if complete information was not provided. Characteristics of each study were entered into a data structure in Matlab R2008a. This database is extendable to include characteristics currently not analyzed and more restrictive criteria could be used if desired to address specific stroke populations.

Model Development
To stabilize variance of data presented as proportions11 and to account for variability due to different number of subjects, Freeman-Tukey modification of the arc-sine square root transformation was first applied to the outcome data.12 The arc-sine square root transformation permits the generation of Gaussian function from proportions (eg, the proportion that achieved mRS 0 to 2).12

Minimization and Outlier Elimination
Nonlinear optimization functions (nlinfit and lsqcurvefit) supplied by Matlab were used for minimization of the function.13 Both functions use a modified Newton method called the "interior trust region approach" of minimization.13,14 As per recommendations, outliers were eliminated if the Studentized residual was >2.15 The minimization/outlier elimination routine was automatically iterated until no further outliers remained. The fitting and minimization routines were independently verified using Sigmaplot 9.0 to establish further confidence in custom Matlab functions.

Multidimensional Prediction Intervals
Efforts in the previous 2 steps produce a set of parameters associated with minimized function and generate an r2 and a probability value. Output from the previous 2 steps was used in a Matlab function to generate prediction intervals for the function and prediction intervals for an observation based on principles outlined in the Engineering Statistics Handbook.16 Prediction intervals take into account noise in a future observation as well as noise in generation of the minimized function and the variability of the data used to model the function. This concept was expanded from calculating prediction intervals at a single point16–18 to generating surfaces in 3 dimensions to represent surfaces that bound the model function on either side. The final program (Pooled Placebo REsponse DICtates Treatment Success [PPREDICTS]) calculates expected outcomes and ±95% prediction surfaces. For this analysis, we selected median NIHSS and mean age for the baseline variables. The percent that died and achieved an mRS 0 to 2 were the outcome measures.

Testing the Model
Outcomes of the treatment (and selected placebo) arms of all published randomized, controlled trials in which baseline NIHSS, age, and 3-month mortality and/or mRS 0 to 2 were compared against the model function and the ±95% surfaces generated by the second and third previously described steps and determined which studies lay within, below, or above the surfaces.


*    Results
up arrowTop
up arrowAbstract
up arrowIntroduction
up arrowMethods
*Results
down arrowDiscussion
down arrowReferences
 
Generation of Models
Twenty-eight studies representing 7136 subjects satisfied inclusion criteria and their control arms were used for mortality model development (Table). In generation of the control mortality arm function, 4 of 28 studies, representing 140 (2%) of 7136 patients, had Studentized residuals greater than the cutoff value and thus were eliminated in generating the minimized function. The function generated from the fit of the Freeman-Tukey transformed data (R2=0.69; P<0.0001) is plotted as a surface along with the ±95% prediction interval surfaces (supplemental Figure IA, available online at http://stroke.ahajournals.org). The mean NIHSS and age of the final group of studies was 12.2 and 67.5, respectively.


View this table:
[in this window]
[in a new window]

 
Table. Study Identification, Baseline Characteristics, and Difference in Treatment Arm Outcomes From Prediction Derived by Subtracting Actual Outcomes From the Predictive Model Calculated Outcomes


Figure 3532820
View larger version (26K):
[in this window]
[in a new window]

 
Figure I. Models and prediction surfaces. A, Predictive function for the percent of subjects that died based on baseline NIHSS and age (middle colored surface, r2=0.69; P<0.0001) obtained from pooled control arms of 28 randomized clinical trials (RCTs) along with ±95% prediction intervals. Color bar on the right indicates ranges of mortality; (B) predictive function for the percent of subjects that achieved an mRS 0 to 2 based on baseline NIHSS and age (middle colored surface, r2=0.81; P<0.0001) obtained from pooled control arms of 20 RCTs along with ±95% prediction intervals. Color bar indicates ranges of percent that achieved an mRS 0 to 2.

Of 28 studies used in the generation of the mortality model, 20 had complete mRS 0 to 2 data in the placebo/control arms. During minimization, one of the 20 studies representing 18 (0.3%) patients out of 5939 total had residuals above the cutoff point and was eliminated from consideration during function generation. The function (R2=0.81; P<0.0001) generated from the fit to the Freeman-Tukey transformed data is plotted as a surface along with the ±95% prediction interval surfaces (supplemental Figure IB). The mean NIHSS and age of this final function was 12.7 and 67.8, respectively.

Performance of the Randomized, Controlled Trial Treatment Arms Against the Predictive Functions
Mortality
Four treatment arm mortalities were higher than the +95% prediction interval (ATLANTIS27 [letter L], GAIN29 [letter N], Prolyse in Acute Cerebral Thromboembolism [PROACT-II39; letter Z], and PROACT41 [letter b]), indicating greater than expected mortality (Figure 1A). Twenty-three treatment arm mortalities were within the prediction interval bounds indicating that mortality was no different than predicted natural history. The Middle cerebral artery Embolism Local fibrinolytic intervention Trial (MELT34; letter U) had mortality below the –95% prediction interval, indicating lower than expected mortality.


Figure 1532820
View larger version (25K):
[in this window]
[in a new window]

 
Figure 1. Results for treatment arms of all studies plotted onto the predictive functions for mortality and functional outcome based on baseline NIHSS and age along with ±95% prediction interval surfaces. Color bar on the right indicates ranges of mortality. A, Percent that died in 28 treatment arms: letters A to Z and a and b identify the treatment series (see the Table). Studies L (ATLANTIS A), N (GAIN), Z (PROACT-II), and b (PROACT) had mortality outcomes higher (worse than) the +95% prediction interval surface and U (MELT) had mortality outcome lower (better than) the –95% prediction interval surface, whereas the remainder had outcomes within the ±95% interval surfaces; (B) percent that achieved mRS 0 to 2 of 20 treatment arms: studies H (NEST-1), U (MELT), V (NINDS), and X (CLOTBUST) had outcomes higher (better) than +95% prediction interval surface. Middle surface representing the predictive function has been made transparent to show studies below the function. Color bar indicates ranges of percent that achieved an mRS 0 to 2.

Functional Outcome
The outcomes in 16 studies were within the prediction bounds indicating no different from controls. Four studies, NeuroThera Effectiveness and Safety Trial-1 (NEST-123; H), MELT34 (U), National Institute of Neurological Diseases and Stroke (NINDS35; V), and CLOTBUST37 (X) had outcomes better than +95% prediction interval suggesting that their functional outcome was better than predicted from the pooled control treatment function (Figure 1B).

Trials Above +95% Prediction Interval: NINDS, NEST-1, CLOTBUST, and MELT
The percent of patients that achieved an mRS 0 to 2 in the NINDS treatment arm when plotted onto the prediction surfaces is above the +95% prediction interval (Figure 2A), consistent with the conclusion that intravenous recombinant tissue plasminogen activator within the 3-hour window is beneficial. When separately plotting NINDS Part 1 and Part 2, both are above the +95% prediction surface (supplemental Figure IIA). Had these been done sequentially, our method would have suggested that Part 2 should proceed. The NINDS trial generated some controversy because randomization was thought to have favored the treatment arm over the placebo arm.42 However, the percent of subjects in the NINDS placebo arm is near the prediction surface (Figure 2A), indicating that even in the presence of imbalances in strata of NIHSS, the overall result is representative of a broad population of patients with stroke.


Figure 2532820
View larger version (26K):
[in this window]
[in a new window]

 
Figure 2. The percent of subjects that achieved mRS 0 to 2 for the NINDS and SAINT-I and -II trials plotted onto the predictive function and ±95% prediction interval surfaces. A, NINDS intravenous recombinant tissue plasminogen activator treatment (blue dot) and placebo arm (red dot) outcomes. The percent that achieved an mRS 0 to 2 in the treatment arm exceeded the +95% confidence interval. B, Treatment and control arm outcomes of SAINT-I (blue dot and blue circle) and SAINT-II (red dot and red circle). Both treatment and placebo arms clustered around the control outcome function, indicating little chance for treatment trial success for this end point.


Figure 4532820
View larger version (39K):
[in this window]
[in a new window]

 
Figure II. Percent of subjects that achieved an mRS 0 to 2 for NINDS Parts 1 and II, NEST-1, CLOTBUST, and MELT plotted onto the predictive function and ±95% prediction interval surfaces. A, NINDS Part 1 (blue dot, treatment; blue circle, placebo) and Part 2 (red dot, treatment; red circle, placebo). B, NEST-1 treatment (blue dot) and control (red dot) arms. C, CLOTBUST treatment (blue dot) and control (red dot) arms. D, MELT treatment (blue dot) and control (red dot) arms.

Three trials yet to be subjected to Phase III results demonstrated outcomes above the +95% prediction interval of subjects that achieved an mRS 0 to 2, suggesting the probability that they would have improved outcomes compared with a large control group. The NEST-123 treatment arm used a low-energy laser to treat patients within 24 hours of an acute ischemic stroke. There were several baseline imbalances that mostly favored the placebo arm (ie, lower NIHSS and age). Despite these imbalances, when our model is applied to the data, the outcomes of the NEST-1 treatment arm is above the +95% prediction interval (supplemental Figure IIB) for a comparable control population. Note that the placebo arm outcome is below the prediction surface, suggesting it may not be representative of a broader population; hence, when replicated in a larger population, the strength of effect may be less in a follow-up larger study should the control arm be more representative.

CLOTBUST37 used transcranial ultrasound directed at a thrombus occluding a middle cerebral artery during administration of intravenous recombinant tissue plasminogen activator in a 3-hour treatment window. CLOTBUST treatment arm functional outcome is above the +95% prediction interval (supplemental Figure IIC) indicating it likely represents an effective treatment. Note that its control group, intravenous recombinant tissue plasminogen activator alone, is close but not above the interval. This different result from the clearly positive NINDS trial reflects a different population with a higher baseline NIHSS selected in CLOTBUST for large vessel occlusion. Interestingly, when the NINDS result was analyzed based on stratified NIHSS groups,43 it did not demonstrate a substantial treatment effect in the NIHSS range of 15 to 20, the group represented here. This result may indicate that adjunctive ultrasound is particularly beneficial in more severe stroke when a less robust treatment effect from intravenous recombinant tissue plasminogen activator may be expected. CLOTBUST was also positive using mRS 0 to 1 as the outcome measure (as used in the original trial)37 (data not shown).

MELT34 used intra-arterial urokinase within 6 hours of onset compared with a control population who received an intra-arterial catheter and treatment with heparin. Our result indicates that this treatment was effective using mRS 0 to 2 as the outcome compared with this broader population (supplemental Figure IID). Its control group functional outcome is on the prediction surface, indicating it is representative of a broader population. The original publication indicated that treatment was effective with mRS 0 to 1 as the outcome, which was also confirmed in our mRS 0 to 1 model (data not shown). It is interesting that MELT restricted its maximum dose of urokinase to 600 000 U, a dose associated with better outcome in a prior study from the same group44 and virtually identical with that identified independently as optimal in our prior systematic review of the best performing intra-arterial therapies in which we compared outcomes with an earlier pooled sample.10

Early and Subsequent Phase III Results: SAINT and AbESTT
SAINT-I,4 a large, early Phase III trial of NXY-059 in the 0- to 6-hour window, was thought to be positive in terms of a "shift" in mRS but negative in terms of those that achieved a mRS 0 to 2. In our mRS 0 to 2 model (Figure 2B), SAINT-I and its control group outcomes were nearly identical to the control arm function. SAINT-II,6 a larger follow-up to SAINT-I, had outcomes that fell slightly below the predictive function surface, whereas its control group fell on the surface suggesting that this trial, like its precursor, was representative of the population at large. Neither result provides any signal for therapeutic benefit with this end point. AbESTT,3 the precursor trial to AbESTT-II5 and AbESTT-2C5 (companion cohort of AbESTT-II), and its control group were nearly identical with the control function and would not have appeared promising (supplemental Figure III). The subsequent larger AbESTT-II and AbESTT-2C and their control group functional outcomes were also close to the model surface confirming this lack of benefit.


Figure 5532820
View larger version (34K):
[in this window]
[in a new window]

 
Figure III. Percent of subjects that achieved an mRS 0 to 2 for AbESTT (blue dot), AbESTT-II (red dot), and AbESTT-2C (purple dot); outcomes plotted onto prediction function. Open circles represent the control arm outcomes. The treatment arms are clustered around the predictive function indicating little difference from that expected in a control population.

PROACT
PROACT41 and PROACT-II,39 in which prourokinase administered through an arterial catheter was compared with intra-arterial heparin within a 6-hour treatment window in middle cerebral artery occlusion. The Phase III PROACT-II trial demonstrated a 15% improvement over control therapy that was positive by a stratified outcome method,39 but not by direct comparison of both groups (by our calculation using published data: P=0.07; Fisher test of proportions). Imbalances that generally favored the placebo arm relative to the treatment arm were also noted in PROACT II.39 In our functional outcome models, PROACT-II was nearly positive in terms of mRS 0 to 2 (supplemental Figure IVA) and PROACT was positive with respect to mRS 0 to 1 (data not shown). However, both arms showed higher than expected mortality (supplemental Figure IVB) and the control arm had a substantially lower percent that achieved a good outcome (supplemental Figure IVA) than predicted, supporting our earlier suspicion10 that the difference between treatment and control arms may have been inflated by a particularly bad outcome for the controls.


Figure 6532820
View larger version (22K):
[in this window]
[in a new window]

 
Figure IV. PROACT functional and mortality outcomes. A, PROACT-II treatment arm (blue dot) and control arm (blue circle) mRS 0 to 2 outcomes plotted onto the predictive function and ±95% prediction interval surfaces. PROACT did not report mRS 0 to 2 outcomes. Treatment arm came close to the +95% prediction surface, whereas the control arm was below the expected percent that achieved an mRS 0 to 2. B, PROACT treatment arm (red dot) and control arm (red circle) and PROACT-II treatment arm (blue dot) and control arm (blue circle) mortality outcomes plotted onto the morality function. All arms have a higher than expected mortality, particularly evident in PROACT control.


*    Discussion
up arrowTop
up arrowAbstract
up arrowIntroduction
up arrowMethods
up arrowResults
*Discussion
down arrowReferences
 
By comparison of individual outcomes with 95% prediction intervals, our method correctly identified all negative late Phase III trials and the positive US Food and Drug Administration-approved treatment, intravenous recombinant tissue plasminogen activator within 3 hours of stroke onset.2 Additionally, we identified 3 studies that performed better than predicted in terms of functional outcome and one that showed reduced mortality (MELT34). The strength of our approach, applying valid statistical methodology to a large and broad sample of patients with stroke, could in some circumstances be considered its weakness as well. If a particular therapy is directed at a restricted population such as basilar artery thrombosis, fewer subjects will be available to generate normative functions and it is likely that prediction intervals will be broader. In that case, confidence in the outcomes and likelihood of subsequent success needs to accommodate this uncertainty. However, the availability of large public databases with detailed patient characteristics could be a source for pooling this information. Note that although the factors considered here (baseline NIHSS and age) contributed considerable predictive value for outcomes, it is likely not possible to randomize for all variables with a potential effect on outcome.

Through analysis of the control arms of these series such as in PROACT, insights were gained into potential issues that may arise when the treatment is generalized to a larger population or to control arms representing best medicine without additional investigational treatments. In the case of PROACT, it is possible that use of an intra-arterial catheter infusing heparin and prohibition of early administration of aspirin in the control arm increased mortality, reduced the likelihood of a good functional outcome, and inflated the apparent benefit of addition of prourokinase. Although it is also possible that the specific population studied in this case, middle cerebral artery occlusion, has a higher than expected mortality and lower good outcomes than a broader population, numerous studies with a similar population are included in the control function and the majority of patients with NIHSS >10 have a large artery occlusion,45 suggesting this explanation is not likely.

We confirmed that mortality outcomes depend on baseline NIHSS and age, although to a somewhat less degree than in Uchino et al’s work because the r2 was not quite as robust. We were able to generate an excellent model for the relationship among baseline NIHSS, age, and functional outcome (r2=0.81). Our novel feature was the development of 95% bounding surfaces and the use of those surfaces to assess individual studies. The equations that generated these surfaces were intended to define the likelihood that a future observation will fall within these ranges.16

We validated the models by showing that trials that initially appeared promising and later proven to be neutral had outcomes within the bounding surfaces (AbESTT, AbESTT-II, SAINT-I, SAINT-II)3–6; indeed, the treatment results were nearly identical with the placebo function itself. Note that we do not address why these studies were initially considered successful on statistical grounds or why the later versions failed to show any beneficial effects,46,47 but rather indicate that use of our method would not have considered the early results as promising enough to take to further study. Certain studies (eg, AbESTT3) suggest that benefit occurred in selected subgroups based on initial NIHSS. In our opinion, subgroup analysis is likely even more vulnerable to imbalances because of their smaller size. Our method could be used to confirm this suspicion. Unfortunately, none of these studies reported the median NIHSS and age of their subgroups, information that we would need to test these results against our functions. We suggest that in the future these data be reported along with their outcomes for any subgroup analysis.

For this proof-of-principle study, we selected 2 end points that may not have been the primary end point for an individual study. Our method could be extended by considering other outcomes measures and methods of analysis48–51 as well as other independent variables such as gender, arterial territory, or treatment approaches provided there are sufficient series published to permit generation of models. Although it will not be possible to visualize beyond 3 dimensions, a user is primarily interested in whether or not an outcome of a trial at a particular point in n-dimensional independent variable space is between the +95% and –95% prediction values and therefore visualization is not critical. It is our intention to add subsequent studies to the model on an ongoing basis and test these additional factors and outcomes. This way any potential drift in outcomes of the control arms could be readily accounted for.

We envision 2 other potentials application of our method. The first is to compare an individual study, with its own confidence interval, on an ongoing basis with our functions as subjects are accumulated. This would be particularly useful to assess for early signals of increased mortality or benefit when randomization imbalances are most likely to occur. Another application is to estimate effect size. By comparison to a large and diverse "control" group, we can assess whether a particular control group was indeed representative of what is to be expected in a larger trial. In the control arm in NEST-1,23 43.9% achieved an mRS 0 to 2, whereas our method would have predicted 48.4%±10%. This example indicates that our method would suggest a more conservative estimate of effect size in the planning process for follow-up confirmation. We anticipate investigators will also use this feature to test early case series in the absence of a control arm to estimate effect size for subsequent randomized trials. In theory, our method could be extended to any condition in which baseline factors influence outcome in which imbalances in randomization may lead to erroneous conclusions.


*    Acknowledgments
 
Disclosures

P.M. and T.A.K. hold the copyright for PPREDICTS and a patent application has been submitted on their behalf for the method described here. PPREDICTS, Inc has been formed by the Baylor College of Medicine to commercialize these results.

Received July 31, 2008; revision received October 22, 2008; accepted November 4, 2008.


*    References
up arrowTop
up arrowAbstract
up arrowIntroduction
up arrowMethods
up arrowResults
up arrowDiscussion
*References
 
1. Kidwell CS, Liebeskind DS, Starkman S, Saver JL. Trends in acute ischemic stroke trials through the 20th century. Stroke. 2001; 32: 1349–1359.[Abstract/Free Full Text]

2. The National Institute of Neurological Disorders and Stroke rt-PA Stroke Study Group. Tissue plasminogen activator for acute ischemic stroke. N Engl J Med. 1995; 333: 1581–1587.[Abstract/Free Full Text]

3. Abciximab Emergent Stroke Treatment Trial (AbESTT) Investigators. Emergency administration of abciximab for treatment of patients with acute ischemic stroke: results of a randomized phase 2 trial. Stroke. 2005; 36: 880–890.[Abstract/Free Full Text]

4. Lees KR, Zivin JA, Ashwood T, Davalos A, Davis SM, Diener HC, Grotta J, Lyden P, Shuaib A, Hardemark HG, Wasiewski WW; Stroke-Acute Ischemic NXY Treatment (SAINT I) Trial Investigators. NXY-059 for acute ischemic stroke. N Engl J Med. 2006; 354: 588–600.[Abstract/Free Full Text]

5. Adams HP, Effron MB, Torner J, Davalos A, Frayne J, Teal P, Leclerc J, Oemer B, Padgett L, Barnathan ES, Hacke W; AbESTT-II Investigators. Emergency administration of abciximab for treatment of patients with acute ischemic stroke: results of an international Phase III trial: Abciximab in Emergency Treatment of Stroke Trial (AbESTT-II). Stroke. 2008; 39: 87–99.[Abstract/Free Full Text]

6. Shuaib A, Lees KR, Lyden P, Grotta J, Davalos A, Davis SM, Diener HC, Ashwood T, Wasiewski WW, Emeribe U. NXY-059 for the treatment of acute ischemic stroke. N Engl J Med. 2007; 357: 562–571.[Abstract/Free Full Text]

7. Labiche LA, Grotta JC. Pharmacologic modification of acute cerebral ischemia. In: Mohr JC, Choi DW, Grotta JC, Weir B, Wolff PA, eds. Stroke Pathophysiology, Diagnosis and Management, IV ed. New York: Elsevier; 2004: 1025–1058.

8. Grotta JC, Labiche LA. Combination of thrombolytic therapy with neuroprotectants. In: Lyden PD, ed. Thrombolytic Therapy for Acute Stroke, II ed. Totowa, NJ: Humana Press; 2005: 77–93.

9. Weimar C, König IR, Kraywinkel K, Ziegler A, Diener HC; German Stroke Study Collaboration. Age and National Institutes of Health Stroke Scale Score within 6 hours after onset are accurate predictors of outcome after cerebral ischemia: development and external validation of prognostic models. Stroke. 2004; 35: 158–162.[Abstract/Free Full Text]

10. Mandava P, Kent TA. Intra-arterial therapies for acute ischemic stroke. Neurology. 2007; 68: 2132–2139.[Abstract/Free Full Text]

11. Uchino K, Billheimer D, Cramer SC. Entry criteria and baseline characteristics predict outcome in acute stroke trials. Stroke. 2001; 32: 909–916.[Abstract/Free Full Text]

12. Zar JH. Biostatistical Analysis, III ed. Upper Saddle River, NJ: Prentice-Hall; 1996: 282–283.

13. Matlab Optimization Toolbox. Users Guide. Version 2. Natick, MA: The Mathworks Inc; 2000.

14. Beers KJ. Numerical Methods for Chemical Engineering. Applications in Matlab. Cambridge, UK: Cambridge University Press; 2007: 81–85, 225–230.

15. Pedhazhur EJ, Pedhazur LS. Measurement, design, and analysis: an integrated approach. Hillsdale, NJ: Lawrence Erlbaum Associates; 1991: 398–399.

16. NIST/SEMATECH e-Handbook of Statistical Methods. Available at: www.itl.nist.gov/div898/handbook/Chapter 4.1.3.2. Accessed February 1, 2008.

17. Bates DM, Watts DW. Nonlinear Regression Analysis and Its Applications. New York: Wiley; 1988: 6–13.

18. Dolan KD, Yang L, Trampel CP. Nonlinear regression technique to estimate kinetic parameters and confidence intervals in unsteady-state conduction-heated foods. J Food Eng. 2007; 80: 581–593.[CrossRef]

19. Safety study of tirilazad mesylate in patients with acute ischemic stroke (STIPAS). Stroke. 1994; 25: 418–423.[Abstract]

20. Rudolf J; HES in Acute Stroke Study Group. Hydroxyethyl starch for hypervolemic hemodilution in patients with acute ischemic stroke: a randomized, placebo-controlled phase II safety study. Cerebrovasc Dis. 2002; 14: 33–41.[CrossRef][Medline] [Order article via Infotrieve]

21. Lamonte MP, Nash ML, Wang DZ, Woolfenden AR, Schultz J, Hursting MJ, Brown PM; ARGIS-1 Investigators. Argatroban anticoagulation in patients with acute ischemic stroke (ARGIS-1): a randomized, placebo-controlled safety study. Stroke. 2004; 35: 1677–1682.[Abstract/Free Full Text]

22. The RANTTAS Investigators. A randomized trial of tirilazad mesylate in patients with acute stroke (RANTTAS). Stroke. 1996; 27: 1453–1458.[Abstract/Free Full Text]

23. Lampl Y, Zivin JA, Fisher M, Lew R, Welin L, Dahlof B, Borenstein P, Andersson B, Perez J, Caparo C, Ilic S, Oron U. Infrared laser therapy for ischemic stroke: a new treatment strategy: results of the NeuroThera Effectiveness and Safety Trial-1 (NEST-1). Stroke. 2007; 38: 1843–1849.[Abstract/Free Full Text]

24. Clark WM, Wissman S, Albers GW, Jhamandas JH, Madden KP, Hamilton S. Recombinant tissue-type plasminogen activator (alteplase) for ischemic stroke 3 to 5 hours after symptom onset: the ATLANTIS study: a randomized controlled trial. Alteplase Thrombolysis for Acute Noninterventional Therapy in Ischemic Stroke. JAMA. 1999; 282: 2019–2026.[Abstract/Free Full Text]

25. Davis SM, Donnan GA, Parsons MW, Levi C, Butcher KS, Peeters A, Barber PA, Bladin C, De Silva DA, Byrnes G, Chalk JB, Fink JN, Kimber TE, Schultz D, Hand PJ, Frayne J, Hankey G, Muir K, Gerraty R, Tress BM, Desmond PM; EPITHET Investigators. Effects of alteplase beyond 3 h after stroke in the Echoplanar Imaging Thrombolytic Evaluation Trial (EPITHET): a placebo-controlled randomised trial. Lancet Neurol. 2008; 7: 299–309.[CrossRef][Medline] [Order article via Infotrieve]

26. Hacke W, Kaste M, Fieschi C, von Kummer R, Davalos A, Meier D, Larrue V, Bluhmki E, Davis S, Donnan G, Schneider D, Diez-Tejedor E, Trouillas P. Randomized double-blind placebo-controlled trial of thrombolytic therapy with intravenous alteplase in acute ischaemic stroke (ECASS II). Second European–Australasian Acute Stroke Study Investigators. Lancet. 1998; 352: 1245–1251.[CrossRef][Medline] [Order article via Infotrieve]

27. Clark WM, Albers GW, Madden KP, Hamilton S. The rtPA (alteplase) 0- to 6-hour acute stroke trial, part A (A0276g): results of a double-blind, placebo-controlled, multicenter study: Thrombolytic Therapy in Acute Ischemic Stroke Study investigators. Stroke. 2000; 31: 811–816.[Abstract/Free Full Text]

28. Montaner J, Chacón P, Krupinski J, Rubio F, Millan M, Molina CA, Hereu P, Quintana M, Alvarez-Sabin J. Simvastatin in the acute phase of ischemic stroke: a safety and efficacy pilot trial. Eur J Neurol. 2008; 15: 82–90.[Medline] [Order article via Infotrieve]

29. Sacco RL, DeRosa JT, Haley EC, Levin B, Ordronneay P, Phillips SJ, Rundek T, Snipes RG, Thompson JL; Glycine Antagonist in Neuroprotection Americas Investigators. Glycine antagonist in neuroprotection for patients with acute stroke: GAIN Americas: a randomized controlled trial. JAMA. 2001; 285: 1719–1728.[Abstract/Free Full Text]

30. Lyden P, Jacoby M, Schim J, Albers G, Mazzeo P, Ashwood T, Nordlund A, Odergren T. The Clomethiazole Acute Stroke Study in tissue-type plasminogen activator-treated stroke (CLASS-T): final results. Neurology. 2001; 57: 1199–1205.[Abstract/Free Full Text]

31. Enlimomab Acute Stroke Trial Investigators. Use of anti-ICAM-1 therapy in ischemic stroke: results of the Enlimomab Acute Stroke Trial. Neurology. 2001; 57: 1428–1434.[Abstract/Free Full Text]

32. Clark WM, Coull BM, Karukin M, Hendin B, Kelley R, Rosing H, Zachariah S, Winograd M, Raps E, Walshe T, Singer S, Mettinger KL. Randomized trial of cervene, a kappa receptor-selective opioid antagonist, in acute ischemic stroke. J Stroke Cerebrovasc Dis. 1996; 6: 35–40.[CrossRef][Medline] [Order article via Infotrieve]

33. Clark WM, Wechsler LR, Sabounjian LA, Schwiderski UE; Citicholine Stroke Study Group. A phase III randomized efficacy trial of 2000 mg citicoline in acute ischemic stroke patients. Neurology. 2001; 57: 1595–1602.[Abstract/Free Full Text]

34. Ogawa A, Mori E, Minematsu K, Taki W, Takahashi A, Nemeto S, Miyamoto S, Sasaki M, Inoue T; MELT Japan Study Group. Randomized trial of intraarterial infusion of urokinase within 6 hours of middle cerebral artery stroke: the middle cerebral artery embolism local fibrinolytic intervention trial (MELT) Japan. Stroke. 2007; 38: 2633–2639.[Abstract/Free Full Text]

35. NINDS t-PA Stroke Study Data Set (on CD-ROM). Available at: www.ntis.gov. Data processed in Matlab. Accessed February 1, 2008.

36. Lyden P, Shuaib A, Ng K, Levin K, Atkinson RP, Rajput A, Wechsler L, Ashwood T, Claeson L, Odergren T, Salazar-Grueso E; CLASS-I/H/T Investigators. Clomethiazole Acute Stroke Study in ischemic stroke (CLASS-I): final results. Stroke. 2002; 33: 122–128.[Abstract/Free Full Text]

37. Alexandrov AV, Molina CA, Grotta JC, Garami Z, Ford SR, Alvarez-Sabin J, Montaner J, Saggur M, Demchuk AM, Moye LA, Hill MD, Wojner AJ; CLOTBUST Investigators. Ultrasound-enhanced systemic thrombolysis for acute ischemic stroke. N Engl J Med. 2004; 351: 2170–2178.[Abstract/Free Full Text]

38. Camerlingo M, Salvi P, Belloni G, Gamba T, Cesana BM, Mamoli A. Intravenous heparin started within the first 3 hours after onset of symptoms as a treatment for acute nonlacunar hemispheric cerebral infarctions. Stroke. 2005; 36: 2415–2420.[Abstract/Free Full Text]

39. Furlan AJ, Higashida R, Wechsler L, Gent M, Rowley H, Kase C, Pessin M, Ahuja A, Callahan F, Clark WM, Silver F, Rivera F. Intra-arterial prourokinase for acute ischemic stroke. The PROACT II study: a randomized controlled trial Prolyse in Acute Cerebral Thromboembolism. JAMA. 1999; 282: 2003–2011.[Abstract/Free Full Text]

40. Eggers J, König IR, Koch B, Händler G, Seidel G. Sonothrombolysis with transcranial color-coded sonography and recombinant tissue-type plasminogen activator in acute middle cerebral artery main stem occlusion: results from a randomized study. Stroke. 2008; 39: 1470–1475.[Abstract/Free Full Text]

41. del Zoppo GJ, Higashida RT, Furlan AJ, Pessin MS, Rowley HA, Gent M. PROACT: a phase II randomized trial of recombinant pro-urokinase by direct arterial delivery in acute middle cerebral artery stroke. PROACT Investigators Prolyse in Acute Cerebral Thromboembolism. Stroke. 1998; 29: 4–11.[Abstract/Free Full Text]

42. Ingall TJ, O'Fallon WM, Asplund K, Goldfrank LR, Hertzberg VS, Louis TA, Christianson TJ. Findings from the reanalysis of the NINDS tissue plasminogen activator for acute ischemic stroke treatment trial. Stroke. 2004; 35: 2418–2424.[Abstract/Free Full Text]

43. Grotta JC. The NINDS Stroke Study Group Response. BMJ. 2002. Available at: www.bmj.com/cgi/eletters/324/7339/723. Accessed February 1, 2008.

44. Ezuri M, Kagawa S. Selective and superselective infusion of urokinase for embolic stroke. Surg Neurol. 1992; 38: 353–358.[CrossRef][Medline] [Order article via Infotrieve]

45. Fischer U, Arnold M, Nedeltchev K, Brekenfeld C. NIHSS score and arteriographic findings in acute ischemic stroke. Stroke. 2005; 36: 2121–2125.[Abstract/Free Full Text]

46. Ginsberg MD. Life after Cerovive: a personal perspective on ischemic neuroprotection in the post-NXY-059 era. Stroke. 2007; 38: 1967–1972.[Abstract/Free Full Text]

47. Hess DC. NXY-059: a hopeful sign in the treatment of stroke. Stroke. 2006; 37: 2649–2650.[Free Full Text]

48. Adams HP, Leclerc JR, Bluhmki E, Clark W, Hansen MD, Hacke W. Measuring outcomes as a function of baseline severity of ischemic stroke. Cerebrovasc Dis. 2004; 18: 124–129.[CrossRef][Medline] [Order article via Infotrieve]

49. Saver JL. Novel end point analytic techniques and interpreting shifts across the entire range of outcome scales in acute stroke trials. Stroke. 2007; 38: 3055–3062.[Abstract/Free Full Text]

50. Fisher M, Hanley DF, Howard G, Jauch EC, Warach S; STAIR Group. Recommendations from the STAIR V Meeting on Acute Stroke Trials, Technology and Outcomes. Stroke. 2007; 38: 245–248.[Free Full Text]

51. Savitz SI, Lew R, Bluhmki E, Hacke W, Fisher M. Shift analysis versus dichotomization of the modified Rankin Scale outcome scores in the NINDS and ECASS-II trials. Stroke. 2007; 38: 3205–3212.[Abstract/Free Full Text]


Related Article:

To Phase 3 or Not to Phase 3?
Warren W. Wasiewski
Stroke 2009 40: 1553-1554. [Extract] [Full Text] [PDF]



This article has been cited by other articles:


Home page
StrokeHome page
J. L. Saver, G. W. Albers, B. Dunn, K. C. Johnston, M. Fisher, and for the STAIR VI Consortium
Stroke Therapy Academic Industry Roundtable (STAIR) Recommendations for Extended Window Acute Stroke Therapy Trials
Stroke, July 1, 2009; 40(7): 2594 - 2600.
[Abstract] [Full Text] [PDF]


Home page
StrokeHome page
W. W. Wasiewski
To Phase 3 or Not to Phase 3?
Stroke, May 1, 2009; 40(5): 1553 - 1554.
[Full Text] [PDF]


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow All Versions of this Article:
40/5/1803    most recent
STROKEAHA.108.532820v1
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrowRequest Permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Mandava, P.
Right arrow Articles by Kent, T. A.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Mandava, P.
Right arrow Articles by Kent, T. A.
Right arrowPubmed/NCBI databases
Medline Plus Health Information
*Clinical Trials
*Stroke
Related Collections
Right arrow Acute Cerebral Infarction
Right arrow Emergency treatment of Stroke
Right arrow Neuroprotectors
Right arrow Thrombolysis
Right arrow Other Stroke Treatment - Medical
Right arrowRelated Article