(Stroke. 2001;32:2867.)
© 2001 American Heart Association, Inc.
Original Contributions |
From the Department of Public Health Sciences, Kings College London, London, UK (K.T., C.D.A.W.); Department of Social Medicine, University of Bristol, Bristol, UK (J.A.C.S.); Elderly Care Unit, Guys Kings and St Thomas School of Medicine, St Thomas Hospital, London, UK (A.G.R.); and Department of Epidemiology, Johns Hopkins School of Hygiene and Public Health (T.A.G.), and Department of Neurology, Johns Hopkins School of Medicine (R.J.W.), Baltimore, Md.
Correspondence to Kate Tilling, Department of Public Health Sciences, Kings College London, 5th Floor, Capital House, 42 Weston St, London SE1 3QD, UK. E-mail kate.tilling{at}kcl.ac.uk
| Abstract |
|---|
|
|
|---|
Methods Data on functional recovery (Barthel Index) at 0, 2, 4, 6, and 12 months after stroke were collected prospectively for 299 stroke patients at 2 London hospitals. Multilevel models were used to model recovery trajectories, allowing for day-to-day and between-patient variation. The predictive performance of the model was validated with an independent cohort of 710 stroke patients.
Results Urinary incontinence, sex, prestroke disability, and dysarthria affected the level of outcome after stroke; age, dysphasia, and limb deficit also affected the rate of recovery. Applying this to the validation cohort, the average difference between predicted and observed Barthel Index was -0.4, with 90% limits of agreement from -7 to 6. Predicted Barthel Index lay within 3 points of the observed Barthel Index on 49% of occasions and improved to 69% when patients recovery histories were taken into account.
Conclusions The model predicts recovery at various stages of rehabilitation in ways that could improve clinical decision making. Predictions can be altered in light of observed recovery. This model is a potentially useful tool for comparing individual patients with average recovery trajectories. Patients at elevated risk could be identified and interventions initiated.
Key Words: activities of daily living disability evaluation models, statistical prognosis recovery of function
| Introduction |
|---|
|
|
|---|
Many studies of recovery after stroke35 have estimated the probability of a patient achieving a specific benchmarkeg, independence in a number of activities of daily livingby a given time pointeg, discharge from stroke rehabilitation.6 Such probabilities may vary according to treatment regimen or patient characteristics. This work has not yielded clinically useful algorithms because this approach does not allow for individually tailored prediction of recovery based on particular characteristics of the patient and important early markers of progress. In addition, no information is available on the actual level of recovery if the benchmark is not achieved.
It has been emphasized that normal patterns of recovery from stroke should be established as a guide to monitoring recovery of future patients.3,7 However, carefully designed multivariable statistical models needed for the development of these normal patterns of recovery have been lacking. In a previous article, we presented the statistical theory and justification for a new approach to modeling recovery over time.8 Here, we demonstrate its clinical utility.
Longitudinal outcome data require nonstandard statistical analyses because repeated measures on the same individual are not independent, which is an assumption of standard statistical models.9 The number of patients in the study may decrease over time, and any model needs to be based on all patients, not just those who survive until the end of the study. These issues can be addressed with multilevel models,10 which take into account the fact that the data are nested as observations (first level) within individuals (second level). The aim of this study was to demonstrate the clinical utility of our newly developed model that takes these statistical issues into account. This model can be used to make clinically useful predictions of the course of functional recovery based on patient characteristics and initial progress. We used data from 2 sourcesa clinical trial of a rehabilitation program and a second, independent observational cohortof stroke patients to examine the accuracy of these predictions.
| Subjects and Methods |
|---|
|
|
|---|
Patient characteristics, including age, sex, ethnicity (white/not white), and prestroke disability (defined as a Rankin Scale score of
3), were collected within 48 hours of randomization. Data on the severity of stroke had been recorded within 2 weeks of the stroke and were extracted from case notes. These included the presence of urinary incontinence, dysarthria, limb deficit (weakness or paralysis in any limb), swallowing deficit, dysphasia, and level of consciousness (with the Glasgow Coma Scale), all measured at the time of maximum impairment. All stroke patients, including both ischemic and hemorrhagic stroke patients, were eligible for inclusion.
Functional recovery was assessed at randomization and at
2, 4, 6, and 12 months after randomization with the Barthel Index (BI).12 The scoring of the BI is somewhat different in the United Kingdom than in the United States. Dependence in a given activity scores 0, with degrees of independence scoring 1, 2, or 3, depending on the activity13 (corresponding to scores of 5, 10, or 15 in the US BI). The total score has a minimum of 0 (completely dependent) and a maximum of 20 (completely independent).
As previously reported, there was no evidence for an effect of intervention on the main outcome for this trial (BI at 12 months after randomization).11 The mean age for this cohort was 70 years (SD=11.1 years); 165 (55%) were male; and 219 (73%) were white. The baseline characteristics of this cohort are shown in Table 1.
|
Statistical Methods
Multilevel growth curve models were used to estimate the effect on the BI of patient characteristics and stroke severity variables at baseline and how these effects varied over time. A multilevel growth curve model predicts the average recovery curve for patients with a given set of characteristics. It is assumed that each patient has his or her own true recovery curve and that these true recovery curves vary about the average recovery curve. Thus, the models allow recovery patterns to differ, even among patients with the same baseline characteristics. In addition, the observed outcomes for each patient will vary about their true recovery curve because of measurement error and day-to-day variation. In addition to estimating the average recovery curve and how this curve is related to patient characteristics, the multilevel growth curve also quantifies the variation between individual patient recovery curves and the degree of variability because of measurement error and day-to-day variation. Technical aspects of the models are given in detail elsewhere.8
The first model fitted included all the patient characteristics listed in the previous section, with subtype of stroke defined as ischemic, hemorrhagic, or ill defined/unclassified. Variables were selected for inclusion in the final model by use of backward selection; a variable was retained in the model if the probability value for its effect (using a likelihood ratio test) was <0.1. The same criterion was used to assess whether the effect of each variable changed with time since stroke. The model describes the relationship between BI and time since stroke and thus can be used to predict recovery at any time point up to 1 year after stroke.
The parameters of the model can be used to estimate the correlation between the outcomes for a particular patient at any 2 time points. The reason is that the model accounts for both measurement error and day-to-day variability and the degree to which patients recovery curves differ. Given the observed outcome for an individual at 1 time point, this correlation can be used to predict the outcome for that individual at a future time point.8 Thus, predictions of an individuals future pattern of recovery can be made after their characteristics at the time of stroke and their recovery history to the present are taken into account. This allows predictions for any individual to be modified in light of their observed recovery without any change to the underlying model.
Multilevel models were fitted by use of MLn,14 and all other statistical analyses were performed with Stata.15
Validation of Predictions
The accuracy and precision of the predictions from the model were evaluated by use of data from an observational cohort of 1140 stroke patients registered by the South London Stroke Register between January 1995 and December 1998. This cohort of patients had the same baseline covariates measured as the trial cohort. The South London Stroke Register aims to register all first strokes in a geographically defined population; thus, this unselected cohort is representative of the entire stroke population in this area.16 Comparison of this cohort and the Framingham cohort of 501 stroke patients17 showed them to have comparable mean age at stroke (74 years in the South London Stroke Register, 72 years in the Framingham cohort), proportion of men (48% versus 43%, respectively), and mean acute BI (9.6 versus 10.6).
Only those 710 patients with measurements of BI on
2 occasions after stroke were included in the validation exercise. The mean age of this cohort was 70 years (SD=13.5 years); 374 (53%) were male; and 546 (77%) were white. The baseline characteristics of this cohort are shown in Table 1. The model was used to produce predictions of BI, the first based only on patient characteristics at the time of stroke and the second additionally on patients BI scores measured at the previous visit. Limits of agreement between predicted and actual BI scores were calculated as a way to validate the clinical utility of this model.18
| Results |
|---|
|
|
|---|
|
|
Factors Associated With Recovery After Stroke
Presence of prestroke disability, urinary incontinence, dysarthria, and sex were associated with lower BI after stroke (Table 3), but their effects did not vary over time. For example, a stroke patient with dysarthria at baseline would be expected to have a BI
1 point lower than a stroke patient with no dysarthria at baseline at any time after stroke. The likely size of some of these differences could be modest at the individual level (eg, the effect of dysarthria could be as small as a mean decrease of 0.38 points on the BI) but potentially important at the population level.
|
There was no evidence of an effect of intervention (ie, intensity of rehabilitation therapy), ethnic group, or ischemic versus hemorrhagic stroke. The lack of a significant difference in outcome between hemorrhagic and ischemic strokes may be due to low power because there were few hemorrhagic strokes (9%).
The effects of age, dysphasia, and limb deficit at baseline on BI varied over time (Figure 2). On average, patients >80 years of age, with dysphasia or a limb deficit, had poorer functional recovery after stroke. In addition, patients >80 years of age tended to improve faster than younger patients initially but then to show a sharper long-term decline. Patients with dysphasia tended to improve faster initially, but after
12 weeks after stroke, the recovery curves for those with and without dysphasia appeared to be parallel. Those with no limb paralysis or weakness showed little recovery because of the "ceiling" effect of the BI (Figure 2). Those with limb deficit improved quickly initially but then showed a slightly steeper long-term decline than those with no limb deficit.
|
There were also clear differences in patterns of BI over time between patients who died during the study and those who survived. Patients who died showed a considerably more rapid decline in outcome than those who survived (Figure 2).
Prediction of Outcome Based on Baseline Patient Characteristics
Patient characteristics (age, sex, prestroke disability), together with the stroke severity measurements (taken at time of maximum clinical impairment), can be used to predict BI at any time up to 1 year after stroke. For example, the predicted BI at 8 weeks after stroke for a man <80 years of age with limb deficit, urinary incontinence, and dysarthria is 15.5. This information could be used to plan initial rehabilitation targets, make preliminary predictions about length of stay in hospital, and provide patients and their caregivers with some information on the likely pattern of recovery.
Prediction of Outcome Based Additionally on Recovery History
The model parameters can be used to derive correlation coefficients for the prediction of outcome at 1 time point with outcome measured at a previous time point. These can be used to alter the predictions for future outcome by taking into account the current observation of outcome. For example, suppose that a man <80 years of age with limb deficit, urinary incontinence, and dysarthria had a BI of 6 when he was assessed at 8 weeks after stroke (much lower than the predicted value of 15.5). This is taken into account in predictions of his outcome at 20 weeks after stroke, giving a predicted value of 8.9 instead of the prediction based on patient characteristics alone, which is 16.
Information such as this could be clinically useful to determine the likelihood of success in rehabilitation. For example, many patients are discharged from acute rehabilitation if they fail to meet rehabilitation goals. This model could be used to identify patients who are likely to have better outcome even if they demonstrate an early recovery plateau. These patients might otherwise not be eligible for continued access to rehabilitation services. On the other hand, the model could be used to identify patients who are unlikely to make good progress despite an absence of clear indicators of poor prognosis.
Details on the use of this model to predict values of the BI for individual patients are available from the authors. These calculations can also be made directly with a simple calculation that uses patient characteristics and the estimated model parameters. An Excel spreadsheet that does this is available from the authors at http://www.epi.bris.ac.uk/user/jons/stroke.
Validation of Prediction of Recovery After Stroke
We used an independent, unselected cohort of patients from a stroke registry in London to investigate the ability of the model to predict individual patients recovery patterns. BI was measured on a total of 1959 occasions for 710 patients: at 7 days (all patients), discharge from hospital (110 patients), and 3 months (692 patients) and 1 year (447 patients) after stroke. Sixty-five patients died before the end of the study. The mean BI over these 1959 occasions was 14.1 (SD=6.44). For predictions based only on patients baseline characteristics and their stroke severity (1959 separate patient occasions at the time points described above), the average predicted BI was 15.4 (SD=2.57), with a minimum predicted value of 6 and a maximum of 20. The average difference between the predicted and actual BI scores was 1.27 (SD=5.43), with 90% limits of agreement from -8 to 10. On 936 occasions (49%), the predicted BI was within 3 points of the measured BI.
Prediction was greatly improved when the measurement for a subject was also used to predict BI at the next occasion. There were 1242 measurements of BI with an immediately previous measurement (eg, a 1-year BI measurement with a 3-month BI measurement for the same individual) at hospital discharge and 3 months and 1 year after stroke. The average BI for these 1242 occasions was 15.5 (SD=5.62). The predicted BI was on average 15.1 (SD=4.43), with a minimum of 0 and a maximum of 20. For these 1242 occasions, the average difference between the predicted and actual BI scores was -0.4 (SD=3.84), with 90% limits of agreement from -7 to 6. Conditionally predicted BI was within 3 points of measured BI on 859 occasions (69%).
Prediction of Death After Stroke
Of the patients in the validation data set, 65 did not survive until 1 year after stroke. Because death tended to be preceded by a rapid decline in BI, a measured BI of >1 point below the predicted value was used to predict death before the next measurement occasion. Application to the validation data set (710 patients, 1242 measurements) yielded a sensitivity of 65% and specificity of 79% (42 of 65 measurements when the patient died before the next visit and 924 of 1177 when the patient survived).
| Discussion |
|---|
|
|
|---|
The predictions made on the basis of each individuals observed recovery history for the validation data set were of sufficient accuracy (69% of predictions lay within 3 points of the true value) to be of use in a clinical setting. This is especially important given that, at present, there is no way to make predictions of outcome over time since stroke or to include knowledge of previous outcome for a patient in predictions of future outcome. Rehabilitation health professionals could use this model to monitor the recovery of stroke patients. Initial predictions of recovery could be used to set rehabilitation targets. Actual recovery for each patient could be compared with that predicted by the model, and this information could be used to adjust the amount of rehabilitation therapy received. The comparison of actual and predicted BI scores could also be used to identify patients who were not recovering as well as expected. For these patients, additional intervention may be warranted.
This study has 2 important weaknesses. First, no comprehensive neurological scale such as the Scandinavian Stroke Scale19 or the NIH Stroke Scale20 was available for this cohort. However, many of the variables included in these scales, eg, level of consciousness, speech, and swallowing deficits, were also included here as covariates. The major prognostic factors for which data were unavailable in this study were orientation, gaze and visual field, sensory ability, and neglect. Despite omitting these factors, the model still showed reasonable predictive accuracy on an independent cohort of patients.
Second, the model was developed initially with a selected cohort of stroke patients drawn from a clinical trial of a rehabilitation program who met minimum mobility and self-care criteria. This was reflected in the predicted values for the independent cohort, which were too high (ie, predicted disability was too low) when based only on patient characteristics at the time of stroke. However, there was no evidence of bias in the predictions based additionally on recovery history, indicating that the selection of the development cohort affected mean outcome but not the pattern of recovery or the relationship between outcome at different time points. In addition, only the extremely severe strokes will not be represented in the model development (trial) cohort, and these stroke patients may be very different from most stroke patients. Any selection biases associated with the use of this cohort are likely to be less important given that more severely impaired patients do not normally make use of rehabilitation and thus the prognostic model may be of little relevance to them.
The model was developed with a selection of baseline characteristics, including stroke severity indicators. Many other factors may influence recovery, including stroke subtype, intensity and type of therapy, and psychosocial factors. However, the aim of this model was to use simple, easily measured variables to predict recovery to make the model as generalizable as possible. These methods could be extended to include variables of interest to specific groups by developing more complex models.
Although many studies have evaluated outcome after stroke, to the best of our knowledge, none has quantified patterns of recovery over time in this way. The general pattern of initial rapid recovery followed by a plateau that we have shown corroborates several other descriptive studies.3,2125 A trial of physiotherapy late after stroke also demonstrated a long-term decline in outcome after stroke, which could be reversed by physiotherapy intervention.26 We have extended previous work in this area by demonstrating the predictive value of a statistical model that takes into account individual characteristics and previous progress. This model allows the average functional recovery over the entire period up to 1 year after stroke to be quantified. Beyond this point, the BI should be supplemented with more appropriate measures of long-term recovery, which may be more sensitive to small improvements and to adaptations made by the patient to overcome any residual disabilities or impairments.
We have separated patient characteristics at the time of stroke into those affecting average level of outcome (sex, prestroke disability, dysarthria, urinary incontinence) and those related to recovery rate (age, dysphasia, limb deficit). We found no evidence of any association between stroke subtype and outcome, possibly because there were few hemorrhagic strokes (9%). Previous studies have shown that urinary incontinence,6,27 increasing age,2830 prestroke disability,31 and presence of motor impairment28 (all measured at the time of maximum impairment) are associated with a poorer outcome after stroke. However, estimation of the effect of characteristics on rate of recovery was not possible with simpler, cross-sectional methods.
As with any standard linear regression model, our model ignores the discrete nature of the BI. However, predicted scores can be rounded to the nearest whole number, and in our example, this made negligible difference to the predictive power and validity. In addition, the BI displays both "floor" and "ceiling" effects. For example, recovery may continue once a person has achieved a BI score of 20, but the scale will be unable to capture it (ceiling effect). This problem could be addressed by supplementing the BI with a measure of extended activities of daily living, eg, the Frenchay Activities Index.32
Our results have implications for the design and analysis of stroke intervention trials. Figure 3 shows a hypothetical graph of the effect of intervention on recovery. The end point of interest, the difference in outcome between the 2 arms of the trial, differs according to the time since stroke. For example, if outcome were compared only at 6 months, we would conclude that intervention had little or no effect, although in fact it improved recovery rate considerably. Interventions in stroke, eg, admission to a stroke unit or specialist rehabilitation programs, are likely to have time-varying effects that cannot be described adequately with cross-sectional methods. This time-varying effect may be amplified in older patients or those with limb deficit.
|
These methods allow predictions to be altered to take into account a patients recovery to date. Similar methods have been used to provide conditional centiles for fetal growth33 and for weight and height of children.34 With a larger data set, it would be possible to produce normal ranges for outcome after stroke. An evolving prediction of outcome could be made for each patient that is based on their characteristics but updated after each new outcome measurement. Progress of recovery falling outside the normal range might indicate further investigation and perhaps intervention. Thus, for the first time, it might be possible to construct individualized recovery curves that would be sufficiently sensitive and simple to use to be an important component of an integrated care pathway. These methods therefore have potential use as clinical tools for monitoring recovery of stroke patients.
| Acknowledgments |
|---|
Received March 29, 2001; revision received July 26, 2001; accepted August 17, 2001.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
H F Lingsma, D W J Dippel, S E Hoeks, E W Steyerberg, C L Franke, R J van Oostenbrugge, G de Jong, M L Simoons, W J M Scholte op Reimer, and The Netherlands Stroke Survey investigators Variation between hospitals in patient outcome after stroke is only partly explained by differences in quality of care: results from the Netherlands Stroke Survey J. Neurol. Neurosurg. Psychiatry, August 1, 2008; 79(8): 888 - 894. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. I. Dallas, S. Rone-Adams, J. L. Echternach, L. M. Brass, and D. M. Bravata Dependence in Prestroke Mobility Predicts Adverse Outcomes Among Patients With Acute Ischemic Stroke Stroke, August 1, 2008; 39(8): 2298 - 2303. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. De Wit, K. Putman, B. Schuback, A. Komarek, F. Angst, I. Baert, P. Berman, K. Bogaerts, N. Brinkmann, L. Connell, et al. Motor and Functional Recovery After Stroke: A Comparison of 4 European Rehabilitation Centers Stroke, July 1, 2007; 38(7): 2101 - 2107. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. T. Engelter, M. Gostynski, S. Papa, M. Frei, C. Born, V. Ajdacic-Gross, F. Gutzwiller, and P. A. Lyrer Epidemiology of Aphasia Attributable to First Ischemic Stroke: Incidence, Severity, Fluency, Etiology, and Thrombolysis Stroke, June 1, 2006; 37(6): 1379 - 1384. [Abstract] [Full Text] [PDF] |
||||
![]() |
T. Koyama, K. Matsumoto, T. Okuno, and K. Domen A new method for predicting functional recovery of stroke patients with hemiplegia: logarithmic modelling Clinical Rehabilitation, July 1, 2005; 19(7): 779 - 789. [Abstract] [PDF] |
||||
![]() |
K. Yamada, S. Mori, H. Nakamura, H. Ito, O. Kizu, K. Shiga, K. Yoshikawa, M. Makino, S. Yuen, T. Kubota, et al. Fiber-Tracking Method Reveals Sensorimotor Pathway Involvement in Stroke Patients Stroke, September 1, 2003; 34 (9): e159 - e162. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2001 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |