| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Stroke. 2003;34:488.)
© 2003 American Heart Association, Inc.
Original Contributions |
From the Department of Preventive Medicine and Center on Aging, University of Kansas Medical Center, Kansas City, Kansas (S.-M.L., S.P.); Brooks Center for Rehabilitation Studies, University of Florida, and North Florida/South Georgia Department of Veteran Affairs, Gainesville, Fla (P.W.D.); and Rehabilitation Services Evaluation Unit, Rehabilitation Institute of Chicago, and Department of Physical Medicine and Rehabilitation, Northwestern University Medical School, Chicago, Ill (R.B.).
Correspondence to Sue-Min Lai, MS, MBA, PhD, Department of Preventive Medicine, University of Kansas Medical Center, 3901 Rainbow Blvd, Kansas City, KS 66160-7313. E-mail slai{at}kumc.edu
| Abstract |
|---|
|
|
|---|
Methods The SIS and SF-36 were administered to 278 stroke subjects
90 days after stroke. The SIS-16 and SF-36 Physical Functioning (PF) domain characterize physical function, whereas the SIS Participation and SF-36 Social Functioning (SF) domains characterize social function. Descriptive statistics and an analysis of variance were used to characterize physical and social functioning after stroke across levels of the modified Rankin Scale (MRS). Rasch analysis was used to compare the hierarchies and ranges of item difficulties in the SIS-16 and the SF-36 PF domains, as well as in the SIS Participation and the SF-36 SF domains.
Results Item hierarchies for the SIS-16 and SF-36 PF domain demonstrate that the SIS-16 contains less difficult items that could differentiate physical function among patients with more severe limitations. Compared with the SF-36 SF domain, the item hierarchy for the SIS Participation domain contained more difficult items that could differentiate social function among patients who were more active. In contrast to SIS-16, the SF-36 PF has major floor effects. In contrast to SIS Participation, the SF-36 SF domain has major ceiling effects. Both SIS-16 and SF-36 PF were able to discriminate well among the MRS levels of 0 to 1, 2, 3, and 4. The SIS Participation domain was also able to discriminate across the MRS levels of 0 to 1, 2, and 3 to 4. On the other hand, the SF-36 SF was similar among MRS levels 0, 1, and 2 and among MRS levels 2, 3, and 4.
Conclusions Both the physical and participation subscales of the SIS cover a wider range of item difficulty than their counterparts from the SF-36. Compared with the SF-36 PF and SF domains, the SIS-16 and SIS Participation are better able to capture physical functioning and social well-being in patients with strokes.
Key Words: outcome quality of life stroke stroke assessment
| Introduction |
|---|
|
|
|---|
A recently developed stroke-specific instrument, the Stroke Impact Scale (SIS), was designed to comprehensively assess stroke-related outcomes.1517 The SIS assesses 8 domains, including strength, hand function, ADL and instrumental ADL (IADL), mobility, emotion, memory, communication, and participation. This comprehensive instrument has been found to accurately assess recovery after stroke.1618 The SIS Participation domain and the SIS-16, which includes selected items from the Hand Function, ADL/IADL, and Mobility domains, can be used as stand-alone scales to assess social and physical function. The SIS-16 has previously been compared with the Barthel Index and found to be sensitive to functional differences across all levels of stroke severity as characterized by MRS levels 0 to 5.17 This study examined item difficulty and the response patterns of persons with stroke to the items in the physical and social function domains of both the SIS and SF-36 using the Rasch analytical technique.19 Also, rates of floor and ceiling effects (percentage of cases with minimum and maximum scores) and their ability to discriminate poststroke impairments in physical and social functioning among individuals with differing levels of stroke severity were investigated.
| Methods |
|---|
|
|
|---|
50 years of age. For the purposes of this study, the World Health Organization definition of stroke was used.20 A stroke was defined as symptoms of rapid onset and of vascular origin reflecting a focal disturbance of cerebral function, excluding isolated impairment of higher function, and these deficits must have persisted for >24 hours. In addition, patients could not have had any of the following exclusion criteria: stroke onset >28 days, stroke resulting from subarachnoid hemorrhage, deficits from a previous stroke, life expectancy of <1 year, New York Heart Association class IV heart failure, dwelling outside the community before the stroke, not independent in basic ADL before the stroke, residence >50 miles from participating hospital, progressive or severe neurological disease, amputation, obtunded, comatose, or unable to follow a 3-step command. At registry enrollment, patients demographics, stroke types, prior functional status, and stroke severity as judged by the National Institutes of Health Stroke Scale21 and the Barthel Index were assessed by interview and examination by research nurses and physical therapists using standardized questionnaires. Approximately 90 days after stroke, all registry participants were again assessed in terms of basic ADL and IADL using the Barthel Index and Lawton IADL.22 For the present investigation of the SIS and SF-36, all patients were assessed in their homes or nursing facilities by a masters level research associate between 90 and 120 days after stroke. Patients were assessed for stroke severity with the MRS, strength with the Motricity Index,23 and cognitive ability with the Folstein Mini-Mental State Examination.24 After these measures were gathered, patients were interviewed using the SIS and SF-36. The SIS domains, including SIS-16, have previously been shown to be valid, responsive, reliable (administered to patients as well as to proxies), and internally consistent within the domain.1517,25,26 The intraclass correlation coefficients were >0.90 between in-person and telephone interviews to patients and was 0.74 in the patient-proxy study.
For the present investigation, only the SIS-16 (16 items,) SIS Social Participation (8 items), the 10-item SF-36 Physical Functioning (PF), and the 2-item SF-36 Social Functioning (SF) are included in the analysis. These 4 domains have been transformed to a scale with total scores ranging from 0 to 100, with 0 being the worst possible score and 100 being the best possible score.15 As such, the floor effect is defined as a score of 0, indicating that patients are unable to perform physical functioning (or social functioning), and the ceiling effect is a score of 100, implying that patients are able to perform all physical activities (or best social functioning).
Items from the SF-36 PF10 and the SIS-16 and from the SF-36 SF and SIS Participation domains were cocalibrated to examine their functioning relative to each other. Cocalibration consists of the simultaneous analysis of the responses of persons in a single sample to items in
2 instruments. It is similar in procedure, but not in intent, to common item equating in which only a subset of items is common across >1 sample. In common item equating, the intent is to place total scores from each instrument on a common scale. In cocalibration, the intent is to place estimates of item difficulty for items in >1 instrument on a common scale. In the SIS/SF-36 analysis, cocalibration was used to examine the extent to which the items in the SIS-16 and SIS Participation domain covered the same or a wider range of difficulty than the items in the SF-36 PF and SF domains. Rasch analysis, using WINSTEPS version 3.31,27 was used to transform the ordinal raw scores into interval-level measures to illustrate the hierarchy of items in both instruments (now on a common scale) from least to most difficult to perform. In Rasch analysis, both person ability and item difficulty are expressed as a logit, the natural logarithm of the odds of a person being able to perform a particular task. The odds of a person being able to perform a particular task is the ratio of the probability of the person being able to perform the task to the probability of the person not being able to perform the task. Logits of greater magnitude represent increasing item difficulty.
Descriptive statistics were also used to summarize demographics, stroke characteristics, and stroke severity data. To evaluate the discriminant validity of PF and SF domains of the SIS and SF-36, mean scores for each domain to the groups (levels) defined by MRS were compared by use of analysis of variance with a Tukey-Kramer correction for multiple comparisons.28 We also assessed concurrent validity by examining the relationships between standard measures of stroke outcomes and these 4 domain scores, when appropriate, with Pearson correlation coefficients. SAS version 8.1 was used for all statistical analyses except cocalibration of item difficulties.
| Results |
|---|
|
|
|---|
|
Simultaneous maps of the item hierarchies for the SIS-16 and the SF-36 PF (Figure 1) demonstrate that both SIS-16 and SF-36 PF have a good spread of item difficulty, but only the SIS-16 has incorporated easier items (as indicated by smaller logit values) that are capable of measuring lower levels of physical functioning in patients with severe stroke. Similar simultaneous maps of the item hierarchies for the SIS Participation and the SF-36 SF domains (Figure 2) show that the SIS Participation domain has a good spread of item difficulty, whereas the SF-36 SF domain does not. The 2 items in the SF-36 subscale basically measures the same level of item difficulty, leading to severe ceiling effects and an inability to discriminate among more active patients.
|
|
The mean SIS-16 and SF-36 PF scores across 6 levels of the MRS (0 to 5) are shown in Table 2. The mean scores of the SIS-16 and SF-36 PF were similar between MRS levels 0 and 1 but were significantly different from all the other MRS groups, as were the differences between means of the remaining MRS groups with each other (P<0.025 for all, P<0.0001 for most pairwise comparisons). The mean SIS Participation and SF-36 SF scores across the 6 MRS levels are shown in Table 3. SIS Participation significantly differed across MRS 0 and 1, 2, and 3 and 4 levels. The associated significant values were P<0.0001 for all pairwise comparisons except 2 values of P=0.0021 and P=0.0184, which were observed between MRS 0 and 3 and MRS 2 and 3, respectively. On the other hand, mean scores of SF-36 SF were similar among MRS levels 0, 1, and 2, and among MRS levels 2, 3, and 4. Better discriminant validity in SIS-16 was descriptively shown by smaller variability within each level of the MRS. Both the SIS Participation and SF-36 SF domains have greater variability within each level of the MRS (Tables 2 and 3).
|
|
The percentages of cases with floor and ceiling effects (those at the minimum and maximum scores for each scale) are shown in Table 4. For example, the percentages of cases with floor and ceiling effects for SIS-16 were 0% and 4% compared with 9% and 1%, respectively, for the SF-36 PF domain. The SF-36 PF suffered floor effects in patients with MRS levels 4 and 5, and the SF-36 SF domain showed major ceiling effects.
|
| Discussion |
|---|
|
|
|---|
In a previous article,17 we demonstrated that the SIS-16 incorporated more complex activities such as performing heavy household chores (eg, vacuuming and doing laundry), walking fast, and walking 1 block to minimize ceiling effects. In the present analysis, we show that the SIS-16 also incorporated less difficult yet essential activities like bowel control and standing without losing balance. The inclusion of these items helps the SIS-16 avoid floor effects that have been observed when the SF-36 PF is used to assess stroke patients with severe disability. Because of the preponderance of items with high levels of difficulty, the SF-36 PF suffers significant floor effects when used with this type of sample. For example, 37% of the 52 subjects with an MRS of 4 scored 0 in their SF-36 PF assessment (Table 4).
Social functioning, as operationally defined in these instruments, is an integral part of assessing recovery after stroke. However, the SF-36 SF domain was unable to capture levels of social functioning in stroke patients because of the limited number of items (2 items) and the relative ease of endorsing these items, both of which have the same level of difficulty (Figure 2). These 2 items have a level of difficulty equivalent to the item "spiritual/religious activities" in the SIS Participation domain. In contrast, the SIS Participation domain includes 8 items that have wide ranges of activities to characterize patients social functioning.
This study also has some limitations. Our sample is potentially biased from the true population of all stroke survivors; it is hospital based and limited to persons who were previously community dwelling and independent in personal care. It is likely to underrepresent the most severe strokes because our eligibility criteria excluded persons who were obtunded or comatose at entry. The predominance of mild to moderate strokes in this study compared with the universe of stroke survivors is supported by our data; this study had a lower death rate than the Jorgenson et al31 population-based study in Copenhagen. Such population-based studies would be expected to provide the best estimates of recovery in the true population of stroke survivors, although they also suffer from detection limited to hospitalization. Thus, our results are least applicable to persons who have had very severe or very mild strokes; very severe strokes with coma were excluded, and very mild strokes for which patients were never hospitalized would not have been detected by our recruitment strategy. Our results are relevant to most stroke survivors, who would be hospitalized initially and enter institutional rehabilitation, skilled nursing units, or community-based programs such as day hospital or home health, typically 3 to 14 days after the initial event.
In summary, SIS-16 and the SIS Participation domain discriminated well across levels of the MRS. This study has demonstrated that SIS-16, in contrast to SF-36 PF, and SIS Participation, in contrast to SF-36 SF, can adequately assess patients physical and social well-being.
| Acknowledgments |
|---|
Received May 23, 2002; revision received August 22, 2002; accepted September 11, 2002.
| References |
|---|
|
|
|---|
2. Kim P, Warren S, Madill H, Hadley M. Quality of life of stroke survivors. Qual Life Res. 1999; 8: 293301.[CrossRef][Medline] [Order article via Infotrieve]
3. Clarke P, Marshall V, Black SE, Colantonio A. Well-being after stroke in Canadian seniors: finding from the Canadian Study of Health and Aging. Stroke. 2002; 33: 10161021.
4. Sturm JW, Dewey HM, Donnan GA, Macdonell RAL, McNeil JJ, Thrift AG. Handicap after stroke: how does it relate to disability, perception of recovery, and stroke subtype? The North East Melbourne Stroke Incidence Study (NEMESIS). Stroke. 2002; 33: 762768.
5. Mahoney FI, Barthel DW. Functional evaluation: the Barthel Index. Md State Med J. 1965; 14: 6165.[Medline] [Order article via Infotrieve]
6. van Swieten JC, Koudstaal PJ, Visser MC, Schouten HJA, van Gijn J. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988; 19: 604607.
7. Sulter G, Steen C, De Keyser J. Use of the Barthel Index and modified Rankin Scale in acute stroke trials. Stroke. 1999; 30: 15381541.
8. Duncan PW, Samsa G, Weinberger M, Goldstein L, Bonito A, Witter D, et al. Health status of individuals with mild stroke. Stroke. 1997; 28: 740745.
9. Schulz U, Baird T, Grant M, Bone I, Muir KW, Hareendran A, et al. Validity of a Structured Interview for the modified Rankin Scale: comparison with other stroke assessment scales. Stroke. 2001; 32: 333.
10. de Haan R, Aaronson N, Limburg M, Langton Hewer R, van Crevel H. Measuring quality of life in stroke. Stroke. 1993; 24: 320327.
11. Ware JE. SF-36 Health Survey: Manual and Interpretation Guide. Boston, Mass: Health Institute, New England Medical Center; 1993.
12. Anderson C, Laubscher S, Burns R. Validation of the Short-Form 36 (SF-36) Health Survey questionnaire among stroke patients. Stroke. 1996; 27: 18121816.
13. Dorman P, Slattery J, Farrell B, Dennis M, Sandercock P. Qualitative comparison of the reliability of health status assessments with the EuroQol and SF-36 questionnaires after stroke. Stroke. 1998; 29: 6368.
14. Hobart J, Williams LS, Moran K, Thompson AJ. Quality of life measurement after stroke: uses and abuses of the SF-36. Stroke. 2002; 33: 13481356.
15. Duncan PW, Wallace D, Lai SM, Johnson D, Embretson S, Laster LJ. The stroke impact scale version 2.0: evaluation of reliability, validity, and sensitivity to change. Stroke. 1999; 30: 21312140.[Medline] [Order article via Infotrieve]
16. Duncan PW, Bode RK, Lai SM, Perera S. Rasch analysis of a new stroke specific outcome scale: the Stroke Impact Scale. Arch Phys Med Rehabil. In press.
17. Duncan PW, Lai SM, Bode RK, Perera S, DeRosa JT. Stroke Impact Scale-16 (SIS-16): a brief instrument for assessing physical function in stroke patients. Neurology. 2003; 60: 291296.
18. Lai SM, Studenski S, Duncan PW, Perera S. Persisting consequences of stroke measured by the Stroke Impact Scale. Stroke. 2002; 33: 18401844.
19. Rasch G. Probabilistic Models for Some Intelligence and Attainment Tests. Copenhagen, Denmark: Danmarks Paedogogiske Institut; 1960.
20. World Health Organization. Proposal for the Multinational Monitoring of Trends and Determinants in Cardiovascular Disease (MONICA Project). Rev 1. Geneva, Switzerland; World Health Organization; 1983.WHO/MNC/82.1.
21. Brott T, Adams HP Jr, Olinger CP. Measurements of acute cerebral infarction: a clinical examination scale. Stroke. 1989; 20: 864870.
22. Lawton M, Brody E. Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist. 1969; 9: 179186.[Medline] [Order article via Infotrieve]
23. Collin C, Wade D. Assessing motor impairment after stroke: a pilot reliability study. J Neurol Neurosurg Psychiatry. 1990; 53: 576579.
24. Folstein M, Folstein S, McHugh P. Mini-Mental State: a practical guide for grading the cognitive state of patients for the clinician. J Psychiatry Res. 1975; 53: 189198.
25. Norvell J, Lai SM, Duncan PW, Tyler D. Reliability of telephone interview on proxy responses to the Stroke Impact Scale. Paper presented at: Annual Meeting of the American Geriatrics Society AFAR; May 2000; Nashville, Tenn.
26. Duncan PW, Lai SM, Tyler D, Perera S, Reker D, Studenski S. Evaluation of proxy responses to the Stroke Impact Scale. Stroke. 2002; 33: 25932599.
27. Wright BD, Linacre JM. Winsteps: A Rasch Model Computer Program. Version 3.31. Chicago, Ill: MESA Press; 2001.
28. Dunnett CW. Pairwise multiple comparisons in the homogeneous variance, unequal sample size case. J Am Stat Assoc. 1980; 75: 789795.[CrossRef]
29. Weimar C, Kurth T, Kraywinkel K, Wagner M, Busse O, Harberl RL, Diener HC. Assessment of functioning and disability after ischemic stroke. Stroke. 2002; 33: 20522059.
30. Hobart JC, Williams LS, Moran K, Thompson AJ. Quality of life measurement after stroke: uses and abuses of the SF-36. Stroke. 2002; 33: 13481356.
31. Jorgensen HS, Nakayama H, Raaschou HO, Olsen TS. Acute stroke: prognosis and a prediction of the effect of medical treatment on outcome and health care utilization. Neurology. 1997; 49: 13351342.
This article has been cited by other articles:
![]() |
A. A. Schmid, P. W. Duncan, S. Studenski, and L. Richards Response to Letter by Lord and Rochester Stroke, April 1, 2008; 39(4): e76 - e76. [Full Text] [PDF] |
||||
![]() |
K. J Sullivan, D. A Brown, T. Klassen, S. Mulroy, T. Ge, S. P Azen, C. J Winstein, and for the Physical Therapy Clinical Research Network Effects of Task-Specific Locomotor and Strength Training in Adults Who Were Ambulatory After Stroke: Results of the STEPS Randomized Clinical Trial Physical Therapy, December 1, 2007; 87(12): 1580 - 1602. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. J Sullivan Invited commentary on the movement continuum special series. Physical Therapy, July 1, 2007; 87(7): 928 - 930. [Full Text] [PDF] |
||||
![]() |
J. L. Banks and C. A. Marotta Outcomes Validity and Reliability of the Modified Rankin Scale: Implications for Stroke Clinical Trials: A Literature Review and Synthesis Stroke, March 1, 2007; 38(3): 1091 - 1096. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Ruttmann, J. Willeit, H. Ulmer, O. Chevtchik, D. Hofer, W. Poewe, G. Laufer, and L. C. Muller Neurological Outcome of Septic Cardioembolic Stroke After Infective Endocarditis Stroke, August 1, 2006; 37(8): 2094 - 2099. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. K. Kapral, J. Fang, M. D. Hill, F. Silver, J. Richards, C. Jaigobin, A. M. Cheung, and for the Investigators of the Registry of the Canad Sex Differences in Stroke Care and Outcomes: Results From the Registry of the Canadian Stroke Network Stroke, April 1, 2005; 36(4): 809 - 814. [Abstract] [Full Text] [PDF] |
||||
![]() |
A.-C. Jonsson, I. Lindgren, B. Hallstrom, B. Norrving, and A. Lindgren Determinants of Quality of Life in Stroke Survivors and Their Informal Caregivers Stroke, April 1, 2005; 36(4): 803 - 808. [Abstract] [Full Text] [PDF] |
||||
![]() |
I-P. Hsueh, W.-C. Wang, C.-F. Sheu, and C.-L. Hsieh Rasch Analysis of Combining Two Indices to Assess Comprehensive ADL Function in Stroke Patients Stroke, March 1, 2004; 35(3): 721 - 726. [Abstract] [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2003 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |