on February 17, 2005
Published online before print February 17, 2005, doi: 10.1161/01.STR.0000157596.13234.95
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Submitted on August 12, 2004
From the Department of Psychology (J.T.L.W., B.M.), University of Stirling, Stirling, UK; Outcomes Research (A.Hareendran), Pfizer Ltd, Sandwich, UK; the Department of Medicine for the Elderly (A.Hendry), Wishaw General Hospital, Wishaw, UK; the Department of Medicine for the Elderly (J.P.), Victoria Infirmary, Glasgow, UK; and the Department of Neurology (I.B., K.W.M), Institute of Neurological Sciences, Glasgow, UK. * To whom correspondence should be addressed. E-mail: J.T.L.Wilson{at}stir.ac.uk.
Background and Purpose--The modified Rankin Scale (mRS) is widely used to assess global outcome after stroke. The aim of the study was to examine rater variability in assessing functional outcomes using the conventional mRS, and to investigate whether use of a structured interview (mRS-SI) reduced this variability. Methods--Inter-rater agreement was studied among raters from 3 stroke centers. Fifteen raters were recruited who were experienced in stroke care but came from a variety of professional backgrounds. Patients at least 6 months after stroke were first assessed using conventional mRS definitions. After completion of initial mRS assessments, raters underwent training in the use of a structured interview, and patients were re-assessed. In a separate component of the study, intrarater variability was studied using 2 raters who performed repeat assessments using the mRS and the mRS-SI. The design of the latter part of the study also allowed investigation of possible improvement in rater agreement caused by repetition of the assessments. Agreement was measured using the Results--Inter-rater reliability: Pairs of raters assessed a total of 113 patients on the mRS and mRS-SI. For the mRS, overall agreement between raters was 43% ( Conclusions--Although individual raters are consistent in their use of the mRS, inter-rater variability is nonetheless substantial. Rater variability on the mRS is thus particularly problematic for studies involving multiple raters. There was no evidence that improvement in inter-rater agreement occurred simply with repetition of the assessment. Use of a structured interview improves agreement between raters in the assessment of global outcome after stroke.
Revised on November 19, 2004
Accepted on December 2, 2004
Reliability of the Modified Rankin Scale Across Multiple Raters. Benefits of a Structured Interview
J. T. Lindsay Wilson PhD*;
statistic (unweighted and weighted using quadratic weights).=0.25, w=0.71), and for the structured interview overall agreement was 81% (=0.74, w=0.91). Agreement between raters was significantly greater on the mRS-SI than the mRS (P<0.001). Intrarater reliability: Repeatability of both the mRS and mRS-SI was excellent (=0.81, w 
0.94).
Key words: clinical trials • disability evaluation • outcome
This article has been cited by other articles:
 |
|
 |
|
  A. M. Naidech, R. K. Garg, S. Liebling, K. Levasseur, M. P. Macken, S. U. Schuele, and H. H. Batjer Anticonvulsant Use and Outcomes After Intracerebral Hemorrhage Stroke, December 1, 2009; 40(12): 3810 - 3815. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. J. Quinn, J. Dawson, M. R. Walters, and K. R. Lees Reliability of the Modified Rankin Scale: A Systematic Review Stroke, October 1, 2009; 40(10): 3393 - 3395. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Alexander, S. Poloyac, L. Hoffman, M. Gallek, Dianxu Ren, J. Balzer, A. Kassam, and Y. Conley Endothelial Nitric Oxide Synthase Tagging Single Nucleotide Polymorphisms and Recovery From Aneurysmal Subarachnoid Hemorrhage Biol Res Nurs, July 1, 2009; 11(1): 42 - 52. [Abstract] [PDF]
|
|
|
|
|
|
T. J. Quinn, J. Dawson, M. R. Walters, and K. R. Lees Exploring the Reliability of the Modified Rankin Scale Stroke, March 1, 2009; 40(3): 762 - 766. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. J. Quinn, J. Dawson, M. R. Walters, and K. R. Lees Variability in Modified Rankin Scoring Across a Large Cohort of International Observers Stroke, November 1, 2008; 39(11): 2975 - 2979. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. Ay, E. M. Arsava, M. Vangel, B. Oner, M. Zhu, O. Wu, A. Singhal, W. J. Koroshetz, and A. G. Sorensen Interexaminer Difference in Infarct Volume Measurements on MRI: A Source of Variance in Stroke Research Stroke, April 1, 2008; 39(4): 1171 - 1176. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. B. Slot, E. Berge, P. Dorman, S. Lewis, M. Dennis, P. Sandercock, and on behalf of the Oxfordshire Community Stroke Proj Impact of functional status at six months on long term survival in patients with ischaemic stroke: prospective cohort studies BMJ, February 16, 2008; 336(7640): 376 - 379. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. J. Quinn, J. Dawson, J. S. Lees, T.-P. Chang, M. R. Walters, K. R. Lees, and for the GAIN and VISTA Investigators Time Spent at Home Poststroke: "Home-Time" a Meaningful and Robust Outcome Measure for Stroke Trials Stroke, January 1, 2008; 39(1): 231 - 233. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. J. Quinn, J. Dawson, M. R. Walters, and K. R. Lees Reliability of the Modified Rankin Scale Stroke, November 1, 2007; 38(11): e144 - e144. [Full Text] [PDF]
|
|
|
|
|
|
T. J. Quinn, K. R. Lees, H.-G. Hardemark, J. Dawson, and M. R. Walters Initial Experience of a Digital Training Resource for Modified Rankin Scale Assessment in Clinical Trials Stroke, August 1, 2007; 38(8): 2257 - 2261. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
M. Eriksson, P. Appelros, B. Norrving, A. Terent, and B. Stegmayr Assessment of Functional Outcome in a National Quality Register for Acute Stroke: Can Simple Self-Reported Items Be Transformed Into the Modified Rankin Scale? Stroke, April 1, 2007; 38(4): 1384 - 1386. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. L. Banks and C. A. Marotta Outcomes Validity and Reliability of the Modified Rankin Scale: Implications for Stroke Clinical Trials: A Literature Review and Synthesis Stroke, March 1, 2007; 38(3): 1091 - 1096. [Abstract] [Full Text] [PDF]
|
|