This Article Full Text Full Text (PDF) All Versions of this Article: 36/4/777    most recent 01.STR.0000157596.13234.95v1 Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Request Permissions Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Wilson, J. T. L. Articles by Muir, K. W. Search for Related Content PubMed PubMed Citation Articles by Wilson, J. T. L. Articles by Muir, K. W. Related Collections Behavioral/psychosocial - stroke Behavioral Changes and Stroke

(Stroke. 2005;36:777.)
© 2005 American Heart Association, Inc.

Original Contributions

Reliability of the Modified Rankin Scale Across Multiple Raters

Benefits of a Structured Interview

J. T. Lindsay Wilson, PhD; Asha Hareendran, PhD; Anne Hendry, FRCP; Jan Potter, FRCP; Ian Bone, MD Keith W. Muir, MD

From the Department of Psychology (J.T.L.W., B.M.), University of Stirling, Stirling, UK; Outcomes Research (A.Hareendran), Pfizer Ltd, Sandwich, UK; the Department of Medicine for the Elderly (A.Hendry), Wishaw General Hospital, Wishaw, UK; the Department of Medicine for the Elderly (J.P.), Victoria Infirmary, Glasgow, UK; and the Department of Neurology (I.B., K.W.M), Institute of Neurological Sciences, Glasgow, UK.

Correspondence to J.T.L. Wilson, Department of Psychology, University of Stirling, Stirling FK9 4LA, UK. E-mail J.T.L.Wilson{at}stir.ac.uk

Background and Purpose— The modified Rankin Scale (mRS) is widely used to assess global outcome after stroke. The aim of the study was to examine rater variability in assessing functional outcomes using the conventional mRS, and to investigate whether use of a structured interview (mRS-SI) reduced this variability.

Methods— Inter-rater agreement was studied among raters from 3 stroke centers. Fifteen raters were recruited who were experienced in stroke care but came from a variety of professional backgrounds. Patients at least 6 months after stroke were first assessed using conventional mRS definitions. After completion of initial mRS assessments, raters underwent training in the use of a structured interview, and patients were re-assessed. In a separate component of the study, intrarater variability was studied using 2 raters who performed repeat assessments using the mRS and the mRS-SI. The design of the latter part of the study also allowed investigation of possible improvement in rater agreement caused by repetition of the assessments. Agreement was measured using the statistic (unweighted and weighted using quadratic weights).

Results— Inter-rater reliability: Pairs of raters assessed a total of 113 patients on the mRS and mRS-SI. For the mRS, overall agreement between raters was 43% (=0.25, _w=0.71), and for the structured interview overall agreement was 81% (=0.74, _w=0.91). Agreement between raters was significantly greater on the mRS-SI than the mRS (P<0.001). Intrarater reliability: Repeatability of both the mRS and mRS-SI was excellent (=0.81, _w 0.94).

Conclusions— Although individual raters are consistent in their use of the mRS, inter-rater variability is nonetheless substantial. Rater variability on the mRS is thus particularly problematic for studies involving multiple raters. There was no evidence that improvement in inter-rater agreement occurred simply with repetition of the assessment. Use of a structured interview improves agreement between raters in the assessment of global outcome after stroke.

Key Words: clinical trials • disability evaluation • outcome

This article has been cited by other articles:

				H. Ay, E. M. Arsava, M. Vangel, B. Oner, M. Zhu, O. Wu, A. Singhal, W. J. Koroshetz, and A. G. Sorensen Interexaminer Difference in Infarct Volume Measurements on MRI: A Source of Variance in Stroke Research Stroke, April 1, 2008; 39(4): 1171 - 1176. [Abstract] [Full Text] [PDF]

				K. B. Slot, E. Berge, P. Dorman, S. Lewis, M. Dennis, P. Sandercock, and on behalf of the Oxfordshire Community Stroke Proj Impact of functional status at six months on long term survival in patients with ischaemic stroke: prospective cohort studies BMJ, February 16, 2008; 336(7640): 376 - 379. [Abstract] [Full Text] [PDF]

				T. J. Quinn, J. Dawson, J. S. Lees, T.-P. Chang, M. R. Walters, K. R. Lees, and for the GAIN and VISTA Investigators Time Spent at Home Poststroke: "Home-Time" a Meaningful and Robust Outcome Measure for Stroke Trials Stroke, January 1, 2008; 39(1): 231 - 233. [Abstract] [Full Text] [PDF]

				T. J. Quinn, J. Dawson, M. R. Walters, and K. R. Lees Reliability of the Modified Rankin Scale Stroke, November 1, 2007; 38(11): e144 - e144. [Full Text] [PDF]

				T. J. Quinn, K. R. Lees, H.-G. Hardemark, J. Dawson, and M. R. Walters Initial Experience of a Digital Training Resource for Modified Rankin Scale Assessment in Clinical Trials Stroke, August 1, 2007; 38(8): 2257 - 2261. [Abstract] [Full Text] [PDF]

				M. Eriksson, P. Appelros, B. Norrving, A. Terent, and B. Stegmayr Assessment of Functional Outcome in a National Quality Register for Acute Stroke: Can Simple Self-Reported Items Be Transformed Into the Modified Rankin Scale? Stroke, April 1, 2007; 38(4): 1384 - 1386. [Abstract] [Full Text] [PDF]

				J. L. Banks and C. A. Marotta Outcomes Validity and Reliability of the Modified Rankin Scale: Implications for Stroke Clinical Trials: A Literature Review and Synthesis Stroke, March 1, 2007; 38(3): 1091 - 1096. [Abstract] [Full Text] [PDF]