(Stroke. 1997;28:307-310.)
© 1997 American Heart Association, Inc.
Articles |
Reliability of the National Institutes of Health Stroke Scale
Extension to Non-Neurologists in the Context of a Clinical Trial
the Divisions of Neurology (L.B.G.) and General Internal Medicine (G.P.S.), Department of Medicine, the Department of Community and Family Medicine (Biometry) (G.P.S.), and the Center for Health Policy Research and Education (L.B.G., G.P.S.), Duke University; and the Division of Neurology (L.B.G.), Durham Department of Veterans Affairs Medical Center, Durham, NC.
Correspondence to Larry B. Goldstein, MD, Box 3651, Duke University Medical Center, Durham, NC 27710. E-mail golds004@mc.duke.edu.
Background and Purpose The reliability of the National Institutes of Health Stroke Scale (NIHSS) has been established through testing its use in live and videotaped patients. This reliability testing has primarily focused on the use of the scale by neurologists. We sought to determine the reliability of the NIHSS as used by non-neurologists in the context of a clinical trial.
Methods In anticipation of the initiation of a randomized trial of a new therapy for patients with acute ischemic stroke, 30 physician investigators (30% of whom were not neurologists) and 29 non-physician study coordinators were trained in the use of the NIHSS at an informational and training conference using standardized videotaped patient examinations. A series of 4 patients were rated initially. After 3 months, the same 4 patients were rerated, providing a measure of intraobserver reliability. An additional series of 4 new patients were also rated after 3 months and, with the initial 4 ratings, provided data for assessment of interobserver reliability.
Results Overall, 28% of the raters had previous experience with the NIHSS, and 22% had previously used the videotapes as used in the present trial. The coefficients of determination (r2) were each greater than .95 when the means of the two ratings of the same 4 cases were compared between (1) neurologists and other types of physicians, (2) physicians and study coordinators, (3) raters who had prior experience with the NIHSS and those without prior experience, and (4) raters who had used the videotapes in the past and those who had never viewed the tapes. The calculated r2s were greater than .98 for the initial rating of the first 4 cases and for the later rating of the 4 new cases. The slopes of the regression lines were all near 1, indicating that the raters were similarly calibrated. The intraclass correlation coefficients were .93 and .95, reflecting high levels of intraobserver and interobserver reliability.
Conclusions These data extend the previously demonstrated reliability of the NIHSS to non-neurologists and show that both a variety of physician investigators and nurse study coordinators can be rapidly trained to reliably apply the scale in the context of an actual clinical trial.
Key Words: clinical trials • stroke assessment
This article has been cited by other articles:
 |
|
 |
|
  D.C. Suh, J.K. Kim, J.W. Choi, B.S. Choi, H.W. Pyun, Y.J. Choi, M.-H. Kim, H.R. Yang, H.I. Ha, S.J. Kim, et al. Intracranial Stenting of Severe Symptomatic Intracranial Stenosis: Results of 100 Consecutive Patients AJNR Am. J. Neuroradiol., April 1, 2008; 29(4): 781 - 785. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. P. Adams Jr, G. del Zoppo, M. J. Alberts, D. L. Bhatt, L. Brass, A. Furlan, R. L. Grubb, R. T. Higashida, E. C. Jauch, C. Kidwell, et al. Guidelines for the Early Management of Adults With Ischemic Stroke: A Guideline From the American Heart Association/American Stroke Association Stroke Council, Clinical Cardiology Council, Cardiovascular Radiology and Intervention Council, and the Atherosclerotic Peripheral Vascular Disease and Quality of Care Outcomes in Research Interdisciplinary Working Groups: The American Academy of Neurology affirms the value of this guideline as an educational tool for neurologists. Circulation, May 22, 2007; 115(20): e478 - e534. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. Mikulik, M. Ribo, M. D. Hill, J. C. Grotta, M. Malkoff, C. Molina, M. Rubiera, R. Delgado-Mederos, J. Alvarez-Sabin, A. V. Alexandrov, et al. Accuracy of Serial National Institutes of Health Stroke Scale Scores to Identify Artery Status in Acute Ischemic Stroke Circulation, May 22, 2007; 115(20): 2660 - 2665. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. Roquer, A. Ois, A. Rodriguez-Campello, M. Gomis, E. Munteis, J. Jimenez-Conde, E. Cuadrado-Godia, and J. E. Martinez-Rodriguez Atherosclerotic Burden and Early Mortality in Acute Ischemic Stroke Arch Neurol, May 1, 2007; 64(5): 699 - 704. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 H. P. Adams Jr, G. del Zoppo, M. J. Alberts, D. L. Bhatt, L. Brass, A. Furlan, R. L. Grubb, R. T. Higashida, E. C. Jauch, C. Kidwell, et al. Guidelines for the Early Management of Adults With Ischemic Stroke: A Guideline From the American Heart Association/ American Stroke Association Stroke Council, Clinical Cardiology Council, Cardiovascular Radiology and Intervention Council, and the Atherosclerotic Peripheral Vascular Disease and Quality of Care Outcomes in Research Interdisciplinary Working Groups: The American Academy of Neurology affirms the value of this guideline as an educational tool for neurologists Stroke, May 1, 2007; 38(5): 1655 - 1711. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. Mikdashi, B. Handwerger, P. Langenberg, M. Miller, and S. Kittner Baseline Disease Activity, Hyperlipidemia, and Hypertension Are Predictive Factors for Ischemic Stroke and Stroke Severity in Systemic Lupus Erythematosus Stroke, February 1, 2007; 38(2): 281 - 285. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. Bondanelli, M. R. Ambrosio, A. Onofri, A. Bergonzoni, S. Lavezzi, M. C. Zatelli, D. Valle, N. Basaglia, and E. C. degli Uberti Predictive Value of Circulating Insulin-Like Growth Factor I Levels in Ischemic Stroke Outcome J. Clin. Endocrinol. Metab., October 1, 2006; 91(10): 3928 - 3934. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Lyden, R. Raman, L. Liu, J. Grotta, J. Broderick, S. Olson, S. Shaw, J. Spilker, B. Meyer, M. Emr, et al. NIHSS Training and Certification Using a New Digital Video Disk Is Reliable Stroke, November 1, 2005; 36(11): 2446 - 2449. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. W. Duncan, R. Zorowitz, B. Bates, J. Y. Choi, J. J. Glasberg, G. D. Graham, R. C. Katz, K. Lamberty, and D. Reker Management of Adult Stroke Rehabilitation Care: A Clinical Practice Guideline Stroke, September 1, 2005; 36(9): e100 - e143. [Full Text] [PDF]
|
|
|
|
|
|
P. D. Syme, A. W. Byrne, R. Chen, R. Devenny, and J. F. Forbes Community-Based Stroke Incidence in a Scottish Population: The Scottish Borders Stroke Study Stroke, September 1, 2005; 36(9): 1837 - 1843. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. K. Schiemanck, M. W.M. Post, Th. D. Witkamp, L. J. Kappelle, and A. J.H. Prevo Relationship between Ischemic Lesion Volume and Functional Status in the 2nd Week after Middle Cerebral Artery Stroke Neurorehabil Neural Repair, June 1, 2005; 19(2): 133 - 138. [Abstract] [PDF]
|
|
|
|
 |
|
 L. B. Goldstein and D. L. Simel Is This Patient Having a Stroke? JAMA, May 18, 2005; 293(19): 2391 - 2402. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. H. Kim, C. L. Haney, and G. Van Ginhoven Utility of Outcome Measures After Treatment for Intracranial Aneurysms: A Prospective Trial Involving 520 Patients Stroke, April 1, 2005; 36(4): 792 - 796. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Gao, K. S. Wong, T. Hansberg, W. W. M. Lam, D. W. Droste, and E. B. Ringelstein Microembolic Signal Predicts Recurrent Cerebral Ischemic Events in Acute Stroke Patients With Middle Cerebral Artery Stenosis Stroke, December 1, 2004; 35(12): 2832 - 2836. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. M. Nor, C. McAllister, S.J. Louw, A.G. Dyker, M. Davis, D. Jenkinson, and G.A. Ford Agreement Between Ambulance Paramedic- and Physician-Recorded Neurological Signs With Face Arm Speech Test (FAST) in Acute Stroke Patients Stroke, June 1, 2004; 35(6): 1355 - 1359. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. R. Lees Stroke Is Best Managed by a Neurologist: Battle of the Titans Stroke, November 1, 2003; 34(11): 2764 - 2765. [Full Text] [PDF]
|
|
|
|
 |
|
 L. Perry and S. McLaren Implementing evidence-based guidelines for nutrition support in acute stroke Evid. Based Nurs., July 1, 2003; 6(3): 68 - 71. [Full Text] [PDF]
|
|
|
|
 |
|
 M Uno, K T Kitazato, K Nishi, H Itabe, and S Nagahiro Raised plasma oxidised LDL in acute cerebral infarction J. Neurol. Neurosurg. Psychiatry, March 1, 2003; 74(3): 312 - 316. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. E. Kasner, B. L. Cucchiara, M. L. McGarvey, J. M. Luciano, D. S. Liebeskind, and J. A. Chalela Modified National Institutes of Health Stroke Scale Can Be Estimated From Medical Records Stroke, February 1, 2003; 34(2): 568 - 570. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. Schlegel;, S. J. Kolb, J. M. Luciano, J. M. Tovar, B. L. Cucchiara, D. S. Liebeskind, and S. E. Kasner Utility of the NIH Stroke Scale as a Predictor of Hospital Disposition Stroke, January 1, 2003; 34(1): 134 - 137. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. L. Tirschwell, W.T. Longstreth Jr, K. J. Becker, R. E. Gammans Sr, L. A. Sabounjian, S. Hamilton, and L. B. Morgenstern Shortening the NIH Stroke Scale for Use in the Prehospital Setting Stroke, December 1, 2002; 33(12): 2801 - 2806. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
B. C. Meyer, T. M. Hemmen, C. M. Jackson, and P. D. Lyden Modified National Institutes of Health Stroke Scale for Use in Stroke Clinical Trials: Prospective Reliability and Validity Stroke, May 1, 2002; 33(5): 1261 - 1266. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Kastenbauer, F. Winkler, H.-W. Pfister, J. F. Bruzzi, D. D. Brennan, Y. Tokuda, N. Nakazato, S. Segal, P. Tattevin, F. Bruneel, et al. Cranial CT before Lumbar Puncture in Suspected Meningitis N. Engl. J. Med., April 18, 2002; 346(16): 1248 - 1251. [Full Text] [PDF]
|
|
|
|
|
|
R. Hasbun, J. Abrahams, J. Jekel, and V. J. Quagliarello Computed Tomography of the Head before Lumbar Puncture in Adults with Suspected Meningitis N. Engl. J. Med., December 13, 2001; 345(24): 1727 - 1733. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W.S. Burgin, L. Staub, W. Chan, PhD;, T.H. Wein, R.A. Felberg, J.C. Grotta, A.M. Demchuk, S.L. Hickenbottom, and L.B. Morgenstern Acute stroke care in non-urban emergency departments Neurology, December 11, 2001; 57(11): 2006 - 2012. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Rundek, H. Mast, A. Hartmann, B. Boden-Albala, L. Lennihan, I.-F. Lin, M. C. Paik, and R. L. Sacco Predictors of resource use after acute hospitalization: The Northern Manhattan Stroke Study Neurology, October 24, 2000; 55(8): 1180 - 1187. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. W. Duncan, H. S. Jorgensen, and D. T. Wade Outcome Measures in Acute Stroke Trials : A Systematic Review and Some Recommendations to Improve Practice Stroke, June 1, 2000; 31(6): 1429 - 1438. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. M. Britt, J. E. Heiserman, R. M. Snider, H. A. Shill, C. R. Bird, and R. C. Wallace Incidence of Postangiographic Abnormalities Revealed by Diffusion-Weighted MR Imaging AJNR Am. J. Neuroradiol., January 1, 2000; 21(1): 55 - 59. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. P. Grichnik, A. J.J. Ijsselmuiden, T. A. D’Amico, D. H. Harpole Jr, W. D. White, J. A. Blumenthal, and M. F. Newman Cognitive decline after major noncardiac operations: a preliminary prospective study Ann. Thorac. Surg., November 1, 1999; 68(5): 1786 - 1791. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
P. Lyden, M. Lu, C. Jackson, J. Marler, R. Kothari, T. Brott, and J. Zivin Underlying Structure of the National Institutes of Health Stroke Scale : Results of a Factor Analysis Stroke, November 1, 1999; 30(11): 2347 - 2354. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
A. G. Dyker, K. R. Edwards, P. B. Fayad, J. T. Hormes, and K. R. Lees Safety and Tolerability Study of Aptiganel Hydrochloride in Patients With an Acute Ischemic Stroke Stroke, October 1, 1999; 30(10): 2038 - 2042. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. E. Kasner, J. A. Chalela, J. M. Luciano, B. L. Cucchiara, E. C. Raps, M. L. McGarvey, M. B. Conroy, and A. R. Localio Reliability and Validity of Estimating the NIH Stroke Scale Score from Medical Records Stroke, August 1, 1999; 30(8): 1534 - 1537. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. P. Adams Jr., P. H. Davis, E. C. Leira, K.-C. Chang, B. H. Bendixen, W. R. Clarke, R. F. Woolson, and M. D. Hansen Baseline NIH Stroke Scale score strongly predicts outcome after stroke: A report of the Trial of Org 10172 in Acute Stroke Treatment (TOAST) Neurology, July 1, 1999; 53(1): 126 - 126. [Abstract] [Full Text]
|
|
|
|
|
|
A. G. Dyker and K. R. Lees Safety and Tolerability of GV150526 (a Glycine Site Antagonist at the N-Methyl-D-Aspartate Receptor) in Patients With Acute Stroke Stroke, May 1, 1999; 30(5): 986 - 992. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K.J. van Everdingen, J. van der Grond, L.J. Kappelle, L.M.P. Ramos, and W.P.T.M. Mali Diffusion-Weighted Magnetic Resonance Imaging in Acute Stroke Stroke, September 1, 1998; 29(9): 1783 - 1790. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Schmulling, M. Grond, J. Rudolf, and P. Kiencke Training as a Prerequisite for Reliable Use of NIH Stroke Scale Stroke, June 1, 1998; 29(6): 1258 - 1259. [Full Text]
|
|
|
|
|
|
L. Roberts and C. Counsell Assessment of Clinical Outcomes in Acute Stroke Trials Stroke, May 1, 1998; 29(5): 986 - 991. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
H. P. Adams Jr Treating Ischemic Stroke as an Emergency Arch Neurol, April 1, 1998; 55(4): 457 - 461. [Abstract] [Full Text] [PDF]
|
|