(Stroke. 1999;30:56-60.)
© 1999 American Heart Association, Inc.
Original Contributions |
From the National Institute of Public Health, Community Medical Research Unit, Verdal, Norway (H.E., J.H., Ø.K), and the Department of Medicine, University of Uppsala, Uppsala, Sweden (A.T.).
Correspondence to Hanne Ellekjær, MD, National Institute of Public Health, Community Medical Research Unit, N-7650 Verdal, Norway. E-mail verdalfh{at}due.unit.no
| Abstract |
|---|
|
|
|---|
MethodsA record linkage was made between a population-based stroke register and the discharge records of the hospital serving the population of the stroke register (n=70 000). The stroke register (including patients aged 15 and older and with no upper age limit), applied here as a "gold standard," was used to estimate sensitivity, positive predictive value, and accuracy of the discharge diagnoses classification. The length of stay in hospital by stroke patients was measured.
ResultsIdentifying cerebrovascular diseases by hospital discharge diagnoses (International Classification of Diseases, 9th Revision [ICD-9], codes 430 to 438.9, first admission) lead to a substantial overestimation of stroke in the target population. Restricting the retrieval to acute stroke diagnoses (ICD-9 codes 430, 431, 434, and 436) gave an incidence estimate closer to the "true" incidence rate in the stroke register. Selecting ICD-9 codes 430 to 438 of cerebrovascular diseases gave the highest sensitivity (86%). The highest positive predictive value (68%) was achieved by selecting acute stroke diagnoses (ICD-9 codes 430, 431, 434, and 436), at the expense of a lower sensitivity (81%). Accuracy of ICD codes 430 to 438.9 (n=678) revealed the highest proportion of incident strokes identified by the acute stroke diagnoses (ICD-9 codes 430, 431, 434, and 436). Seventy-four percent of hospital discharge diagnoses classified as first-ever stroke kept the original diagnosis. Only 4.6% of the discharge diagnoses were classified as nonstroke diagnoses after validation. The estimation of length of stay in the hospital was improved by selection of acute stroke diagnoses from hospital discharge data (ICD-9 codes 430, 431, 434, and 436), which gave the same estimate of length of stay, a median of 8 days (2.5 percentile=0 and 97.5 percentile=56), compared with a median of 8 days (2.5 percentile=0 and 97.5 percentile=51) based on the stroke register.
ConclusionsHospital discharge data may overestimate stroke incidence and underestimate the length of stay in the hospital, unless selection routines of hospital discharge diagnoses are restricted to acute stroke diagnoses (ICD-9 codes 430, 431, 434, and 436). If supplemented by a validation procedure, including estimates of sensitivity, positive predictive value, and accuracy, hospital discharge data may provide valid information on hospital-based stroke incidence and lead to better allocation of health resources. Distinguishing subtypes of stroke from hospital discharge diagnoses should not be performed unless coding practices are improved.
Key Words: stroke assessment diagnosis stroke classification epidemiology
| Introduction |
|---|
|
|
|---|
A recently established stroke register in Norway (including patients aged 15 and older and with no upper age limit),10 used here as a "gold standard," made it possible to assess the validity of discharge diagnoses. The aim of this article was to estimate positive predictive value and sensitivity of hospital discharge data of first-ever stroke and to study the accuracy of International Classification of Diseases, 9th Revision (ICD-9), codes of cerebrovascular diseases by comparing ICD-9 codes of hospital discharge diagnoses with the population-based stroke register. The median length of hospital stay is presented to demonstrate the potential impact on cost-of-illness analyses of various methods of retrieving stroke diagnoses from hospital discharge data.
| Subjects and Methods |
|---|
|
|
|---|
Identification of Incident Stroke by Use of Hospital Discharge
Data
Patients with discharge diagnoses of ICD-9 codes 430 to 438.9
(all positions) and ICD-9 codes 430, 431, 434, and 436 (all positions)
at first admission to the hospital in the study period were selected.
By using the personal identification number, a link was made between
the first-ever strokes in the stroke register and those in the hospital
discharge diagnoses. In this way, discharge diagnoses associated with
first-ever stroke were identified. A surrogate estimate of stroke
incidence based on hospital discharge data were compared with estimates
from the stroke register, with and without hospitalized cases
included.
Sensitivity and Positive Predictive Value
Sensitivity was defined as the proportion of first-ever stroke
in the discharge data (identified by the stroke register) to first-ever
stroke in the stroke register. Positive predictive value was defined as
the proportion of first-ever stroke among discharge diagnoses.
Accuracy of Diagnoses
A comparison by cross-classification of discharge diagnoses
versus hospitalized cases in the stroke register was made. A
corresponding event was identified if the date of admission to the
hospital and the date of the event in the stroke register coincided
(±28 days).
Length of Stay in Hospital
The median length of stay in days was calculated for all
hospitalized cases with discharge diagnosis ICD-9 codes 430 to 438.9. A
comparison between validated stroke diagnoses in the stroke register
and hospital discharge diagnoses was made.
| Results |
|---|
|
|
|---|
|
After linkage to the stroke register, a total of 369 events among
discharge diagnosis ICD-9 codes 430 to 438.9 (n=759) were associated
with a first-ever stroke, giving a positive predictive value of 49%.
Discharge diagnosis ICD-9 codes 430 to 438.9 contained 369 first-ever
stroke cases out of a total of 430 first-ever strokes in the
population-based stroke register, giving a sensitivity of 86%.
Restricting the analyses to hospitalized cases in the register
increased to 95% the sensitivity of discharge diagnosis ICD-9 codes
430 to 438.9. Selecting only acute stroke diagnosis ICD-9 codes 430,
431, 434, and 436 gave a total of 508 discharge diagnoses, and the
proportion of first-ever strokes identified decreased to 81% (347 of
430) and 89% when compared with only hospitalized cases in the stroke
register. However, the positive predictive value increased to 68%
(Table 1
).
The accuracy of discharge diagnoses assessed by
cross-classification of ICD-9 codes 430 to 438 versus the stroke
register categories of first-ever stroke, recurrent, other stroke
diagnoses, and nonstroke is shown in Table 2
. Ninety percent (678 of 759) had a
validated diagnosis in the stroke register. A total of 81 events did
not have a match in the stroke register: 32 events outside the accepted
range of time (± 28days) and 49 with no medical records available.
Most first-ever incident strokes were confirmed by discharge diagnosis
ICD-9 codes 430, 431, 434, and 436; the proportions identified as
first-ever stroke were 69%, 77%, 68%, and 68%, respectively.
Fifteen percent (73 of 471) of acute stroke diagnoses (ICD-9 codes 430,
431, 434, and 436) were classified as other stroke diagnoses (ICD-9
codes 432, 433, 435, 437, and 438) or nonstroke diagnoses in the stroke
registry. Of the discharge diagnoses classified as first-ever stroke
according to the stroke register, 74% (260 of 351) kept the original
diagnosis. Most noteworthy, acute strokes cases with negative CT
results were classified as ICD-9 code 436 (unspecified) at discharge;
according to the diagnostic criteria in the stroke
register, these should have been categorized as ischemic stroke
events, thus leading to an underestimation of cerebral infarction
(66.5% in the discharge data compared with 74.5% in the stroke
register). Discharge data gave a good estimate of the proportion of
subarachnoid and intracerebral
hemorrhage in the population (2.8% and 12.0%, respectively)
compared with 3.0% and 10.5% in the stroke register.
|
Thirty-six percent of the stroke cases were found to be other than first-ever or recurrent stroke. Nearly half of the discharge diagnoses (327 of 678) were found to be other than first-ever stroke. Thirty-one of 678 (4.6%) were classified as nonstroke events.
The median length of hospital stay of patients with discharge diagnosis ICD-codes 430 to 438 (n=678) who had a match in the stroke register was 6 days (2.5 percentile=0 and 97.5 percentile=50). Retrieving only acute stroke diagnoses, first admission (ICD-9 codes 430, 431, 434, and 436) from hospital discharge data gave a median length of stay of 8 days (2.5 percentile=0 and 97.5 percentile=56). Of those who had a "true" stroke according to the stroke register (n=431, first-ever or recurrent hospitalized stroke), the median length of stay was 8 days (2.5 percentile=0 and 97.5 percentile=51).
| Discussion |
|---|
|
|
|---|
A strength of this study was the population-based stroke register. We
made a great effort to trace every suspected case of stroke in the
community, in the local hospital, and in the 2 neighboring
hospitals.10 A validation of the registration procedures
showed a case-finding rate of nearly 100% in the age group 15
to 74 years, 87% in the age group 75 to 84 years, and 76% in age
group
85 years. A higher completion of case finding in the stroke
register would lead to a reduction of the sensitivity of hospital
discharge diagnoses.
Misclassification was measured by interobserver agreement between
the research registrar, a neurologist, and a specialist in internal and
physical medicine (the latter 2 from other hospitals). The validation
of the interobserver agreement gave a
index of 0.68 between
research registrar and neurologist, 0.61 between research registrar and
specialist in internal medicine, and 0.65 between neurologist and
specialist in internal medicine.10 Despite acceptable
indices, inaccuracy of diagnostic procedures in the stroke
register may explain some of the discrepancies between the stroke
register and hospital discharge diagnoses. When using the stroke
register as a gold standard, these limitations should be taken into
account.
In the hospital discharge register, 49 patient files could not be traced. This illustrates practical problems in maintaining high-quality hospital discharge files. There is no reason to assume that the missing files were selected, and they are therefore not likely to have any substantial impact on the results of the study.
A study from Rochester, Minn,4 reported 23% incident
strokes missing from hospital discharge diagnoses. This study included
persons aged
75 years but combined the data sets from 1980 and 1989,
in which 19% of first-ever strokes were not hospitalized during the
event. In the Innherred, Norway, stroke register,10 only
10% of first-ever stroke patients were not hospitalized; this may
explain the differences in sensitivity between the 2 studies. The only
Scandinavian study comparing discharge diagnoses versus a population
based stroke register, the MONICA register in Northern
Sweden,1 reported that 6% of incident stroke cases were
not identified by hospital discharge diagnoses. However, this study
reported results from a population <75 years of age, and the hospital
discharge diagnoses did not include fatal events. This difference in
study population and design may explain the lower proportion of
unidentified incident stroke cases in the hospital discharge data in
the MONICA register compared with that in the present
study.
Limiting the number of diagnoses to acute stroke increased the positive predictive value of incident first-ever stroke to 68%, which is exactly the same as that reported from The MONICA register in Sweden1 and higher than that found in the Rochester study.4 Again, the differences in study design described above must be taken into account. Differences in age distribution in the study population and time of study may influence the probability of an acute stroke discharge diagnosis being a first-ever stroke event.
Accuracy of hospital discharge diagnoses have been validated in several studies performed at different times and in different populations. Additionally, the local diagnostic tools and coding practices may explain the discrepancies between studies. Leibson et al4 described the limitations of using discharge diagnoses in the classification of stroke by type. They found a lower proportion of unspecified stroke when a neurologist reviewed the medical records, indicating that knowledge about criteria and definitions of stroke subtypes are important in obtaining reliable classification. In the present study, 17% of incident strokes by discharge data were categorized as unspecified stroke compared with 12.0% in the stroke registry. The corresponding data in the Rochester study were 29% and 10%, respectively. Lindblad et al3 found that 73% of discharge diagnoses suggesting an acute stroke kept the original diagnosis after validation, compared with 74% in the present study. This Swedish study did not distinguish between first-ever and recurrent stroke, and therefore comparison of these data may be doubtful.
The validation of discharge diagnoses in the present study showed that only a few cases (4.6%) were classified as nonstroke events, which indicates that such data may be valid for analytical studies of predictors of stroke. Studies indicate also that applying more strict hospital routines, eg, in registering first-admission and acute stroke diagnoses (ICD-9 codes 430, 431, 434, and 436), might improve the quality of hospital stroke registers.4 9
Calculations of costs for stroke are dependent on reliable incidence data. Ours study reveals that use of hospital discharge diagnoses of stroke must be used with caution to avoid an overestimation of first-ever stroke cases. The direct cost of providing medical care to stroke patients consists of, among other components, the length of hospital stay.6 7 8 9 11 Bed-days in the hospital are a major contributor to the cost of acute care of stroke, and the validity of such data are enhanced by assessment of the accuracy of the discharge diagnoses.
According to the findings of the present study, we conclude that hospital discharge diagnoses are valuable sources of stroke incidence data for both health service planning and epidemiological research. Acute stroke diagnoses are most valid, and better diagnostic routines would improve the validity of the other hospital discharge diagnoses.
| Acknowledgments |
|---|
| Appendix 1 |
|---|
|
|
|---|
431Intracerebral hemorrhage
432Other and unspecified intracranial hemorrhage
433Occlusion and stenosis of precerebral arteries
434Occlusion of cerebral arteries
435Transient cerebral ischemia
436Acute but ill-defined cerebrovascular disease
437Other and ill-defined cerebrovascular disease
438Late effects of cerebrovascular disease
Received August 25, 1998; revision received October 2, 1998; accepted October 8, 1998.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
P. Spolaore, S. Brocco, U. Fedeli, C. Visentin, E. Schievano, F. Avossa, G. Milan, V. Toso, D. Vanuzzo, L. Pilotto, et al. Measuring Accuracy of Discharge Diagnoses for a Region-Wide Surveillance of Hospitalized Strokes Stroke, May 1, 2005; 36(5): 1031 - 1034. [Abstract] [Full Text] [PDF] |
||||
![]() |
V. C. Douglas, D. C. Tong, L. A. Gillum, S. Zhao, L. M. Brass, J. Dostal, and S. C. Johnston Do the Brain Attack Coalition's criteria for stroke centers improve care for ischemic stroke? Neurology, February 8, 2005; 64(3): 422 - 427. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. J. Fullerton, R. J. Adams, S. Zhao, and S. C. Johnston Declining stroke rates in Californian children with sickle cell disease Blood, July 15, 2004; 104(2): 336 - 339. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Medin, A. Nordlund, and K. Ekberg Increasing Stroke Incidence in Sweden Between 1989 and 2000 Among Persons Aged 30 to 65 Years: Evidence From the Swedish Hospital Discharge Register Stroke, May 1, 2004; 35(5): 1047 - 1051. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Okamoto Editorial Comment--Stroke Incidence and Quality Standard for Comparison Stroke, September 1, 2003; 34(9): 2107 - 2108. [Full Text] [PDF] |
||||
![]() |
H. J. Fullerton, Y. W. Wu, S. Zhao, and S. C. Johnston Risk of stroke in children: Ethnic and gender disparities Neurology, July 22, 2003; 61(2): 189 - 194. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Penberthy, D. McClish, A. Pugh, W. Smith, C. Manning, and S. Retchin Using Hospital Discharge Files to Enhance Cancer Surveillance Am. J. Epidemiol., July 1, 2003; 158(1): 27 - 34. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Al-Shahi, J. J. Bhattacharya, D. G. Currie, V. Papanastassiou, V. Ritchie, R. C. Roberts, R. J. Sellar, and C. P. Warlow Scottish Intracranial Vascular Malformation Study (SIVMS): Evaluation of Methods, ICD-10 Coding, and Potential Sources of Bias in a Prospective, Population-Based Cohort Stroke, May 1, 2003; 34(5): 1156 - 1162. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. P. Johnsen, L. Pedersen, S. Friis, W. J. Blot, J. K. McLaughlin, J. H. Olsen, and H. T. Sorensen Nonaspirin Nonsteroidal Anti-Inflammatory Drugs and Risk of Hospitalization for Intracerebral Hemorrhage: A Population-Based Case-Control Study Stroke, February 1, 2003; 34(2): 387 - 391. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. L. Tirschwell and W.T. Longstreth Jr Validating Administrative Data in Stroke Research Stroke, October 1, 2002; 33(10): 2465 - 2470. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Stavem and O.M. Ronning Survival of unselected stroke patients in a stroke unit compared with conventional care QJM, March 1, 2002; 95(3): 143 - 152. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. A. Gillum and S. C. Johnston Characteristics of Academic Medical Centers and Ischemic Stroke Outcomes Stroke, September 1, 2001; 32(9): 2137 - 2142. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. A. Derby, K. L. Lapane, H. A. Feldman, and R. A. Carleton Possible Effect of DRGs on the Classification of Stroke : Implications for Epidemiological Surveillance Stroke, July 1, 2001; 32(7): 1487 - 1491. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. C. Johnston, L. H. Fung, L. A. Gillum, W. S. Smith, L. M. Brass, J. H. Lichtman, A. N. Brown, and D. Z. Wang Utilization of Intravenous Tissue-Type Plasminogen Activator for Ischemic Stroke at Academic Medical Centers : The Influence of Ethnicity Editorial Comment : It Is Time to Implement Stroke Practice Improvement Programs and Prevent the Racial Disparity in Stroke Care Stroke, May 1, 2001; 32(5): 1061 - 1068. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Wigertz and R. Westerling Measures of prevalence: which healthcare registers are applicable? Scand J Public Health, January 1, 2001; 29(1): 55 - 62. [Abstract] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 1999 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |