| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
(Stroke. 2009;40:1564.)
© 2009 American Heart Association, Inc.
Original Contributions |
From INSERM U708 "Neuroepidemiology" (S.B., C.D., A.A., C.T.), Paris; UPMC Univ Paris 06 (S.B., C.D., A.A., C.T.), Paris; INSERM U593 and Université Bordeaux 2 (C.H.), Bordeaux; INSERM U888 (K.R.), Montpellier; INSERM U909 (J.-P.E., P.D.), Villejuif; and the Department of Neurology (M.G.B., C.T.), Hôpital Lariboisière, Paris, France.
Correspondence to Dr Christophe Tzourio, INSERM U708, Hôpital de la Salpêtrière, 47, boulevard de lHôpital, 75651 PARIS CEDEX 13, France. E-mail tzourio{at}chups.jussieu.fr
| Abstract |
|---|
|
|
|---|
Methods— The sample comprised 6913 subjects from the 3C Study, aged 65 to 84 at baseline, who were followed up to 6 years. Predictive accuracy of the original Framingham stroke risk function was assessed in a 3-step procedure: comparison between the Framingham and 3C cohorts of the prevalence of selected risk factors and the associated relative risks (RR) for stroke, comparison of the predicted to the observed number of stroke events (calibration), and ability to separate high-risk from low-risk participants (discrimination). We also compared predictive performances of the original Framingham, the recalibrated Framingham, and the local stroke risk functions.
Results— During follow-up, 110 incident strokes occurred. For most risk factors, RRs were comparable between the 2 cohorts, except for age in women. The original Framingham stroke risk function applied to the 3C cohort overestimated the 6-year absolute risk for stroke by a factor of 3.7 for men and 4.4 for women. However, the recalibrated Framingham and 3C functions did not show any over- or underestimation of stroke risk. The 3 stroke risk functions (original, recalibrated, and 3C) provided acceptable discrimination with areas under the ROC curve ranging from 0.67 to 0.73.
Conclusions— The original Framingham stroke risk function strongly overestimated the stroke risk for 3C participants. Derived Framingham stroke score sheets should not be directly used by physicians in the French elderly population.
Key Words: stroke risk aging cohort studies
| Introduction |
|---|
|
|
|---|
Epidemiological studies have identified numerous stroke risk factors such as age, blood pressure, atrial fibrillation, heart failure, and diabetes mellitus.3,4 Prediction models have subsequently been developed to assess the individual absolute risk of developing stroke.5–9 Several widely used risk functions for stroke have been drawn from the Framingham Heart Study (FHS), one of the well-known studies in this field.5,6,9 Primary prevention based on such tool should help to decrease stroke incidence, stroke-related mortality, and long-term disability among the elderly.
However, the Framingham cohort has certain particularities which may preclude generalization of these risk functions to other samples including the large proportion of white, middle-aged, suburban Americans included, and the low prevalence of subjects treated for classical cardiovascular risk factors. To apply FHS risk functions to other populations, external validation studies are therefore required.
Implementation of the Framingham stroke risk functions has been rarely investigated in other geographic settings and in elderly populations taking multiple medications.7,10,11 The aim of the present study was to assess the external validity of the Framingham stroke risk functions in a large cohort of French people aged 65 years and over, the Three-City (3C) Study.
| Materials and Methods |
|---|
|
|
|---|
Recruitment
Participants in the 3C Study were recruited between March 1999 and March 2001. To be eligible, subjects had to be: aged 65 years and over, living in Bordeaux, Dijon, or Montpellier, noninstitutionalized, and registered on electoral rolls. An invitation letter to participate was sent to eligible subjects, and the acceptance rate was 37%. The original 3C sample included 9294 persons (2104 in Bordeaux, 4931 in Dijon, and 2259 in Montpellier). The Framingham stroke risk function was established in persons aged 55 to 84 years and free of stroke at baseline. To have samples as comparable as possible, 3C participants aged 85 years or older and those who reported stroke history at baseline were excluded from the current analyses (n=1017). Similarly, participants with missing values in one or more of the risk factors included in the stroke risk function were excluded (n=1178). The baseline sample therefore included 7099 participants. Figure 1 presents a flow chart of the sample selection for the current analysis.
|
Risk Factor Measurement
During a face-to-face interview using a standardized questionnaire, trained psychologists collected data including medical history, past and current tobacco consumption, and medication use. Clinical examination included blood pressure measurements, ECG, and blood sampling. Subjects who smoked regularly during the previous 6 months or had stopped in the previous 6 months were classified as smokers. A subject was classified with cardiovascular disease history when he/she reported a history of myocardial infarction or coronary bypass or angioplasty or vascular surgery for lower limb arteritis. Medications taken regularly during the month preceding inclusion were recorded, and participants were asked to provide all prescriptions and medications where feasible. Medications were coded according to the French translation of the World Health Organizations Anatomic Therapeutical Chemical (ATC) classification.13 Two separate measures of systolic and diastolic blood pressure were performed using a digital electronic tensiometer (OMRON M4). The mean was used for these analyses. Diabetes mellitus was defined as being present if the participant was under hypoglycaemic treatment (insulin or oral blood glucose lowering drugs) or if glycaemia was greater than 1.26 g/dL (7 mmol/L).14 A diagnosis of atrial fibrillation history was made either by ECG or self-report. Although left ventricular hypertrophy based on ECG was used in the Framingham risk function, it was not assessed in the 3C Study, therefore for this factor a missing value was attributed to all participants.10
Follow-Up and Case Ascertainment
At each follow-up examination (2, 4, and 6 years after enrolment), information was collected concerning suspicion of stroke occurrence. In participants who reported incident stroke (during interview or by self-administered questionnaire), further medical data were collected from general practitioners, specialists, and hospital records where possible.
An end point adjudication committee reviewed source documentation for all individuals with a suspected stroke or those who died during follow-up. Outcomes were coded according to the tenth revision of the International Classification of Diseases.15 A stroke was classified as nonfatal if the patient was alive 28 days after stroke onset.
Framingham Stroke Risk Function
Sex-specific Framingham stroke risk functions used in the present study were derived from a Framingham Study sample, which included 2372 men and 3362 women, aged 55 to 84 years old, who were free of stroke history in 1966 (examination 9) or in 1976 (examination 14).6 Subjects were followed over 10 years. The outcome of interest was occurrence of a first ischemic/hemorrhagic stroke. Stroke risk factors included were: age, systolic blood pressure, antihypertensive therapy, cigarette smoking, diabetes mellitus, cardiovascular disease (history of myocardial infarction, angina pectoris, coronary insufficiency, intermittent claudication, or congestive heart failure), atrial fibrillation, and left ventricular hypertrophy by ECG (LVH-ECG).
There are 2 published versions of the stroke risk function: the second one,6 used in the present study, being an update of the original one9 by adding the interaction term between antihypertensive therapy and systolic blood pressure.
Statistical Analysis
Cox Proportional Hazards Model
Sex-specific Cox proportional hazards models were constructed incorporating the stroke risk factors identified from the Framingham Study.9 Underlying validity assumptions (proportionality and log-linearity) were tested and fulfilled by the 3C data.16 For the prediction of the 6-year absolute risk of stroke, we used the following model:
|
|
with f(x,M)=β1(xi1-M1)+ ... +βp(xip-Mp). Here, β1 ... βp are the Cox regression coefficients associated with the p risk factors included in the model, xii ... xip are the risk factor levels for an individual i, M1 ... Mp are the mean values of each of the p risk factors in the cohort, and S0(t) is the average incidence rate at time t ie, the survival rate at the mean values of the risk factors at time t (here, t=6 years).17
Cox proportional hazards model were computed from a sample of 6913 individuals (Figure 1). No stroke occurred during follow-up in 3C women participants who smoked at baseline, and therefore no Cox coefficient could be estimated. To keep these subjects in the analyses, we assigned to all subjects belonging to this group the same Cox coefficient as the one estimated from the Framingham cohort data for women who smoked.18
Performances of the Framingham Prediction Function
The performances of the Framingham prediction function applied to 3C participants was assessed using 3 classical steps: (1) Relative risks comparison; (2) calibration; (3) discrimination.17
Relative Risks Comparison
We compared multivariate-adjusted relative risk (RR) for each risk factor between the Framingham and 3C cohorts. In multivariate analyses of the 3C data, RR were additionally adjusted for the center (Dijon, Bordeaux, or Montpellier). For the comparison, we extracted regression coefficients generated from Cox models computed in both samples. For a given risk factor, a 2-tailed z statistic was generated to compare Framingham and 3C regression coefficients, where z=(β[F]–β[3C])/SE, β[F] and β[3C] being, respectively, the regression coefficients of the Framingham and the 3C models. The SE is the standard error of the difference in coefficients and SE=(SE[F]2+SE[3C]2)1/2, with SE[F] and SE[3C] being respectively the standard errors of β[F] and β[3C]. The degree of significance was set to P<0.10.17,19
Calibration
This step consisted in a comparison of the 6-year predicted number of events to the 6-year observed number. Distribution of 6-year risk predicted by the model was categorized into deciles. The goodness-of-fit Hosmer–Lemeshow (H-L)
2 test assessed the difference between predicted and observed number of events categorized in deciles. It is compared to a
2 distribution with
=(g–n) degrees of freedom (df), with g=10 (number of deciles) and n whose value depends on the study population.20 A
2 statistic with a degree of significance of less than 0.01 indicated a lack of calibration. In the framework of a Cox survival model with censored observations, we used a modified Hosmer–Lemeshow
2 test where the Kaplan–Meier estimator yields the observed incidence of stroke events and the Cox model estimates the average predicted probabilities.21 Finally, we also calculated a global ratio of the predicted number over the observed number of stroke events.22,23
Discrimination
To assess the ability of the Framingham stroke risk function to distinguish high-risk participants who actually had a stroke from low-risk participants who had no stroke, we calculated the area under the receiver operating characteristic (ROC) curve or c statistic which assesses the discrimination of the function. We used the traditional following thresholds for the area under the ROC curve: 0.5, no discrimination; 0.5 to 0.7, poor discrimination;
0.7 acceptable discrimination;
0.8 excellent discrimination;
0.9 outstanding discrimination.24
Original Framingham, Recalibrated Framingham, and 3C Functions
To compare the predictive abilities of the original Framingham risk function, we repeated these 3 steps for 2 other Framingham risk functions: the recalibrated Framingham risk function and the 3C "local" risk function.17 The 3 risk functions differ in terms of average incidence rate S0(t), the βp Cox regression coefficients and mean values of the p risk factors Mp. In the original Framingham risk function, these 3 parameters are all estimated from the Framingham cohort. When an overestimation or underestimation of risk by the original Framingham function is suspected, recalibration may optimize data fit. Thus, in the recalibrated Framingham risk function, mean values of risk factors and average incidence rate are derived from the 3C data. Finally, in the 3C "local" risk function, which represents the best possible risk function for the 3C data, the β coefficients, mean values of risk factors and average incidence rate are all estimated from the 3C data (Table 1).
All statistical analyses were performed with SAS software, version 9.1 (SAS Institute).
|
| Results |
|---|
|
|
|---|
Table 2 describes risk factor distribution at baseline examination in men and women for each cohort (Framingham and 3C). 3C participants were on average 7 years older than Framingham Study participants. Mean systolic blood pressure was comparable between the 2 cohorts in women, but higher SBP levels were observed in men from the 3C Study. Similarly, compared to Framingham, for both sexes, there were more subjects taking antihypertensive medication in 3C. The smoking rate and the prevalence of cardiovascular diseases were lower among 3C participants, whereas comparable diabetes mellitus and atrial fibrillation prevalence rates were observed in the 2 cohorts.
|
Table 3 shows the multivariate-adjusted relative risks associated with risk factors in the Framingham stroke risk function applied to the 2 cohorts in men and women.
|
For both men and women, age, SBP, and atrial fibrillation were independently associated with stroke risk in 3C. Diabetes, smoking, and history of cardiovascular disease were not significantly associated with stroke risk in this study. For most risk factors, RR did not differ significantly between the 2 cohorts. A 10-year age increase was associated with a higher increase in stroke risk among 3C participants than among Framingham participants (Men: RR3C=2.29 versus RRF=1.63, P=0.27; Women: RR3C=3.51 versus RRF=2.01, P=0.09).
In the calibration analysis, the H-L
2 value was 95.8 for men (P<0.001; 10 df) with a global ratio of predicted over observed strokes of 3.70 [95% CI, 2.84 to 4.80]. Average estimated 6-year stroke risk by deciles in men ranged from 2.8 to 18.9%. For women, the H-L
2 was 158.9 (P<0.001; 10 df) with a global ratio of predicted over observed strokes of 4.35 (95% CI, 3.34 to 5.67). Average estimated 6-year stroke risk by deciles in women ranged from 1.7% to 17.3%. The original Framingham stroke risk function overestimated expected stroke rate in 3C men and women (Figure 2). In the discrimination analysis, the areas under the ROC curve were acceptable, 0.67 (95% CI=0.59 to 0.74) for men and 0.70 (95% CI, 0.64 to 0.76) for women (Table 4).
|
|
In the calibration analysis using the recalibrated Framingham risk function (ie, β coefficients extracted from the Framingham Cox model, but mean values of risk factors and average incidence rate estimated from the 3C cohort), the H-L
2 was 7.6 for men (P=0.67; 10 df) with a global ratio of predicted over observed strokes of 1.17 (95% CI, 0.90 to 1.52). Average estimated 6-year stroke risk by deciles in men ranged from 0.9 to 6.2%. The H-L
2 was 16.9 for women (P=0.08; 10 df) with a global ratio of predicted over observed strokes of 0.85 (95% CI, 0.65 to 1.11). Average estimated 6-year stroke risk by deciles in women ranged from 0.3 to 3.5%. Therefore, the recalibrated Framingham stroke risk function did not overestimate expected stroke rate among 3C men and women compared to the observed ones (Figure 2). As expected, the areas under the ROC curve were not affected by recalibration (Table 4).
In the calibration analysis using the 3C risk function, the H-L
2 was 20.1 for men (P=0.02; 9 df) with a global ratio of predicted over observed strokes of 1.13 (95% CI, 0.87 to 1.47). Average estimated 6-year stroke risk by deciles in men ranged from 0.8 to 7.4%. The H-L
2 was 8.8 among women (P=0.46; 9 df) with a global ratio of predicted over observed strokes of 0.97 (95% CI, 0.75 to 1.26). Average estimated 6-year stroke risk by deciles in women ranged from 0.3 to 4.5%. Therefore, the 3C stroke risk function did not overestimate stroke rates observed among 3C men and women (Figure 2). In the discrimination analysis, the areas under the ROC curve were acceptable, 0.68 (95% CI, 0.61 to 0.75) for men and 0.73 (95% CI, 0.67 to 0.79) for women (Table 4).
| Discussion |
|---|
|
|
|---|
The overestimation of stroke risk using the original Framingham risk function may be explained in a number of ways. First, the Framingham stroke risk function estimated in fact the risk of incident stroke (atherothrombotic brain infarction, cerebral embolus, intracranial hemorrhage) and transient ischemic attacks pooled together and accounting for 78% and 22% of the events, respectively.9 In the 3C Study, only incident stroke was an event of interest, as has been the case in most other recent studies.7,11 Second, differences in stroke incidence and risk factor levels between the 2 countries, especially over the past 3 decades, could also explain this overestimation. There are large differences in stroke incidence between the high-risk American Framingham cohort and the low-risk French 3C cohort. Third, the original Framingham stroke risk function was estimated based on data gathered in the 1980s whereas the 3C data were collected in 2000. But, over the past 30 years, preventive and therapeutic strategies have evolved considerably, especially in the cardiovascular area, causing significant decreases in stroke incidence.25 For example, the Framingham stroke risk function takes into account only treatment for high blood pressure and not treatment for diabetes, hypercholesterolemia, or atrial fibrillation.6 Fourth, although 3C participants were asked, at each wave, whether they had a stroke since last examination, levels of screening and surveillance were not comparable between 3C and the Framingham studies, and we cannot exclude a few incident cases were missed among 3C participants. Finally, 3C participants were older than Framingham participants (mean age in the 3C study was 73 years old compared to 66 in the Framingham study). This important age difference could influence the results and explain, at least partly, why several of the stroke risk factors of the Framingham risk function were not associated with stroke risk in the 3C cohort. Despite this important age difference, effect of age was statistically similar between the 2 cohorts in men (RR comparison in men, P=0.27) and only slightly different in women (RR comparison in women, P=0.09). Other relative risks associated with factors included in the Framingham risk function were not statistically significantly different between the 3C and the Framingham cohort. Moreover, magnitude and direction of the association were globally similar between the 2 cohorts. We may therefore assume that age differences between the 2 studies are likely to have only a limited impact on the overestimation observed.
Transposition of the Framingham risk function to other elderly populations has given conflicting results. In a European study of hypertensive patients, no global overestimation of predicted stroke risk was observed.10 However, a subanalysis among French patients in this European sample showed that the use of the Framingham risk function led to a predicted/observed strokes ratio of 2.0, which is close to our findings. In a cohort of Dutch elderly, the original Framingham stroke risk function had good predictive performance.11 However, calibration was adequate only in persons with a low to moderate 5-year predicted risk (<5%), whereas overestimation was reported in higher deciles of risk. Compared to the 3C sample, Dutch participants were younger, had lower mean systolic blood pressure, used less antihypertensive medication, were more often smokers, and had more cardiovascular diseases. Moreover, it should be noted that the authors reported that the predictive performance of the Framingham function was reduced when applied to older persons. Differences between population characteristics could partly explain the Framingham predictive value in the 3C sample. In a cohort of American elderly, the original Framingham stroke risk function gave good prediction of stroke.7 There was a 15-fold incidence gradient between the highest and the lowest quintile of predicted risk showing powerful discrimination. Framingham model gave similar predictive to the 3C sample with areas under the ROC curve of 0.69 for men and 0.73 for women.
Our study has several strengths, including the large cohort size, the high follow-up rate, and the standardized and centralized procedures for both data recording and incident events validation. It also has some potential limitations. In the 3C Study, participants were volunteers and thus likely to have a better health and medical follow-up than the French general population. In the Framingham Study, participants were also volunteers, but they were enrolled at a younger age and the healthy volunteer bias related to the outcome of interest is likely to be smaller than in the 3C study. However, it is difficult to estimate the consequences of participation selection on the observed results. It should also be noted that all 3C participants were of white ethnicity, and our findings are not generalizable to other ethnicities.
Compared to the original Framingham stroke risk function, the recalibrated Framingham and 3C functions showed good agreement between predicted and observed stroke rates, without over- or underestimation of stroke risk. The abilities of the 3 original Framingham, recalibrated Framingham, and 3C stroke risk functions to separate 3C participants who had stroke from those who had not were fairly acceptable with areas under the ROC curve ranging from 0.67 to 0.73, which are similar to those reported in other studies.7,11
Caution should be exercised by clinicians in applying the original Framingham risk function within the French context, as it is likely to strongly overestimate the 6-year risk of stroke. From the patient perspective, it could result in inappropriate treatment with unjustified side effects. In terms of public health, it could also have negative consequences such as increased costs and overestimation of the burden of stroke in France. The recalibrated Framingham risk function gave reliable and accurate correction of the risk of overestimation and may thus be a useful primary approach in French elderly populations. Its predictive performance can be easily compared with similar studies in other settings. The 3C "local" risk function using only 3C data showed satisfactory predictive performance, despite the restriction of having to adhere to the Framingham cardiovascular risk factors. However, its performances did not improve substantially those of the recalibrated Framingham risk function.
Further analyses of the 3C cohort may enable us to develop our own risk function to study the predictive power of other potential clinical, biological, and radiological risk factors such as walking speed, serum creatinine,7 hypercholesterolemia,26 carotid intima-media thickness and plaques,27 or white matter hyperintensity volume on brain MRI.28 Adjustments on therapies such as statins, blood glucose lowering drugs, or antiplatelets/anticoagulants agents could also be explored. Such predictions would be 3C-specific and thus closer to the current health status of the French elderly population. However, sensitivity analyses showed us that the integration of some of these "nonclassical" stroke risk factors in the model did not substantially modify the prediction of stroke in the 3C sample (data not shown). Indeed, overestimation of cardiovascular risk between the United States and France is traditionally related to the average incidence rate [S0(t)] heterogeneity between the 2 countries, which is probably attributable to currently unknown differences of lifestyle, alimentation, or socio-cultural risk backgrounds.
To conclude, we found that the Framingham stroke risk function strongly overestimated the 6-year absolute risk of stroke in a population-based cohort of French elderly, the 3C Study. Thus, score sheets developed from this model should not be directly used by physicians in stroke prevention in the French elderly population. Recalibration process corrected this overestimation. The recalibrated Framingham stroke risk function seems to be an interesting alternative between the misuse of a well-known risk function and the development of a too-specific local population risk function. Finally, in the area of the cerebrovascular primary prevention for French elderly people, further development is needed to elaborate an adequate risk function which could be based on the recalibrated Framingham stroke risk function.
| Acknowledgments |
|---|
The Three-City Study is conducted under a partnership agreement between the Institut National de la Santé et de la Recherche Médicale (INSERM), the Victor Segalen–Bordeaux II University, and Sanofi-Aventis. The Fondation pour la Recherche Médicale funded the preparation and initiation of the study. The 3C Study is also supported by the Caisse Nationale Maladie des Travailleurs Salariés, Direction Générale de la Santé, MGEN, Institut de la Longévité, Conseils Régionaux of Aquitaine and Bourgogne, Fondation de France, and Ministry of Research–INSERM Programme "Cohortes et collections de données biologiques." Sponsors are involved neither in the design of the study nor in the data analyses or manuscript elaboration. Scientific steering committee: A. Alpérovitch (Principal Investigator), P. Amouyel, J.F. Dartigues (co-PI), P. Ducimetière, B. Mazoyer, K. Ritchie, C. Tzourio. End point committee for stroke: M.G. Bousser (Chair), F. Pico, J.F. Pinel, F. Rouanet.
Disclosures
None.
Received July 24, 2008; revision received October 3, 2008; accepted November 13, 2008.
| References |
|---|
|
|
|---|
2. Bonita R. Epidemiology of stroke. Lancet. 1992; 339: 342–344.[CrossRef][Medline] [Order article via Infotrieve]
3. Wolf PA. Risk factors for stroke. Stroke. 1985; 16: 359–360.
4. Manolio TA, Kronmal RA, Burke GL, O'Leary DH, Price TR. Short-term predictors of incident stroke in older adults. The Cardiovascular Health Study. Stroke. 1996; 27: 1479–1486.
5. Anderson KM, Odell PM, Wilson PW, Kannel WB. Cardiovascular disease risk profiles. Am Heart J. 1991; 121: 293–298.[CrossRef][Medline] [Order article via Infotrieve]
6. D'Agostino RB, Wolf PA, Belanger AJ, Kannel WB. Stroke risk profile: adjustment for antihypertensive medication. The Framingham Study. Stroke. 1994; 25: 40–43.[Abstract]
7. Lumley T, Kronmal RA, Cushman M, Manolio TA, Goldstein S. A stroke prediction score in the elderly: validation and Web-based application. J Clin Epidemiol. 2002; 55: 129–136.[CrossRef][Medline] [Order article via Infotrieve]
8. Tanne D, Yaari S, Goldbourt U. Risk profile and prediction of long-term ischemic stroke mortality: a 21-year follow-up in the Israeli Ischemic Heart Disease (IIHD) Project. Circulation. 1998; 98: 1365–1371.
9. Wolf PA, D'Agostino RB, Belanger AJ, Kannel WB. Probability of stroke: a risk profile from the Framingham Study. Stroke. 1991; 22: 312–318.
10. Bastuji-Garin S, Deverly A, Moyse D, Castaigne A, Mancia G, de Leeuw PW, Ruilope LM, Rosenthal T, Chatellier, G. The Framingham prediction rule is not valid in a European population of treated hypertensive patients. J Hypertens. 2002; 20: 1973–1980.[CrossRef][Medline] [Order article via Infotrieve]
11. Voko Z, Hollander M, Koudstaal PJ, Hofman A, Breteler MM. How do Am stroke risk functions perform in a Western European population? Neuroepidemiology. 2004; 23: 247–253.[CrossRef][Medline] [Order article via Infotrieve]
12. The 3C Study Group. Vascular factors and risk of dementia: design of the Three-City Study and baseline characteristics of the study population. Neuroepidemiology. 2003; 22: 316–325.[CrossRef][Medline] [Order article via Infotrieve]
13. http://www.theriaque.org. Centre National Hospitalier dInformation sur le Medicament, France 2002.
14. Report of the Expert Committee on the Diagnosis and Classification of Diabetes Mellitus. Diabetes Care. 1997; 20: 1183–1197.[Medline] [Order article via Infotrieve]
15. World Health Organization. International Statistical Classification of Diseases and Related Health Problems, Tenth Revision (ICD-10). Geneva, Switzerland: World Health Organization, 1992.
16. Cox DR. Regression Models and Life-Tables (with Discussion). J R Stat Soc B. 1972; 34: 187–220.
17. D'Agostino RB Sr, Grundy S, Sullivan LM, Wilson P. Validation of the Framingham coronary heart disease prediction scores: results of a multiple ethnic groups investigation. JAMA. 2001; 286: 180–187.
18. Little RJA, Rubin DB. Statistical Analysis with Missing Data. I ed. New York: John Wiley & Sons Inc; 1987.
19. Liu J, Hong YL, D'Agostino RB, Wu ZS, Wang W, Sun JY, Wilson PWF, Kannel WB, Zhao D. Predictive value for the Chinese population of the Framingham CHD risk assessment tool compared with the Chinese multi-provincial cohort study. JAMA. 2004; 291: 2591–2599.
20. Hosmer D, Lemeshow SA goodness-of-fit test for the multiple logistic regression model. Comm Stat. 1980; A10: 1043–1069.
21. D'Agostino R, Nam BH. Evaluation of the performance of survival analysis model: discrimination and calibration measures. Handbook of Statistics, Vol. 23. Amsterdam, The Netherlands: Elsevier; 2004: 1–25.
22. Empana JP, Ducimetiere P, Arveiler D, Ferrieres J, Evans A, Amouyel PH, Dalongeville J. Are the Framingham and PROCAM coronary heart disease risk functions applicable to different European populations? The PRIME Study. Eur Heart J. 2003; 24: 299.
23. Rothman KJ, Greenland S. Modern Epidemiology. II ed. Lippincott-Raven Publishers; 1998.
24. Hosmer D, Lemeshow S. Applied Logistic Regression. II ed. New York: John Wiley & Sons Inc; 2000.
25. Carandang R, Seshadri S, Beiser A, Kelly-Hayes M, Kase CS, Kannel WB, Wolf PA. Trends in incidence, lifetime risk, severity, and 30-day mortality of stroke over the past 50 years. JAMA. 2006; 296: 2939–2946.
26. Bots ML, Elwood PC, Nikitin Y, Salonen JT, Freire dC, Inzitari D et al. Total and HDL cholesterol and risk of stroke. EUROSTROKE: a collaborative study among research centres in Europe. J Epidemiol Community Health. 2002; 56: i19–i24.
27. Touboul PJ, Labreuche J, Vicaut E, Amarenco P. Carotid intima-media thickness, plaques, and Framingham risk score as independent determinants of stroke risk. Stroke. 2005; 36: 1741–1745.
28. Jeerakathil T, Wolf PA, Beiser A, Massaro J, Seshadri S, D'Agostino RB, Sivenius J, Benetou V, Tuomilehto J, Koudstaal PJ, Grobbee DE. Stroke risk profile predicts white matter hyperintensity volume: the Framingham Study. Stroke. 2004; 35: 1857–1861.
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Stroke Home | Subscriptions | Archives | Feedback | Authors | Help | AHA Journals Home | Search Copyright © 2009 American Heart Association, Inc. All rights reserved. Unauthorized use prohibited. |