exacerbations of chronic obstructive pulmonary disease ( copd ) have a large impact on morbidity and quality of life and place a huge financial burden on the health care system.13 patients with moderate - to - severe copd seek medical attention on average two to three times a year for exacerbations , of which one requires hospitalization.4 this fuels the interest in strategies to reduce the number of exacerbations . adequate prediction models could guide clinicians in subsequent intensified monitoring and treatment of those at increased risk and , thus , reduce the number of exacerbations . the majority of published prediction models developed for patients with copd , however , aim to predict mortality,57 and models specifically developed to predict exacerbations are scarce . moreover , most of these models are based on severe exacerbations , those requiring hospitalization.810 also , studies that developed prediction models for future exacerbations typically included severely diseased copd patients recruited from tertiary care centers , and are therefore not representative of the copd patient population at large . severity indices like the bode ( body mass index , obstruction , dyspnea and exercise ) index5 and the dose ( dyspnea , obstruction , smoking and exacerbations ) index11 have also been tested on their ability to predict future exacerbations and showed acceptable performance measures ( ie , c - statistics in the range of 0.60.7 in their original cohorts ) . as these scores were not initially developed to predict exacerbations , some potentially important predictors for exacerbations were not considered . thus , the need remains for an easily applicable prediction model that can be applied to all patients with copd , including those with mild disease and predicting all exacerbations , including those not requiring hospitalization . also , the model should be practicable in everyday care , including the primary care setting , in which many patients with ( mild ) copd are managed . for the development of the prediction model , we used a cohort of copd patients , originally set up to screen for heart failure in patients with copd.12 in brief , patients from primary care enlisted with a general practitioner s ( gp s ) diagnosis of copd and aged 65 years or over were selected from 51 general practices in the netherlands between april 2001 and june 2003 . at the baseline assessment , the gp s diagnosis of copd was reevaluated by newly performed standardized pulmonary function tests ( spirometry , body box measurements , and diffusion testing ) , and presence or absence of copd was determined by an expert panel including a pulmonologist , applying the global initiative for chronic obstructive lung disease ( gold ) criteria.13 copd was established in 243 patients . follow - up data for all 243 patients was collected over a period of 24 months from study entry measurements by scrutinizing the treating gp s electronic medical files , including letters from medical specialists.14 the institutional review board of the university medical center utrecht , utrecht , the netherlands , approved the study protocol , and all participants gave written informed consent . the validation cohort originated from the utrecht general practitioners network database , in which collaborating gps enter all data related to daily patient contacts electronically into a gp information system . for this study we included 793 patients aged 50 years or over with a diagnosis of copd based on available spirometric data ( post - bronchodilator forced expiratory volume in 1 second [ fev1]/forced vital capacity < 70% ) . we artificially set the study entry at january 2010 for our study , and baseline characteristics and follow - up data of the eligible patients were determined for 24 months from that period of time onwards . for both cohorts we used the same  operational definition for exacerbation of copd , that is , symptomatic deterioration requiring pulsed oral steroid use or hospitalization.1517 the list of candidate predictors to be studied was based on the literature and was limited to those predictors that are readily available in clinical practice . the list of selected potential predictors included age,10 fev1,9,10,18,19 previous exacerbations,9,10,19,20 body mass index,1820 pack years smoked , history of vascular disease,2123 and history of ischemic heart disease ( ihd ) . previous exacerbations were considered present if at least one exacerbation occurred in the year prior to the baseline assessment , also defined as symptomatic deterioration requiring pulsed oral steroid use or a hospitalization . for fev1 , the post - bronchodilator value was used , and the percentage of predicted ( % predicted ) fev1 according to age , height , and sex was calculated . a history of ihd was defined as a history of myocardial infarction , angina pectoris , percutaneous coronary intervention , or coronary artery bypass grafting . a history of vascular disease was defined as stroke , transient ischemic attack , or peripheral arterial disease . in the validation cohort , follow - up information was missing for three participants ( 1.3% ) , and these patients were excluded from the analyses . in six participants ( 2.5% ) , data on previous exacerbations were missing . in the validation cohort , post - bronchodilator fev1 values were missing in eleven patients ( 1.4% ) , smoking status in 161 patients ( 20.3% ) , and number of pack years in 398 patients ( 50.2% ) . all missing values were imputed using multiple regression techniques.24 rubin s rules25 were applied to the 25 multiple imputation sets to calculate the pooled c - statistics . as the exclusion of patients with a missing value ( so - called complete - case analysis ) in general may lead to biased results , we performed a separate reanalysis that was restricted to complete cases  of the univariable associations between the number of pack years smoked and exacerbations . the univariable odds ratios were similar to those derived from the imputed dataset , although with broader confidence intervals ( cis ) . descriptive analyses were used to assess differences in baseline characteristics of patients who experienced an exacerbation in the 2 years after the baseline assessment and those who did not . for model development , we used multivariable logistic regression analysis to examine the independent association between candidate predictors and the occurrence of a copd exacerbation within 24 months . age , fev1 , and pack years were assessed on their continuous scale . to improve linearity , we started with all six preselected candidate predictors in the model and then applied backward - selection procedures , using a p - value<0.20 from the log likelihood ratio test to select predictors for the final model . the model was internally validated using bootstrapping techniques . to correct for overfitting , the beta coefficients of the predictors in the final model were multiplied by the shrinkage factor derived from the 500 bootstrap samples.26 the performance of the final model ( after shrinkage ) was assessed with the c - statistic and its 95% ci , and calibration was assessed with a calibration plot . for validation of the model , the predicted probabilities were calculated for each patient in the validation set using the regression coefficients , after shrinkage , from the original model obtained from the derivation cohort . in a calibration plot , data were analyzed using spss 20.0 for windows ( ibm corporation , armonk , ny , usa ) and r ( v 2.9.2 ; the r foundation for statistical computing , vienna , austria ) . for the development of the prediction model , we used a cohort of copd patients , originally set up to screen for heart failure in patients with copd.12 in brief , patients from primary care enlisted with a general practitioner s ( gp s ) diagnosis of copd and aged 65 years or over were selected from 51 general practices in the netherlands between april 2001 and june 2003 . at the baseline assessment , the gp s diagnosis of copd was reevaluated by newly performed standardized pulmonary function tests ( spirometry , body box measurements , and diffusion testing ) , and presence or absence of copd was determined by an expert panel including a pulmonologist , applying the global initiative for chronic obstructive lung disease ( gold ) criteria.13 copd was established in 243 patients . follow - up data for all 243 patients was collected over a period of 24 months from study entry measurements by scrutinizing the treating gp s electronic medical files , including letters from medical specialists.14 the institutional review board of the university medical center utrecht , utrecht , the netherlands , approved the study protocol , and all participants gave written informed consent . the validation cohort originated from the utrecht general practitioners network database , in which collaborating gps enter all data related to daily patient contacts electronically into a gp information system . for this study we included 793 patients aged 50 years or over with a diagnosis of copd based on available spirometric data ( post - bronchodilator forced expiratory volume in 1 second [ fev1]/forced vital capacity < 70% ) . we artificially set the study entry at january 2010 for our study , and baseline characteristics and follow - up data of the eligible patients were determined for 24 months from that period of time onwards . for both cohorts we used the same  operational  definition for exacerbation of copd , that is , symptomatic deterioration requiring pulsed oral steroid use or hospitalization.1517 the list of candidate predictors to be studied was based on the literature and was limited to those predictors that are readily available in clinical practice . the list of selected potential predictors included age,10 fev1,9,10,18,19 previous exacerbations,9,10,19,20 body mass index,1820 pack years smoked , history of vascular disease,2123 and history of ischemic heart disease ( ihd ) . previous exacerbations were considered present if at least one exacerbation occurred in the year prior to the baseline assessment , also defined as symptomatic deterioration requiring pulsed oral steroid use or a hospitalization . for fev1 , the post - bronchodilator value was used , and the percentage of predicted ( % predicted ) fev1 according to age , height , and sex was calculated . a history of ihd was defined as a history of myocardial infarction , angina pectoris , percutaneous coronary intervention , or coronary artery bypass grafting . a history of vascular disease was defined as stroke , transient ischemic attack , or peripheral arterial disease . in the validation cohort , follow - up information was missing for three participants ( 1.3% ) , and these patients were excluded from the analyses . in six participants ( 2.5% ) , data on previous exacerbations were missing . in the validation cohort , post - bronchodilator fev1 values were missing in eleven patients ( 1.4% ) , smoking status in 161 patients ( 20.3% ) , and number of pack years in 398 patients ( 50.2% ) . rubin s rules25 were applied to the 25 multiple imputation sets to calculate the pooled c - statistics . as the exclusion of patients with a missing value ( so - called complete - case analysis ) in general may lead to biased results , we performed a separate reanalysis that was restricted to complete cases  of the univariable associations between the number of pack years smoked and exacerbations . the univariable odds ratios were similar to those derived from the imputed dataset , although with broader confidence intervals ( cis ) . descriptive analyses were used to assess differences in baseline characteristics of patients who experienced an exacerbation in the 2 years after the baseline assessment and those who did not . for model development , we used multivariable logistic regression analysis to examine the independent association between candidate predictors and the occurrence of a copd exacerbation within 24 months . age , fev1 , and pack years were assessed on their continuous scale . to improve linearity , we started with all six preselected candidate predictors in the model and then applied backward - selection procedures , using a p - value<0.20 from the log likelihood ratio test to select predictors for the final model . the beta coefficients of the predictors in the final model were multiplied by the shrinkage factor derived from the 500 bootstrap samples.26 the performance of the final model ( after shrinkage ) was assessed with the c - statistic and its 95% ci , and calibration was assessed with a calibration plot . for validation of the model , the predicted probabilities were calculated for each patient in the validation set using the regression coefficients , after shrinkage , from the original model obtained from the derivation cohort . in a calibration plot , data were analyzed using spss 20.0 for windows ( ibm corporation , armonk , ny , usa ) and r ( v 2.9.2 ; the r foundation for statistical computing , vienna , austria ) . descriptive analyses were used to assess differences in baseline characteristics of patients who experienced an exacerbation in the 2 years after the baseline assessment and those who did not . for model development , we used multivariable logistic regression analysis to examine the independent association between candidate predictors and the occurrence of a copd exacerbation within 24 months . age , fev1 , and pack years were assessed on their continuous scale . to improve linearity , we started with all six preselected candidate predictors in the model and then applied backward - selection procedures , using a p - value<0.20 from the log likelihood ratio test to select predictors for the final model . the beta coefficients of the predictors in the final model were multiplied by the shrinkage factor derived from the 500 bootstrap samples.26 the performance of the final model ( after shrinkage ) was assessed with the c - statistic and its 95% ci , and calibration was assessed with a calibration plot . for validation of the model , the predicted probabilities were calculated for each patient in the validation set using the regression coefficients , after shrinkage , from the original model obtained from the derivation cohort . in a calibration plot , data were analyzed using spss 20.0 for windows ( ibm corporation , armonk , ny , usa ) and r ( v 2.9.2 ; the r foundation for statistical computing , vienna , austria ) . during the 24-month follow - up period , 70 ( 29.2% ) patients experienced at least one exacerbation of copd in the derivation cohort , and 222 ( 28.0% ) in the validation cohort . for both cohorts , the number of exacerbations increased with increasing severity of copd and ranged from 22% of patients with mild copd ( gold i ) to 45% in patients with severe copd ( gold iii / iv ) . disease classification according to the gold criteria13 and other baseline characteristics of the 240 patients from the derivation cohort and 793 patients from the validation cohort , stratified by occurrence of an exacerbation , are summarized in tables 1 and 2 . in the multivariable analysis , decreased values of fev1 , previous exacerbations , pack years of smoking , and vascular disease were independent predictors of an exacerbation within 24 months . the model discriminated well with a c - statistic after shrinkage of 0.75 ( 95% ci : 0.690.82 ) and with a shrinkage factor of 0.90 . calibration of the model was good : the predicted and actual risks of exacerbation within 24 months were in close agreement ( figure 1 ) . the model showed a moderate discrimination in the validation cohort , with a c - statistic of 0.66 ( 95% ci : 0.620.71 ) . the calibration plot indicated close agreement between the predicted and observed risks ( figure 1 ) . in the multivariable analysis , decreased values of fev1 , previous exacerbations , pack years of smoking , and vascular disease were independent predictors of an exacerbation within 24 months . the model discriminated well with a c - statistic after shrinkage of 0.75 ( 95% ci : 0.690.82 ) and with a shrinkage factor of 0.90 . calibration of the model was good : the predicted and actual risks of exacerbation within 24 months were in close agreement ( figure 1 ) . the model showed a moderate discrimination in the validation cohort , with a c - statistic of 0.66 ( 95% ci : 0.620.71 ) . the calibration plot indicated close agreement between the predicted and observed risks ( figure 1 ) . our study shows that easy - to - assess variables are independently associated with the occurrence of future copd exacerbations . a model including these variables from history - taking and spirometry ( fev1 % predicted ) could be used by both pulmonologists and gps in everyday care . after external validation , our model showed moderate discrimination ( c - statistic 0.66 ) and a good calibration . our findings that lower levels of fev1 as % predicted and that a history of previous exacerbations are related to an increased risk of future exacerbations are in line with previous studies.9,10,1820 hurst et al20 identified previous exacerbations as the single best predictor of future exacerbations . to examine this claim in our cohort , we tested previous exacerbations as a single value , which resulted in c - statistics of 0.66 and 0.59 in the derivation and validation cohort , respectively . this suggests that other predictors are needed to more adequately predict future exacerbations in a broad sample of patients with copd . we also evaluated the dose index in our derivation cohort.11 this index yielded a c - statistic of 0.65 , which is considerably lower than our own model . unfortunately , we could not evaluate the widely accepted bode index,5 because we did not perform a 6-minute walking test in any of our cohorts . importantly , however , when we applied the bode index without information on exercise capacity , it resulted in a poor c - statistic of 0.61 in the derivation cohort . moreover , the performance of the bode index on prediction of future exacerbations is rather poor in other than the original cohorts , with c - statistics of 0.67 and 0.62.6 we also considered cardiovascular diseases because they are a major cause of morbidity and mortality in patients with copd.2730 low - grade systemic inflammation and smoking are key components in the pathophysiology of vascular plaque formation , which may explain the increased rates of cardiovascular disease in copd.31 importantly , however , copd patients with concomitant ihd did not experience a higher incidence of copd exacerbations in our population , a result similar to previous studies.30,32 on the other hand , a history of vascular disease ( including stroke ) was positively ( and independently ) associated with copd exacerbations in our study . although the relationship between deep venous thrombosis and exacerbations is well studied,2123 vascular disease at large , including peripheral arterial disease and stroke , has not been identified before as a predictor of future copd exacerbations . peripheral arterial disease is possibly associated with more severe copd,33 and this might translate into the observed association between vascular disease and the risk of future exacerbations . increased platelet activation could be a mechanism that plays a role in this association.34 we were not able to include all potential predictors available from the literature , such as exercise capacity , the st george s respiratory questionnaire , oxygen therapy , and gastroesophageal reflux , because these variables were not available in the derivation cohort . importantly , however , most of these variables are not available in clinical practice , and , thereby , these predictors would not be useful for prediction within individual patients in everyday practice . it has become increasingly clear that the severity and frequency of exacerbations is only marginally related to disease severity . because most patients with copd can be classified as gold i and ii ( ie , mild copd ) , the absolute number of exacerbations and overall burden is largest in those with mild copd.20 this illustrates the importance of including patients with gold i and ii , as we did in our study . patients in the validation cohort were younger ; more frequently current smokers ; had , in general , milder disease ; were more likely to have vascular disease ; and experienced fewer exacerbations in the previous year than the derivation cohort . despite these differences in baseline characteristics (  case mix  ) , the model yielded acceptable discrimination ( c - statistic 0.66 ) and good calibration , indicating that our findings are generally applicable , including in younger copd patients . the relatively small sample size of the derivation cohort could be considered a limitation of the study . we chose this data set because the data were prospectively collected , with , as a result , a higher quality of data compared to the validation cohort . the definition of copd exacerbations is always a challenge in follow - up studies such as ours . we used symptomatic deterioration requiring pulsed oral steroid use or hospitalization as a definition for exacerbation . this is somewhat different from previous studies that also included treatment with antibiotics.3537 in dutch primary care guidelines on copd , short - course oral corticosteroids are recommended for copd exacerbations , and addition of antibiotics should only be considered when bacterial infection is suspected.38 thus , exacerbations of copd are rarely , if ever , treated solely with antibiotics only in the netherlands . as a result , with our definition , all exacerbations are captured in the derivation and validation cohort and , as such , our results are generalizable to other populations of copd , including in other parts of the world . we used logistic regression modeling to estimate the risk of occurrence of copd exacerbations within the proceeding 24 months . cox proportional hazards modeling would also have been a valid approach for risk estimation , but we chose logistic regression analysis because we considered each exacerbation within our predefined time frame of 2 years to be of equal importance , regardless of whether this exacerbation occurred early or late in the follow - up period . furthermore , calculation of absolute probabilities of exacerbation in future patients is more straightforward using the coefficients of a logistic model than it would be for a cox survival model due to the unspecified baseline function in the latter.39 to the best of our knowledge , this is the first study providing predictors of future exacerbations in a broad spectrum of patients with copd , including patients with mild disease . because we developed and tested the model in a sample of the copd patient population at large , the applicability of the model is broad and seems applicable to both primary and secondary care . the performance of our prediction model is very promising , and the applicability of the model is facilitated by the limited number of predictors in the model and their ready availability in daily practice . the model helps clinicians to identify copd patients at high risk of exacerbations and to guide intensified management and monitoring of these patients . to determine the impact of our prediction model on daily practice in terms of patient outcome and the use of health care resources , an implementation study should be performed . cardiovascular disease should be considered in the management of these patients , and adequate treatment of vascular disease could possibly reduce the risk of future exacerbations .
purposeprediction models for exacerbations in patients with chronic obstructive pulmonary disease ( copd ) are scarce . our aim was to develop and validate a new model to predict exacerbations in patients with copd.patients and methodsthe derivation cohort consisted of patients aged 65 years or over , with a copd diagnosis , who were followed up over 24 months . 
 the external validation cohort consisted of another cohort of copd patients , aged 50 years or over . 
 exacerbations of copd were defined as symptomatic deterioration requiring pulsed oral steroid use or hospitalization . logistic regression analysis including backward selection and shrinkage 
 were used to develop the final model and to adjust for overfitting . 
 the adjusted regression coefficients were applied in the validation cohort to assess calibration of the predictions and calculate changes in discrimination applying c-statistics.resultsthe derivation and validation cohort consisted of 240 and 793 patients with copd , of whom 29% and 28% , respectively , experienced an exacerbation during follow - up . the final model included four easily assessable variables : exacerbations in the previous year , pack years of smoking , level of obstruction , and history of vascular disease , with a c - statistic of 0.75 ( 95% confidence interval [ ci ] : 0.690.82 ) . 
 predictions were well calibrated in the validation cohort , with a small loss in discrimination potential ( c - statistic 0.66 [ 95% ci 0.610.71]).conclusionour newly developed prediction model can help clinicians to predict the risk of future exacerbations in individual patients with copd , including those with mild disease .