Pulmonary infection after cardiopulmonary bypass surgery in children: a risk estimation model in China

Abstract

Objectives

The occurrence of pulmonary infection after congenital heart disease (CHD) surgery can lead to significant increases in intensive care in cardiac intensive care unit (CICU) retention time, medical expenses, and risk of death risk. We hypothesized that patients with a high risk of pulmonary infection could be screened out as early after surgery. Hence, we developed and validated the first risk prediction model to verify our hypothesis.

Methods

Patients who underwent CHD surgery from October 2012 to December 2017 in the Children’s Hospital of Chongqing Medical University were included in the development group, while patients who underwent CHD surgery from December 2017 to October 2018 were included in the validation group. The independent risk factors associated with pulmonary infection following CHD surgery were screened using univariable and multivariable logistic regression analyses. The corresponding nomogram prediction model was constructed according to the regression coefficients. Model discrimination was evaluated by the area under the receiver operating characteristic curve (ROC) (AUC), and model calibration was conducted with the Hosmer-Lemeshow test.

Results

The univariate and multivariate logistic regression analyses identified the following six independent risk factors of pulmonary infection after cardiac surgery: age, weight, preoperative hospital stay, risk-adjusted classification for congenital heart surgery (RACHS)-1 score, cardiopulmonary bypass time and intraoperative blood transfusion. We established an individualized prediction model of pulmonary infection following cardiopulmonary bypass surgery for CHD in children. The model displayed accuracy and reliability and was evaluated by discrimination and calibration analyses. The AUCs for the development and validation groups were 0.900 and 0.908, respectively, and the P-values of the calibration tests were 0.999 and 0.452 respectively. Therefore, the predicted probability of the model was consistent with the actual probability.

Conclusions

Identified the independent risk factors of pulmonary infection after cardiopulmonary bypass surgery. An individualized prediction model was developed to evaluate the pulmonary infection of patients after surgery. For high-risk patients, after surgery, targeted interventions can reduce the risk of pulmonary infection.

Introduction

Congenital heart disease (CHD) is the most common birth defect worldwide [1].Most CHD patients require surgical treatment. Hospital-acquired infections (HAIs) are a major cause of morbidity and mortality in paediatric patients undergoing cardiac surgery [2, 3]. Pulmonary infection results in significant morbidity (e.g., increased antibiotic usage, prolonged hospital and intensive care unit (ICU) stays, and prolonged periods of mechanical ventilation and inotropic support), which contributes to an increase in mortality [2, 4]. With the progress in cardiothoracic surgery, cardiopulmonary bypass surgery, myocardial protection and postoperative nursing practices, the survival rate of children with CHD has significantly improved. However, secondary ischaemia-reperfusion injury, hypothermia and surgical trauma can induce supplementary cascade reactions, the release of endotoxins, the activation of leukocytes and vascular endothelial cells, and the release of inflammatory cytokines, leading to a temporary immunosuppressive state [5, 6]. During the process of postoperative recovery, this immunosuppressive state leaves children vulnerable to infection and increases the risk of HAIs [2].

There are reports of risk factors for nosocomial infection after CHD surgery locally and abroad, but there are few reports on pulmonary infection [2, 7, 8]. The occurrence of pulmonary infection varied among different studies; from 11.6% in hospitals in the U.S.A. to 30 to 60 and 65.6% in hospitals in Spain and Mexico,respectively [2, 3]. Pulmonary infection is a common hospital-acquired infection in children after cardiopulmonary bypass surgery; at present, we can routinely use advanced antibiotics / antiviral drugs / strong airway management for all patients after cardiopulmonary bypass surgery, but this is not in accordance with the principle of antibiotic use or the economic benefits of patients. Identifying risk factors for pulmonary infection after cardiopulmonary bypass surgery and attempting to use these risk factors to create a risk prediction model is necessary. Therefore, we established a risk prediction model based on the possibility of postoperative pulmonary infection in patients undergoing CHD surgery. We constructed a nomogram to allow doctors to screen for high-risk patients after surgery. These patients should receive targeted interventions to reduce the risk of pulmonary infections, and these interventions should be evaluated in future clinical trials. The reported risk prediction model was developed and reported in accordance with the guideline for the Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) [9, 10].

Methods

Source of data and participants

Retrospective data were collected from the Children’s Hospital of Chongqing Medical University from October 2012 to October 2018. The study was conducted in accordance with the Declaration of Helsinki and was approved by the Ethical Committee of Chongqing Medical University. Written informed consent was obtained from the patients’ parents before inclusion in this study. The research data were anonymized, and personal identifiers were completely removed.

The clinical data of 1776 patients who underwent cardiac surgery under cardiopulmonary bypass between October 2012 and December 2017 were collected. Patients admitted to the thoracic surgery ward with a clinical and two-dimensional echocardiogram-based diagnosis of CHD [11], which was established by paediatric cardiologists, and who underwent cardiac surgery under cardiopulmonary bypass during hospitalization were enrolled. No therapeutic antibiotics were administered the week before surgery. All patients entered the CICU for further treatment after surgery.

All patients entered the CICU after operation, all patients were treated separately nurse, avoiding contact with the family and the outside world. The primary end point of the analysis was “pulmonary infection,” The criteria for the diagnosis of pulmonary infection was as follows: Chest radiograph showing new or worsening lung infiltrates (cannot be explained by other reasons), coughing up purulent sputum or purulent secretions in the trachea, and having any of the following: ①Bronchoalveolar lavage fluid (BALF) or Anti-pollution brush sampling is positive for quantitative culture; ②lower respiratory tract culture and blood culture are both positive and the same pathogen; ③lower respiratory tract culture and pleural fluid culture are both positive and the same pathogen [12, 13]. For patients with incomplete demographic data, patients with preoperative pulmonary infection or patients with other disease and those without cardiopulmonary bypass surgery were excluded.

Outcome and predictors

The primary outcome of the study was the occurrence of pulmonary infection after cardiopulmonary bypass surgery. Because our goal was to predict the probability of the occurrence of pulmonary infection after surgery by creating a model, the endpoint was the end of surgery, and the analysis included preoperative data and intraoperative data.

We selected candidate variables based on previously identified risk factors for pulmonary infection after cardiac surgery [2, 7, 8, 14] as well as potential risk factors based on the clinical suspicion of the authors. We collected and analysed the following factors for all the subjects: general information (sex, age, weight), preoperative data (risk-adjusted classification for congenital heart surgery (RACHS)-1 scores, pulmonary hypertension, preoperative hospital stay, preoperative total protein content, preoperative albumin), and intraoperative data (anaesthesia time, cardiopulmonary bypass time, aortic occlusion time, operation time, intraoperative blood transfusion). Sex, pulmonary hypertension, and intraoperative blood transfusion were set as binary variables. Age, weight, preoperative hospital stay, anaesthesia time, cardiopulmonary bypass time and aortic occlusion time, operation time, preoperative total protein content and preoperative albumin were grouped by optimal scale regression grouping (Table 1). The patients were divided into two groups according to their RACHS-1 [15,16,17] scores and the methods of a previous study [18].

Table 1 Baseline characteristics in the development group and validation group

Model development

The results showed that among 1776 patients, the number of candidate predictors was 13, so the sample size met the basic requirements to build the model. We also introduced a data set for external validation to verify the reliability of the model. No comparison to other relative risk prediction models was needed, as our model was the first model in the field.

Statistical analysis

The measurement data in this study were all count data. Therefore, the count data were expressed as frequencies (percentages). The count data were analysed using the chi-square test. A multiple collinearity test was used to exclude confounding factors. Risk factor analysis was performed using univariate and multivariate logistic regression analyses. Data were not used in the multivariate logistic regression if the variance inflation factor (VIF) was greater than 10. Variables showing statistical significance in the univariate analysis were included in the multivariate logistic regression analysis, and the forward stepwise method was used to select the variables that were eventually included in the model [19].

Based on the collinearity diagnostics of the independent variables, we established an individualized nomogram prediction model of pulmonary infection following surgery for CHD in children.

Measures of calibration and discrimination assessed the predictive performance of the models. The prediction model was evaluated in terms of discrimination and calibration. The discrimination of the prediction model refers to its ability to distinguish between patients with pulmonary infection after surgery and patients with no pulmonary infection after surgery. A dichotomized outcome discrimination is most often assessed by calculating the area under the curve (AUC) of the receiver operating characteristic (ROC) curve. The AUC value is between 0.5 and 1.0 [20]. The closer the AUC value is to 1, the better the discrimination capacity the prediction model has. Generally, a prediction model with an AUC of 0.5–0.75 is considered acceptable, and an AUC > 0.75 indicates that the model shows excellent discrimination [19].

The statistical analyses were performed using SPSS version 24 (IBM, Armonk, NY, U.S.A) and RStudio software (U.S.A).

Results

Patient demographics

In this study, a total of 2171 patients were enrolled, with 1776 in the development group and 395 in the validation group. In the development group, 580 patients presented pulmonary infections and 1196 patients did not develop pulmonary infections. In the validation group, 128 patients presented pulmonary infections and 267 patients did not develop pulmonary infections. Age and weight were significantly lower, RACHS-1 scores were significantly higher, preoperative hospital stay was significantly longer and intraoperative blood transfusion occurred more often in the pulmonary infection group than in the non-pulmonary infection group. In the non-pulmonary infection group, anaesthesia time, cardiopulmonary bypass time, aortic occlusion time and operation time were significantly shorter than those in the pulmonary infection group (Table 1).

Nomogram development

The univariate analysis of the development group showed that the statistically significant risk factors were age, weight, RACHS-1 score, preoperative hospital stay, anaesthesia time, cardiopulmonary bypass time, aortic occlusion time and intraoperative blood transfusion (P < 0.05), whereas sex, pulmonary hypertension, preoperative total protein content and preoperative albumin were not related to pulmonary infection (Table 2). The statistically significant variables from the univariate analysis were included in the non-conditional binary multivariate logistic regression. The six factors of age, weight, RACHS-1 score, preoperative hospital stay, cardiopulmonary bypass time and intraoperative blood transfusion were independent risk factors of pulmonary infection after surgery for CHD (Table 2). We conducted collinearity diagnostics for the above independent risk factors, and the variance inflation factors VIFs were 2.869,2.877,1.394,1.100,1.535 and 1.243 respectively, suggesting that there was no multiple collinearity among the six independent risk factors.

Table 2 Univariate and multivariate logistic regression models for the development group

Based on the logistic multivariate regression analysis, the six independent risk factors were included in the prediction model. We then establish an individualized nomogram prediction model of pulmonary infection after surgery (Fig. 1).

Fig. 1

Nomogram to predict the probability of pulmonary infection after cardiopulmonary bypass surgery. To estimate the probability of pulmonary infection after cardiopulmonary bypass surgery, the value of each factor is acquired on each variable axis, then a straight line is drawn upward to determine the points. The sum of these 6 numbers is located on the Total Points axis and a line is drawn downward to the Diagnostic Possibility axes to determine the likelihood of pulmonary infection after cardiopulmonary bypass surgery

Nomogram validation

The validation of the model was based on discrimination and calibration. We drew the ROC curves of the predicted probability (Figs. 2, 3) and calculated the AUCs for the development and validation groups [20]. The ROC curve was used to compare the AUC values of the six independent risk factors from the nomogram and multivariate analysis (Table 3); the differences were statistically significant (P < 0.05). The AUC values were 0.900 and 0.908 for the development group and the validation group. The P-values for the calibration tests for the two groups were 0.999 and 0.452 respectively (Figs. 4, 5). Therefore the predicted probability of the model was consistent with the actual probability [21].

Fig. 2

ROC curves for Development group

Fig. 3

ROC curves for Validation group

Table 3 The AUCs of the ROC curves for the nomogram and variables from the logistic regression model for the development group and validation group

Fig. 4

Calibration plots of the nomogram for the probability of pulmonary infection after cardiopulmonary bypass surgery. (Development group)

Fig. 5

Calibration plots of the nomogram for the probability of pulmonary infection after cardiopulmonary bypass surgery. (Validation group)

Discussion

Pulmonary infection is a major cause of morbidity and mortality in paediatric patients undergoing cardiac surgery [2]. And patients with CHD have unique characteristics, ischemia-reperfusion injury, low temperature and surgical trauma can cause transient immunosuppression in the body [5, 6]. Therefor, the occurrence of pulmonary infection after cardiac surgery is reported to be high at home and abroad [2, 3]. Our study showed that the incidence of pulmonary infection in our centre was approximately 30%. For a surgeon, controlling perioperative pulmonary infection is a very serious consideration. But we donundefinedt know which patients be at high risk of pulmonary infection after surgery. Often, patients with pulmonary infections were found when the symptoms are serious. Therefore, it is very important to identify patients with a high-risk of pulmonary infection after CHD surgery. Patients with a high-risk of infections after surgery should be identified early so that medical staff can focus on monitoring and care, and if possible, administe interventional treatments in advance [22]. In our study, we identified risk factors for pulmonary infection and created a model that can be used to estimate a patient’s pulmonary infection risk. We validated the model by using another data set for external validation and showed that it had good discrimination. The clinical tool can help us assess the risk of pulmonary infection for the patients following the end of the procedure.

Previous studies have evaluated risk factors for specific types of postoperative infections. Cardiopulmonary bypass time, an increased duration of surgery, a prolonged preoperative stay, young age and low body weight increased the risk of infection. Prolonged cardiopulmonary bypass can easily lead to the decrease of immune function and the disorder of water electrolyte and acid-base balance. The cardiopulmonary function and immune function of children with CHD are poor, and often need longer cardiopulmonary bypass support, which will significantly increase the burden of the body, further decrease the immune function of children, resulting in long cardiopulmonary bypass time become a risk factor for the occurrence of pulmonary infection after congenital heart disease. With the growth of children, the development of their own respiratory tract and the establishment of immune function, so pulmonary infection is more likely to occur in children of young age and low body weight [2, 3, 7, 18, 23,24,25,26] .The review by Dresbach et al. [27] reported the central venous catheter (CVC) indwelling time was an independent risk factor for infection. Costello et al. [28] reported that the transfusion of blood products was an independent risk factor for infection. However, none of the previous studies developed a model considering preoperative and operative factors that can be clinically applied to predict the risk of pulmonary infection in patients who treated in the CICU after surgery [14]. In this study, the factors that were significantly associated with pulmonary infection in the multivariable analysis were largely similar to previously identified risk factors. The factor that accounted for the greatest increase in risk was high complexity. Anaesthesia time, aortic occlusion time and operation time were associated with pulmonary infection in the univariate analysis, but did not remain risk factors according to the multivariable analysis, suggesting that these factors may be reflected in cardiopulmonary bypass time. In our study, sex, pulmonary hypertension, preoperative albumin content, and intraoperative albumin content were not associated with pulmonary infection in the univariate analysis. Some previous studies reported that postoperative ventilator time was a risk factor [14]. Our clinical tool was created to be used at the end of the surgery, so we did not include this candidate variable in our study.

Based on the characteristics of patients with CHD in our region, we successfully developed a risk prediction model based on age, weight, RACHS-1 score, preoperative hospital stay, cardiopulmonary bypass time and intraoperative blood transfusion. An objective evaluation of a model is necessary, and a valuable model can be characterized by the 2 related properties of discrimination and calibration [19, 20]. The model was regarded as clearly useful according to the discrimination analysis because the AUC was more than 0.75. The calibration of the prediction model was perfect in both groups. The discrimination and calibration results indicated that the model results were similar to the actual situation [29]. We constructed a nomogram to reduce multiple statistical predictive models into a single numerical estimate of the probability of an event [30]. Doctors can use the nomogram to easily assess the possibility of pulmonary infection following surgery for CHD.

In our study, all patients had no pulmonary infection before surgery, and the first generation of cephalosporins were used to prevent infection before surgery. After the operation, they were sent to the CICU for further treatment. In the CICU, all patients were all isolated and treated individually by medical staff to minimize exposure to external sources of infection exposure and other factors. Patients with pulmonary infection after surgery were diagnosed, we would adopt strong airway management and antibiotic treatment schemes. However, we attempted to assess our patients after operation as soon as they were admitted to the CICU, in order to assess the possibility of pulmonary infection following surgery for CHD. For patients with high possibility of pulmonary infection, we would conduct more intensive care, and adopt strong airway management, such as emphasizing physical support treatment of the respiratory tract, moisturizing sputum, and timely clearing of airway secretions, etc. Such patients need to pay attention to the role of auxiliary therapies such as oxygen therapy and sedation. Previous studies have shown that gram-negative bacilli are the most common pathogens in pulmonary infection after cardiopulmonary bypass surgery [18], patients with a high-risk of infections after surgery were screened out by our clinical tool, we speculate that the use of antibiotics against gram-negative bacilli may achieve ideal results for these patients.

The strengths of this study are that this was the first risk prediction model for pulmonary infection following cardiopulmonary bypass surgery for CHD in children in our region, and the developed model can be easily applied in clinical situations. However, there are some limitations to this study. First, it was a retrospective study, that could not avoid selection bias. However, we strictly set the inclusion criteria and collected relatively adequate clinical samples so that our clinical tool the truly reflected the actual condition of occurrence. Second, the study was a single-centre study. Although we used patient samples from different periods to validate the model, we still need evidence from other centres for validation. Multicentre studies with large sample should be developed in the future. Therefore, in the follow-up research, we will persuade other medical centres to join this research project and will provide the appropriate clinical data to conduct an in-depth assessment and validation of the prediction model.

Conclusions

An individualized nomogram prediction model was developed to evaluate pulmonary infection in patients after surgery. We can accurately predict the risk of pulmonary infection in patients after surgery with this prediction model. For high-risk patients, after surgery, targeted interventions to reduce the risk of pulmonary infection should be applied.