Preoperative risk stratification models fail to predict hospital cost of cardiac surgery patients
© Badreldin et al.; licensee BioMed Central Ltd. 2013
Received: 6 October 2012
Accepted: 29 April 2013
Published: 9 May 2013
Preoperative risk stratification models have previously been suggested to predict cardiac surgery unit costs. However, there is a lack of consistency in their reliability in this field. In this study we aim to test the correlation between the values of six commonly known preoperative scoring systems and evaluate their reliability at predicting unit costs of cardiac surgery patients.
Over a period of 14 months all consecutive adult patients undergoing cardiac surgery on cardiopulmonary bypass were prospectively classified using six preoperative scoring models (EuroSCORE, Parsonnet, Ontario, French, Pons and CABDEAL). Transplantation patients were the only patients we excluded. Total hospital costs for each patient were calculated independently on a daily basis using the bottom up method. The full unit costs were calculated including preoperative diagnostic tests, operating room cost, disposable materials, drugs, blood components as well as costs for personnel and fixed hospital costs. The correlation between hospital cost and the six models was determined by linear regression analysis. Both Spearman’s and Pearson’s correlation coefficients were calculated from the regression lines. An analysis of residuals was performed to determine the quality of the regression.
A total of 887 patients were operated on for CABG (n = 608), valve (n = 142), CABG plus valve (n = 100), thoracic aorta (n = 33) and ventricular assist devices (n = 4). Mean age of the patients was 68.3±9.9 years, 27.6% were female. 30-day mortality rate was 4.1%. Correlation between the six models and hospital cost was weak (Pearson’s: r < 0.30; Spearman’s: r < 0.40).
The risk stratification models in this study are not reliable at predicting total costs of cardiac surgical patients. We therefore do not recommend their use for this purpose.
KeywordsHospital cost Cardiac surgery Scoring models
Preoperative risk stratification scoring models have been used to predict mortality after heart surgery . Several studies have suggested that these models can be used to predict the total cost of cardiac surgical patients [2–7]. An admission scoring model that can accurately predict an estimate of patients’ cost would facilitate allocation of resources as well as the planning of more economical patient care. As these models were originally designated for the sole purpose of predicting mortality we find their use to predict events other than mortality (e.g. morbidity or hospital cost) questionable. Hence, we reviewed the literature searching for previous studies that investigated the correlation between preoperative cardiac surgical scoring models and total hospital costs. We then conducted a prospective study to evaluate these scoring systems as a predictor of total hospital costs in open heart surgery. The six models we evaluated were: EuroSCORE, Parsonnet, Ontario, French, Pons and CABDEAL.
Risk factors for all consecutive adult patients undergoing open heart surgery in the department of Cardiothoracic Surgery at the University of Cologne, over a period of 14 months, were prospectively collected. The patients’ records contained all variables necessary to match the criteria for all six risk stratification scoring systems: EuroSCORE , Parsonnet , Ontario , French , Pons , and CABDEAL . We have used the additive EuroSCORE and not the logistic EuroSCORE, to keep it consistent with the other models.
All information required was collected on patient admission and were documented in the quality control system QIMS 2.0b (University hospital of Muenster, Germany). Relevant laboratory data were collected electronically from the central laboratories and were integrated in the QIMS 2.0b system. The attending physicians collected the data and checked for accuracy. The data collection and calculations of the scoring systems were validated by both a medical clerk and a senior supervisor.
Total hospital costs were calculated on a daily basis for each patient using the bottom up method. All costs were calculated including preoperative diagnostic tests, operating room costs, disposables, drugs, blood components as well as costs for personnel, and hospital-fixed costs, according to the “Manual for calculating patient costs; Version 3.0” published in the year 2007 by the German Hospital Federation (DKG) and the German insurance companies (GKV and PKV).
No experimental research was conducted for this study neither on humans nor on animals. All data were measured within the limits of a routine ICU admission of each individual patient. Therefore an ethical approval was not necessary.
Statistical analyses were performed using SPSS software version 18 (SPSS Inc, Chicago, IL, USA). Continuous scale data are presented as mean ± standard deviation (SD) and were analyzed by the Kolmogorov–Smirnov test for normal distribution. A p-value < 0.05 was considered significant for all tests.
Linear regression analysis was used to determine the correlation between costs and the six risk stratifications models. Both Pearson’s and Spearman’s correlation coefficients were calculated from the regression line. An analysis of residuals was performed to determine the quality of the regression.
The Pearson’s correlation coefficient (r) measures the linear association between two scale variables (in this study, the score points and the total hospital cost). A perfect positive (increasing) linear correlation is represented by +1 and a perfect negative decreasing linear relationship is represented by −1 . As values approach zero there is less correlation and zero represents no correlation. Generally, correlations above 0.80 are considered high.
Furthermore, the t-test is used to establish if the correlation coefficient is significantly different from zero, and, hence that there is evidence of an association between the two variables. This means that, when the p-value of Pearson’s test is significant, this indicates only that there is merely a linear relation between both variables. But this significance does not indicate if this relation (correlation) is high or low. This p-value is influenced by the sample size; however, with larger sample sizes the strength of the correlation weakens.
The normal distribution of the data in both variables is a prerequisite for Pearson’s test. If this is not the case, the conclusions may well be invalidated. Accordingly, it is better to use Spearman’s coefficient.
Rank correlation coefficients, such as Spearman’s measures the extent to which, as one variable increases, the other variable tends to increase or decreases, without requiring that this association is a linear relationship. Spearman’s test is an alternative test to Pearson’s to make the coefficient less sensitive to non-normality in distributions. However, Spearman’s test is best seen as a measure of a different type of association, rather than as alternative measure [15, 16].
Unlike Pearson’s correlation, Spearman’s correlation indicates that as the value of one variable (score model in this study) changes, there is always a change in the value of the other variable (total hospital cost), when there is a perfect rank correlation. On the other hand, Pearson’s correlation is perfect when the increase in the first variable is accompanied with an equal change (increase or decrease) in the other variable. Accordingly, a good Spearman’s correlation does not necessarily mean a good Pearson’s correlation as well. Hence, the values of the two coefficients cannot meaningfully be compared .
Preoperative patient characteristics of the study population
All patients (n = 887)
80.55 ± 13.33
Ejection Fraction (<50%)
Permanent pace maker
Recent myocardial infarction (< 90 days)
Preoperative cardiac massage
Ventricular tachycardia or fibrillation
Chronic Obstructive Pulmonary Disease
Creatinine > 1.6 mmol/l
Acute renal failure
Focal neurological deficit
Previous cardiac surgery
Mean values of the preoperative risk stratification models
Data of different operative procedures performed during the study period
30-day mortality (%)
71.3 ± 124.3
15.5 ± 7.9
83.2 ± 92.0
15.8 ± 6.7
CABG + Valve
134.8 ± 198.4
18.6 ± 15.4
255.7 ± 320.9
19.97 ± 10.4
359.0 ± 280.0
22.75 ± 11.7
88.5 ± 148.8
16.7 ± 8.9
Values of total hospital cost and reimbursement in Euro for different operative procedures
Costs per patient
Reimbursement per patient
10,761.29 ± 6,319.15
12,949.37 ± 6,922.07
14,030.38 ± 5,211.57
17,089.57 ± 6,635.17
CABG + Valve
17,440.30 ± 11,261.86
19,455.60 ± 9,502.96
23,931.19 ± 16,721.23
25,656.26 ± 20,727.58
82,544.65 ± 15,885.09
46,853.25 ± 37,305.62
12,851.31 ± 9,428.97
14,999.33 ± 9,292.13
The correlation of all preoperative scoring models with the total hospital cost was weak with correlation coefficients ranging between 0.122 and 0.264, according to Pearson’s test and between 0.122 and 0.372, according to Spearman’s test. This is despite a significant difference from zero in both tests with a p-value < 0.01 all through in both tests, except for the correlation of CABDEAL score with the reimbursement, which was not different from zero (uncorrelated) with p = 0.05.
Statement of key findings
The purpose of this study was to evaluate whether the six preoperative risk stratification models can predict total hospital costs in cardiac surgical patients. The results show that all of these models have low correlation with total hospital cost and reimbursement (r < 0.4).
Results of previous studies
Several studies concluded that preoperative risk stratification models, initially designed to predict mortality, are also useful for predicting resource utilization in cardiac surgical patients [2–7]. Haehnel et al.  suggested that the Cleveland score predicts costs in cardiac surgery. Unfortunately this paper shows this finding graphically only, without giving a correlation coefficient or a p-value. Kurki et al.  also evaluated the relationship between the Cleveland score and hospital costs. Again, no information about the correlation value was provided.
Moreover, both Pinna Pintor et al.  and Nilsson et al.  used a log transformation of the dependent variable (hospital cost) in order to measure the relationship between EuroSCORE and hospital costs. The advantage of this transformation is that the influence of outliers is reduced and that the regression analysis looks better. This procedure gives an inflated sense of dependence of the hospital costs on the predictor variable (EuroSCORE) .
Correlation of scoring models with total hospital cost
Correlation of scoring models with reimbursement
Ferraris et al.  found a poor correlation between the New York State risk model and hospital costs. A similar finding was reported by Riordan et al. , who demonstrated that the STS model is a poor predictor of costs on an individual patient level. The correlation coefficient in this study was r = 0.34. Both studies were confirmed by our data although we used different risk stratification models.
Length of ICU-stay and total costs
All studies mentioned above [2–7, 20, 21] showed a good relationship between hospital costs and length of stay in the ICU, which was also confirmed by our study (r = 0.94, p = 0.0001, Figure 2). Time in the operating room (OR) is the most expensive part of hospitalization, however, OR time is relatively uniform between patients. The second most expensive stay is in the ICU which highly variable in this study (range was 14 – 1776 hours). Therefore, total hospital costs are likely to be correlated mainly with the ICU length of stay. The pre-operative hospitalization and non-ICU portion of the convalescence are much less expensive. However, this correlation between total cost and ICU length of stay can be calculated only after ICU discharge, which does not help the allocation of resources upon admission.
The cost of a non-fatal complication due to cardiac surgery is difficult to predict with existing models for risk-assessment. This may be because the models were designed to predict death rather than costs of morbid events. Also patients with complications do not necessarily have longer admission times, which introduce considerable variability when attempting to predict hospital cost from preoperative risk-assessment data. The failure of the six risk models tested in predicting costs is not surprising, since they were designed to predict mortality [10–13, 22, 23]. Thus, development of more accurate morbidity scores may be an option to achieve appropriate financial risk models.
All six preoperative scoring models evaluated here fail to accurately predict the total costs of a cardiac surgery patient. Reconsidering the variable of these scores and their additive weight regarding the total hospital cost as an outcome is recommended to produce a reliable financial risk model.
Written informed consent was not obtained from the patients for publication of this report or any accompanying images, since we report of a large population not about an individual patient. No image of an individual patient is accompanied.
European system for cardiac risk evaluation
Intensive care unit
- Geissler HJ, Holzl P, Marohl S, Kuhn-Regnier F, Mehlhorn U, Südkamp M, de Vivie ER: Risk stratification in heart surgery: comparison of six score systems. Eur J Cardiothorac Surg. 2000, 17 (4): 400-406. 10.1016/S1010-7940(00)00385-7.View ArticlePubMed
- Haehnel JC, Roth P, Lohmann E, Meisner H, Hehrlein FW: Implications of the introduction of fixed reimbursement rates in Germany. Thorac Cardiovasc Surg. 1996, 44 (2): 97-102. 10.1055/s-2007-1011994.View ArticlePubMed
- Kurki TS, Hakkinen U, Lauharanta J, Ramo J, Leijala M: Evaluation of the relationship between preoperative risk scores, postoperative and total length of stays and hospital costs in coronary bypass surgery. Eur J Cardiothorac Surg. 2001, 20 (6): 1183-1187. 10.1016/S1010-7940(01)00988-5.View ArticlePubMed
- Kurki TS, Kataja MJ, Reich DL: Validation of a preoperative risk index as a predictor of perioperative morbidity and hospital costs in coronary artery bypass graft surgery. J Cardiothorac Vasc Anesth. 2002, 16 (4): 401-404. 10.1053/jcan.2002.125153.View ArticlePubMed
- Sokolovic E, Schmidlin D, Schmid ER, Turina M, Ruef C, Schwenkglenks M, Szucs TD: Determinants of costs and resource utilization associated with open heart surgery. Eur Heart J. 2002, 23 (7): 574-578. 10.1053/euhj.2001.3031.View ArticlePubMed
- Pinna Pintor P, Bobbio M, Colangelo S, Veglia F, Marras R, Diena M: Can EuroSCORE predict direct costs of cardiac surgery?. Eur J Cardiothorac Surg. 2003, 23 (4): 595-598. 10.1016/S1010-7940(02)00868-0.View ArticlePubMed
- Nilsson J, Algotsson L, Höglund P, Lührs C, Brandt J: EuroSCORE predicts intensive care unit stay and costs of open heart surgery. Ann Thorac Surg. 2004, 78: 1528-1535. 10.1016/j.athoracsur.2004.04.060.View ArticlePubMed
- Roques F, Nashef SA, Michel P, Gauducheau E, de Vincetii C, Baudet E, Cortina J, David M, Faichney A, Gabrielle F, Gams E, Harjula A, Jones MT, Pintor PP, Salamon R, Thulin L: Risk factors and outcome in European cardiac surgery: analysis of the EuroSCORE multinational database of 19030 patients. Eur J Cardiothorac Surg. 1999, 15 (6): 816-822. 10.1016/S1010-7940(99)00106-2. discussion 822–3View ArticlePubMed
- Parsonnet V, Dean D, Bernstein AD: A method of uniform stratification of risk for evaluating the results of surgery in acquired adult heart disease. Circulation. 1989, 79 (6 Pt 2): I3-I12.PubMed
- Tu JV, Jaglal SB, Naylor CD: Multicenter validation of a risk index for mortality, intensive care unit stay, and overall hospital length of stay after cardiac surgery. Steering committee of the provincial adult cardiac care network of Ontario. Circulation. 1995, 91 (3): 677-684. 10.1161/01.CIR.91.3.677.View ArticlePubMed
- Roques F, Gabrielle F, Michel P, De Vincentiis C, David M, Baudet E: Quality of care in adult heart surgery: proposal for a self-assessment approach based on a French multicenter study. Eur J Cardiothorac Surg. 1995, 9 (8): 433-439. 10.1016/S1010-7940(05)80078-8. discussion 439–40View ArticlePubMed
- Pons JM, Granados A, Espinas JA, Borras JM, Martin I, Moreno V: Assessing open heart surgery mortality in Catalonia (Spain) through a predictive risk model. Eur J Cardiothorac Surg. 1997, 11 (3): 415-423. 10.1016/S1010-7940(96)01061-5.View ArticlePubMed
- Kurki TS, Kataja M: Preoperative prediction of postoperative morbidity in coronary artery bypass grafting. Ann Thorac Surg. 1996, 61 (6): 1740-1745. 10.1016/0003-4975(96)00142-7.View ArticlePubMed
- Dowdy S, Wearden S: Statistics for Research. 1983, New York: John Wiley & Sons Inc
- Yule GU, Kendall MG: An Introduction to the Theory of Statistics. 1950, London: Griffin
- Kendall MG: Rank Correlation Methods. 1955, London: Griffin
- Bühl A, Zöfel P: SPSS Version 10. 2000, München: Addison Wesley Verlag, 319-332. 7
- Ferraris VA: Invited commentary. Ann Thorac Surg. 2004, 78 (5): 1534-1535. 10.1016/j.athoracsur.2004.05.078.View ArticlePubMed
- Edbrooke D, Nightingale P: Relationship between TISS and costs in intensive care. Intensive Care Med. 1998, 24 (10): 995-996. 10.1007/s001340050706.View ArticlePubMed
- Ferraris VA, Ferraris SP, Singh A: Operative outcome and hospital cost. J Thorac Cardiovasc Surg. 1998, 115 (3): 593-602. 10.1016/S0022-5223(98)70324-1. discussion 602–3View ArticlePubMed
- Riordan CJ, Engoren M, Zacharias A, Schwann TA, Parenteau GL, Durham SJ, Habib RH: Resource utilization in coronary artery bypass operation: does surgical risk predict cost?. Ann Thorac Surg. 2000, 69 (4): 1092-1097. 10.1016/S0003-4975(99)01562-3.View ArticlePubMed
- Nashef SA, Roques F, Michel P, Gauducheau E, Lemeshow S, Salamon R: European system for cardiac operative risk evaluation (EuroSCORE). Eur J Cardiothorac Surg. 1999, 16 (1): 9-13. 10.1016/S1010-7940(99)00134-7.View ArticlePubMed
- Kurki TS, Jarvinen O, Kataja MJ, Laurikka J, Tarkka M: Performance of three preoperative risk indices; CABDEAL, EuroSCORE and Cleveland models in a prospective coronary bypass database. Eur J Cardiothorac Surg. 2002, 21 (3): 406-410. 10.1016/S1010-7940(02)00007-6.View ArticlePubMed
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.