Victória Helena Stelzer RochaI; Paulo Henrique MansoI; Fábio CarmonaI
DOI: 10.21470/1678-9741-2020-0521
ABSTRACT
Introduction: Major adverse events (MAE) are unexpected but undesirably frequent after pediatric congenital heart surgery and contribute to poorer outcomes. The aim of this study was to test the predictive value of a ratio between central venous oxygen saturation and arterial lactate (ScvO2/lactate) for MAE after pediatric congenital heart surgery in a Brazilian university hospital.AUC = Area under the receiver operating characteristics curve
CI = Confidence interval
CPB = Cardiopulmonary bypass
cTnI = Cardiac troponin I
IL = Interleukin
LCOS = Low cardiac output syndrome
MAE = Major adverse events
NPV = Negative predictive value
PPV = Positive predictive value
RACHS-1 = Adjustment for Congenital Heart Surgery 1
ROC = Receiver operating characteristics
ScvO2 = Central venous oxygen saturation
SD = Standard deviation
VIS = Vasoactive-inotropic score
INTRODUCTION
Major adverse events (MAE) are unexpected but undesirably frequent after pediatric congenital heart surgery and contribute to poorer outcomes. A MAE can be defined as cardiac arrest (with or without extracorporeal life support), emergency chest reopening or reoperation, and death[1]. Identifying patients at risk for MAE is challenging, but it could help physicians and nurses to monitor and allocate more resources to specific patients to prevent or rapidly address and treat a MAE. This has been attempted with the use of clinical examination (capillary refill time, pulses, urine output, core-toe temperature gradient), classical (heart rate, arterial blood pressure, central venous pressure, etc) and more advanced (cardiac index, systemic or pulmonary vascular resistance) hemodynamic variables, and laboratorial tests (lactate, base excess, arterial or central venous oxygen saturation [ScvO2]), but these approaches lacked sensitivity[1,2].
Arterial lactate and ScvO2 are indirect markers of hypoxia, reflecting poor tissue perfusion, and exhibit higher sensitivity and specificity for predicting MAE than other variables do, especially after pediatric congenital heart surgery. However, when isolated, they still have low accuracy, but a combination of these two markers (a ratio between ScvO2 and arterial lactate, named ScvO2/lactate ratio), when < 5, showed a positive predictive value (PPV) of 93.8% for MAE, as well as 78.9% sensitivity and 90.5% specificity[1]. More recently, the vasoactive-inotropic score (VIS) was associated with poor outcomes after pediatric congenital heart surgery[3].
However, the predictive value of ScvO2/lactate ratio for MAE after pediatric congenital heart surgery, with a cutoff value of 5, has not been validated in other populations. Therefore, we aimed to retrospectively assess the predictive value of ScvO2/lactate ratio for MAE after pediatric congenital heart surgery in a Brazilian university hospital. We hypothesized that a low ScvO2/lactate ratio would have a PPV of 90% or more for MAE.
METHODS
This was a retrospective observational study carried out in a single center, a Brazilian tertiary care university hospital, the Hospital das Clínicas, Faculdade de Medicina de Ribeirão Preto, Universidade de São Paulo. The study followed the Brazilian regulations for research on human subjects[4], it was approved by the local institutional review board (Research Ethics Committee HCFMRP-USP, protocol #CAAE: 99316918.0.0000.5440), and informed consent was waived. This study followed the STROBE recommendations for observational studies (https://www.strobe-statement.org/).
All patients < 18 years old submitted to congenital heart surgery between 2015 and 2017 were eligible for the study. The inclusion criteria were age < 18 years, gestational age ≥ 37 weeks, body weight ≥ 2 kg, and being submitted to open heart surgery. The exclusion criteria were death in the operation room, lack of information on medical records, and not having ScvO2 or lactate measured within 12 hours after surgery.
Data were retrieved from the electronical medical records, including demographic, clinical, surgical, and laboratorial data. An anonymized database was created using the Research Electronic Data Capture (or REDCap)[5]. Our primary outcome was the occurrence of a MAE within 48 hours after surgery — at least one of the following: cardiac arrest, unplanned reoperation, emergency chest reopening, low cardiac output syndrome (LCOS), or death. Unplanned reoperation was defined as the need for an additional, unanticipated surgical procedure or revision as a result of a significant postoperative residual lesion. Emergency chest reopening was defined as the need of sternum opening for exploration, bleeding control, or to alleviate pressure on the mediastinum. LCOS was clinically defined as the presence of altered mental status, mottled skin, cold extremities, prolonged capillary refill time (> 2 seconds), and weak pulses.
All ScvO2 measurements were done in venous blood drawn from catheters placed in the superior vena cava or in the right atrium (in the absence of left-to-right shunt). Lactate was measured in blood drawn from indwelling arterial lines already in place or from arterial puncture. The ScvO2/lactate ratios were calculated using paired measurements (within the same hour). The first values obtained within 0-6, 6-12, 12-24, and 24-48 hours after surgery were used for analysis, as well as the worst values within the first 48 hours (lowest for ScvO2 and ScvO2/lactate ratio, and highest for lactate). In all patients, only measurements made before the occurrence of MAE were considered in the analysis.
Statistical Analysis
All results were described by means and standard deviations, medians and interquartile ranges, or counts (percentages). The continuous independent variables were categorized, and the best cutoff points for each one were determined by adjusting receiver operating characteristics (ROC) curves. The areas under the ROC curves (AUC), sensitivity, specificity, PPV, and negative predictive value (NPV) were also calculated. The individual contributions of each independent variable to the prediction of MAE were assessed by adjusting a multiple log-binomial regression model. The significance level was set at 0.05. Statistical packages JASP version 0.12.2 (JASP Team), Statistical Package for the Social Sciences (SPSS Inc. Released 2008, SPSS Statistics for Windows, Version 17, Chicago: SPSS Inc.), and Stata 14.0 (StataCorp, 2015, Stata Statistical Software: Release 14, College Station, TX: StataCorp LP.) were used.
RESULTS
A total of 197 patients were eligible for the study, but only 194 (98%) were included (Figure 1). The reason for exclusion of three patients was death at the operation room. The overall incidence of MAE was 16% (31 patients). The demographic, clinical, and surgical characteristics of all patients are depicted in Table 1. In short, patients who experienced a MAE were younger, more complex, and had higher VIS at the end of surgery and 12 hours after that. The types of MAE we observed are listed in Table 2.
Despite experiencing MAE, some patients also had minor/moderate adverse events and complications (92 events) — pleural effusion, cardiac arrhythmia, reintubation, pneumonia, and mechanical ventilation > 7 days were the most frequent events. They are described in Table 3.
The mortality for patients who experienced a MAE was significantly higher than that of patients in the control group (45.1% vs. 6.7%, P<0.001). Patients who experienced MAE had significantly higher lactate levels and significantly lower ScvO2 and ScvO2/lactate ratio values than those not experiencing MAE at all time frames after surgery, except for lactate between six and 12 hours (Table 4). For ScvO2, the AUC in all time frames were good discriminants of MAE. The best AUC for ScvO2 was obtained with the lowest value between zero and 48 hours after surgery (0.763) (Figure 2A). For lactate, all AUC were good discriminants of MAE, and the best AUC was obtained with the values between 12 and 48 hours (0.806) (Figure 2B). For ScvO2/lactate ratio, values in all time frames were also good discriminants of MAE. The best AUC for ScvO2/lactate ratio was the lowest value between zero and 48 hours after surgery (0.841) (Figure 2C). ScvO2/lactate ratio had the higher AUC for prediction of MAE.
Characteristic | Control (n=163) | MAE (n=31) | P-value |
---|---|---|---|
Gender, male, n (%) | 102 (63%) | 16 (52%) | 0.252 |
Age, months (mean ± SD) | 34±52 | 14±43 | 0.044 |
RACHS-1 category, n (%) | 0.031 | ||
1 | 49 (36%) | 2 (13%) | |
2 | 34 (25%) | 2 (13%) | |
3 | 44 (33%) | 9 (56%) | |
4 | 8 (6%) | 3 (19%) | |
VIS at end of surgery (mean ± SD) | 11.4±15.4 | 21.1±24.1 | 0.004 |
VIS 12 hours after end of surgery (mean ± SD) | 9.6±10.8 | 25.4±23.3 | < 0.001 |
Cardiopulmonary bypass duration, minutes (mean ± SD) | 118±55 | 136±76 | 0.160 |
Table 5 presents a comparison between different cutoff points for ScvO2/lactate ratio. All cutoff points rendered good NPV, but very low PPV and variable sensitivity and specificity. The lower cutoff (< 5) increases specificity at the cost of a low sensitivity, while the higher cutoff (< 17) increases sensitivity at the cost of low specificity. The intermediate cutoff point (< 9) yields very good NPV, and low sensitivity (61%) with fair specificity (85%). The cutoff < 5 had the best accuracy (87%). According to each cutoff, the relative risks of a patient with a ScvO2/lactate ratio < 5, < 9, or < 17 experience a MAE were 6.33 (95% confidence interval [CI] 3.60-11.2), 5.40 (95% CI 2.85-10.2), and 3.64 (95% CI 1.77-7.47), respectively. Based on these numbers, having a ScvO2/lactate ratio < 5 at any time within 48 hours after surgery is associated with a six-fold increased risk of MAE, with accuracy of 87% and specificity and NPV > 90%.
DISCUSSION
We have shown that ScvO2/lactate ratio can accurately predict the occurrence of MAE within 48 hours after pediatric congenital heart surgery, with very good NPV, but poor PPV. Thus, our hypothesis was not confirmed. This means that ScvO2/lactate ratio > 5 is best suitable for identifying patients at low risk of MAE. We have also confirmed that ScvO2/lactate ratio is superior to either variable alone for this purpose.
Complication | Control (n=163) | MAE (n=31) | Total (n=194) |
---|---|---|---|
Pleural effusion | 2 (1.2%) | 22 (70.9%) | 24 (12.4%) |
Cardiac arrhythmia | 5 (3.1%) | 6 (19.3%) | 11 (5.7%) |
Reintubation | - | 7 (22.6%) | 7 (3.6%) |
Pneumonia | 2 (1.2%) | 3 (9.7%) | 5 (2.6%) |
Mechanical ventilation, > 7 days | 2 (1.2%) | 3 (9.7%) | 5 (2.6%) |
Bleeding | 3 (1.8%) | 1 (3.2%) | 4 (2.1%) |
Seizure | 1 (0.6%) | 3 (9.7%) | 4 (2.1%) |
Unplanned extubation | - | 3 (9.7%) | 3 (1.6%) |
Sepsis and septic shock | - | 3 (9.7%) | 3 (1.6%) |
Pneumothorax | - | 3 (9.7%) | 3 (1.6%) |
Chylothorax | - | 2 (6.5%) | 2 (1.0%) |
Malignant hyperthermia | 1 (0.6%) | - | 1 (0.5%) |
Infectious endocarditis | - | 1 (3.2%) | 1 (0.5%) |
Pulmonary hypertension | - | 1 (3.2%) | 1 (0.5%) |
Catheter-based procedure, unplanned | - | 1 (3.2%) | 1 (0.5%) |
Marker | Control (n=163) | MAE (n=31) | P-value | |
---|---|---|---|---|
ScvO2 (%) | 0-6 h | 59±23 | 48±25 | 0.031 |
6-12 h | 58±23 | 50±10 | 0.157 | |
12-24 h | 59±21 | 47±18 | 0.023 | |
24-48 h | 59±21 | 47±18 | 0.023 | |
Lowest value | 54±23 | 40±25 | 0.005 | |
Lactate (mmol/L) | 0-6 h | 2.8±2.2 | 7.7±6.7 | < 0.001 |
6-12 h | 2.6±1.7 | 7.4±6.5 | < 0.001 | |
12-24 h | 2.2±1.4 | 5.7±5.4 | < 0.001 | |
24-48 h | 2.2±1.4 | 5.7±5.4 | < 0.001 | |
Highest value | 3.3±2.7 | 10.7±7.8 | < 0.001 | |
ScvO2/lactate ratio | 0-6 h | 29.9±18.6 | 14.0±10.6 | < 0.001 |
6-12 h | 31.1±23.4 | 15.4±10.3 | 0.009 | |
12-24 h | 37.1±22.0 | 15.3±11.9 | < 0.001 | |
24-48 h | 43.9±25.6 | 18.1±13.5 | < 0.001 | |
Lowest value | 24.8±18.2 | 8.8±9.5 | < 0.001 |
The need for predicting tools for the occurrence of MAE is not new. Many studies have focused on lactate clearance, time of elevated lactate, cardiopulmonary bypass (CPB) duration, inflammatory markers, and other markers, and emphasis have been put in predicting LCOS, but an ideal predictive tool has not been found yet, as of today.
One of the first attempts was made in a study with 63 neonates undergoing heart surgery for transposition of the great arteries, in which high postoperative levels of cardiac troponin T, interleukin (IL)-6, and IL-8 were associated with LCOS[6]. In 46 children submitted to open heart surgery, our group showed that preoperative N-terminal pro-B-type natriuretic peptide plus postoperative IL-8 or platelet count were independent predictors of LCOS (sensitivity 93%, specificity 75%, PPV 87%, and NPV 86%), while CPB duration or postoperative IL-8 plus postoperative cardiac troponin I (cTnI) were independent predictors of death (sensitivity 100%, specificity 65%, PPV 38%, and NPV 100%)[7]. In 99 consecutive children undergoing open heart surgery for congenital heart disease, a cTnI level > 13 ng/mL four hours postoperatively predicted LCOS with sensitivity of 0.78, specificity of 0.72, and AUC of 0.75. In addition, cTnI was the only predictive variable associated with LCOS in multivariate logistic regression analysis[8]. In a study of 312 post CPB neonates, an oxygen delivery index had an AUC of 0.79, showing good prediction of low ScvO2, as a surrogate for LCOS[9]. In 117 children submitted to open heart surgery, the VIS score at two hours after CPB was an independent predictor of LCOS[10]. A LCOS score (tachycardia, oliguria, toe temperature < 30 °C, volume administration > 30 mL/kg/day, decreased near infrared spectroscopy measurements, hyperlactatemia, and need for vasoactive/inotropes in excess of milrinone at 0.5 μg/kg/min) showed an AUC for a composite morbidity (prolonged mechanical ventilation, new infection, cardiopulmonary arrest, neurologic event, renal dysfunction, necrotizing enterocolitis, and extracorporeal life support) of 0.83 in 55 patients undergoing pediatric open heart surgery[11]. Later, a modified LCOS score was superior to the inadequate oxygen delivery index in predicting adverse events linked to LCOS in 536 bypass pediatric operations for congenital heart defects[12].
Only a few studies focused on the detection of MAE, a more comprehensive outcome than LCOS. Duke et al.[2] studied a cohort of 90 children submitted to heart surgery and investigated the predictive value of several variables for MAE. They found an incidence of MAE of 13.3% (ours was 18.9%), and the independent predictors of MAE were lactate (measured at intensive care unit admission), CPB duration, lactate and CO2 difference (both measured four hours after admission), and lactate and base deficit (both measured eight hours after admission). They did not study ScvO2/lactate ratio specifically. Kalyanaraman et al.[13] studied 129 children submitted to heart surgery and evaluated the predictive value of repeated measurements of arterial lactate for MAE. Moreover, they looked at the amount of time that lactate was > 2 mmol/L (“lactime”). They concluded that “lactime” had 98% sensitivity, but only 60% PPV for a postoperative MAE. Later, Schumacher et al.[14] studied 231 infants undergoing cardiac surgery, and found that a lactate increase rate of 0.6 mmol/L/h had very good discriminatory ability (AUC 0.89) with a sensitivity of 90%, specificity of 84%, PPV of 34%, and NPV of 99% for a poor outcome (death, need for extracorporeal support, and dialysis). More recently, in a cohort of 257 pediatric patients undergoing cardiac surgery, the incidence of MAE was 19% and mortality was 13%. The predictors of MAE were cyanotic congenital heart disease, longer CPB duration (> 120 minutes), high inotropes (at least two, at high doses), and increase in lactate > 0.75 mmol/L/h or more in the first 24 hours (odds ratio 37.1, 95% CI 10.1-136.3)[15].
Before our study, only one study assessed the predictive value of the ScvO2/lactate ratio for MAE. Seear et al.[1] showed, in 52 children submitted to heart surgery, that a ScvO2/lactate ratio < 5 predicted MAE with PPV of 93.8%, sensitivity of 78.9% and specificity of 90.5% (NPV was not reported). They also showed that the PPV of ScvO2/lactate ratio was higher than those of a ScvO2 < 40% (58.3%) or a lactate > 8 mmol/L (63.6%) alone. In our study, using the same cutoff point (< 5), NPV was higher than PPV, specificity was high, but sensitivity was too low. These results suggest that calculating the ScvO2/lactate ratio when caring for a pediatric patient right after open heart surgery is an easy, quick, and inexpensive tool that may help physicians to identify patients at low risk of MAE, allocating more resources to those at higher risk.
Limitations
The limitations of our study include: (a) retrospective data, implying that some MAE may have not been properly recorded and that ScvO2 and lactate were not consistently measured; and (b) the significant heterogeneity of heart conditions and surgeries, which compromises generalizability to other centers and populations. Therefore, our results need to be taken with caution.
REFERENCES
1. Seear MD, Scarfe JC, LeBlanc JG. Predicting major adverse events after cardiac surgery in children. Pediatr Crit Care Med. 2008;9(6):606-11. [MedLine]
2. Duke T, Butt W, South M, Karl TR. Early markers of major adverse events in children after cardiac operations. J Thorac Cardiovasc Surg. 1997;114(6):1042-52. doi:10.1016/S0022-5223(97)70018-7. [MedLine]
3. Gaies MG, Jeffries HE, Niebler RA, Pasquali SK, Donohue JE, Yu S, et al. Vasoactive-inotropic score is associated with outcome after infant cardiac surgery: an analysis from the Pediatric cardiac critical care consortium and virtual PICU system registries. Pediatr Crit Care Med. 2014;15(6):529-37. doi:10.1097/PCC.0000000000000153. [MedLine]
4. Ministério da Saúde. Conselho Nacional de Saúde. Resolução CNS n.o 466, de 12 de dezembro de 2012. Aprova as diretrizes e normas de pesquisa envolvendo seres humanos e regova as Resoluções CNS nos. 196/96, 303/2000 e 404/2008. Brasília (DF): Ministério da Saúde; 2012.
5. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377-81. doi:10.1016/j.jbi.2008.08.010. [MedLine]
6. Hövels-Gürich HH, Vazquez-Jimenez JF, Silvestri A, Schumacher K, Minkenberg R, Duchateau J, et al. Production of proinflammatory cytokines and myocardial dysfunction after arterial switch operation in neonates with transposition of the great arteries. J Thorac Cardiovasc Surg. 2002;124(4):811-20. doi:10.1067/mtc.2002.122308. [MedLine]
7. Carmona F, Manso PH, Vicente WV, Castro M, Carlotti AP. Risk stratification in neonates and infants submitted to cardiac surgery with cardiopulmonary bypass: a multimarker approach combining inflammatory mediators, N-terminal pro-B-type natriuretic peptide and troponin I. Cytokine. 2008;42(3):317-24. doi:10.1016/j.cyto.2008.03.005. [MedLine]
8. Froese NR, Sett SS, Mock T, Krahn GE. Does troponin-I measurement predict low cardiac output syndrome following cardiac surgery in children? Crit Care Resusc. 2009;11(2):116-21. [MedLine]
9. Baronov D, McManus M, Butler E, Chung D, Almodovar MC. Next generation patient monitor powered by in-silico physiology. Annu Int Conf IEEE Eng Med Biol Soc. 2015;2015:4447-53. doi:10.1109/EMBC.2015.7319382. [MedLine]
10. Pérez-Navero JL, Merino-Cejas C, Ibarra de la Rosa I, Jaraba-Caballero S, Frias-Perez M, Gómez-Guzmán E, et al. Evaluation of the vasoactive-inotropic score, mid-regional pro-adrenomedullin and cardiac troponin I as predictors of low cardiac output syndrome in children after congenital heart disease surgery. Med Intensiva. 2019;43(6):329-36. doi:10.1016/j.medin.2018.04.005.
11. Ulate KP, Yanay O, Jeffries H, Baden H, Di Gennaro JL, Zimmerman J. An elevated low cardiac output syndrome score is associated with morbidity in infants after congenital heart surgery. Pediatr Crit Care Med. 2017;18(1):26-33. doi:10.1097/PCC.0000000000000979. [MedLine]
12. Rogers L, Ray S, Johnson M, Feinstein Y, Dominguez TE, Peters MJ, et al. The inadequate oxygen delivery index and low cardiac output syndrome score as predictors of adverse events associated with low cardiac output syndrome early after cardiac bypass. Pediatr Crit Care Med. 2019;20(8):737-43. doi:10.1097/PCC.0000000000001960.
13. Kalyanaraman M, DeCampli WM, Campbell AI, Bhalala U, Harmon TG, Sandiford P, et al. Serial blood lactate levels as a predictor of mortality in children after cardiopulmonary bypass surgery. Pediatr Crit Care Med. 2008;9(3):285-8. doi:10.1097/PCC.0b013e31816c6f31. [MedLine]
14. Schumacher KR, Reichel RA, Vlasic JR, Yu S, Donohue J, Gajarski RJ, et al. Rate of increase in serum lactate level risk-stratifies infants after surgery for congenital heart disease. J Thorac Cardiovasc Surg. 2014;148(2):589-95. doi:10.1016/j.jtcvs.2013.09.002. [MedLine]
15. Murni IK, Djer MM, Yanuarso PB, Putra ST, Advani N, Rachmat J, et al. Outcome of pediatric cardiac surgery and predictors of major complication in a developing country. Ann Pediatr Cardiol. 2019;12(1):38-44. doi:10.4103/apc.APC_146_17. [MedLine]
Authors' roles & responsibilities
VHSR Substantial contributions to the design of the work; and the acquisition and analysis of data for the work; drafting the work; final approval of the version to be published
PHM Substantial contributions to the conception of the work; revising the work critically for important intellectual content; final approval of the version to be published
FC Substantial contributions to the conception or design of the work; and analysis of data for the work; drafting the work; final approval of the version to be published
Article receive on Monday, September 28, 2020
Article accepted on Tuesday, October 6, 2020