FormalPara Key Summary Points

Why carry out this study?

Respiratory depression occurs in 46% of patients receiving opioids on the general care floor, where standard of care monitoring consists of intermittent pulse oximetry spot-checks.

Continuous pulse oximetry and capnography monitoring can detect respiratory depression, but the cost–benefit of continuous pulse oximetry and capnography monitoring is unknown.

The purpose of this study was to model the cost and length of stay savings, investment break-even point, and likelihood of cost savings for continuous pulse oximetry and capnography monitoring of general care floor patients at risk for respiratory depression.

What was learned from the study?

Continuous pulse oximetry and capnography monitoring of high-risk patients could reduce annual hospital cost by $535,531 and cumulative patient length of stay by 103 days, reaching a break-even investment point when the incidence of respiratory depression decreases by 1.5%.

Compared to intermittent pulse oximetry, continuous pulse oximetry and capnography monitoring of general care floor patients receiving opioids has a high chance of being cost-effective.

Plain Language Summary

Respiratory depression occurs when a person has an abnormally slow breath rate, low oxygen saturation, low or high concentration of exhaled carbon dioxide, or stops breathing intermittently. This condition occurs in 46% of patients receiving opioids in medical and surgical hospital units. Respiratory depression can be detected using continuous respiratory monitoring to measure respiratory rate, heart rate, blood oxygen saturation, and exhaled carbon dioxide. However, the cost–benefit of continuous respiratory monitoring in patients hospitalized in medical and surgical units is unknown. We created an economic model to predict differences in hospital cost and patient length of stay when using continuous respiratory monitoring, compared to intermittent blood oxygen saturation and heart rate monitoring. This model predicts the break-even point where the cost of investing in monitoring technology will equal the costs saved by preventing respiratory depression, and evaluates the chance that continuous respiratory monitoring will be cost saving. If patients at highest risk for respiratory depression are continuously monitored, the model projects annual hospital cost will decrease by $535,531, and total length of stay of all patients will decrease by 103 days. The cost of investing in monitoring is predicted to equal the cost savings if respiratory depression decreases by 1.5%, and there is a high probability of the investment being cost saving. The model also predicts that continuous monitoring will reduce annual cost and length of stay if patients at high and intermediate risk, or if all patients, undergo continuous respiratory monitoring. Overall, continuous respiratory monitoring has a high chance of being cost-effective.

Digital Features

This article is published with digital features, including a summary slide and plain language summary, to facilitate understanding of the article. To view digital features for this article go to https://doi.org/10.6084/m9.figshare.14541750.

Introduction

Respiratory depression is common on hospital general care floors, where nurses traditionally assess vital signs every 4–6 h [1,2,3]. However, compared to intermittent assessment of respiratory status, continuous electronic monitoring detects significantly more cardiorespiratory events [1, 4]. For example, 20% of all postoperative patients experience significant time under hypoxemic thresholds, and almost all go undetected with intermittent monitoring [1]. Low respiratory rate occurs in 41% of patients in the post-anesthesia care unit and general care floor [5].

Recently, the PRediction of Opioid-induced respiratory Depression In patients monitored by capnoGraphY (PRODIGY) trial reported that 46% of postsurgical and medical patients receiving parenteral opioids experienced respiratory depression episodes [2]. This prospective trial comprehensively assessed respiratory depression, monitoring patients with blinded continuous pulse oximetry and capnography, including strict time and threshold cutoffs to define respiratory depression [2]. The PRODIGY trial found that adverse events requiring rescue action or prolonged hospitalization occurred more often in patients with monitor-detected respiratory depression episodes [2, 6]. This is consistent with prior reports using continuous pulse oximetry or capnography only [1, 5], further substantiating that respiratory depression may be preventable with better monitoring and earlier intervention [2, 6, 7].

Respiratory opioid-related adverse events (ORADE) are costly to healthcare systems [8,9,10]. In particular, unrecognized respiratory depression contributes to poor patient outcomes and longer lengths of stay that increase healthcare cost [6, 11,12,13]. Compared to United States (US) general care floor patients without respiratory depression, hospital cost is $3686 higher in patients with respiratory depression [6]. Although professional organizations and their clinical practice guidelines recommend the use of electronic respiratory monitoring, the majority of US hospitals do not have an adequate supply of devices [14, 15]. This is because despite current evidence that early recognition of respiratory depression can potentially decrease hospital cost, instituting continuous monitoring is perceived as requiring significant financial investment [16].

The purpose of this analysis was to evaluate the economic value of continuous monitoring by modeling the investment break-even point and likelihood of cost savings with continuous pulse oximetry and capnography monitoring compared to intermittent pulse oximetry monitoring of general care floor patients receiving opioids.

Methods

A model was developed to estimate the investment break-even point and likelihood of cost savings associated with implementation of continuous pulse oximetry and capnography monitoring of US general care floor patients at risk for respiratory depression. The model, which follows good practice guidelines (International Society of Pharmacoeconomics and Outcomes Research) [17], was created using a decision tree framework in Excel (Microsoft, Redmond, WA). The model considers a budget holder perspective for a median-sized US hospital and projects cost over a 1-year time horizon.

Model Structure

The model was created to compare costs and outcomes for (1) standard of care intermittent pulse oximetry monitoring versus (2) continuous respiratory monitoring with pulse oximetry and capnography of medical and surgical patients receiving opioids on the general care floor. Within the continuously monitored group, the model simulates outcomes for three scenarios: monitoring of patients at (1) high risk, (2) high and intermediate risk, or (3) any level (high, intermediate, or low) risk of respiratory depression, determined using the PRODIGY score (Fig. 1) [2]. This model considers three PRODIGY trial outcomes: (1) incidence of respiratory depression episodes, (2) length of stay, and (3) total hospital admission costs. Owing to lack of interventional data, the effect of implementing continuous monitoring was modeled from 0% to 100% reduction in respiratory depression.

Fig. 1
figure 1

Model framework, distinguishing between total annual hospital cost for a standard of care intermittent pulse oximetry monitoring and b implementation of continuous pulse oximetry and capnography monitoring based on patient PRODIGY score

PRODIGY Trial

The PRODIGY trial enrolled 1495 patients age ≥ 18, 20, and 21 across the USA and Europe, Japan, and Singapore, respectively. This post hoc analysis included only US patients who received parenteral opioids and underwent blinded continuous pulse oximetry and capnography monitoring on the general care floor (N = 758) [2, 18]. Continuous monitoring continued up to 48 h using the Capnostream™ 20p or 35 portable bedside monitor (Medtronic, Boulder, CO). The PRODIGY trial was conducted following institutional review board or ethics committee approval, with written informed consent collected from all patients. Respiratory depression episodes included respiratory rate ≤ 5 breaths/minute, oxygen saturation ≤ 85%, or end-tidal carbon dioxide ≤ 15 or ≥ 60 mmHg for ≥ 3 min; apnea episode for > 30 s; or any respiratory opioid-related adverse event [2, 18]. Each patient was retrospectively assessed for the risk of respiratory depression using the PRODIGY score, which was derived from the PRODIGY dataset using a multivariable logistic regression model [18]. The model includes five independent patient characteristics, including age ≥ 60 in decades, male sex, sleep disordered breathing, opioid naivety, and chronic heart failure [2]. Each variable is assigned a point value, and patients can be easily evaluated for their risk of respiratory depression based on the sum of the points assigned, with low (< 8 points), intermediate (≥ 8 and < 15 points), and high (≥ 15 points) risk categories [2, 6]. Since the PRODIGY dataset was used to derive the PRODIGY score, for the purposes of this analysis, each PRODIGY patient was retrospectively assigned a PRODIGY score based on his or her age, sex, opioid naivety, and presence of sleep disordered breathing and chronic heart failure [6].

Patients missing length of stay and hospital cost data (N = 11) or data required to determine PRODIGY score (N = 9) were excluded [6]. To determine the influence of patient outliers on the model, the analysis was performed using all patients with hospital costs available, and separately using a population excluding patient outliers for hospital cost or length of stay, identified using Cook’s distance [6].

Modeled Cohort

The model extrapolates PRODIGY outcomes to a cohort of general care floor patients receiving opioids in a median-sized US hospital. On the basis of the 2018 Premier® Healthcare Database, 90% of surgical patients and 45% of medical patients on US general care floors receive opioids, with a median 2447 opioid-receiving patients per hospital per year (95% CI 2092–2802) (Table S1 in Supplementary Material). This is consistent with recent literature [10, 19,20,21,22,23].

Model Inputs and Data Sources

Twenty percent (N = 171/835), 34% (N = 300/874), and 60% (N = 442/738) of the modeled cohort was allocated to low-, intermediate-, and high-risk respiratory depression groups, matching the PRODIGY trial distribution (Tables 1 and 2). PRODIGY cost and length of stay data were model inputs (Table 1) [6]. Discount rates, to determine net present value of costs and outcomes, and inflationary adjustments were not applied because of the model’s short time horizon and the recency of the PRODIGY trial. The same model structure was applied separately utilizing inputs from the PRODIGY cohort excluding outliers (Table S2 in Supplementary Material).

Table 1 Model inputs
Table 2 Model of cost and length of stay savings when continuous pulse oximetry and capnography monitoring is implemented

For intermittent pulse oximetry monitoring, device pricing consisted of a multiparameter monitor ($3000) prorated over 7 years and a reusable pulse oximetry sensor ($65). A US hospital with 27 opioid-receiving general care floor patients (Premier® Healthcare Database) would need three multiparameter monitors and two reusable pulse oximetry sensors per monitor, resulting in a device cost of $0.68 per patient stay. Continuous pulse oximetry and capnography device pricing consisted of a Capnostream™ portable respiratory monitor ($4300, Medtronic, Boulder, CO) prorated over 7 years, a Microstream™ capnography filterline ($14.50, Medtronic, Boulder, CO), and a disposable Nellcor™ pulse oximetry sensor ($8.50, Medtronic, Boulder, CO), for a device cost of $52.73 per monitored patient.

In the base case, the percentage reduction in patients with ≥ 1 respiratory depression episode was conservatively assumed at 20% reduction based on available literature, which reports a 34% risk reduction for intensive care unit (ICU) transfer upon implementation of continuous pulse oximetry monitoring, and reduction of severe opioid-related adverse events from 3.1/10,000 patients to 0.6/10,000 patients and a 50% decrease in rapid response calls due to opioid-induced respiratory depression following implementation of continuous capnography monitoring [16, 24, 25]. Break-even and sensitivity analyses did not rely on this assumption.

Modeled Scenarios

In the base case, the model evaluates annual hospital cost and cumulative patient length of stay using intermittent pulse oximetry monitoring of all general care floor patients receiving opioids, versus continuous pulse oximetry and capnography monitoring of general care floor patients with high respiratory depression risk receiving opioids (Fig. 1). Additional scenarios evaluate the same outcomes, comparing intermittent pulse oximetry monitoring versus continuous respiratory monitoring of general care floor patients receiving opioids with high and intermediate respiratory depression risk, or any level respiratory depression risk. Break-even analysis simulated the minimum requirements needed to justify the investment, modeling cost and length of stay savings as a function of the percentage respiratory depression reduction from 0% to 100%.

Sensitivity Analysis

Probabilistic sensitivity analysis was performed using 1000 Monte Carlo simulations [26] to determine the probability of continuous pulse oximetry and capnography monitoring being cost saving. The model estimates the investment break-even point and likelihood of cost savings when respiratory depression cases decrease from 0% to 100%. Parameters were assigned a probability distribution, including distinction of costs (gamma distribution), and epidemiological parameters (beta distributions), and accounted for the standard error of PRODIGY dataset parameters. One-way deterministic sensitivity analysis was performed to examine the effects of model parameters on cost and length of stay outcomes. The uncertainty of each parameter was determined using variability estimated from the PRODIGY dataset.

Results

Base Case

Across all general care floor patients receiving opioids, continuous pulse oximetry and capnography monitoring of patients with high risk for respiratory depression would result in $535,531 annual savings and a cumulative length of stay decrease of 103 days per year (Table 2), compared to standard of care intermittent pulse oximetry monitoring. This assumes a 20% respiratory depression reduction and an annual general care floor volume of 2447 patients receiving opioids per median-sized hospital (Table S1 in Supplementary Material). In this scenario, the model predicts that a 1.5% reduction in respiratory depression would achieve an investment break-even point, with cost and length of stay savings increasing linearly as respiratory depression decreases (Fig. 2a–b). Reducing respiratory depression by 10%, 20%, and 30% would decrease hospital costs by $341, $726, and $1110 per patient, respectively (Fig. S1A in Supplementary Material).

Fig. 2
figure 2

a Annual cost savings (US dollars) and b length of stay reduction predicted following implementation of continuous pulse oximetry and capnography monitoring on patients with high (blue line), high or intermediate (red line), or high, intermediate, or low (green line) risk for respiratory depression. Model was derived the on basis of the US PRODIGY cohort with cost data available, including outliers

Additional Monitoring Scenarios

A second scenario modeled the cost savings of continuously monitoring patients at high and intermediate respiratory depression risk with pulse oximetry and capnography, compared to intermittent pulse oximetry monitoring of all patients. In this scenario, cumulative patient length of stay would decrease by 152 days, with an annual savings of $606,463 (Table 2). The reduction in respiratory depression required to reach a break-even point was 2.5% (Fig. 2a).

The third scenario, in which all patients receiving opioids, regardless of risk for respiratory depression, undergo continuous respiratory monitoring, projected a cumulative length of stay savings of 204 days, with $688,221 in annual savings, compared to intermittent pulse oximetry monitoring of the same patients (Table 2). The projected break-even point would occur when respiratory depression decreased by 3.5% (Fig. 2a). These continuous monitoring scenarios are expected to linearly decrease per-patient cost and length of stay as respiratory depression decreases (Fig. S1A in Supplementary Material, Fig. 2b).

Monitoring Scenarios Excluding Patient Outliers

To evaluate the impact of patient outliers, a separate analysis was performed using the PRODIGY cohort excluding patient outliers. Compared to intermittent pulse oximetry monitoring on all patients, continuous pulse oximetry and capnography monitoring of patients with high respiratory depression risk would result in a 119-day reduction in cumulative length of stay and an annual hospital cost savings of $257,561 (Table S3 in Supplementary Material). A 3% reduction in respiratory depression would achieve an investment break-even point (Fig. S2A in Supplementary Material), with a $355 per-patient cost savings if respiratory depression decreased 20% (Fig. S1B in Supplementary Material). Similarly, the model excluding outliers predicts length of stay reductions of 183 and 216 days and annual savings of $380,405 and $497,734 following implementation of continuous respiratory monitoring on patients with high and intermediate risk of respiratory depression, or on all patients, respectively (Table S3 in Supplementary Material). In these scenarios, the break-even point would occur when respiratory depression decreases by 4–4.5%, with a linear decrease in length of stay as respiratory depression decreases (Fig. S2A-B in Supplementary Material).

Probabilistic Sensitivity Analysis

To achieve a ≥ 80% probability of cost savings when patients with high respiratory depression risk undergo continuous respiratory monitoring, a decrease in respiratory depression ≥ 17% would be needed. This increases to a ≥ 96% probability of cost savings if respiratory depression is decreased by ≥ 30% (Fig. 3). In scenarios in which continuous monitoring is applied to high- and intermediate-risk patients, or to all patients, a ≥ 27% and ≥ 31% reduction in respiratory depression would be needed to achieve a ≥ 80% probability of being cost saving, respectively (Fig. 3).

Fig. 3
figure 3

Probability of cost savings following implementation of continuous pulse oximetry and capnography monitoring on patients with high (blue line), high or intermediate (red line), or high, intermediate, or low (green line) risk for respiratory depression. Model was derived on the basis of the US PRODIGY cohort with cost data available, including outliers

Probabilistic sensitivity analysis of the model using the PRODIGY cohort excluding outliers projects that when patients with high, high or intermediate, or any respiratory depression risk undergo continuous monitoring, a respiratory depression decrease of ≥ 27%, ≥ 35%, and ≥ 35%, respectively, would be needed to achieve a ≥ 80% probability of being cost saving (Fig. S3 in Supplementary Material).

Deterministic Sensitivity Analysis

Model drivers were evaluated using one-way deterministic sensitivity analysis. For the model based on the PRODIGY cohort with outliers, admission cost of high- and intermediate-risk patients with respiratory depression had the strongest influence on model outcomes (Fig. S4A in Supplementary Material). Other drivers included the admission cost of high- and intermediate-risk patients without respiratory depression, the cost of low-risk patients with respiratory depression, and the number of general care floor patients receiving opioids per year. For the model excluding patient outliers, the main model drivers were similar (Fig. S4B in Supplementary Material). Monitoring device costs had a minimal influence on results.

Discussion

Our analysis suggests that a reduction of ≥ 1.5%, ≥ 2.5%, and ≥ 3.5% in respiratory depression episodes would justify the investment for continuous pulse oximetry and capnography monitoring when continuously monitoring high, high and intermediate, or all patients, respectively. Projected annual cost savings, assuming a 20% reduction in respiratory depression, would be $535,531 to $688,221, and reduction in cumulative length of stay would be 103–204 days annually, depending on the PRODIGY risk group(s) monitored. Furthermore, implementation of continuous respiratory monitoring has ≥ 80% probability of being cost saving if respiratory depression is reduced by ≥ 17%, ≥ 27%, and ≥ 31% if implemented on high-risk, high- and intermediate-risk, and all patients, respectively. Importantly, implementation of continuous monitoring alone will not decrease respiratory depression or adverse events, but can alert bedside providers to respiratory depression and facilitate early intervention. A true decrease in respiratory depression is dependent on how bedside providers respond to these alerts.

Our analysis showed that the top model drivers include the cost burden of respiratory depression and general care floor volume, not the cost of monitoring equipment. This may be explained by the high cost of respiratory depression events. Specifically, monitoring equipment per patient may cost less to hospitals than a respiratory depression event, which sometimes leads to rapid response team activation and ICU transfer [6, 16]. The cost burden of surgical patients with ORADEs are reported to be $4350–8225 [10, 21, 27, 28], representing a 27–47% increase in admission cost. This is consistent with the cost burden of respiratory depression observed in the PRODIGY trial, which were inputs in this model [6].

We also evaluated the effect of patient outliers on modeling results. Model outcomes were consistent across both analyses, with a low break-even point for implementation of continuous respiratory monitoring and decreased annual cost and length of stay following reduction in respiratory depression.

This model has important implications for US hospital administrators, value and analysis committees, and clinical practice stakeholders who are considering (1) whether to continuously monitor hospital general care floor patients receiving opioids, as well as (2) if the monitoring equipment is worth the investment for a subset of this patient population. A critical decision-making element for hospital administrators is identifying appropriate patients to monitor, to balance therapeutic benefit while limiting expenditure. Importantly, sensitivity analysis indicated that across the modeled scenarios, there is a high probability of continuous monitoring being cost saving, with the highest likelihood when monitoring high-risk patients. This analysis may be of particular value to cash-strapped hospitals needing to minimize equipment expenditure while maximizing patient safety.

The clinical utility of implementing continuous respiratory monitoring using pulse oximetry and capnography is supported by multiple studies. In one study, all postoperative patients who had respiratory depression requiring intervention were recognized by capnography, not by pulse oximetry [29]. Additionally, a systematic review and meta-analysis reported that compared to intermittent spot-check monitoring, continuous pulse oximetry decreased the risk of ICU transfer 34%, and SpO2 < 90% > 1 h was 15 times more likely to be detected [24]. With continuous capnography monitoring, 8.6% more respiratory depression events were detected compared to pulse oximetry monitoring alone, and the odds of respiratory depression detection were 5.83 times higher using capnography vs pulse oximetry [24].

The top strengths of this analysis include its real-world utility to hospital budget holders, its novelty in the literature, and its use of clinical trial data as the basis for the economic model. The hospital budget holder perspective, along with modeling a range of scenarios to minimize budget impact while maximizing patient safety, is pertinent since hospitals are likely to be in financial distress due to the Covid-19 pandemic. This work also adds novelty to the literature, in which we are not aware of any comparable models for respiratory depression. Finally, this model was created on the basis of PRODIGY trial data, which was the largest prospective observational trial of continuous multiparameter monitoring, where waveform data was collected in a blinded manner and subsequently evaluated by an independent adjudication committee.

Our work has some limitations. Our assumption of the number of patients per hospital does not apply to all hospitals. However, we used the Premier® database, which is one of the largest hospital-based discharge databases in the country, to determine the modeled cohort size and represent a median-sized US hospital. While this approach does represent all hospitals, a PRODIGY cost savings calculator to tailor this model to individual hospitals may be helpful but was beyond the scope of this analysis. Second, a 20% reduction in respiratory depression in the base case is supported by limited literature demonstrating reduced adverse events following implementation of continuous respiratory monitoring. Importantly, our sensitivity analysis eliminated this assumption and evaluated the likelihood of cost savings when all possible scenarios of respiratory depression reduction were modeled from 0% to 100%. Third, we assume that bedside providers will respond to continuous monitoring alerts, resulting in decreased incidence of respiratory depression, though data on response to continuous monitoring alerts is limited. This model did not include the cost of early intervention to prevent respiratory depression. Finally, the model is based on US PRODIGY patients only, which may limit the applicability of this model internationally, where opioid administration, standard of care practices, and hospital costs vary significantly [30,31,32,33].

Conclusion

Although intermittent monitoring has been standard of care for decades, continuous pulse oximetry and capnography monitoring detect more deviations of vital signs and has the potential to increase patient safety on the general care floor [1, 2, 24]. We assessed the investment cost–benefit ratio, and found that compared to intermittent pulse oximetry monitoring, continuous pulse oximetry and capnography monitoring of general care floor patients receiving opioids may be a cost-effective and worthwhile investment from the US hospital budget holder perspective. Our results suggest that limiting continuous monitoring to high-risk patients may be the least impactful to budgets, though expansion to intermediate- and low-risk patients may offer good value considering the likely reduction in respiratory depression and associated costs.