Article Text
Abstract
Background Delays to timely admission from emergency departments (EDs) are known to harm patients.
Objective To assess and quantify the increased risk of death resulting from delays to inpatient admission from EDs, using Hospital Episode Statistics and Office of National Statistics data in England.
Methods A cross-sectional, retrospective observational study was carried out of patients admitted from every type 1 (major) ED in England between April 2016 and March 2018. The primary outcome was death from all causes within 30 days of admission. Observed mortality was compared with expected mortality, as calculated using a logistic regression model to adjust for sex, age, deprivation, comorbidities, hour of day, month, previous ED attendances/emergency admissions and crowding in the department at the time of the attendance.
Results Between April 2016 and March 2018, 26 738 514 people attended an ED, with 7 472 480 patients admitted relating to 5 249 891 individual patients, who constituted the study’s dataset. A total of 433 962 deaths occurred within 30 days. The overall crude 30-day mortality rate was 8.71% (95% CI 8.69% to 8.74%). A statistically significant linear increase in mortality was found from 5 hours after time of arrival at the ED up to 12 hours (when accurate data collection ceased) (p<0.001). The greatest change in the 30-day standardised mortality ratio was an 8% increase, occurring in the patient cohort that waited in the ED for more than 6 to 8 hours from the time of arrival.
Conclusions Delays to hospital inpatient admission for patients in excess of 5 hours from time of arrival at the ED are associated with an increase in all-cause 30-day mortality. Between 5 and 12 hours, delays cause a predictable dose–response effect. For every 82 admitted patients whose time to inpatient bed transfer is delayed beyond 6 to 8 hours from time of arrival at the ED, there is one extra death.
- emergency department
- crowding
- death/mortality
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information. The study involved secondary analysis of an existing data set of anonymised data. HES data were made available by NHS Digital (©2018, reused with the permission of NHS Digital. All rights reserved). Publicly-available ONS data were also used.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Key messages
What is already known on this subject
Small studies from Canada and Australia have indicated that there is an increased mortality rate among patients who experience delays in admission to an inpatient bed from the emergency department (ED).
Counterfactual modelling has shown reduced patient mortality as a result of the NHS 4-hour operational standard. The NHS Benchmarking Network found a coefficient of determination (R2 value) of 0.07 between time greater than 4 hours in the ED and a hospital’s Summary Hospital-level Mortality Indicator.
What this study adds
This study of over five million NHS patients shows an increase in all-cause 30-day mortality that is independently associated with delays to hospital admission from the ED rather than with crowding alone.
The standardised mortality rate starts to rise from 5 hours after the patient’s time of arrival at the ED.
The increasing effect of long stays in the ED before inpatient admission can be measured and represented as a number needed to harm metric: after 6–8 hours, there is one extra death for every 82 patients delayed.
Introduction
In England, by the end of the 20th century, demographic changes and reduced numbers of acute hospital beds had resulted in crowded emergency departments (EDs) and long delays for patients. In consequence, the NHS 4-hour operational standard was introduced in 2004 and shortly thereafter, the other nations of the UK and several other countries, such as Canada and Australia, introduced similar standards for ED waiting times.1–5 (The 4-hour standard is a binary time threshold for discharge, admission or transfer; it starts when the patient arrives at the ED, and time in the ED beyond 4 hours is a ‘breach’ of the ‘target’.)
For more than a decade, the 4-hour standard served both patients and the NHS well but, during the past few years, further increases in the demand for urgent and emergency care have exacerbated long waits for hospital admission.6 By 2019–2020, over 3.2% of all ED patients waited in the ED for more than 12 hours from their time of arrival.7 Long ED delays are most often caused by ‘exit block’ due to a lack of available inpatient beds. This was demonstrated using data collected from all English EDs over a 90-day period by an NHS economics team. They showed that higher inpatient bed occupancy was correlated with longer ED waiting times, but with a non-linear association.8
Delay-related harm in the ED was previously reported by Guttmann et al in Canada in 2011.9 However, their study had a case mix that was substantially different from that of the UK, as the proportion of admitted patients was only 10% of the total, compared with a current NHS average of around 30%. Another smaller study that demonstrated harm both from presentations to a crowded department and longer durations of stay in the ED was confined to admissions at just three hospitals in Australia.10 A further paper from China in 2019 showed that prolonged length of stay in the ED was independently associated with an increased risk of hospital mortality in patients with sepsis requiring admission to an intensive care unit.11
In England, the harm caused by long stays in the ED was modelled by the National Bureau of Economic Research and the Institute of Fiscal Studies in 2018. The researchers asked the counterfactual question of what would have happened if the 4-hour NHS operational standard had not existed between 2011 and 2013. They found that 30-day patient mortality was reduced by 0.4% (or 14% of baseline) as a result of the ED 4-hour standard.12 The NHS Benchmarking Network looked at data for 2019–2020 and found a coefficient of determination (R2 value) of 0.07 between ED stays of 4 hours or longer and the Summary Hospital-level Mortality Indicator for a hospital. This suggests that time in ED would explain 7% of the variation in mortality between sites.13
This study aimed to use a large NHS database to confirm or disprove an increased risk of death in patients with increasing lengths of stay in the ED before hospital admission and to quantify any such harm that was found to exist.
Methods
Study design
This was a cross-sectional, comparative, retrospective, observational study of all patients admitted from all type 1 EDs in England between April 2016 and March 2018. (Type 1 EDs are major NHS departments that are open 24 hours a day under the supervision of consultants in emergency medicine.)
Only a patient’s first admission in the study period was included because it was considered that there were too many confounders with multiple attendances. Patients attending more than once are known to have poorer outcomes and their inclusion would have increased the overall mortality rates. In addition, to compensate for these factors, a more complicated multilevel logistic regression model would have been required. Patients who waited in the ED for longer than 12 hours were also excluded from the mortality analysis as temporal data were found to be unreliable after this point and the numbers were relatively small.
All times were measured from the patient’s arrival at the ED until their transfer to an inpatient bed. NHS data did not allow us to differentiate between treatment time in the ED and non-value-added time while waiting for imaging, a specialist opinion or an available bed on a hospital ward. Thus, the study investigated longer lengths of ED stay, which were often multifactorial in origin. The primary outcome was death from all causes within 30 days of hospital admission.
Patient and public involvement
We received valuable encouragement from the lay group of the Royal College of Emergency Medicine to undertake this research, although the group had no direct involvement or responsibility for our methods and findings.
Data sources
This study employed NHS England’s Hospital Episode Statistics record of ED attendances (HES AE) linked to the Hospital Episode Statistics admitted patient care record (HES APC) and Office of National Statistics (ONS) population mortality data. HES data include information on a range of clinical, demographic, administrative and geographical variables.7 The 30-day mortality data were identified by linking HES data to the ONS primary care mortality data file.14 15 This latter dataset contains details relating to a person’s death, including date and cause of death taken from the death certificate. Published reports on HES data quality and the percentage of data linkage show that these data, although incomplete, cover most admissions and 30-day mortality.16 HES data are supplied already ‘cleansed’ from their primary source—namely, the Secondary Uses Service secure data warehouse of NHS Digital. Further information about data handing and about the completeness of the data fields used in this study is provided in Box 1.
Further information about data handling, inclusion criteria and incomplete records
Hospital Episode Statistics data and Office of National Statistics (ONS) mortality data were linked by NHS Digital before release and provided in tables coupled by a pseudonymised, unique patient identifier. Patient admission data were included when the date of admission, patient identifier, primary diagnosis and admission code were all present. Where patients had multiple emergency department (ED) attendances in a single day, the final attendance of the day was counted. ED data were included when both arrival date and arrival time were recorded. The dataset for use was created by linking admissions to ED presentations by means of the unique patient identifier. ED presentations were linked to the admission when they occurred on the same day as the admission or on the day before. All admissions without a corresponding ED presentation were removed. Thus, during this process, all admissions via the ED were linked to a valid ED presentation in the data, and all admissions had a valid diagnosis and patient identifier. Mortality data from the ONS were then linked to the admission via the patient identifier and the date of death.
Patients with data that could be processed comprised an essential part of the selection criteria for the study. It was of course, impossible not to exclude patients with incomplete or missing admission data or records that could not be matched. The incompleteness and inaccuracy of many records—and the prior cleansing undertaken by NHS Digital—makes an exact estimate of their number very difficult.
At a later stage, 4714 (0.09%) patients out of a total of 5 254 605 individual patients were excluded because of the lack of the key variables of age or gender.
Statistical analysis
To minimise selection bias for time in the ED (ie, older or sicker patients waiting longer because they take more time to treat), a logistic regression model was used to predict 30-day mortality. Variables included in the model were referenced to patient characteristics, time of attendance and the level of ED crowding. The percentage of 4-hour breaches in the department at the time of the patient’s attendance was used as a proxy for ED crowding.
Specifically, the model accounted for:
Patient characteristics: age, sex, deprivation (using Indices of Multiple Deprivation) and comorbidities (using van Walraven scoring (vWs) for Elixhauser Comorbidity Indices).17 18 (Comorbidities are a measure of disease complexity but not of patient acuity.)
Temporal and ED factors: month of any previous ED attendances or emergency admission(s), the time of attendance and level of congestion in the ED at the time of the index attendance.
Time spent in the ED was divided into 15-minute aliquots. To account for potential non-linearities in the continuous variables, quadratic terms (ie, the squares of these numbers) were used. (This is denoted by the superscript following four of the variables in table 2.) To estimate an indirectly standardised mortality rate (SMR) referenced to delay times, the observed number of deaths was summed and then divided by the expected number of deaths. Poisson confidence intervals were determined for the SMR. The SMR was plotted against time in the ED to enable visual inspection of the results and to estimate a p value by fitting a linear model to the graph. An adjusted mortality rate was also calculated by multiplying the SMR by the overall crude mortality rate.
Results
Between April 2016 and March 2018, there were 26 738 514 attendances in English type 1 EDs with 7 472 480 matched admissions. Around 30% of ED admissions were patients who had been admitted on at least one other occasion in the previous 2 years; only the first attendance was included in the analysis. This left 5 254 605 individual patients, over 3% of whom waited for more than 12 hours. A further 4714 patients (0.09%) were later excluded owing to missing age and gender data, leaving 5 249 891 patients for inclusion in the logistic regression model.
In this group of admitted patients, there were 433 962 deaths within 30 days. The overall crude 30-day mortality rate was 8.71% (95% CI 8.69% to 8.74%). Table 1 shows the demographic breakdown of admitted patients. The median age of patients admitted to hospital from the ED was 55 years; their comorbidities increased in number with age. Over 1.8 times as many patients were from the highest decile of deprivation as from the least deprived decile. The most frequent time of arrival was between 12:00 and 17:59, with the first 3 months of the year accounting for the biggest proportion of patients. The mean time that a patient spent in the ED was just under 5 hours and 4-hour breach rates in EDs at the patient’s time of arrival averaged around 38%.
Table 2 shows the logistic regression model used to estimate the indirectly standardised mortality rate. The risk of death is seen to increase with the number of previous emergency attendances and admissions, Elixhauser Comorbidity Index (vWs) and age. In addition, the likelihood of dying rises with both male sex and increasing deprivation. Patients admitted between April and December had a lower mortality rate than those admitted between January and March. The variable with the largest OR was the 4-hour breach rate, used here to approximate the level of crowding in the ED at the time of the patient’s arrival. The area under the receiver operating characteristic curve for this model was 0.862.
Figure 1 shows the SMR for all-cause 30-day deaths plotted against duration in the ED from time of arrival. It demonstrates an increased SMR for patients admitted to hospital after 5 hours. The SMR increases in an approximately linear fashion from this point until accurate data are unavailable after 12 hours. If a linear model is applied to the data between 240 and 720 minutes, then the SMR is found to increase by about 0.008 (95% CI 0.003 to 0.013) points per minute (p<0.001).
The SMR can also be represented as a number needed to harm in order to clarify the magnitude of effect (table 3).
Discussion
The results from this study show that there is a ‘dose-dependent’ association between time in excess of 5 hours in the ED for admitted patients and their all-cause 30-day mortality. The data indicate a 10% increase in the SMR within 30 days for admitted patients remaining in the ED between 8 and 12 hours in comparison with those who leave the ED within 6 hours. Moreover, 30-day mortality is a relatively crude metric that does not account for either increases in patient morbidity or for the inevitably worse patient experiences.19
ED time targets are popular with patients and politicians alike.20 This study showed that an increasing 4-hour breach rate in the ED is a strong predictor of higher 30-day mortality. The NHS 4-hour operational standard thus appears to have succeeded in preventing avoidable delay-related patient harm in hospitals where it has been achieved while also reducing additional morbidity and poor patient experiences.
Despite limited supporting evidence,9–13 there are a number of clinically plausible reasons to accept that there is a temporal association between delayed admission to a hospital inpatient bed and poorer patient outcomes, including:
Long lengths of stay in the ED are associated with exit block and crowding, which has been shown to increase time to analgesia, time to antibiotics and time to other vital treatments.21 However, our study attempted to adjust for ED crowding and to investigate an association with delays to hospital admission alone.
Lack of ED space leads to mitigation processes with patients accommodated in suboptimal areas that make it more difficult for close observation and for the delivery of good care.22
Long periods in the ED usually reduce temporospatial clues (eg, patient unable to see the external environment) with consequent increases in disorientation and precipitation or exacerbation of delirium, especially in elderly patients.23
Long waits in the ED, especially for elderly patients, are correlated with an increase in subsequent hospital length of stay. This, in turn, increases the risk of hospital-acquired infection, iatrogenic harm and physiological and psychological deconditioning.24
Delayed admission (exit block) from the ED is usually related to bed occupancy levels, which are highest in the late afternoon and usually lower around midnight. Thus, a disproportionate number of delayed patients are moved to a ward during night hours when staffing levels are at their lowest.25
The methodology in this study attempted to adjust for a wide range of relevant confounding variables, including the ED 4-hour breach rate (at the time of the patient’s arrival at hospital) as an imperfect proxy for ED crowding. Selected variables were those that are obtainable from HES and that are potential confounders. However, the reliability of some of the data (such as patient comorbidities) is not sufficiently good to be sure that all variables were completely accounted for by our logistic regression model. Moreover, there might be other confounding variables that are not obtainable from HES. Further limitations include the effect of missing data and of patients removed before the mortality analysis, especially those with multiple attendances and delays longer than 12 hours. Physiological metrics are lacking and thus no estimation can be made of varying patient acuity; staffing and bed occupancy data were also unavailable. Finally, this study was unable to differentiate between the various causes of non-value-added time in the ED. Such delays for patients may have included long ED processing and decision-making times, waiting for investigations or specialist opinions and lack of availability of a suitable inpatient bed.
Future research could examine multiple attendances and non-admitted patients and attempt to address some of the limitations detailed above. Although these limitations could obviously be overcome by a prospective randomised controlled trial, this would never be ethically acceptable. Instead, we believe that future researchers could use the approach of Arpino and Cannas to propensity score matching to develop a causation model of the effect of ED delays on patient outcomes.26
Conclusions
Time in the ED for an individual patient requiring hospital admission should be of therapeutic benefit. Delays to inpatient admission from any cause are of no value to the patient and may also impede timely care for new ED arrivals. This study demonstrates a time-associated linear increase in all-cause 30-day mortality for patients who remain in the ED for more than 5 hours from their time of arrival. One extra death occurs for every 82 patients who are delayed for more than 6 to 8 hours. This study confirms that healthcare policy makers should continue to mandate timely admission from the ED in order to protect patients from hospital-associated harm.
Data availability statement
All data relevant to the study are included in the article or uploaded as supplementary information. The study involved secondary analysis of an existing data set of anonymised data. HES data were made available by NHS Digital (©2018, reused with the permission of NHS Digital. All rights reserved). Publicly-available ONS data were also used.
Ethics statements
Patient consent for publication
References
Footnotes
Handling editor Simon Carley
Twitter @jones_prof, @DrChrisMoulton, @sib313
Deceased Clifford Mann deceased
Contributors This study was conceived by SB, SS and PM, following conversations with CMo and CMa. RO and NM undertook data preparation and SJ led the statistical analysis with support from RO and PM. CMo and CMa informed study design, supported interpretation and assessed the likely clinical impact. CMo and SJ drafted the paper. All authors contributed their time free of charge; no funding was provided. SJ is the guarantor of this study.
Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.
Competing interests All authors have completed the Unified Competing Interest form (available on request from the corresponding author). The authors who work for Methods Analytics declare the paragraph given below: Methods Analytics has undertaken work previously on behalf of NHS England, NHS Improvement, CCGs, trusts and local authorities investigating apparent issues with mortality rates as well as analysis pertaining to service redesign within emergency and urgent care settings. Methods Analytics have also undertaken analytical work for NHS England’s “Getting It Right First Time” programme (GIRFT) to develop the emergency medicine provider level data pack, which includes metrics concerning hospital mortality.
Provenance and peer review Not commissioned; externally peer reviewed.
Press release Yes.