Background Appropriate interpretation of vital signs is essential for risk stratification in the emergency department (ED) but may change with advancing age. In several guidelines, risk scores such as the Systemic Inflammatory Response Syndrome (SIRS) and Quick Sequential Organ Failure Assessment (qSOFA) scores, commonly used in emergency medicine practice (as well as critical care) specify a single cut-off or threshold for each of the commonly measured vital signs. Although a single cut-off may be convenient, it is unknown whether a single cut-off for vital signs truly exists and if the association between vital signs and in-hospital mortality differs per age-category.
Aims To assess the association between initial vital signs and case-mix adjusted in-hospital mortality in different age categories.
Methods Observational multicentre cohort study using the Netherlands Emergency Department Evaluation Database (NEED) in which consecutive ED patients ≥18 years were included between 1 January 2017 and 12 January 2020. The association between vital signs and case-mix adjusted mortality were assessed in three age categories (18-65; 66-80; >80 years) using multivariable logistic regression. Vital signs were each divided into five to six categories, for example, systolic blood pressure (SBP) categories (≤80, 81–100, 101–120, 121–140, >140 mm Hg).
Results We included 101 416 patients of whom 2374 (2.3%) died. Adjusted ORs for mortality increased gradually with decreasing SBP and decreasing peripheral oxygen saturation (SpO2). Diastolic blood pressure (DBP), mean arterial pressure (MAP) and heart rate (HR) had quasi-U-shaped associations with mortality. Mortality did not increase for temperatures anywhere in the range between 35.5°C and 42.0°C, with a single cut-off around 35.5°C below which mortality increased. Single cut-offs were also found for MAP <70 mm Hg and respiratory rate >22/min. For all vital signs, older patients had larger increases in absolute mortality compared with younger patients.
Conclusion For SBP, DBP, SpO2 and HR, no single cut-off existed. The impact of changing vital sign categories on prognosis was larger in older patients. Our results have implications for the interpretation of vital signs in existing risk stratification tools and acute care guidelines.
- emergency department
- risk management
Data availability statement
Data are available on reasonable request. Deidentified participant data are available on reasonable request from the corresponding author.
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
What is already known on this subject
Many risk stratification tools and acute care guidelines specify a single cut-off for vital signs suggesting that above or below this cut-off prognosis changes substantially.
It is unknown whether relevant single cut-off values for vital signs truly exist.
In older age, physiological changes may cause differences in the single cut-offs for vital signs and the need for different interpretation.
What this study adds
This retrospective study of 101 416 emergency department visits from three hospitals showed that mortality and high dependency care unit admission increased gradually or in a U-shaped fashion with changing vital signs. Older patients had larger increases in absolute risks for mortality with changing vital signs.
Relevant single cut-offs did not exist for systolic blood pressure or oxygen saturation; cut-offs were found for respiratory rate, temperature and mean arterial pressure; however, using these single cut-offs would ignore further increase of risk with more extreme values of these vital signs.
The use of a single cut-off for each vital sign in risk stratification tools like SIRS and qSOFA and acute care guidelines deserves scrutiny; risk tools should consider using age-adjusted numerical scores.
Vital signs are used for risk stratification in nearly all acute care guidelines.1–4 Many risk stratification tools, such as the Systemic Inflammatory Response Syndrome (SIRS), Quick Sequential Organ Failure Assessment (qSOFA) and CURB-65 scores,2 5–8 specify a single cut-off (or threshold) for each of the commonly measured vital signs, suggesting that one cut-off may discriminate between good and bad prognosis. However, recent studies in patients with traumatic brain injury and sepsis showed that prognosis linearly worsened with decreasing systolic blood pressure (SBP), without an identifiable single threshold.9 10 Similarly, linear or U-shaped instead of dichotomous associations may exist for other vital signs used in ED risk stratification.
In addition, most risk stratification models are applied in all ED patients irrespective of age. However, a recent study showed that risk stratification tools are inappropriate for older ED patients.11 12 The association between vital signs and outcomes may change with advancing age due to physiological changes. Arterial walls become stiffer in older patients, heart rate (HR) response to stress is blunted and fever is absent in many older patients with sepsis.13
Although a single cut-off for vital signs may be convenient in risk stratification tools, numerical scores based on predicted mortality will possibly better inform physicians and prevent impaired recognition of early deterioration in ED patients. Physiological changes with increasing age may implicate that currently used risk stratification tools should be age-adjusted. This is particularly important given the ageing of the population with an increasing number of older ED patients.
Therefore, the aims of the present study are twofold: First, to assess the associations of vital signs and relevant clinical outcomes (eg, mortality and intensive care unit (ICU)/medium care unit (MCU) admission) and whether a single cut-off or threshold exist for each vital sign, and second, to study whether associations of vital signs and relevant clinical outcomes change with advancing age.
Study design and setting
This observational multicentre study was conducted in three EDs in the Netherlands, each with approximately 25 000–30 000 ED visits per year. Data from the three sites spanned slightly different times: data from the tertiary care centre included visits between 1 January 2017 and 8 June 2019, and data from the two urban teaching hospitals included visits between 1 January 2019 to 12 January 2020 and 1 January 2017 to 31 December 2019, respectively. The tertiary care centre uses the Manchester Triage System and both urban hospitals use the Dutch Triage Standard. The study was registered in the Netherlands Trials Register: NL8422.
Selection of participants
All consecutive ED patients ≥18 years were included if one or more of the following vital signs were measured: respiratory rate (RR), peripheral oxygen saturation (SpO2), SBP, diastolic blood pressure (DBP), mean arterial blood pressure (MAP), HR and temperature.
Data were collected from the Netherlands Emergency department Evaluation Database (NEED), the Dutch quality registry for EDs (www.stichting-need.nl), a record containing clinical data from all ED visits from the participating hospitals. Online supplemental file 1 provides a detailed description of the data collected in the NEED. Twice a year all clinical data from the participating hospitals is downloaded into the record. Onset of participation in the NEED differs per hospital. For the current study, data were available from three of the nine participating hospitals. The NEED stores data using the web-based application Project Manager Internet Server (ProMISe, Leiden, the Netherlands, https://www.msbi.nl/promise/promise.aspx). Privacy sensitive data are encrypted by a trusted third party (ZorgTTP, Houten, the Netherlands, www.zorgttp.nl) with Trusted Reversible Encryption Service.
The vital signs measured at the beginning of ED presentation, before ED treatment, were recorded in the NEED. Only one set of vital signs was recorded per patient. If patients arrived by own transport, HR, SpO2 and temperature were measured in a triage room by a nurse mostly in seated, sometimes supine, position. These vital signs were entered manually in the hospital information system. Once moved to a patient room, the other vital signs were measured by a nurse with the MP52 IntelliVue, Intellivue MP30, Intellivue MX400 or MX500 monitor (Philips, Eindhoven, the Netherlands). Multipatient reusable latex-free NIBP Comfort Care Cuff from Philips are used with cuff a small cuff (27–35 cm), medium cuff (35–45 cm), large cuff (42–54 cm) and extra-large cuff (44–56 cm), depending on the size of the patient. Vital signs registered in the patient room were automatically transferred in the hospital information system, except for temperature, which was entered manually. Temperature was measured with a Genius 3 Tympanic Thermometer. If patients arrived by ambulance, vital signs were measured in supine position in the patient room as described. In the tertiary care centre, vital signs were automatically measured every 2.5–15 min and transferred to the electronic patient file with PDMS software (Chipsoft, the Netherlands), depending on the personalised setting for a specific patient. Median values of vital signs were registered for the first 10 min of measuring.
Before we could perform statistical analysis, several variables had to be synchronised among hospitals. Beforehand, we could not assume that the association between vital signs and outcomes were linear. Therefore, vital signs were categorised into ranges based on expected distribution and commonly used reference intervals: RR (not measured, 0–9, 10–19, 20–29, ≥30/min), SpO2 (0%–80%, 81%–85%, 86%–90%, 91%–95%, 96%–100%), SBP (0–80, 81–100, 101–120, 121–140, >140 mm Hg), DBP (0–60, 61–80, 81–100, 101–120, >120 mm Hg), MAP (0–60, 61–80, 81–100, 101–120, >120 mm Hg), HR (0–50, 51–75, 76–100, 101–125, >125beats/min.), temperature (not measured, 0–30, 31–34, 35–37, 38–39, ≥40°C).
Correspondent to literature,14 RR and temperature were often not registered. To limit the number of missings in the analyses, we included a category ‘not registered’. In EDs in the Netherlands, vital signs are not registered in all patients. For example, vital signs are often not registered in patients with an ankle distortion or a single fracture, because they are at low risk of adverse events and often discharged, and RR is often only registered if patients are considered critically ill by the nurse. Therefore, the fact that vital signs are registered may provide relevant information for risk stratification. Online supplemental file 2 describes how the variables triage levels, chief complaints (the top 10 chief complaints was used) and treating specialties were modified before they could be used as potential confounders in the statistical analyses.
Patients were stratified into three age categories: 18–65, 66–80 and >80 years. These age categories were chosen based on the mean SBP in the general population in the Netherlands according to the National Institute for Public Health and the Environment (RIVM, www.rivm.nl). The mean SBP increases substantially above 65 years.
The primary outcome was whether there was a vital sign category that could be used as a cut-off to predict the outcomes of in-hospital mortality and ICU or MCU admission, which also included the Coronary Care Unit.
Sample size estimation
Approximately 5–10 events per variable are needed to prevent overfitting in association studies.15 The NEED contained 148 828 ED visits of patients ≥18 years. We estimated that in ~60% of the ED visits vital signs were registered resulting in ~90 000 ED visits which could be used for the analyses. In-hospital mortality was estimated to be ~3%. Included patients were stratified in three age categories, yielding ~90 000/3=30 000 patients per age category. Thus, we expected to have ~0.03×30,000=900 events per group to be able to adjust for the 37 potential confounders (see main statistical analysis) in the analyses with in-hospital mortality as outcome, which is appropriate to prevent overfitting.
Patient characteristics were described as mean (SD) for normally distributed data, and median (IQR) for skewed data. Categorical data were presented as number (N, (%)).
For all analyses, one category per vital sign was used as reference category (ie, reference category for HR was 50–75 beats/min). The number of measured vital signs outside the reference range were calculated.
We used multivariable logistic regression analyses for the association between vital sign categories and the primary and secondary outcomes. The following potential confounders were entered in the models for which then backward stepwise elimination was performed: age, sex, triage level, top 10 chief complaints, hospital, treating specialty, disposition (ward, ICU/MCU), SpO2, temperature (including category ‘not registered’), Glasgow Coma Scale (GCS) (not assessed, assessed and 15 points, assessed and <15 points), lab tests (0=no lab tests performed, 1=any lab test performed), blood gas analyses (0=not tested, 1=tested), number of consultations in the ED (0, 1, 2 or ≥3 consultations) and performed radiological test (0=none, 1=any test). Other vital signs were not entered in the models because of potential multicollinearity among vital signs. The number of consultations, lab tests and radiological tests were used as measures of comorbidities/complexity, as has been suggested previously.16 17 Triage level, GCS, blood gas analyses and ICU/MCU admission were used as disease severity measures.11 ICU/MCU admission is an outcome and also a proxy of disease severity not captured in the initial vital signs. For example, a patient with an initial SBP of 90 mm Hg who responds to fluid resuscitation can be admitted to a normal ward and has a different risk for in-hospital mortality compared with a patient who also has an initial SBP of 90 mm Hg does not respond to fluid resuscitation and consequently needs ICU admission. In other words, the variable ICU/MCU admission also reflects the response to treatment. For the secondary outcome, the potential confounder disposition was replaced by the amount of fluid administration as a proxy of disease severity. Multicollinearity was assumed not to be a problem if variation inflation factors were below three. The associations between vital sign categories and case-mix adjusted outcomes were assessed in two ways to give better insight in differences between age categories, as the relative risk (AORs) for the outcome may be similar among age categories, while the absolute risk may be different due to different baseline risk at the reference values. We used adjusted odds ratios (AORs) with 95% CI as relative risk measure and predicted (case mix-adjusted) mortality as absolute risk measure.
In the figures, the AORs of in-hospital mortality were plotted as a function of vital sign categories for the pooled data and for all age categories. If we observed a sudden rise or decline in AORs by changing vital sign categories, we performed minimal p value analyses to assess a more precise value for the possible threshold. In these analyses, we changed the vital sign into a binary value (below or above a cut-off value) in the multivariable logistic regression as described above. We repeated the analyses with all possible cut-off values in steps of 0.5°C (temperature), 1/min. (RR), 5.0 mm Hg (SBP, DBP, MAP), 5.0 beats/min (HR) or 5.0% (SpO2). The cut-off value with the lowest p value for the AOR was considered as threshold. In this way, a threshold was determined in approximately continuous data of the vital sign. Thresholds with minimal p value analyses were not determined if vital signs had no clear single cut-off.
P<0.05 was considered as statistically significant. Data were analysed using SPSS (V.25.0, IBM, New York, USA).
Subgroup and sensitivity analyses
We performed subgroup analyses for suspected infection and trauma patients to assess whether aetiology affected the primary associations of interest. See online supplemental files 3 and 4 for case definitions. A sensitivity analyses was performed to assess whether hospital transfers may have influenced our results, as we did not follow-up on these patients. The main analyses were repeated in which patients transferred to other hospitals were considered as deceased.
Patient and public involvement
No patients were involved.
Patient inclusion and characteristics
Figure 1 shows that of the 147 728 ED visits of patients ≥18 years, 101 416 patients were included in whom vital signs were measured.
Table 1 shows patient characteristics of the total cohort and per age-category. The mean age of included patients was 59.6 years (19.6). Table 1 also shows the percentage of patients in whom vital signs fell outside the reference ranges which are normally used in adults. For most values, the rate of abnormal vital signs increased with advancing age.
The association between vital signs and clinical outcomes
The AORs for predicted mortality (table 2) increased gradually with worsening values of SBP and SpO2, while DBP, MAP and HR had a quasi-U-shaped association with mortality (figures 2 and 3). There was no clear cut-off point between categories of SBP, DBP, SpO2 and HR and AORs for mortality. The AOR for RR gradually increased between 10 and 19 mm (figure 3), with a substantial increase for mortality at 22/min. The AOR of mortality showed a substantial increase for temperature below a threshold of 35.5°C; however, temperatures above this were not associated with mortality. For MAP, a threshold at <70 mm Hg was found for mortality. Although single cut-offs for MAP, RR and temperature exist, using these cut-offs would ignore further increase of risk with more extreme values of these vital signs.
Older patients had larger increases in case-mix adjusted predicted mortality compared with younger people with changing vital sign categories (right panels in figures 2 and 3). In contrast, AORs for mortality decreased or increased to a similar extent with changing vital sign categories. Only patients aged 18–65 years with an SpO2 <80% had higher odds for mortality (AOR 11.09; 7.40–16.62) compared with patients aged 66–80 years (AOR 4.50; 3.19–6.34) and >80 years (AOR 4.99; 3.30–7.56).
For ICU/MCU admission (table 3, online supplemental files 5 and 6), SBP had a relevant cut-off in the category of <80 mm Hg and was calculated at 70 mm Hg with minimal p value analysis. For MAP, a threshold of <60 mm Hg existed for admission to the ICU/MCU. When RR was registered, AOR for ICU admission was at least doubled compared with when it was not recorded, but no other cut-off was seen. Temperature <31°C had a substantially higher likelihood for ICU admission.
Younger patients had larger increases in predicted ICU/MCU admission compared with older patients with increasing DBP, RR, HR and decreasing SpO2 categories (online supplemental files 5 and 6). In contrast, AORs changed to a similar extent among all age categories for changing vital signs.
Subgroup and sensitivity analyses
The AORs for mortality increased or decreased to the same extent in the subgroups with suspected infection and trauma patients, and in the sensitivity analyses, regardless of the patient’s age category (online supplemental files 3, 4 and 7).
The present study has two main findings. First, in-hospital mortality increased gradually with decreasing SBP and SpO2, without the existence of a single threshold for these vital signs. For DBP, MAP and HR, we found quasi-U-shaped associations with in-hospital mortality. A single cut-off existed for MAP, RR and temperature; however, using these single cut-offs would ignore further increase of risk with more extreme values of these vital signs.
Second, absolute mortality increased substantially more in older compared with younger patients with changing vital sign categories.
The use of a single threshold for SBP in many acute care guidelines and risk stratification tools deserves scrutiny.6–8 18 19 The linear association between SBP and mortality in an unselected ED population corresponds with previous studies in traumatic brain injury, sepsis, hypertension and unselected ED patients.9 20 21 Our study suggests that a single cut-off is also absent for SpO2 correspondent to earlier findings in a study by Ljunggren et al in 96 512 unselected ED patients.22 Interestingly, temperatures above 35.5°C, that is, normal temperature and fever, were not significantly associated with mortality in our and Ljunggren’s study. This finding is in contrast to what has been suggested in several risk stratification tools, like the national and modified Early Warning Score (EWS), in which points are assigned for high temperature.23 It should be noted, however, that the original EWS was not intended to be a predictor of outcome but rather to be a simple tool to assist inexperienced nursing or medical staff in recognising patients at risk for deterioration and in securing immediate, more experienced help.24
In addition to a threshold for temperature, we also found a single cut-off for MAP and RR. RR was the least registered vital sign, but our findings confirm the importance of RR given the strong association with mortality and the higher odds for ICU/MCU admission if RR was registered, compared with if it was not registered. The threshold we found for MAP <70 mm Hg was similar to the thresholds used in several guidelines.1 3 Interestingly, the odds for ICU admission only started to increase with MAP below 60 mm Hg. Probably, physicians are less triggered to admit patients to an ICU or MCU with a MAP between 60 and 80 mm Hg. This discrepancy between the associations of MAP and in-hospital mortality versus ICU admission warrants further research as it may reflect unrecognised hypotension, and patients with higher MAPs may need ICU admission.
Different from other studies, we have studied the effect of age on associations between vital signs and outcome. Older patients had larger increases in the absolute risk for mortality with changing vital sign categories compared with younger patients, while the relative risk for mortality had similar increases. Previously, the use of different single cut-off values for SBP in trauma patients have been suggested for advanced age.25 Although prognosis has been found to deteriorate at higher SBP threshold, our data suggest not to use a single cut-off at all.
The findings of the present study have several implications for clinical practice. Although a single cut-off may be convenient and easy to use, our first finding suggests that the use of a cut-off for several vital signs in risk stratification tools and acute care guidelines are inappropriate.1–6 The use of a single cut-off suggests that above or below this specific threshold, prognosis changes substantially. Using only a single threshold, like for SBP or RR in the qSOFA score, does not mean that the chosen threshold for SBP of 100 mm Hg discriminates better between low-risk and high-risk patients than a threshold of 90, 110, 120, 130, 140 mm Hg and so on, as has been demonstrated previously for SBP in traumatic brain injury.9 Even if a single cut-off exists, that is, if an association between outcome and a vital sign is only apparent from a certain value, dichotomous risk stratification would ignore further increase of the risk with more extreme values of the vital sign. This implicates that several risk stratification tools and acute care guidelines could be improved by using numerical scores based on AORs or predicted mortality rather than using dichotomous variables.1–6 Currently, these grading scores are already used in EWS, although the scores in the EWS are not supported by AORs derived from prediction models.23
APACHE II is a good example of a numerical score for ICU patients.26 Similar risk stratification scores may be developed for the ED to improve recognition, initial resuscitation and disposition.
Our second main finding implicates that risks scores need to be age-adjusted. The effect of vital signs on mortality did change with advancing age, because baseline risk for older age was higher. For example, if SBP decreased and the risk on in-hospital mortality increased fourfold, the effect on younger patients with a baseline mortality risk, that is, 0.5% would be much smaller than the effect on older patients with a baseline mortality risk, that is, 4.0%. More points may be assigned in a numerical score for older age for similar vital signs.
Interestingly, the subgroup analyses in sepsis and trauma patients suggests that the aetiology of changes in vital signs does not affect the impact of vital signs on relevant outcomes. Future studies should incorporate our findings in development of risk stratification tools and acute care guidelines for ED patients using numerical scores based on statistical risks.
Our study has several strengths like a large sample size with unselected patients and the multicentre design. Several limitations merit emphasis. First, this observational study used the NEED, which lacks information about the medical history and comorbidities of patients. However, to overcome this, we used variables that are associated with comorbidities and complexity.16 Second, information bias cannot be completely ruled out although data collection was largely automatised and only reliably registered variables are collected in the NEED. Finally, we missed outcomes of patients who were hospitalised elsewhere. However, the sensitivity analyses in which we considered these patients as deceased, yielded similar results.
The use of a single cut-off for each vital sign in acute care guidelines and risk stratification tools deserves scrutiny, as our results show that clinical outcomes increase gradually or in a U-shaped fashion with changing vital signs. A threshold for MAP, RR and temperature exists; however, using these single cut-offs would ignore further increase of risk with more extreme values of these vital signs. Age-adjusted numerical scores will improve risk stratification, as older patients have larger absolute increases in mortality with changing vital signs, even after adjusting for confounders.
Data availability statement
Data are available on reasonable request. Deidentified participant data are available on reasonable request from the corresponding author.
Patient consent for publication
The study was approved by the medical ethics committee of the LUMC who waived the need for individual consent because of the purely observational character of the study. The study was registered at the Netherlands Trial Register (ID NL8422).
Handling editor Kirsty Challen
Contributors BdG devised and designed the study, collected data, contributed to the analyses and edited the manuscript. BC and RD collected and analysed data and wrote the manuscript. MIG, EtA, OS, HL, RH and RR are founders of the NEED, collected data and edited the manuscript. EvZ helped with statistical analyses and edited the manuscript. EdJ edited the manuscript. BdG takes full responsibility for the study and acts as a guarantor. All authors have read and approved the manuscript.
Funding BC and BdG received financial funding from the Dutch Emergency Medicine Research Fund (SGO-fonds, award number NA).
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.