You are here

  • Home
  • Archive
  • Volume 38, Issue 2
  • Post-exertion oxygen saturation as a prognostic factor for adverse outcome in patients attending the emergency department with suspected COVID-19: a substudy of the PRIEST observational cohort study

Article Text

Article menu
XML
Original research
Post-exertion oxygen saturation as a prognostic factor for adverse outcome in patients attending the emergency department with suspected COVID-19: a substudy of the PRIEST observational cohort study
  1. Steve Goodacre1,
  2. Ben Thomas1,
  3. Ellen Lee1,
  4. Laura Sutton1,
  5. Amanda Loban1,
  6. Simon Waterhouse1,
  7. Richard Simmonds1,
  8. Katie Biggs1,
  9. Carl Marincowitz1,
  10. José Schutter1,
  11. Sarah Connelly1,
  12. Elena Sheldon1,
  13. Jamie Hall1,
  14. Emma Young1,
  15. Andrew Bentley2,
  16. Kirsty Challen3,
  17. Chris Fitzsimmons4,
  18. Tim Harris5,
  19. Fiona Lecky1,
  20. Andrew Lee1,
  21. Ian Maconochie6,
  22. Darren Walter7
  1. 1 School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, UK
  2. 2 Respiratory and Intensive Care Medicine, Manchester University NHS Foundation Trust, Manchester, Greater Manchester, UK
  3. 3 Emergency Department, Lancashire Teaching Hospitals NHS Foundation Trust, Chorley, Lancashire, UK
  4. 4 Emergency Department, Sheffield Children's Hospital NHS Foundation Trust, Sheffield, UK
  5. 5 Department of Emergency Medicine, Royal London Hospital, London, UK
  6. 6 Emergency Department, Imperial College Healthcare NHS Trust, London, UK
  7. 7 Emergency Department, University Hospital of South Manchester NHS Foundation Trust, Manchester, UK
  1. Correspondence to Professor Steve Goodacre, School of Health and Related Research (ScHARR), University of Sheffield, Sheffield S1 4DA, UK; s.goodacre{at}sheffield.ac.uk

Abstract

Background Measurement of post-exertion oxygen saturation has been proposed to assess illness severity in suspected COVID-19 infection. We aimed to determine the accuracy of post-exertional oxygen saturation for predicting adverse outcome in suspected COVID-19.

Methods We undertook a substudy of an observational cohort study across 70 emergency departments during the first wave of the COVID-19 pandemic in the UK. We collected data prospectively, using a standardised assessment form, and retrospectively, using hospital records, from patients with suspected COVID-19, and reviewed hospital records at 30 days for adverse outcome (death or receiving organ support). Patients with post-exertion oxygen saturation recorded were selected for this analysis. We constructed receiver-operating characteristic curves, calculated diagnostic parameters, and developed a multivariable model for predicting adverse outcome.

Results We analysed data from 817 patients with post-exertion oxygen saturation recorded after excluding 54 in whom measurement appeared unfeasible. The c-statistic for post-exertion change in oxygen saturation was 0.589 (95% CI 0.465 to 0.713), and the positive and negative likelihood ratios of a 3% or more desaturation were, respectively, 1.78 (1.25 to 2.53) and 0.67 (0.46 to 0.98). Multivariable analysis showed that post-exertion oxygen saturation was not a significant predictor of adverse outcome when baseline clinical assessment was taken into account (p=0.368). Secondary analysis excluding patients in whom post-exertion measurement appeared inappropriate resulted in a c-statistic of 0.699 (0.581 to 0.817), likelihood ratios of 1.98 (1.26 to 3.10) and 0.61 (0.35 to 1.07), and some evidence of additional prognostic value on multivariable analysis (p=0.019).

Conclusions Post-exertion oxygen saturation provides modest prognostic information in the assessment of selected patients attending the emergency department with suspected COVID-19.

Trial registration number ISRCTN Registry (ISRCTN56149622) http://www.isrctn.com/ISRCTN28342533.

  • clinical assessment
  • respiratory
https://creativecommons.org/licenses/by/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

https://doi.org/10.1136/emermed-2020-210528

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    Key messages

    What is already known on this subject

    • Post exertional decrease in oxygen saturation can be used to predict prognosis in chronic lung diseases.

    • Post exertional desaturation has been proposed as a way of predicting adverse outcome in people with suspected COVID-19.

    What this study adds

    • Post-exertion oxygen saturation provides modest prognostic information in the assessment of selected patients attending the emergency department with suspected COVID-19.

    Introduction

    Guidelines for assessment of suspected COVID-19 recommend measurement of peripheral oxygen saturation to determine the severity of acute respiratory infection.1–3 Clinicians have noted that patients with suspected COVID-19 and a relatively normal oxygen saturation may desaturate after exertion, but the clinical importance of this finding is uncertain. If shown to predict adverse outcome, testing for post-exertional desaturation could be used to identify patients needing hospital admission.

    Field walking tests are commonly used to evaluate exercise capacity and assess prognosis in chronic respiratory diseases.4 The lowest arterial oxygen saturation recorded during a 6-minute walk test is an important marker of disease severity and prognosis.5 The rapid 1-minute sit-to-stand test correlates with the 6-minute walk test and the severity of lung disease.6 Exertional tests have shown desaturation in chronic obstructive lung disease,7 8 chronic interstitial lung disease9–11 and Pneumocystis carinii pneumonia.12 A modified 6-minute walk test has been proposed for use in suspected COVID-19 infection13 but not yet evaluated, to our knowledge. A recent review of rapid exercise tests for oxygen desaturation14 identified a number of studies, as outlined above, but found no published studies in COVID-19. The authors suggested that a 3% drop in oxygen saturation on exercise was a cause for concern, based on evidence from other conditions.

    The Pandemic Respiratory Infection Emergency System Triage (PRIEST) Study is a multicentre observational cohort study designed to develop and evaluate triage methods for patients with suspected COVID-19 infection. We added evaluation of post-exertion oxygen saturation to the aims of the PRIEST Study in response to reports of its use in the assessment of suspected COVID-19. Our specific objective for this post hoc substudy was to determine the accuracy of post-exertional oxygen saturation as a prognostic factor for 30-day adverse outcome.

    Methods

    For the PRIEST Study, we collected data from consecutive patients presenting with suspected COVID-19 infection to 70 hospital emergency departments (EDs) from 53 recruiting sites in the UK, where some sites cover more than one hospital. Hospitals used either prospective data collection, through a standardised assessment form for suspected COVID-19, or retrospective data collection, through research staff extracting data from hospital records onto the standardised form.

    Patients were included in the PRIEST Study if the assessing clinician used the standardised assessment form or recorded that the patient had suspected COVID-19 infection. The clinical diagnostic criteria used for suspected COVID-19 during the study were1 fever (≥38°C) or a history of fever and2 influenza-like illness (two or more of cough, sore throat, rhinorrhoea, limb or joint pain, headache, vomiting or diarrhoea) or severe and/or life-threatening illness suggestive of an infectious process. We did not seek consent to collect data but information about the study was provided in the ED and patients could withdraw their data at their request. Patients with multiple presentations to hospital were only included once, using data from the first presentation identified by research staff.

    The population for this substudy was patients who had post-exertion oxygen saturation recorded as part of routine care. The assessing clinician made the decision to measure post-exertion oxygen saturation and determined the approach to achieving exertion. The study did not influence clinical care, so we were unable to standardise the selection of patients or the approach to measuring post-exertion oxygen saturation. Measurement could have been undertaken deliberately, by asking the patient to exercise in a specified way, or opportunistically, by recording oxygen saturation after the patient had exerted themselves for another purpose.

    Research staff reviewed hospital records to identify outcomes up to 30 days after initial presentation. We defined patients who died or required respiratory, cardiovascular or renal support as having an adverse outcome. We defined respiratory support as any intervention to protect the patient’s airway or assist their ventilation, including mechanical ventilation, non-invasive ventilation or continuous positive airway pressure, but not supplemental oxygen alone or nebulised bronchodilators. We defined cardiovascular support as any intervention to maintain organ perfusion, including extracorporeal membrane oxygenation, inotropic drugs or invasive cardiovascular monitoring, but not peripheral intravenous cannulation and/or fluid administration. We defined renal support as any intervention to assist renal function, including haemofiltration, haemodialysis or peritoneal dialysis, but not intravenous fluid administration or urinary catheterisation.

    We undertook an initial descriptive analysis of the patients with post-exertion oxygen saturation recorded. This identified a number of patients for whom post-exertion oxygen saturation measurement appeared unfeasible, based on age (less than 3 years), performance status bed/chair bound, baseline oxygen saturation below 85%, post-exertion oxygen saturation below 50%, receiving supplemental oxygen or Glasgow Coma Score less than 14. We excluded these patients from the analysis.

    We examined baseline oxygen saturation, post-exertion oxygen saturation and post-exertion change in oxygen saturation (ie, baseline minus post-exertion oxygen saturation). Analysis focused on the latter, because this indicates the additional value achieved by measuring oxygen saturation after exertion. We estimated the accuracy of each index test in terms of the sensitivity, specificity and likelihood ratios of each test across a range of thresholds for positivity, for predicting adverse outcome up to 30 days. CIs for likelihood ratios were calculated using the methods outlined in Bedrick and Koopman.15 Receiving-operator characteristic (ROC) curves were constructed and the c-statistic (area under the ROC curve) was calculated for each index test. We did not attempt to determine an optimal threshold for positivity, because that depends on the relative importance of sensitivity and specificity in the decision that post-exertion oxygen saturation is intended to inform. However, we decided a priori to highlight the performance of a 3% desaturation, as suggested by Greenhalgh et al.14 Analysis was performed on patients with post-exertion oxygen saturation recorded and available 30-day outcome data, as such missing data were not imputed.

    To determine whether measurement of post-exertion oxygen saturation adds prognostic information to standard respiratory assessment, we fitted a multivariable logistic regression model with age, baseline oxygen saturation, respiratory rate, heart rate, asthma, other chronic respiratory illness and post-exertional oxygen saturation as covariates.

    We undertook a secondary analysis that excluded patients for whom post-exertion oxygen saturation measurement appeared less appropriate, based on age (less than 16 years), performance status of limited self-care, baseline oxygen saturation less than 94%, or heart rate, respiratory rate or systolic blood pressure scoring 3 points on the National Early Warning Score (NEWS2). The rationale for this analysis was that local guidelines3 recommend admission for patients with oxygen saturation less than 94% or a score of 3 points or more on any NEWS2 parameter. It has also been suggested that post-exertional assessment is only undertaken in a patient able to stand safely unaided and whose resting saturation is 96% or above.14

    We planned for the PRIEST Study to recruit a sample size of 20 000. The analysis presented here is a secondary analysis, so no sample size was prespecified.

    Patient and public involvement

    The Sheffield Emergency Care Forum (SECF) is a public representative group interested in emergency care research.16 Members of SECF advised on the development of the PRIEST Study and two members joined the Study Steering Committee. Patients were not involved in the recruitment and conduct of the study. We are unable to disseminate the findings to study participants directly.

    Results

    The PRIEST Study recruited 22 484 patients across 70 hospitals between 26 March 2020 and 28 May 2020, of whom 39 requested withdrawal of their data. We identified 874 patients who had post-exertion oxygen saturation recorded and excluded 57 in whom measurement appeared unfeasible, leaving 817 for analysis. Adverse outcome occurred in 30 participants (3.7%), of these 9 died, 22 had respiratory support, 5 had cardiovascular support and 4 renal support.

    Online supplemental figure 1 shows the flow of patients through the study, and online supplemental table S1 shows the characteristics of the whole PRIEST cohort and the characteristics of those included in this analysis. Participants in this analysis were younger, more likely to have unrestricted performance status, less likely to have any comorbidities, tended to have more normal baseline physiology and had a much lower rate of adverse outcome.

    Supplemental material

    Table 1 compares the baseline oxygen saturation, post-exertion oxygen saturation and post-exertion change between those with and without an adverse outcome. Post-exertion oxygen saturation tended to be lower than baseline oxygen saturation and showed a greater decrease in those who suffered adverse outcome (2.9% vs 1.9% mean decrease). However, figure 1 shows that oxygen saturations increased post-exertion in a proportion of cases and there was considerable overlap between those with and without adverse outcome. Online supplemental figures S2 and S3 show overlaid histograms for baseline and post-exertion oxygen saturation.

    View this table:
    Table 1

    Comparison of index tests summary statistics between those with and without adverse outcome

    Figure 1
    Figure 1

    Histograms comparing post-exertion change in oxygen saturation from baseline between patients with and without adverse outcome (N=813).

    Figure 2 shows the ROC curves for baseline oxygen saturation, post-exertion oxygen saturation and post-exertion change in oxygen saturation. The c-statistic of 0.589 (95% CI 0.465 to 0.713) for post-exertion change indicates poor discriminant value, that is, post-exertion change does not predict adverse outcome. This is partly due to post-exertion increases in oxygen saturation showing some association with increased risk of adverse outcome. Table 2 reports sensitivity, specificity and likelihood ratios for thresholds of post-exertion decrease in oxygen saturation (ie, change less than zero). The positive and negative likelihood ratios of a post-exertional desaturation of 3% or more were 1.78 and 0.67, respectively, suggesting that this finding provides a small amount of additional information in prognostic assessment. Online supplemental tables S2 and S3 show the diagnostic parameters for baseline and post-exertion oxygen saturation, respectively.

    View this table:
    Table 2

    Accuracy of post-exertion change in oxygen saturation from baseline at a range of thresholds for positivity, primary analysis (N=813)

    Figure 2
    Figure 2

    ROC curves showing index test accuracies for predicting adverse outcome, primary analysis (n=817). ROC, receiving-operator characteristic.

    Figure 3 and table 3 show comparable results for the secondary analysis excluding cases where post-exertion oxygen saturation measurement appeared less appropriate. The c-statistic of 0.699 (95% CI 0.581 to 0.817) for post-exertion change in oxygen saturation indicates better discriminant value in this group, that is, post-exertion change predicts an increased risk of adverse outcome. This may be explained by exclusion of patients with lower baseline oxygen saturations who had more potential to show a random post-exertion increase in oxygen saturation. The positive and negative likelihood ratios of a post-exertional decrease in oxygen saturation of 3% or more were 1.98 and 0.61, respectively, indicating some modest value in predicting adverse outcome. Online supplemental tables S4 and S5 show the diagnostic parameters for baseline and post-exertion oxygen saturation, respectively, for the secondary analysis.

    View this table:
    Table 3

    Accuracy of post-exertion change in oxygen saturation from baseline at a range of thresholds for positivity, secondary analysis (N=652)

    Figure 3
    Figure 3

    ROC curves showing index test accuracies for predicting adverse outcome, secondary analysis (N=655). ROC, receiving-operator characteristic.

    In the multivariable model on the primary analysis cohort, post-exertional oxygen saturation did not add prognostic value over other factors in the model (p value for model coefficient 0.368, likelihood ratio test for model with and without post-exertion oxygen saturation 0.78, p=0.376). For the secondary analysis, post-exertional oxygen saturation added prognostic value over other factors (p value for model coefficient 0.019, likelihood ratio test for model with and without post-exertion oxygen saturation 4.82, p=0.078), indicating that post-exertion desaturation may help to predict adverse outcome even when other clinical features are taken into account.

    Discussion

    Our findings suggest that measurement of post-exertion oxygen saturation adds modest prognostic information to clinical assessment of suspected COVID-19 in the ED. The likelihood ratios in the primary analysis suggest that a desaturation of 3% or more provides a small amount of prognostic information, the c-statistic of 0.589 for post-exertion change suggests little discriminant value, and multivariate analysis suggests that post-exertion oxygen saturation measurement does not add prognostic value once baseline measurements are taken into account. Secondary analysis limited to more appropriate cases suggested better discriminant value, with a c-statistic of 0.699, and additional prognostic value on multivariable analysis. In appropriate cases, post-exertion oxygen saturation measurement should be safe and relatively easy to incorporate into clinical assessment. It may therefore be worth using in selected patients, such as those with normal baseline observations and oxygen saturation. The low risk of adverse outcome in these selected patients means that absence of desaturation could provide reassurance that discharge home is appropriate.

    The observation that oxygen saturation increased post-exertion, and that some people with adverse outcome showed an increase, may seem surprising, but is probably explained by random variation. Oxygen saturation varies randomly from one measurement to the next and this variation is likely to be greater in sicker patients with baseline hypoxia. Thus, we might expect greater variation in oxygen saturation to show some association with adverse outcome.

    Greenhalgh et al 14 suggested using a desaturation of at least 3% to identify cause for concern in selected patients who are well enough for out-of-hospital management. Our findings suggest that a 3% desaturation indicates a small increase in the likelihood of adverse outcome. Further research could determine whether a more systematic and rigorously controlled approach to post-exertion oxygen saturation measurement can result in more useful prognostic information. The feasibility of such research may be limited by low event rates in people who are able to undertake formal post-exertion measurement of oxygen saturation.

    Our study consisted of a clinically relevant population and was recruited across a wide range of settings, but evaluation of post-exertion oxygen saturation was a post hoc secondary analysis and the study was not designed specifically for this purpose. We are unable to say how patients were selected for measurement of post-exertion oxygen saturation, and the method for undertaking exertion was not standardised or recorded. We excluded 57 patients from analysis for whom post-exertion oxygen saturation measurement appeared unfeasible, and excluded a further 162 from secondary analysis for whom measurement appeared less appropriate. These cases may reflect opportunistic oxygen saturation measurement after exertion, such as on attempting to mobilise, but we cannot exclude the possibility of data recording errors. Furthermore, our judgements regarding feasibility and appropriateness of measurement were somewhat subjective, so others may consider that measurement in these cases could be feasible or appropriate. Only 874 out of 22 445 patients (3.9%) had post-exertion oxygen saturation recorded. This may reflect limited awareness and use of post-exertion oxygen saturation, but may also reflect severity of illness in the ED population. Measurement of post-exertion oxygen saturation is only likely to be feasible and clinically indicated in those with milder illness. The relatively small number of adverse outcomes (N=30) limited the precision of our estimates of sensitivity and power to undertake multivariable analysis.

    In summary, measuring post-exertion oxygen saturation provides modest prognostic information in the assessment of selected patients attending the ED with suspected COVID-19. It could be added to clinical assessment for patients with normal baseline oxygen saturation when there is uncertainty around the decision to admit to hospital.

    Supplemental material

    Supplemental material

    Supplemental material

    Supplemental material

    Acknowledgments

    We thank Katie Ridsdale for clerical assistance with the study, Erica Wallis (sponsor representative), all members of the PRIEST Research Team (online supplemental appendix 1), all members of the Study Steering Committee (online supplemental appendix 2) and the site research teams who delivered the data for the study (online supplemental appendix 3), and the research team at the University of Sheffield past and present (online supplemental appendix 4).

    References

    1. ↵
      1. World Health Organisation
      . Clinical management of severe acute respiratory infection (SARI) when COVID-19 disease is suspected, 2020. Available: https://www.who.int/publications-detail/clinical-management-of-severe-acute-respiratory-infection-when-novel-coronavirus-(ncov)-infection-is-suspected [Accessed 28 Apr 2020].
    2. ↵
      1. World Health Organisation
      . Clinical care of severe acute respiratory infections – tool kit. Available: https://www.who.int/publications-detail/clinical-care-of-severe-acute-respiratory-infections-tool-kit [Accessed 28 Apr 2020].
    3. ↵
      1. NHS
      . Clinical guide for the management of emergency department patients during the coronavirus pandemic. Available: https://www.england.nhs.uk/coronavirus/secondary-care/other-resources/specialty-guides/#ae [Accessed 15 Jun 2020].
    4. ↵
      2. Holland AE ,
      3. Spruit MA ,
      4. Troosters T , et al
      . An official European respiratory Society/American thoracic Society technical standard: field walking tests in chronic respiratory disease. Eur Respir J 2014;44:1428–46.doi:10.1183/09031936.00150314 pmid:http://www.ncbi.nlm.nih.gov/pubmed/25359355
      OpenUrlAbstract/FREE Full Text
    5. ↵
      2. Singh SJ ,
      3. Puhan MA ,
      4. Andrianopoulos V , et al
      . An official systematic review of the European respiratory Society/American thoracic Society: measurement properties of field walking tests in chronic respiratory disease. Eur Respir J 2014;44:1447–78.doi:10.1183/09031936.00150414 pmid:http://www.ncbi.nlm.nih.gov/pubmed/25359356
      OpenUrlAbstract/FREE Full Text
    6. ↵
      2. Bohannon RW ,
      3. Crouch R
      . 1-Minute Sit-to-Stand test: systematic review of procedures, performance, and Clinimetric properties. J Cardiopulm Rehabil Prev 2019;39:2–8.doi:10.1097/HCR.0000000000000336 pmid:http://www.ncbi.nlm.nih.gov/pubmed/30489442
      OpenUrlPubMed
    7. ↵
      2. Crook S ,
      3. Büsching G ,
      4. Schultz K , et al
      . A multicentre validation of the 1-min sit-to-stand test in patients with COPD. Eur Respir J 2017;49:1601871.doi:10.1183/13993003.01871-2016 pmid:http://www.ncbi.nlm.nih.gov/pubmed/28254766
      OpenUrlAbstract/FREE Full Text
    8. ↵
      2. Gloeckl R ,
      3. Teschler S ,
      4. Jarosch I , et al
      . Comparison of two- and six-minute walk tests in detecting oxygen desaturation in patients with severe chronic obstructive pulmonary disease — a randomized crossover trial. Chron Respir Dis 2016;13:256–63.doi:10.1177/1479972316636991
      OpenUrlCrossRefPubMed
    9. ↵
      2. Briand J ,
      3. Behal H ,
      4. Chenivesse C , et al
      . The 1-minute sit-to-stand test to detect exercise-induced oxygen desaturation in patients with interstitial lung disease. Ther Adv Respir Dis 2018;12:1753466618793028. doi:10.1177/1753466618793028 pmid:http://www.ncbi.nlm.nih.gov/pubmed/30091679
      OpenUrlPubMed
    10. ↵
      2. Rusanov V ,
      3. Shitrit D ,
      4. Fox B , et al
      . Use of the 15-steps climbing exercise oximetry test in patients with idiopathic pulmonary fibrosis. Respir Med 2008;102:1080–8.doi:10.1016/j.rmed.2007.12.031 pmid:http://www.ncbi.nlm.nih.gov/pubmed/18457939
      OpenUrlPubMed
    11. ↵
      2. Shitrit D ,
      3. Rusanov V ,
      4. Peled N , et al
      . The 15-step oximetry test: a reliable tool to identify candidates for lung transplantation among patients with idiopathic pulmonary fibrosis. J Heart Lung Transplant 2009;28:328–33.doi:10.1016/j.healun.2008.12.019 pmid:http://www.ncbi.nlm.nih.gov/pubmed/19332258
      OpenUrlCrossRefPubMedWeb of Science
    12. ↵
      2. Smith DE ,
      3. Wyatt J ,
      4. Mcluckie A , et al
      . Severe exercise hypoxaemia with normal or near normal X-rays: a feature of Pneumocystis carinii infection. The Lancet 1988;332:1049–51.doi:10.1016/S0140-6736(88)90066-9
      OpenUrl
    13. ↵
      2. Mantha S ,
      3. Tripuraneni SL ,
      4. Roizen MF , et al
      . Proposed modifications in the 6-minute walk test for potential application in patients with mild COVID-19: a step to optimize triage guidelines. Anesth Analg 2020;131:398-402:398–402. doi:10.1213/ANE.0000000000004986 pmid:http://www.ncbi.nlm.nih.gov/pubmed/32433249
      OpenUrlPubMed
    14. ↵
      2. Greenhalgh T ,
      3. Javid B ,
      4. Knight M
      . What is the efficacy and safety of rapid exercise tests for exertional desaturation in covid-19? 2020. Available: https://www.cebm.net/covid-19/what-is-the-efficacy-and-safety-of-rapid-exercise-tests-for-exertional-desaturation-in-covid-19/
    15. ↵
      2. Bedrick EJ ,
      3. Koopman PAR
      . A family of confidence intervals for the ratio of two binomial proportions. Biometrics 1987;43:993–7.doi:10.2307/2531551 pmid:http://www.ncbi.nlm.nih.gov/pubmed/3427181
      OpenUrlCrossRefPubMedWeb of Science
    16. ↵
      2. Hirst E ,
      3. Irving A ,
      4. Goodacre S
      . Patient and public involvement in emergency care research. Emerg Med J 2016;33:665–70.doi:10.1136/emermed-2016-205700 pmid:http://www.ncbi.nlm.nih.gov/pubmed/27044949
      OpenUrlAbstract/FREE Full Text

    Supplementary materials

    Footnotes

    • Handling editor Ed Benjamin Graham Barnard

    • Twitter @tim harris@resusdocs, @emsdocuk

    • Contributors SG, AB, KC, CF, TH, FL, ALe, IM and DW conceived and designed the study. BT, KB, ALo, SW, RS, JS, SC, ES, JH and EY acquired the data. EL, LS, SG, BT, KB and CM analysed the data. SG, AB, KC, CF, TH, FL, ALe, IM, DW, EL, LS, SG, BT, KB and CM interpreted the data. All authors contributed to drafting the manuscript. SG takes responsibility for the paper as a whole.

    • Funding The PRIEST Study was funded by the UK National Institute for Health Research Health Technology Assessment (HTA) programme (project reference 11/46/07).

    • Disclaimer The funder played no role in the study design; in the collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care.

    • Competing interests None declared.

    • Patient consent for publication Not required.

    • Ethics approval The North West–Haydock Research Ethics Committee gave a favourable opinion on the PAINTED Study on 25 June 2012 (reference 12/NW/0303) and on the updated PRIEST Study on 23rd of March 2020. The Confidentiality Advisory Group of the Health Research Authority granted approval to collect data without patient consent in line with Section 251 of the National Health Service Act 2006.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    • Data availability statement Data are available upon reasonable request. Anonymised data are available from the corresponding author upon reasonable request (contact details on first page).

    • Supplemental material This content has been supplied by the author(s). It has not been vetted by BMJ Publishing Group Limited (BMJ) and may not have been peer-reviewed. Any opinions or recommendations discussed are solely those of the author(s) and are not endorsed by BMJ. BMJ disclaims all liability and responsibility arising from any reliance placed on the content. Where the content includes any translated material, BMJ does not warrant the accuracy and reliability of the translations (including but not limited to local regulations, clinical guidelines, terminology, drug names and drug dosages), and is not responsible for any error and/or omissions arising from translation and adaptation or otherwise.