Article Text

Download PDFPDF

Measuring ‘Need for Recovery’ as an indicator of staff well-being in the emergency department: a survey study
  1. Blair Graham1,2,
  2. Laura Cottey2,3,
  3. Jason E Smith2,3,
  4. Mark Mills4,
  5. Jos M Latour1
  1. 1 Faculty of Health, University of Plymouth, Plymouth, UK
  2. 2 Emergency Department, Derriford Hospital, University Hospitals Plymouth NHS Trust, Plymouth, UK
  3. 3 Academic Department of Military Emergency Medicine, Royal Centre for Defence Medicine, Birmingham, UK
  4. 4 Plymouth Peninsula Medical School, Plymouth University, Plymouth, United Kingdom
  1. Correspondence to Dr Blair Graham, Faculty of Health and Human Sciences, University of Plymouth Faculty of Health and Human Sciences, Plymouth PL4 8AA, UK; blair.graham{at}plymouth.ac.uk

Abstract

Background The Need for Recovery (NFR) Scale is an 11-item questionnaire that assesses how work affects intershift recovery. Items are summated to form a score with a maximum value of 100. Previously reported scores range from 38 in nurses to 55 in miners. This study aimed to determine the NFR Score among ED staff and to identify whether the NFR Score was associated with characteristics potentially implicated with recovery from work.

Methods Staff in a single ED in the South West of England (annual attendances of 93 000) were asked to complete an electronic questionnaire incorporating the NFR Scale plus additional items relating to demographic, work-related and well-being characteristics, in their own time during January 2018. Descriptive statistics are presented, including median NFR Scores and associations with additional characteristics. Thematic analysis of free-text comments from an open-ended question was undertaken.

Results One hundred and sixty-eight responses were obtained (80.3% capture). Median NFR Score across all staff groups was 81.8 out of 100.0 (95% CI 72.7 to 81.8). Shift duration exceeding 12 hours, dissatisfaction with work–life balance and self-reported perceptions of burnout were associated with significantly elevated NFR Scores. Themes resulting from the open-ended question were ‘barriers to intershift recovery’ and ‘coping with work’.

Conclusion The NFR Scores in this study exceeded scores reported elsewhere and were associated with some demographic, occupational and well-being characteristics. The NFR Scale has utility to measure the need for intershift recovery among ED staff. A larger study is warranted to identify specific determinants of recovery and to provide recommendations.

  • emergency department
  • staff support
  • safety
  • qualitative research

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Key messages

What is already known on this subject

  • The Need for Recovery (NFR) Scale has previously been used to assess workers’ subjective need for physical and psychological recuperation following a period of work on a scale from 0, indicating no detectable NFR Score, to 100, indicating maximum NFR Score. A large study developing this scale documented an average NFR Score of 38 within the general population in the Netherlands.

  • The negative effects of increased NFR Score are cumulative and include increased risk of occupational burnout and adverse health outcomes.

What this study adds

  • This is the first study to evaluate the use of the NFR Scale among ED staff. The study shows a baseline score of 81.8 out of 100 among ED staff. This is higher than any previously reported scores in other populations. Further research is needed to define the NFR among ED staff nationally.

Introduction

The unpredictable and often stressful nature of clinical work in the ED is a prominent concern for ED staff and healthcare providers internationally.1 ED staff are frequently required to work rota patterns consisting of consecutive long shifts. As a result, they frequently encounter fatigue while at work, which may contribute towards reduced productivity, impaired personal well-being and increased rates of error.2 3

The concept of Need for Recovery (NFR) describes an individual’s subjective requirement to physically and mentally recuperate following a period of work and should be as low as possible.4 Adequate recovery is required to offset high work demands and mitigate against the development of work-related stress and psychological overload. When an individual cannot adequately recover from a period of work, NFR may cumulatively increase and result in a negative impact on physical health, psychosocial well-being and occupational performance. Persistently increased NFR is associated with a range of long-term health effects, including neuroendocrine dysfunction, depression, cardiovascular disease, psychosomatic complaints and sickness absence.5–9 Although NFR is not explicitly recognised within current definitions of occupational burnout,10 fatigue and impaired recovery may precede the onset of burnout.11 As such, NFR may be a particularly useful focus for assisting in the primary prevention of burnout and identification of individuals and groups at high risk.

Although NFR has received comparatively little attention in the emergency care literature compared with burnout, the cumulative detrimental effect of insufficient recovery on health outcomes means that measurement of NFR may be particularly relevant for staff working in unscheduled care settings, whose work demands are frequently intense and defined by irregular working patterns.2 12 Furthermore, the identification of factors contributing to prolonged NFR may inform initiatives to improve staff well-being in the ED. Such approaches may stand to improve workforce health and also to improve the recruitment and retention of ED staff.

The NFR Scale was originally developed as part of the Dutch Questionnaire on the Experience and Evaluation of Work. Each of the 11 items is scored using a dichotomous ‘yes/no’ response. Items are then summated to yield a score which ranges from 0, indicating no recordable NFR, to 100, indicating maximum attainable NFR (online supplementary material 1).4 A validation study within the Netherlands (n=12 095) suggested a baseline average NFR Score of 38 out of 100 within the general population.12 This was noted to have a negative skew, with the highest proportion of respondents reporting a low NFR Score. Additional studies demonstrate that NFR is broadly similar among a range of occupations, including ambulance staff in the Netherlands (NFR Score 43.6),8 nurses in Brazil (NFR Score 36.4)13 and non-healthcare-related occupations, such as seafarers and outdoor instructors in the UK (NFR Scores 36.4 and 35.6, respectively).14 15 To date, the highest occupational NFR Score identified in the literature is among underground mine workers in Iran (NFR Score 55.2).16

Supplemental material

While burnout scales such as the Maslach and Copenhagen Burnout Inventories are commonly included within well-being surveys aimed at ED staff,17 18 these do not directly measure NFR. As such, the NFR Scale may provide a useful and straightforward means of measuring an additional important concept related to well-being among ED staff.

Research question

What is the baseline NFR Score among staff working in a single UK ED?

Aims

This study aimed to determine the baseline NFR Score of staff working within a single UK ED and to assess whether the NFR Score is associated with selected demographic, occupational and well-being characteristics potentially implicated with impaired recovery from work.

Methods

A single-centre cross-sectional staff survey with thematic analysis of free-text responses to an open-ended question was conducted. The survey was hosted securely using an online platform and was designed in accordance with relevant sections of the Checklist of Reporting Results of Internet E-Surveys.19 The e-survey included the validated 11-item NFR Scale plus additional self-reported demographic, rota and well-being characteristics. A minor amendment to one NFR item was made to increase the applicability to shift workers (Item 4; from ‘After the evening meal, I generally feel in good shape’ to ‘After my breaks I feel fresh to continue my work’).The e-survey consisted of seven pages in total (43 items) and could be openly accessed by any respondent provided with the relevant internet hyperlink. No personal identifiable information was collected at any point. No items were compulsory, and review of answers was allowed. Item randomisation and adaptive questioning was not used. Respondent information was provided, and informed consent was obtained at the beginning of the survey. Signposting to relevant support services was provided on the final page. A panel of independent reviewers outside the study population assessed the readability of items and functionality of the online questionnaire prior to distribution.

Demographic and work pattern characteristics

To facilitate exploration of possible associations between NFR Scores and respondents’ demographics and work pattern, researchers identified characteristics featured in existing studies with potential to affect recovery from work.6 9 12 These were used as the basis for creating items additional to the NFR Scale and included respondents’ profession, age, gender, shift pattern, contract type (full time vs less than full time) and duration of shifts. These characteristics were reported using nominal and ordinal scales.

Well-being characteristics

A further five additional items were designed by the research team to explore the possible relationship between NFR and respondents’ subjective perception of personal well-being. These related to the presence of long-term health conditions or disabilities, caring responsibilities outside of work, self-perception of current burnout and future burnout, and satisfaction with ‘work–life balance’ (online supplementary material 2). To maintain consistency with the original NFR Scale items, well-being characteristics were reported using a dichotomous ‘yes’/’no’ response.

Supplemental material

An optional question with free-text response was provided at the end of the survey to explore suggestions from respondents of how to improve their ability to recover between shifts:

"Do you have any suggestions which you feel might improve your ability to recover between shifts?”

Recruitment

All permanent staff (n=209) working in a single large ED (93 000 annual attendances) were invited to participate by email during January 2018. Participation was voluntary and no incentives were offered. For the purposes of this study, respondents who did not provide answers to all 11 items of the NFR questionnaire were excluded.

Data analysis

Data were collected in Microsoft Excel V.16 and statistical analysis was performed using IBM SPSS Statistics V.24. Descriptive statistics were used to describe NFR Scores and to identify associations with the predetermined respondent characteristics. The median NFR Score, with accompanying 95% CIs, were calculated for the overall population and then within each additional subgroup. To determine the significance of associations between NFR and respondent characteristics, Mann-Whitney U and Kruskal-Wallis tests were undertaken as appropriate. Internal consistency provides an assessment of how reliably individual questionnaire items measure the same concept. Internal consistency of the 11 NFR items was assessed using Cronbach’s alpha, wherea value of >0.7 is generally regarded as an acceptable level of reliability.20

Responses to the free-text question were subjected to exploratory thematic analysis21 22; two researchers (LC and BG) identified initial codes. The independently generated codes were then collated into subthemes and themes. As both coders were practising emergency physicians, review was sought from a researcher independent from the ED (JML). Codes, subthemes and themes were presented together with selected examples of relevant free-text comments. Additional care was taken to ensure that the used comments maintained respondents’ anonymity, for example, by combining those professional groups containing small numbers of respondents.

Outcomes

The primary outcome was the median NFR Score among the study population. Secondary outcomes included associations between NFR and the selected respondent characteristics, and exploration of qualitative comments. Measurable indicators of questionnaire usability among the target population included total response rate, percentage completion and time taken to complete survey.

Patient and public involvement

As this was a staff survey, there was no patient or public involvement in the study design.

Results

One hundred and seventy-three responses were obtained, of which 168 (97.1%) completed all NFR items and were eligible for inclusion. Based on departmental workforce, this yielded an overall response rate of 80.3%. The average time to complete the survey was less than 7 min. Internal consistency of the 11 NFR items was acceptable; Cronbach alpha 0.79.

Nursing and medical staff comprised the majority of respondents (40.5% and 33.9%, respectively). A greater proportion of respondents were female (69.6%), and most respondents were aged 50 years or under (88.1%). Overall, 35.7% of all respondents reported significant caring responsibilities outside of work and 13.1% had at least one long-term condition or disability. With regard to well-being, 42.2% of respondents reported that they felt burned out from work, 73.8% felt at ‘high risk’ of future burnout within the ensuing 6 months, and 57.8% reported current dissatisfaction with work–life balance. Respondent characteristics are summarised in table 1.

Table 1

Results

Responses to the NFR items were non-normally distributed with a negative skew towards high values (figure 1). The median NFR Score within the study population was 81.8 out of 100 (range 0–100, 95% CI 72.7 to 81.8) (table 1). Thirty-nine (23.2%) respondents had a maximum attainable NFR Score of 100.

Figure 1

Histogram demonstrating frequency of responses from minimum attainable NFR Score to maximum attainable NFR Score. NFR, Need for Recovery.

Significant differences were observed in median NFR Scores between staff groups (p=0.02). Post hoc analysis confirmed that the median NFR Score for both nursing staff (81.8, 95% CI 81.8 to 90.9) and administration/support staff (90.9, 95% CI 72.7 to 100) was significantly higher than for allied health professionals (AHPs) (p=0.003 and 0.02, respectively). There were no differences in NFR Score between other staff groups, and AHPs reported the lowest median NFR Scores for any staff group (median NFR Score 63.6, 95% CI 45.5 to 81.8). In addition, average shift duration exceeding 12 hours was also associated with increased NFR Score (81.8, 95% CI 81.8 to 90.9, p=0.02)(figure 2). Older respondents had a higher NFR Score, but this difference was not found to be statistically significant (figure 3). No differences were observed with regard to gender or among groups reporting long-term conditions or disabilities, caring responsibilities outside of work or less than full-time working.

Figure 2

Boxplot demonstrating the relationship between NFR Score and shift duration. NFR, Need for Recovery.

Figure 3

Boxplot demonstrating the relationship between NFR Score and respondent age group. NFR, Need for Recovery.

In relation to well-being characteristics, there were significant associations between likelihood of increased median NFR and current self-reported occupational burnout (90.6, 95% CI 81.8 to 90.9, p≤0.01), self-reported high risk of future burnout over the next 6 months (81.8, 95% CI 81.8 to 90.9, p≤0.01) and current dissatisfaction with work–life balance (81.8, 95% CI 81.8 to 90.9, p≤0.01). A visual representation of the relationship between individual respondent NFR Scores and well-being characteristics is provided in figure 4.

Figure 4

Boxplot demonstrating the relationship between NFR Score and respondent well-being. NFR, Need for Recovery.

Analysis of free-text comments

A total of 95 free-text comments were received. Exploratory thematic analysis revealed 23 codes which were grouped initially into six subthemes, resulting in two themes; ‘barriers to intershift recovery’ and ‘coping with ED work’. Four subthemes were grouped under the theme barriers to intershift recovery and were ‘shift work’, ‘personal circumstances’, ‘maintaining personal well-being’ and ‘organisational factors’. The remaining two subthemes were ‘coping in the present’ and ‘coping in the future’ and were grouped in the second theme, coping with ED work. A summary of results and selected examples of free-text comments are presented in table 2.

Table 2

Results of exploratory thematic analysis and examples of free-text comments

Within the theme of barriers to intershift recovery, many comments contained codes relating to the subtheme of shift work focusing on intensity, length and pattern of shifts. Some respondents reported feeling exhausted following ED shifts (table 2, comment A1); others felt that working a mixed shift pattern contributed to increased NFR (comment A2) or that antisocial shifts adversely affected quality of life (comment A3). Although quantitative data did not establish any statistically significant relationship, several respondents commented on the perceived impact of additional caring responsibilities, including childcare, on their intershift recovery (comments A3 and B1), with one parent specifically remarking that lack of rota flexibility also restricted career development (comment B2). Additionally, advancing age, personal financial status and excessive commuting time (comment B3) all constrained recovery for some respondents. Under the subtheme of maintaining personal well-being, respondents reported that ED shift work prevented time for recuperation (comments C1 and C2) and access to regular physical exercise (comment C3). Several respondents were also critical of the effect of wider organisational factors on intershift recovery and explicitly desired more support from management staff (comments D1 and D2). Under the theme of coping with ED work, some respondents communicated their strategies for coping in the present. One member of nursing staff (comment E1) highlighted this included awareness of existing support networks (comment E2) and developing a positive mental outlook as an adaptive coping strategy. Several respondents reflected on coping in the future and suggested a range of discrete improvements to aid recovery including the use of group debriefing (comment F1), training and ‘away days’ (comment F2), as well as improved recognition of staff (comment F3).

Discussion

The median NFR Score in this study population exceeds previously reported scores among healthcare and non-healthcare-related occupations internationally.8 12–16 In addition, nearly a quarter of all respondents in our study attained the maximum NFR Score. This finding is contrary to baseline general population data, where the highest frequency of responses was observed at the lowest end of the scale. Although the reasons for the high NFR Score obtained in this study are currently unclear, these may relate to operational pressures and workload faced by ED staff at the time of data collection, or personal or cultural differences within this, compared with populations studied previously. Further investigation is required to confirm scores among ED staff and to assess the possibility of ceiling effects using the current iteration of the NFR survey. Monitoring the stability of NFR Scores over time may allow for the effectiveness of quality improvement strategies aimed at directly improving NFR to be assessed.

Several associations with the selected respondent characteristics were also determined. Specifically, there were high NFR Scores among ED nursing staff. Impaired well-being has previously been identified as a major factor driving job dissatisfaction and workforce attrition among UK nurses, and the need to monitor well-being has been addressed as a strategic priority.23 Periodic evaluation of NFR Scores may provide a means of contributing towards such an objective. In addition, several trends in keeping with previous studies using the NFR Scale were also observed. For example, the association between advancing age and risk of higher NFR Scores has been previously reported,24 25 and the trend towards higher NFR Scores with increased shift duration adds to previous observations that personal effectiveness decreases on 12-hour shifts compared with shorter shifts.26 In our study, the NFR Scores were more favourable among AHPs. Determining reasons for this observation may highlight areas of desirable practice which may be transferrable to benefit other staff groups, highlighting the potential utility of the NFR survey as a tool to achieve positive change. The reported incidence of disability and long-term conditions among the study population was in keeping with the UK working population average27 and did not appear to be associated with NFR Scores in our study population. Likewise, quantitative data did not reveal associations between NFR Score and caring responsibilities or respondent gender.

Incidence of burnout within the study population is consistent with estimates from elsewhere in the literature.17 18 28 29 A statistically significant relationship has been observed between increased NFR Score and the presence of perceived occupational burnout, high risk of future burnout and dissatisfaction with work–life balance. This serves to further highlight the possible utility of using the NFR Score to assess well-being of ED staff. In addition to population trends, individual NFR responses highlight that some respondents report very high NFR Scores yet do not align themselves with items aimed at identifying adverse well-being. This may indicate that NFR provides an additional construct to occupational burnout and work–life balance and that measurement of NFR should complement, rather than replace, existing measures. However, it is also plausible that this observation highlights a possible lack of awareness of impaired personal well-being among some ED staff and the need to increase self-awareness among this population.

Although the open-ended question was intended to provide respondents with the opportunity to communicate their proposed solutions to improving intershift recovery, a much broader narrative resulted. Respondents detailed the perceived barriers to intershift recovery encountered in practice and strategies employed to cope with their work. This is the first evaluation of the NFR Scale to include qualitative data and highlights the potential value of assessing lived experiences of impaired intershift recovery. While the NFR Score provides an overview of staff well-being at a population level, exploration of individuals’ experiences provides important additional insights and ‘meaning behind the numbers’.

The straightforward construction and use of dichotomous rating scales within the NFR Scale make it uniquely appealing for routine administration among a busy workforce such as that encountered in the ED. The high response rate and apparent ease of completion in under 10 minutes confirm usability of the questionnaire among this population. Combined, both quantitative and qualitative data from this study may inform interventions aimed at improving staff well-being in the ED.

Limitations

The online survey was designed using current best practice guidelines. However, to provide reassurance regarding anonymity and to simplify recruitment, respondents were not required to register for individualised access to complete the survey. As such, it was not possible to monitor for duplicate or multiple responses, although none were overtly detected during analysis. While this initial study provides some indication of characteristics that may be associated with increased NFR, the number of respondents is small, and the analysis does not consider possible confounding variables. In addition, the use of a single centre may limit broader generalisability of this study. As such, repeat assessment across multiple centres using a more sophisticated multivariate analysis is desirable before these associations can be confirmed. In addition, measurements of NFR in other UK healthcare populations is lacking and would allow for comparison between the ED and other settings. This study aimed to capture subjective perceptions of burnout and well-being among ED staff and highlighted any possible relationship with NFR. Although the use of validated scales may seem desirable to confirm such associations, the inclusion of large numbers of additional questionnaire items may have led to respondent fatigue and reduced survey completion rates.30 In addition, previous work suggests that single-item measurement of subjective perception of burnout correlates satisfactorily with the Maslach Burnout Inventory.31

For the purposes of this study, only responses where all 11 NFR items had been completed were included in analysis, at least one prior study has proposed imputation of NFR Score where equal or greater than eight items have been completed.4 In this study, no respondent failed to complete less than eight items, highlighting imputation as a possible method of analysis for future work in order to maximise responses.

Although not primarily intended as a qualitative study, respondents who chose to write optional free-text comments contributed to a deeper understanding of the determinants of need for recovery, and researchers felt it was important to report these. To ensure rigour, thematic analysis was adopted from the outset. While this is not a well-recognised method for gathering qualitative data, purposeful analysis of free-text comments has been suggested as a means of providing additional valuable information in previous survey studies.32

Conclusion

This study provides quantifiable insight into the high work intensity experienced by staff in a single ED in the UK, with the median NFR Score exceeding all previously reported norms. The analysis of free-text comments has provided additional information and indicated some potential barriers to intershift recovery. It is feasible to use the NFR Scale to assess the need for intershift recovery among ED staff. Further research is warranted to confirm findings from this study, identify specific determinants of recovery and ultimately produce recommendations for improving intershift recovery among ED staff.

Acknowledgments

The authors would like to thank Kara Stevens for providing additional review of the revised manuscript.

References

Footnotes

  • Handling editor Mary Dawood

  • Twitter @timecritical, @lauracottey

  • Contributors BG coordinated the study design and oversight of data collection, undertook initial data analysis, contributed to the thematic analysis of free-text comments, the first draft of the manuscript and subsequent revised versions, and approved the final version for submission. LC co-coordinated study design and oversight of data collection; contributed to the data analysis, including thematic analysis of free-text comments, the first draft of the manuscript and subsequent revised versions; and approved the final version for submission. JES contributed to the development of the study design and contributed to the first draft of the manuscript and subsequent revised versions, and approved the final version for submission. MM contributed to the development of the study design, undertook the initial data collection as part of his medical student special study module and approved the final version of the manuscript for submission. JML contributed to the development of the study design and contributed to the first draft of the manuscript and subsequent revised versions, and approved the final version for submission.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were not involved in the design, conduct, reporting or dissemination plans of this research.

  • Patient consent for publication Not required.

  • Ethics approval The chair of the regional Research Ethics Committee was prospectively approached for comment on this study and confirmed formal ethical approval was not required to conduct staff survey. However, the project was registered with the Audit and Service Evaluation department at the host institution (CA_2017-18-147).

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data availability statement Data are available from the study authors upon reasonable request.