Impact of scribes on emergency medicine doctors’ productivity and patient throughput: multicentre randomised trial
BMJ 2019; 364 doi: https://doi.org/10.1136/bmj.l121 (Published 30 January 2019) Cite this as: BMJ 2019;364:l121Opinion
It’s time to think hard about how clinicians work in a digital age
- Katherine Walker, director of emergency medicine research, adjunct clinical associate professor12,
- Michael Ben-Meir, director of emergency medicine, adjunct senior lecturer12,
- William Dunlop, head scribe, medical student13,
- Rachel Rosler, director of clayton emergency medicine4,
- Adam West, director of paediatric emergency medicine4,
- Gabrielle O’Connor, emergency physician5,
- Thomas Chan, director of emergency medicine, adjunct associate professor56,
- Diana Badcock, director of emergency medicine7,
- Mark Putland, adjunct senior lecturer, clinical director of emergency medicine, director of emergency medicine478,
- Kim Hansen, emergency physician, director of emergency medicine910,
- Carmel Crock, director of emergency medicine11,
- Danny Liew, chair of clinical outcomes research12,
- David Taylor, professor, director of emergency medicine research613,
- Margaret Staples, adjunct senior research fellow, biostatistician214
- 1Emergency Department, Cabrini Hospital, Malvern, VIC 3144, Australia
- 2Department of Epidemiology and Preventive Medicine, Monash University, Melbourne, VIC, Australia
- 3Australian National University, Canberra, ACT, Australia
- 4Emergency Department, Monash Health, Dandenong, Melbourne, VIC, Australia
- 5Emergency Department, Austin Health, Heidelberg, VIC, Australia
- 6University of Melbourne, Melbourne, VIC, Australia
- 7Emergency Department, Bendigo Health, Bendigo, VIC, Australia
- 8Emergency Department, Melbourne Health, Parkville, VIC, Australia
- 9Emergency Department, Prince Charles Hospital, Chermside, QLD, Australia
- 10Emergency Department, St Andrews War Memorial Hospital, Brisbane, QLD, Australia
- 11Emergency Department, Royal Victorian Eye and Ear Hospital, East Melbourne, VIC, Australia
- 12School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
- 13Emergency Medicine, Austin Health, Heidelberg, VIC, Australia
- 14Biostatistics, Cabrini Institute, Malvern, VIC, Australia
- Correspondence to: K Walker katie_walker01{at}yahoo.com.au
- Accepted 7 January 2019
Abstract
Objectives To evaluate the changes in productivity when scribes were used by emergency physicians in emergency departments in Australia and assess the effect of scribes on throughput.
Design Randomised, multicentre clinical trial.
Setting Five emergency departments in Victoria used Australian trained scribes during their respective trial periods. Sites were broadly representative of Australian emergency departments: public (urban, tertiary, regional referral, paediatric) and private, not for profit.
Participants 88 physicians who were permanent, salaried employees working more than one shift a week and were either emergency consultants or senior registrars in their final year of training; 12 scribes trained at one site and rotated to each study site.
Interventions Physicians worked their routine shifts and were randomly allocated a scribe for the duration of their shift. Each site required a minimum of 100 scribed and non-scribed shifts, from November 2015 to January 2018.
Main outcome measures Physicians’ productivity (total patients, primary patients); patient throughput (door-to-doctor time, length of stay); physicians’ productivity in emergency department regions. Self reported harms of scribes were analysed, and a cost-benefit analysis was done.
Results Data were collected from 589 scribed shifts (5098 patients) and 3296 non-scribed shifts (23 838 patients). Scribes increased physicians’ productivity from 1.13 (95% confidence interval 1.11 to 1.17) to 1.31 (1.25 to 1.38) patients per hour per doctor, representing a 15.9% gain. Primary consultations increased from 0.83 (0.81 to 0.85) to 1.04 (0.98 to 1.11) patients per hour per doctor, representing a 25.6% gain. No change was seen in door-to-doctor time. Median length of stay reduced from 192 (interquartile range 108-311) minutes to 173 (96-208) minutes, representing a 19 minute reduction (P<0.001). The greatest gains were achieved by placing scribes with senior doctors at triage, the least by using them in sub-acute/fast track regions. No significant harm involving scribes was reported. The cost-benefit analysis based on productivity and throughput gains showed a favourable financial position with use of scribes.
Conclusions Scribes improved emergency physicians’ productivity, particularly during primary consultations, and decreased patients’ length of stay. Further work should evaluate the role of the scribe in countries with health systems similar to Australia’s.
Trial registration ACTRN12615000607572 (pilot site); ACTRN12616000618459.
Introduction
A medical scribe helps the physician by doing clerical tasks. The scribe stands with the physician at patients’ bedsides, documenting consultations, arranging tests and appointments, completing electronic medical record tasks, finding information and people, booking beds, printing discharge paperwork, and doing clerical tasks (box 1).1 They do this via a computer-on-wheels connected to the hospital’s electronic medical record system. The aim of the role is for scribes to do clerical tasks otherwise done by the physician, enabling the physician to manage more patients in the same amount of time.
Tasks done by scribes
Electronic physician allocation
Locating nurses’ notes
In-room documentation of:
History
Physical examination
Medical plan
Investigation results/interpretations
Progress in emergency department
Diagnosis
Disposition plan
Safety net information
Information retrieval:
Primary care letters
Clinic/specialist letters
Previous hospital records
Previous investigations
Facilitation of investigations:
Adding clerical details to requests
Faxing investigation requests
Calling in radiology staff
Coordinating with porters
Confirming bookings and times
Communicating plans to nurses
Troubleshooting investigation delays
Post-initial consultation tasks:
Booking beds
Conveying written requests to nurses/allied health staff
Paging registrars/residents
Locating specialists
Obtaining specialists on the telephone
Documenting specialist phone opinions
Documenting specialist consultations
Time based data entry
Mandatory registry data entry
Discharge preparation:
Printing sick certificates
Making review appointments
Printing referral letters
Making outpatient test appointments
Printing advice sheets
Patients tolerate the presence of scribes well,234 and less than 1% of consultations are inappropriate for scribes.4 Most doctors working with scribes support or strongly support their use,2567 with 15% preferring not to work with scribes.6 Documentation done by scribes seems to be adequate,8 although the tools used for evaluating quality have been questioned.9 If no major problems regarding quality or risk have been identified in association with use of scribes, the decision about scribe programmes will rest largely on information about their cost effectiveness.
Limited economic research on scribes has been conducted in emergency medicine in the US.171011121314 Some pilot economic data are available from emergency departments showing that allocation of scribes to some, but not all, physicians is likely to prove economically viable in Australia.15161718 Studies from other specialties support the scribe role.1920212223 Evaluations have shown increased medical productivity,1121516202425 but not necessarily faster emergency department throughput, for which the literature is in equipoise.171011131516
At the time of planning of this study, no multicentre randomised studies on the effect of scribes on emergency physicians’ productivity had been done.24 The presence of scribes in the US has risen to 25% of emergency physicians’ shifts, with limited evidence supporting their efficacy. Interest exists in scribe programmes in Canada, Australia, New Zealand, and the UK, and almost all health services struggle with demands not matching available resources. The scribe’s role needs to be evaluated in settings that represent some of the breadth and variety of emergency departments before widespread implementation of scribe programmes at considerable opportunity cost.17 Greater understanding of the effect of scribes on physicians’ productivity will help to inform decisions about whether to start scribe programmes.
We evaluated the productivity of emergency physicians working with and without scribes in Australian emergency departments. We also evaluated emergency department throughput and the effect of scribes in each region of the emergency departments and describe patient safety incidents associated with the presence of scribes.
Methods
Study design
We did a prospective, multicentre, non-blinded, randomised clinical trial between November 2015 and January 2018. Emergency physicians who provided written informed consent had a scribe randomly allocated to their routine shifts, and we compared their productivity between contemporaneous scribed and non-scribed shifts.
Participants
Sites
The study took place at five emergency departments in the state of Victoria, Australia (Cabrini (pilot site), Dandenong, Austin, Bendigo, and Monash Paediatrics). Each site participated by employing competent scribes who had been trained at Cabrini.1718 We purposely selected these sites to represent typical Australian emergency departments. The delineations of the sites enrolled were public/Medicare: metropolitan, tertiary, paediatric, regional referral, and private tertiary (not for profit). The roles of the physicians differed at each site and are described in table 1. Some sites use a senior doctor for a medical triage role. This involves identifying potential emergencies and starting diagnostic investigations and treatment for patients before they are seen by another physician in the main emergency department.26 This triage physician can also discharge patients if they do not need ongoing care. Medical records were either an electronic medical record (Dandenong, Austin, Monash Paediatrics) or a digital medical record with a combination of electronic and paper systems (Cabrini, Bendigo).
Description of participating emergency departments
Physicians
Emergency physicians were eligible for enrolment if they were consultants and permanently employed for at least one shift a week. Eligibility for participation was changed at Bendigo and Monash after the start of the study because the pool of consultants was too small to allow timely completion of the study. Senior emergency medicine physician trainees (in the final two years of fellowship training) were eligible to participate at these sites as well as consultants, provided that the trainees met all other eligibility criteria. All physicians were salaried employees who were paid per hour, not per patient. Participation was voluntary, and all eligible physicians were invited to participate by email before implementation of scribes. The site coordinator at each site facilitated this process (KW, RR, GOC, MP, AW). Physicians were offered 90 minutes of training online and a 90 minute dial-in telephone training session before receiving scribes. Very few physicians took up the offer of training.
Scribes
All scribes were trained until competent at Cabrini before the study and gave consent for participation. We recruited scribes via advertisement, and training of scribes has been described previously for this cohort.1718 Training was delivered in three sections: pre-clinical training using a commercially available blended course with a textbook and e-learning modules (taking 30-40 hours) 2728; two classroom days including emergency department orientation, lectures, and patient simulation and feedback; and finally a clinical apprenticeship with a physician trainer until competent (range 3-16 shifts, competency tested every shift until achieved). Two head scribes were responsible for allocation and management of scribes’ shifts. They managed a pool of 12 scribes who were simultaneously employed at all sites and rotated to each site during its active study period.
Patients
All patients attending the participating emergency departments were eligible for scribe involvement except at the request of the patient or the discretion of the physician (sensitive consultation). The number of patients declining scribes was not recorded. Physicians allocated their name to a patient by using the electronic medical record system. We included patients seen by a physician on a scribe shift in the scribe group, regardless of whether the scribe was present for the consultation. If a physician did not allocate their name to a given patient on the electronic medical record (for example, a junior doctor was the primary physician and the consultant their advisor), we excluded that patient encounter.
Workflow
Physicians visit patients according to their allocated role for the shift. Senior doctors at triage see patients shortly after nursing triage to start treatment. Other physicians will see patients who have been allocated a treatment space. Patients with a triage category of 1 or 2 are seen almost immediately. The rest are usually seen in order of arrival and according to team or regional streaming. Consultants have discretion to visit patients out of order according to their assessment of their capacity while multitasking with an individual patient load and simultaneously supervising other providers and patient throughput.29
When no scribe is present, the usual practice of when physicians document consultations varies. Some physicians document at the bedside (or at triage) during the consultation, others sit or stand at a desktop computer after each consultation, and some document multiple patient encounters later on when they are able.
Randomisation and allocation
Physicians’ rosters were determined several months in advance, with changes made for sick leave or other reasons. We did not distribute these rosters to scribes. Every two weeks, scribes gave their availability and a head scribe used a computer generated random number to allocate scribes to doctors’ shifts. If only one shift was available during a given scribe’s availability, randomisation was not possible and no allocation was made. Public holidays and overnight shifts were excluded from both groups to contain the research budget. Dandenong and Austin had dedicated emergency department observation unit shifts at which the site directors thought that scribes would not provide benefit. At these sites, emergency department observation unit shifts were excluded from allocation and analysis. Bendigo has emergency department observation unit shifts that are paired with a sub-acute patient load, and scribes were considered of potential use in this setting. Therefore, emergency department observation unit shifts were eligible for scribe allocation at Bendigo. Cabrini and Monash paediatric emergency departments have no dedicated emergency department observation unit shifts. Allocation was concealed until publication of the scribe roster, which could not be changed once published, except for last minute physician sick leave, when either an alternative participating physician was identified on the same shift or, if no eligible alternate was identified, the scribe was sent home. If a scribe needed sick leave, the scribe’s shift was cancelled and we included the physician’s shift in the non-scribed group. Blinding to the presence or absence of a scribe during a shift or during data analysis was not possible.
Allocation of patients to a physician was not randomised. In Australian emergency departments, consultants and juniors provide direct patient care and consultants also simultaneously supervise multiple other healthcare providers within the emergency department. Consultants choose patients that they feel they have the capacity to manage at any given time (on the basis of a mix of urgency, wait times, patient complexity, available junior skill mix, and resources), and this capacity to select patients was not altered during this study for either the scribed or non-scribed group.
Intervention
Scribes accompanied their allocated physician for the whole shift. The scribe used either an in-room computer or a computer-on-wheels to document consultations while the physician assessed the patient. Scribes also did other clerical duties as described in box 1. Physicians edited and verified scribes’ documentation before electronic medical record sign-off.
Outcomes
The primary outcome was the difference in physicians’ productivity between scribed and non-scribed shifts. Secondary outcomes were door-to-doctor times, emergency department length of stay times, regional physicians’ productivity, and rates of primary consultations.
We deemed a consultation a primary consultation when the physician was the main physician for the patient (including medical triage consultations in which the patient was immediately discharged without further care from a physician). A secondary consultation was either a medical triage consultation (when the patient is later seen by another physician for a full consultation) or a handover consultation.
We encouraged the scribes and emergency physicians to report patient safety incidents involving the scribes into an anonymous, online, specialty specific incident reporting system (www.emer.org.au). The Emergency Medicine Events Registry (EMER) was established by the Australasian College for Emergency Medicine (ACEM) and the Australian Patient Safety Foundation (APSF). Incidents were collated, categorised, and analysed by an expert panel including emergency physicians. They used an error classification system specific to emergency medicine.30
We did a post hoc, exploratory analysis of the cost-benefits of a scribe programme from the perspective of one hospital, using this study and previously published data from this scribe programme (appendix 1). We made assumptions as required and reported them. We determined the cost of the scribe by incorporating training costs, the number of shifts scribes will work in their careers, and scribes’ wages. We calculated the costs of productivity gains by comparing physician costs of productivity gains with scribe costs for the same gains. We determined savings generated by increased throughput by using a calculated cost per staffed cubicle per minute. We calculated total costs and savings (overall financial positions) with the varying scenarios of training paid for by the hospital or the scribe.
Shift data came from rostering databases, which were confirmed for accuracy each week. We excluded from analysis any unrecorded and unpaid overtime hours of physicians for the purpose of writing notes. Patient data, including physician allocations, came from each site’s electronic medical record database.
Statistical analysis
Previous work at Cabrini calculated a mean throughput of 0.83 patients per hour per doctor with a standard deviation of 0.3.16 We sought a 15% productivity gain from the scribe to create a break-even business case for scribes (an increase from 0.83 to 0.95 consultations per doctor per hour), based on estimated hourly salaries (including 25% “on-costs” to fund pension contributions, leave pay, and insurance) of physicians (US$129.81; £101; €113) and scribes (US$15.91).17 Using a two sided, 5% significance level, we needed 1000 shifts in total (100 scribed and 100 non-scribed from each of the five sites) to achieve 80% power to detect this difference. We calculated total consultations per hour per doctor by using the sum of primary and secondary patient encounters for each doctor, divided by the hours worked each shift.
We analysed characteristics of the patient populations and shift level data by using the Kruskall-Wallis equality-of-populations rank test (age, door-to-doctor time and length of stay, physicians’ productivity) and χ2 tests for categorical variables. Given a positive skew in patients per hour, we used a Kruskall-Wallis test to compare primary outcomes between scribed and non-scribed groups. We determined the effect of the scribe by using linear or logistic regression, as appropriate, with the presence of a scribe as a predictor. We used Stata version 14.2 for calculations.
Patient and public involvement
Previous work showed that patients are ambivalent about the presence of a scribe.4 No patients were involved in setting the research question or the outcome measures, nor were they involved in developing plans for or implementation of the study. No patients were asked to advise on interpretation or writing up of results.
Results
Participant flow and recruitment
Figure 1 shows the flow of eligibility and recruitment. We staggered the trial periods at each site to allow for sufficient availability of scribes. Each data collection period started once sites were ready to accept scribes and was complete and ended once more than 100 scribe shifts were complete. Cabrini ran from October 2015 to September 2016, Dandenong from November 2016 to June 2017, Austin from February 2017 to October 2017, and Monash Paediatrics from July 2017 to January 2018. Bendigo, being rural with residential requirements for scribes, was completed in two phases to accommodate university semester breaks in winter (June to July 2017) and summer (November to December 2017).
Flow chart of study. Two physicians withdrew mid-study as they did not find scribes useful; they consented to their completed shifts being included in the analysis, and these shifts are accounted for in the flow chart
Baseline characteristics
The 88 physicians (54 men) had ages ranging from 32 to 65 years. The 12 scribes (seven women) aged 19-28 years were half medical students and half pre-medical students. Table 2 summarises patients’ demographics at each site during the respective trial periods, and appendix 2 describes them in detail. The scribe and non-scribe groups did not differ in major characteristics. Marked differences existed between sites in terms of patients’ demographics.
Summary characteristics of patient attendances. Values are numbers (percentages) unless stated otherwise
Outcomes and estimation
Primary outcome
Scribes increased physicians’ productivity from 1.13 (95% confidence interval 1.11 to 1.17) to 1.31 (1.25 to 1.38) patients per hour per doctor, representing a 15.9% gain (P<0.001). Primary consultations increased from 0.83 (0.81 to 0.85) to 1.04 (0.98 to 1.11) patients per hour per doctor, representing a 25.6% gain (P<0.001). Table 3 shows the summary productivity changes, and the changes for individual sites are in appendix 3.
Summary productivity and throughput data
Secondary outcomes
Throughput measures showed no significant differences between door-to-doctor times. Median length of stay in emergency departments decreased from 192 (interquartile range 108-311) minutes to 173 (96-208) minutes for scribed shifts, or by 19 minutes (P<0.001). Table 3 shows the effect of the scribe on the ability of the physician to see new patients and manage secondary patients. Table 3 shows summary productivity and throughput data, and individual site date are in appendix 3.
Table 4 shows an analysis of the effect of the presence of scribes on regions of the emergency department, showing most benefit during senior doctor at triage shifts (gain of 0.53 or 24.9% primary patients per doctor per hour), some benefits in acute and paediatric regions, and no significant benefit during sub-acute, fast track, or observation ward shifts. When a scribe was allocated to the observation unit at Bendigo, the intern allocated to the observation unit for the shift was no longer needed, went to sub-acute/fast-track instead, and saw only new patients for the shift. The additional intern consultations were not counted in the study.
Analysis by emergency department roles/regions combined across all sites
Incidents when scribes were present
Table 5 shows incidents recorded in the EMER database. Sixteen incidents involving scribes were recorded, with a reporting rate of one in every 300 consultations. The most common error category was patient identification (7/16; 44%). A recurring scenario involved a patient incorrectly selected in the electronic medical record and then having an investigation ordered. In all scenarios, the scribe or doctor realised and prevented the investigation occurring. In 50% (8/16) of the incidents reported, the scribe was active in preventing a medical error.
Incidents reported while scribe involved in care
Cost-benefit analysis
The results of the cost-benefit analysis are reported in appendix 1. Financial assumptions in generating this analysis included that per patient revenue was assumed to be unchanged with the scribe present. Training the scribe cost US$5015 per scribe,17 and scribes worked 1000 hours once trained, generating a cost per hour worked of US$5 after completion of training. The scribes’ hourly rate was US$20.51 per hour. The physicians’ hourly rate was US$165, generating a saving of US$24.75 per hour in physician time when the scribe was working (15% gain in productivity). A 19 minute shorter length of stay generated a per patient saving in cubicle costs of $26.91 per hour. The saving was US$26.15 per scribed hour if the hospital paid for the scribe training and US$31.15 per scribed hour if the scribe paid for the training.
Discussion
At most sites in our study, the presence of scribes was associated with productivity gains, with a greater increase for primary patients than secondary patients. Regarding patient flow, we saw no change in door-to-doctor time and a 19 minute reduction in length of stay in the emergency department when a scribe was present. When assessing productivity changes by emergency department region, more were gains achieved when the scribe worked with a physician at triage. Productivity gains also occurred in acute/resuscitation bays and in paediatric areas. Sub-acute/fast track areas showed little to no productivity benefits from scribes. The number of reported adverse events with a scribe present was low, often related to identification of patients, and the presence of scribes at times worked as a protective factor in reducing medical error.31
Strengths and limitations of study
This is the first multicentre, randomised study to evaluate physicians’ productivity associated with scribes. It evaluated the effect of scribes in multiple different types of emergency department, serving very different patient populations. The study was limited to one Australian state, and all the emergency department directors were supportive of scribes. Physicians were aware of the study’s aims (introducing a potential Hawthorn effect) and were able to opt out, and these factors may have led to overestimation of the effect of scribes. The number of times a scribe was asked not to attend a sensitive consultation by a patient or physician was not recorded, but we know from other studies that this is very uncommon (less than 1%).41516 We did not measure physicians’ unrecorded overtime, which means that we did not capture data on whether physicians stayed after shifts to complete documentation in either group. We had no run-in period for scribe-physician partnerships, and physicians were largely inexperienced in using scribes. These factors could have led to an underestimation of the effect of scribes. Blinded randomisation of the shifts represents a real working environment, with the challenges of creating rosters to suit all workers, but randomisation reduces the chance of a strong scribe-physician working relationship and could reduce productivity.6 Blinding at analysis was not possible, as the same investigators did database cleaning, merging, and analyses. This study excluded junior doctors owing to the similarity between the wages of scribes and junior doctors (unlikely to achieve economic benefits), so we have no information on the efficacy of scribes with this group. Allocation of patients to physicians was not randomised, and physicians may have chosen different patients when working with or without scribes.
Ours is also the first study to document patient safety incidents associated with scribes, but self reporting probably led to underestimation of the likely harms.32 Voluntary reporting of patient safety incidents captures only a small portion of incidents that occur, and there was no reporting from the control shifts. Furthermore, participants in the study may have been more likely to report incidents in which they prevented a medical error.
Although a previous single site evaluation confirmed patients’ satisfaction with scribes, this may not be representative of all patient groups. Future work would benefit from involvement of patients from the start of the study, so the values and preferences are representative and generated by patients and members of the public.
Comparison with other studies
Heaton et al’s 2016 meta-analysis of four productivity studies1153334 showed increases of 0.17 (95% confidence interval 0.02 to 0.32) patients per hour,24 which is of a similar magnitude to the findings in our study. However, the study methods were limited, all were non-randomised, and half were retrospective. Since then, Heaton et al have published a single centre prospective block allocation study,11 finding no significant change in physicians’ productivity in adult or paediatric emergency department regions, which differs from our overall analysis but not from one of our individual sites. Our study found that productivity changes varied according to the role of the physician, which is contrary to the findings of a previous small study.16
Conclusions and policy implications
For clinicians and policy makers, our study shows that scribes can increase productivity in Australian emergency departments. Our example cost-benefit analysis (appendix 1) shows a cost saving to the hospital per scribed hour of US$26.15 when the hospital absorbs the cost of training. This analysis will vary from site to site, depending on the hourly costs of physicians and scribes (including training) and cubicle minute costs. Other factors to consider will be revenue change per patient and changes in productivity and throughput. All sites should pilot their programme and do financial modelling to ensure that they are achieving benefits. How to implement a scribe programme outside the US has been described in detail.18 Physicians vary in their ability to use scribes effectively,16 and this should also be kept in mind when writing rosters.
Our study has also shown a decrease in length of stay at all sites. This decreased length of stay should be considered in any economic analysis. The time savings allow for additional patients to be seen, so overall costs per patient may decrease. This time reduction will also improve the flow of and access for patient and contribute to achieving the various time based targets most emergency departments are required to achieve. Hospitals finding staffing of emergency departments challenging (such as some rural centres) may wish to determine how junior doctors perform with scribes. Training scribe and physician teams in correct patient identification techniques may be helpful in reducing patient safety events. Given the strong preference of physicians for working with a scribe,6 no effect on the patient experience,4 minimal risk, and the productivity and throughput gains outlined, emergency department and hospital administrators should strongly consider the potential local utility of scribes in their workforce and financial planning.
Future work should include testing scribes in other settings and countries and involve patients in the research team. Specific studies should be done to identify the harms and benefits of scribes in terms of quality and risk. The impact of varying electronic medical records and how this affects the utility of scribes has not been tested.
In conclusion, scribes led to productivity gains that were greatest in primary patient consultations. Sites and emergency department regions varied in the magnitude of the gains. Reductions were seen in length of stay but not in door-to-doctor times. Financial analysis based on gains in productivity and throughput supports implementation of scribes.
What is already known on this topic
Scribes in emergency medicine have been reported to increase productivity in some studies and provide no gains in others
Scribes are well tolerated by patients, and most physicians find working with scribes beneficial
No multicentre randomised studies have been done, and patient safety incidents (adverse events or near misses) associated with scribes have not been evaluated
What this study adds
Emergency physicians who used scribes increased their productivity by 0.18 patients per hour per doctor (15.9%) while emergency department length of stay decreased by 19 minutes per patient
A patient safety incident (adverse event or near miss) involving a scribe was reported in 1 in 300 consultations, mainly involving incorrect patient identification and investigation ordering
Financial cost-benefit analysis supported a scribe programme
Acknowledgments
We thank the emergency department teams at each site for supporting the research and particularly the participating emergency physicians and scribes. We thank the patients, whose data made this study possible. We also thank the following for their assistance in supporting and developing the research and scribe programmes: Cabrini Health and Institute, Andis Graudins, Robert Meek, Neil Goldie, Simon Judkins, and Kathryn Wilson (ethics application).
Footnotes
Prospective registration 10 June 2015, ACTRN12615000607572: A pilot study of the relationship between Australian trained emergency department scribes and emergency physicians’ productivity. In 2015 the study group received enough philanthropic support to start training and evaluating the effect of Australian scribes, rather than relying on American scribes living in Melbourne for brief periods. This trial registration describes evaluation of the productivity of physicians working with and without scribes at our first site (Cabrini). These site data were combined with data from other sites in this paper. We reported some outcomes in other publications (number of clinical shifts needed to train a scribe, cost of training a scribe, productivity of physicians while working with trainee scribes1718). When scribes achieved competency (no longer trainees), productivity and throughput data were collected for this study. We did not measure or report data on the following secondary outcomes: staff and patient satisfaction (separate studies were done simultaneously and registered and reported elsewhere46); complaints (none were received and we report possible harms, collected via the Emergency Medicine Events Registry, in this manuscript instead); periods of time spent on ambulance bypass/diversion (not measured). Completion of this section of the study and demonstration that we had the capability to deliver the project allowed us to seek and achieve funding for an additional four study sites.
Prospective registration 12 May 2016, ACTRN12616000618459: A prospective, multicentre cohort study, evaluating emergency doctor productivity with medical scribe assistance. On 16 September 2016 we changed the sample size required in the registry in response to two updated data points. We determined, from newer datasets during scribe training, that medical productivity (without scribes) had decreased at Cabrini since our first sample size estimate, and we determined the cost of training scribes in Australia, which was previously unknown. This required a doubling of our sample size at each site from 50 to 100 scribed shifts. In this evaluation, we report the primary outcome (patients per hour per doctor) and secondary outcomes 2 and 3 (door-to-doctor and door-to-discharge/emergency department length of stay times). We evaluated the quality of scribes’ notes and report the evaluation elsewhere.9 We did not measure and do not report the following secondary outcomes (with and without scribes): door-to-medical triage times; stress levels of physicians; per patient revenues; comparison of dictation to scribe (patients per hour per doctor). We received enough funding to do the five site evaluation of productivity, but not enough to evaluate the remaining outcomes. This decision was made before data collection was done. We changed the trial registry outcomes on 13 June 2018 to remove the outcomes we did not evaluate.
Contributors: KW and MBM obtained funding. KW and WD obtained ethics approval. KW, MS, DT, DL, WD, MBM, KH, and CC developed the methods for the study. KW, WD, RR, AW, GOC, MP, and DB were responsible for site implementation and data collection. WD was responsible for data cleaning. KW, WD, MS, KH, CC, and MBM were involved in data analysis. KW, WD, MBM, MS, KH, CC, DT, and DL wrote the manuscript, and all authors revised it. All authors had access to all of the data (including statistical reports and tables) and can take full responsibility for the integrity of the data and the accuracy of the data analysis. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted. KW is the guarantor.
Funding: The study was funded by Equity Trustees, the Phyllis Connor Memorial Fund, Cabrini Foundation, and Cabrini and supported by the Cabrini Institute. Funders had no role in study design or protocol, results, or write-up or manuscript submission decisions other than to provide funding. The researchers were independent of the funders.
Competing interests: All authors have completed the ICMJE uniform disclosure form at www.icjme.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: support from the Cabrini Institute for the submitted work; KW is the director of the Cabrini scribe programme; WD is a head scribe and research assistant; the Phyllis Connor Memorial Fund has supported KW and WD to attend conferences to present scribe data; no other relationships or activities that could appear to have influenced the submitted work.
Ethical approval: Human research ethics committee (Monash, Cabrini, Austin, Bendigo Health) approval numbers Monash HREC 16392L, Cabrini HREC 06-27-07-15. All scribes and physicians gave consent before participation in the study.
Data sharing: Medical researchers can obtain de-identified data by contacting the corresponding author.
Transparency: The lead author affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as planned (and, if relevant, registered) have been explained.
This is an Open Access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.