Policy analysis in an information-rich environment
Introduction
Population-based insurance systems using longitudinal administrative data and techniques linking records across multiple files have helped create “information-rich” environments in several sites around the world. Working in Western Australia to develop a linked database (Holman, Bass, Rouse, & Hobbs, 1999) identified the Oxford Record Linkage Study, the Scottish Record Linkage System, the Rochester Epidemiology Project, and the Manitoba Centre for Health Policy as “centres known internationally for the conduct of research using record linkage.” Two other Canadian groups, the Centre for Health Services and Policy Research in British Columbia and the Institute for Clinical and Evaluative Sciences in Ontario, have also been using administrative data for both provincially funded policy work and investigator-initiated research. Routine updates of administrative data (building on consistent formats) facilitate the study of change; analyses of variation in population-based rates over time and cohort studies are often performed (Goldacre, Griffith, Gill, & Mackintosh, 2002; Kendrick, Douglas, Gardner, & Hucker, 1998; Melton, 1996).
Lists of publications, projects, and investigators were obtained for five centres: Oxford, Western Australia, Manitoba, British Columbia, and Ontario. Some research groups (such as in Manitoba) concentrated more on administrative data than others. Substantial efforts were made to identify all relevant publications. Each publication with a title suggesting the use of administrative data was looked up using the National Library of Medicine's PubMed. Abstracts were read by a research associate and by the senior author (LLR) to make sure that administrative data were used. Common exclusion rules were applied across the centres: only studies published from 1994 to 2002 were included. Commentaries and letters were excluded, as was work based on a single disease or surgical registry. Several Canadian studies included authors from more than one centre; the centre providing the data was credited for the research. In multi-centre studies, all participating centres were credited. Each relevant abstract and attached Medical Subject Headings (MeSH) categories were entered into a centre-specific Reference Manager database. MeSH categories were analysed using SAS version 8.2.
Despite PubMed's independent coding and economy, important research might be missed for several reasons: because the work is never published in an academic format (a problem with many projects conducted for government agencies) and because book chapters and certain journals (such as the Canadian Journal on Aging) are not included in PubMed. Further details on the methodology are available from the senior author.
The MeSH word “epidemiology” was most used in reference to the Oxford and Western Australia centres. The terms “utilization”, “economics”, “socioeconomic factors”, “physicians”, and “physician practice patterns” were more frequently used to characterize the research of the three Canadian groups than that of the other sites. Canadian research centres oriented towards local policy problems receive much of their funding from provincial Ministries of Health. This thrust seems to have pushed the Canadian centres in roughly similar directions.
Studies of specific diseases and diagnoses have been popular among all centres; the coding for “disease” in Oxford and “incidence” in Western Australia appears to reflect a broad range of outcomes research at those sites (Table 1). “Utilization” and “socioeconomic factors” were particularly frequent for Manitoba. Published studies with a defined geographic focus, those involving rural populations and others analysing urban populations, were noted more often in Manitoba than elsewhere. The relatively low frequency of “cohort studies” and “case control” in Manitoba reflects less of an emphasis on clinical epidemiology and a greater concern with policy analysis.
The Manitoba Centre has negotiated a series of annual deliverables; almost all of the projects explicitly take advantage of the available databases. As categorized by Manitoba Health, the great majority of projects over the last 13 years have focused on: health and quality of health care (9), regional health authorities—both urban (14) and rural/northern (5), physicians and human resources (5), and financial and cost issues (8). One set of deliverables (11) concerned development of the database and information system. These general topics have all been noted as of national concern (Iglehart, 2000).
In Manitoba the capabilities for policy analysis include the ability to:
- (1)
study interventions longitudinally,
- (2)
compare regions, areas, and hospitals,
- (3)
combine information on patients and physicians,
- (4)
add up expenditures for different services within the Canadian health-care system, and
- (5)
examine the determinants of health using education and family services data in conjunction with health-related information.
Given the great interest in health policy among OECD countries, these information-rich environments should be more extensively used for policy analysis. This paper provides examples from recent Manitoba work, highlighting successful uses of the database which build on its special capabilities. Limitations—both in terms of less successful efforts to influence policy and gaps in available data—are also discussed.
Section snippets
Data
The inner ring of Fig. 1 outlines the Manitoba database with a population-based research registry playing a central role. Besides the three provinces noted earlier, several other Canadian provinces (Saskatchewan, Nova Scotia, Quebec) have organized data in a similar fashion. Longitudinal or linked data are typically put together as needed for each study. The research registry developed by the Manitoba Centre for Health Policy has integrated information from the Manitoba Health registry and
Provincial health reform
The evaluation of interventions such as those associated with health reform is of ongoing importance to Canadian provincial governments. Appropriate research designs use the strength of the available databases—longitudinal information on several types of utilization, measurable indicators of health, the availability of control groups, and so forth. Thus, Manitoba researchers examined the period from 1989 (to provide several years of data before downsizing of the hospital system began in 1992)
Successful efforts
Manitoba efforts at communication to intended consumers of research have been in line with suggestions from students of the policy process (Innvaer, Vist, Trommald, & Oxman, 2002; Lavis et al., 2002). In Manitoba, interaction with the Ministry of Health and Regional Health Authorities has gone beyond the negotiation of deliverables to discussion of substance in working groups and other forums. Feedback occurs from informal briefings and during the 60-day period between presentation of a report
Conclusion
The policy research (and associated provincial funding) described here has extended for over 13 years at this writing. In Manitoba, the governing party has changed while several Ministers and Deputy Ministers of Health have come and gone. A succession plan for the Manitoba Centre for Health Policy is in place for after the current leadership retires. The challenges for new leadership in Manitoba (as at other Canadian centres) will include: building on established relationships while delivering
Acknowledgements
The authors would like to thank Phyllis Jivan, Jo-Anne Baribeau and Carole Ouelette for their help. The assistance of the Oxford Record Linkage Study, the Western Australia Centre for Health Services Research, the Centre for Health Services and Policy Research in British Columbia, and the Institute for Clinical and Evaluative Sciences in Ontario is gratefully acknowledged. This work was supported by the Canadian Population Health Initiative and by project-related funding to the Manitoba Centre
References (71)
- et al.
Monitoring health reformA report card approach
Social Science and Medicine
(2001) - et al.
Potholes in the information highwayThe use of health service utilization data by Alberta Health Care managers
Healthcare Management Forum
(2000) - et al.
Population-based linkage of health records in Western AustraliaDevelopment of the health services research linked database
Australian New Zealand Journal of Public Health
(1999) - et al.
Impact of rural hospital closures in Saskatchewan, Canada
Social Science and Medicine
(2001) History of the Rochester epidemiology project
Mayo Clinic Proceedings
(1996)- et al.
Assessing ecologic proxies for household incomeA comparison of household and neighbourhood-level income measures in the study of population health status
Health and Place
(1999) - et al.
Research meets realityAdministrative data to guide planning for Canadian Regional Health Authorities
Healthcare Management Forum
(2002) - et al.
A research registryUses, development, and accuracy
Journal of Clinical Epidemiology
(1999) The Western Australian road injury database (1987–1996)Ten years of linked police, hospital and death records of road crashes and injuries
Accident; Analysis Prevention
(2001)- et al.
Health reform and technological changeShifting hospitalization patterns for four procedures in Manitoba
Healthcare Management Forum
(2000)
Intensive short-term dynamic psychotherapy in a private psychiatric officeClinical and cost effectiveness
American Journal of Psychotherapy
Health spending and outcomesTrends in OECD countries, 1960–1998
Health Affairs (Millwood)
Toward integrated medical resource policies for Canada8. Geographic distribution of physicians
Canadian Medical Association Journal
An assessment of the potential for repatriating care from urban to rural Manitoba
Medical Care
Using population-based data to enhance clinical practice guideline development
Medical Care
Childhood injury rates in ManitobaSociodemographic influences
Canadian Journal of Public Health
A hospitalization from hellA patient's perspective on quality
Annals of Internal Medicine
Hospital readmission rates for cohorts of Medicare beneficiaries in Boston and New Haven
New England Journal of Medicine
Medical savings accountsWill they reduce costs?
Canadian Medical Association Journal
In-hospital deaths as fraction of all deaths within 30 days of hospital admission for surgeryAnalysis of routine statistics
British Medical Journal
Hospital crisis? What crisis?
Canadian Medical Association Journal
Discharging patients earlier from Manitoba's hospitalsDoes it adversely affect quality of care?
Canadian Medical Association Journal
Using administrative data to study persons with disabilities
Milbank Quarterly
Interview: Restoring the status of an iconA talk with Canada's Minister of Health
Health Affairs (Millwood)
Health policy-makers’ perceptions of their use of evidenceA systematic review
Journal of Health Services Research Policy
Standard cost lists for health care in CanadaIssues in validity and inter provincial consolidation
Pharmacoeconomics
Best-link matching of Scottish health data sets
Methods of Information in Medicine
What is population health?
American Journal of Public Health
Explaining the decline in health insurance coverage, 1979–1995
Health Affairs (Millwood)
Cited by (75)
An unconditional prenatal cash benefit is associated with improved birth and early childhood outcomes for Metis families in Manitoba, Canada
2021, Children and Youth Services ReviewCitation Excerpt :These registries were linked to de-identified administrative data from the province’s healthcare system, education system, social services and public health programs, including the Healthy Baby program. The validity of the data for population health research has been previously established (Jutte, Roos, & Brownell, 2011; Roos & Nicol, 1999; Roos et al., 2019; Roos, Menec, & Currie, 2004). The study cohort included Metis mothers in Manitoba who had a live singleton birth in the years 2003–2011 and were considered low-income during their pregnancy (Fig. 1).
The Mental Health of First Nations Children in Manitoba: A Population-Based Retrospective Cohort Study Using Linked Administrative Data
2024, Canadian Journal of PsychiatrySuicidal Risk and Adverse Social Outcomes in Adulthood Associated with Child and Adolescent Mental Disorders
2022, Canadian Journal of Psychiatry