Competition and Quality: Evidence from the NHS Internal Market

Similar documents
Competition and Quality: Evidence from the NHS Internal Market

Free to Choose? Reform and Demand Response in the British National Health Service

Waiting Times for Hospital Admissions: the Impact of GP Fundholding

how competition can improve management quality and save lives

Scottish Hospital Standardised Mortality Ratio (HSMR)

New Joints: Private providers and rising demand in the English National Health Service

Patient survey report Survey of adult inpatients in the NHS 2010 Yeovil District Hospital NHS Foundation Trust

Supplementary Material Economies of Scale and Scope in Hospitals

Patient survey report Survey of adult inpatients 2011 The Royal Bournemouth and Christchurch Hospitals NHS Foundation Trust

Differences in employment histories between employed and unemployed job seekers

Is there a Trade-off between Costs and Quality in Hospital

Working Paper Series

Patient survey report Survey of adult inpatients in the NHS 2009 Airedale NHS Trust

Case-mix Analysis Across Patient Populations and Boundaries: A Refined Classification System

Papers. Mapping choice in the NHS: cross sectional study of routinely collected data. Abstract. Methods. Introduction

Patient survey report Inpatient survey 2008 Royal Devon and Exeter NHS Foundation Trust

Final Report No. 101 April Trends in Skilled Nursing Facility and Swing Bed Use in Rural Areas Following the Medicare Modernization Act of 2003

Impact of Financial and Operational Interventions Funded by the Flex Program

Staffing and Scheduling

Does Hospital Competition Save Lives? Evidence From The Recent English NHS Choice Reforms

Patient survey report Outpatient Department Survey 2011 County Durham and Darlington NHS Foundation Trust

Ninth National GP Worklife Survey 2017

time to replace adjusted discharges

Frequently Asked Questions (FAQ) Updated September 2007

Patient survey report Outpatient Department Survey 2009 Airedale NHS Trust

Prepared for North Gunther Hospital Medicare ID August 06, 2012

Care Quality Commission (CQC) Technical details patient survey information 2011 Inpatient survey March 2012

Patients Experience of Emergency Admission and Discharge Seven Days a Week

Hospital Strength INDEX Methodology

Population and Sampling Specifications

The new chronic psychiatric population

National Inpatient Survey. Director of Nursing and Quality

Zack Cooper, Stephen Gibbons, Simon Jones and Alistair McGuire

Introduction and Executive Summary

Physiotherapy outpatient services survey 2012

CHE Research Paper 151. Spatial Competition and Quality: Evidence from the English Family Doctor Market

UK GIVING 2012/13. an update. March Registered charity number

GEM UK: Northern Ireland Summary 2008

NATIONAL LOTTERY CHARITIES BOARD England. Mapping grants to deprived communities

Profit Efficiency and Ownership of German Hospitals

A Primer on Activity-Based Funding

EuroHOPE: Hospital performance

Appendix. We used matched-pair cluster-randomization to assign the. twenty-eight towns to intervention and control. Each cluster,

3M Health Information Systems. 3M Clinical Risk Groups: Measuring risk, managing care

General Practice Extended Access: September 2017

An evaluation of ALMP: the case of Spain

ew methods for forecasting bed requirements, admissions, GP referrals and associated growth

An Evaluation of Health Improvements for. Bowen Therapy Clients

paymentbasics The IPPS payment rates are intended to cover the costs that reasonably efficient providers would incur in furnishing highquality

Hospital Inpatient Quality Reporting (IQR) Program

EPSRC Care Life Cycle, Social Sciences, University of Southampton, SO17 1BJ, UK b

Care Quality Commission (CQC) Technical details patient survey information 2012 Inpatient survey March 2012

General practitioner workload with 2,000

General Practice Extended Access: March 2018

GEM UK: Northern Ireland Report 2011

Big Data Analysis for Resource-Constrained Surgical Scheduling

Focus on hip fracture: Trends in emergency admissions for fractured neck of femur, 2001 to 2011

Re: Rewarding Provider Performance: Aligning Incentives in Medicare

Patient survey report Survey of adult inpatients 2016 Chesterfield Royal Hospital NHS Foundation Trust

Health Care Spending Growth under the Prospective. Care

Minnesota health care price transparency laws and rules

Fertility Response to the Tax Treatment of Children

Casemix Measurement in Irish Hospitals. A Brief Guide

Comparison of New Zealand and Canterbury population level measures

Patient survey report Survey of people who use community mental health services 2011 Pennine Care NHS Foundation Trust

Patient survey report Survey of adult inpatients 2013 North Bristol NHS Trust

Patient survey report Survey of adult inpatients 2012 Sheffield Teaching Hospitals NHS Foundation Trust

The association between asymmetric information, hospital competition and quality of healthcare: evidence from Italy

Medicaid HCBS/FE Home Telehealth Pilot Final Report for Study Years 1-3 (September 2007 June 2010)

Patient survey report National children's inpatient and day case survey 2014 The Mid Yorkshire Hospitals NHS Trust

Nursing skill mix and staffing levels for safe patient care

The attitude of nurses towards inpatient aggression in psychiatric care Jansen, Gradus

Results of censuses of Independent Hospices & NHS Palliative Care Providers

The Potential Impact of Pay-for-Performance on the Financial Health of Critical Access Hospitals

HEALTH WORKFORCE SUPPLY AND REQUIREMENTS PROJECTION MODELS. World Health Organization Div. of Health Systems 1211 Geneva 27, Switzerland

Emergency admissions to hospital: managing the demand

Irene Papanicolas, Alistair McGuire. Using a latent variable approach to measure the quality of English NHS hospitals

LOCAL GOVERNMENT CODE OF ACCOUNTING PRACTICE & FINANCIAL REPORTING SUBMISSION RELATING TO THE DISCLOSURE OF

Frequently Asked Questions (FAQ) The Harvard Pilgrim Independence Plan SM

MEDICARE ENROLLMENT, HEALTH STATUS, SERVICE USE AND PAYMENT DATA FOR AMERICAN INDIANS & ALASKA NATIVES

The NHS management workforce

Primary Care Workforce Survey Scotland 2017

Community Performance Report

Hospital Compare Quality Measures: 2008 National and Florida Results for Critical Access Hospitals

Independent Sector Nurses in 2007

Reducing emergency admissions

Workforce intelligence publication Individual employers and personal assistants July 2017

Gender Pay Gap Report. March 2018

NHS Trends in dissatisfaction and attitudes to funding

PATIENTS PERSPECTIVES ON HEALTH CARE IN THE UNITED STATES: NEW JERSEY

DISTRICT BASED NORMATIVE COSTING MODEL

Findings Brief. NC Rural Health Research Program

SCHOOL - A CASE ANALYSIS OF ICT ENABLED EDUCATION PROJECT IN KERALA

Survey of people who use community mental health services Leicestershire Partnership NHS Trust

Creating a Patient-Centered Payment System to Support Higher-Quality, More Affordable Health Care. Harold D. Miller

Piloting Bundled Medicare Payments for Hospital and Post-Hospital Care /

Employed and Unemployed Job Seekers: Are They Substitutes?

Sarah Bloomfield, Director of Nursing and Quality

Primary medical care new workload formula for allocations to CCG areas

The Impact of Competition on Management Quality: Evidence from Public Hospitals

Transcription:

Competition and Quality: Evidence from the NHS Internal Market 1991-1999 Carol Propper University of Bristol, CEPR and CMPO Simon Burgess University of Bristol, CEPR and CMPO Denise Abraham CMPO October 2002 Abstract Payer-driven competition has been widely advocated as a means of increasing efficiency in health care markets. The 1990s reforms to the UK health service followed this path. We examine whether competition led to better outcomes for patients, as measured by death rates after treatment following heart attacks. Using data on mortality as a measure of hospital quality and exploiting the policy change during the 1990s, we find that the relationship between competition and quality of care appears to be negative. JEL Classifications: I1, L8, H4 Key words: Competition, health care, mortality, quality of care Address for correspondence Carol Propper CMPO Department of Economics University of Bristol 8 Woodland Road Bristol BS8 1TN, UK e-mail: Carol.Propper@bristol.ac.uk. Tel: +44 (0)117 9288427. Fax: +44 (0)117 928 8577 1

1. Introduction The introduction of competition and markets into public service has been a recurrent recent theme in reforms initiated by governments across the OECD. However, whilst the rhetoric has been strong, the evidence of the effectiveness of such reforms is somewhat weaker. The UK government has been a world leader in such reforms, introducing markets into publicly funded healthcare, education, housing amongst other services (Le Grand and Bartlett 1993). In this paper we examine the impact of the introduction of competition into a large and complex public sector organisation: the UK National Health Service. Competition between suppliers of health care in the UK was intr oduced in 1991, actively promoted and then later downplayed. Using data from the English NHS, we study the impact of competition on quality of healthcare. Using panel data on English hospital, which allows us to exploit variation in competition across time and space, we find that competition is associated with lower quality. Prior to 1991, publicly funded hospital based health care in the UK 1 was supplied by hospitals that received funding, based on their local populations, directly from central government. In 1991 the Conservation administration introduced competition on the supply side of the health care market by breaking the link between provision and funding. It created a set of buyers, funded by central government, who were free to purchase health care for their populations from both public and private sector suppliers. Public sector suppliers were therefore not given direct funding, but were to compete with each other, alongside a small private sector, for contracts from these public buyers. Competition was thus created by policy. Competition was actively promoted upto the mid-1990s, then somewhat downplayed. In 1997 the incoming Labour administration formally introduced policy change, stressing the role of co-operation over competition, though the separation between buyer and seller of health care remained (and remains currently). 1 Publicly funded care accounts for over 85 percent of UK health care expenditure (Propper 2002). 2

Competition in health care markets is geographically-based, as the service provided requires the user to travel to a provider of health care to receive it. By means of geography, some sellers of health care are therefore located in markets which are inherently more competitive than others. Thus the identification of the impact of competition is difficult, as location is intertwined with competitiveness. In cross-sectional analyses competition is therefore not separable from geography and the correlates of this geography, which might, for example, include the health of local populations or a history of funding. Whilst attempts can be made to control for observables, unobservables that are correlated with geography, but are not due to competition, may still affect the health care outcome in each market and their impact be incorrectly attributed to competition. While panel data can be used to control for unobservables, the slow cha nging nature of health care markets means that competition is often essentially fixed over a number of years. The strategy adopted here is to identify the impact of competition from the interplay of geography and policy change. We use the fact that competition is not possible in all areas because of geography to separate hospitals into two groups: one group for whom competition was possible and one group for whom it was not. We then exploit the fact that policy changed over the period 1990s. Competition was only introduced in 1991, so did not operate until 1991. It was then first actively promoted upto 1995, somewhat downplayed in 1996 and then, after the change in administration, actively discouraged post-1997. We identify the impact of competition from the difference in quality between those hospitals for which competition was possible and those for which it was not between years when competition was actively promoted and those when it was not. We construct a panel of all acute hospitals in England from 1991 to 1999. We measure quality in terms of death rates from emergency admissions for acute myocardial infarction (AMI). Mortality from AMI has been widely used to assess the quality of care of hospitals in the US health care market and was published as a measure of quality for UK hospitals for the first time in 1999. We find that competition appears to have decreased quality: death rates in areas subject to competition were higher than in areas not subject to competition during the first part of the 1990s but declined somewhat from 1996 onwards. The difference is not large, but we estimate the cumulative impact of 3

competition on death rates to have more or less negated the fall in death rates that the whole sector experienced, probably as a result of technological innovation. The organisation of the paper is as follows. Section 2 reviews the literature on the relationship between quality and competition. Section 3 presents the key characteristics of the NHS reforms that introduced competition, discussed the nature of competition in this internal market and describes our econometric strategy. Section 4 presents the data. The results are in Section 5. The final section presents our conclusions. 2. Empirical evidence on the impact of competition on quality in health care A large empirical literature has examined the impact of competition in markets for health care services. While early work focused on the consequences for prices and costs (for example, Dranove and White, 1994)), there is now a growing body of evidence on the impact of competition on quality. What appears to be emerging is rather a mixed picture. Shortell and Hughes (1988) examined the association between in-hospital mortality among Medicare patients and hospital concentration, and found a small and insignificant association between them. However, their methodology has since been criticised for their use of a fixed radius measure of geographic markets. Kessler and McClellan (2000) analysed the impact of competition on both costs and patient health outcomes. They use longitudinal Medicare claims data for the majority of elderly non-rural beneficiaries who were admitted to a hospital with Acute Myocardial Infraction from 1985-1994. They combined that with data on hospital characteristics collected by the American Hospital Association. They found that before 1991 competition led to higher costs and lower rates of adverse health outcomes but after 1990 competition led both to substantially lower costs and significantly lower rates of adverse outcomes. As of 1991, patients in the least competitive fourth of hospital markets experienced approximately 1.5 percentage points higher mortality than those in competitive areas. This might suggest that in the absence of competitive pressures between providers, hospitals take advantage of their market 4

power by skimping on quality of care. Kessler and McClellan conclude from their study that whilst the welfare effects of competition in the 1980s were ambiguous, post-1990 competition was unambiguously welfare improving. Other studies have found more mixed results. Ho and Hamilton (2000) tested the hypothesis that hospital mergers and acquisitions decrease competition and therefore reduce quality of care in the local market. They compared the quality of hospital care before and after mergers and acquisitions in California between 1992 and 1995. They found that hospital mergers had no effect on either heart attack or stroke inpatient mortality. Volpp and Waldfogel (2001) studied the impact of price competition in New Jersey on the quality of hospital care. They found that mortality from heart attacks increased following hospital rate deregulation, suggesting that more active price competition was accompanied by a decrease in quality competition. Gowrisankararan and Town (2001) estimated the effect of competition for both HMO and Medicare patients on hospital-specific mortality rates of hospitals in Southern California. They used data from the OSHPD patient discharge database to formulate risk-adjusted hospital mortality rates for AMI and pneumonia. They found that increases in the degree of competition for HMO patients decrease risk-adjusted hospital mortality rates for both pneumonia and AMI but increases in competition for Medicare enrollees are associated with increases in risk-adjusted death rates for both diagnoses. From this they concluded that, in contrast with the rest of the market, the Medicare system does not generate incentives for hospitals to compete on quality. There is much less UK evidence on the impact of competition in health care, despite this being a central plank of the NHS reforms of the 1990s. Glennerster (1998) draws together the empirical literature in this area and concludes that little evidence exists. Exceptions include the work of Propper (1996), Propper et al. (1998), and Söderlund et al. (1997) who investigate the impact of the internal market on prices, costs and productivity. In the only large-scale study to date of the impact of competition on quality, Propper et al (2002) examined the relationship between competition and quality. As a measure of quality they use death rates after treatment following heart attacks. For each hospital they calculated a number of measures of competition, based on the number of suppliers within each hospital s catchment area. The catchment area was based on travel times, so avoids 5

the problem associated with fixed radius measures or those based on administrative boundaries. The measure also measures potential rather than actual patient flows, and so avoids problems of endogeneity that may be associated with measures based on actual patient flows. An average death rate was calculated for the years 1995-7 for each hospital. Using a cross-sectional analysis we found that competition appears to be associated with lower quality (higher death rates), after controlling for patient mix and other observed characteristics of the hospital and its catchment area. The present paper builds on this work through the use of a panel, rather than a cross-section, data set of hospitals. 3. The UK health care market (a) Health care delivery in Britain post 1991 In 1990 the Conservative administration introduced reforms to promote competition between health care suppliers by separating the roles of financier and supplier of health care services. Finance was still raised through general taxation, and was allocated to public agents who were responsible for purchasing health care for their populations. Two types of purchaser were created: District health authorities (DHAs), responsible for purchasing hospital services for the population in a given geographical area and General Practice Fund-Holders (GPFHs) 2, primary care physicians who bought a subset of elective care for their patients. Health care services were provided by public and private suppliers, who competed for contracts with the purchasers. Public hospitals, which were originally under the control of health authorities, became separate legal entities, NHS Trusts. Contracting between purchasers and pr oviders took place on an annual basis. Both sets of buyers were allocated funds from central government, to be spent on hospital care. DHAs were not free to carry over surpluses from one year to the next. GPFHs were allowed to retain surpluses provided that they invested them in their practices. Patients had relatively little choice of buyer of health care. This is because, in the UK system, they 2 These were a self-selected group who cover the patients for whom they already provided primary care and are given a budget for a limited set of health services sold by providers. 6

have little choice of family doctor. Patients whose family doctor chose to become a GPFH therefore had a purchaser that was a GPFH, while patients whose family doctors chose not to enter the scheme had a purchaser who was the DHA for the area in which they were resident. Prices of services were available to buyers. However, there was no published data on hospital quality. Limited data on quality of care in NHS trusts was first made publicly available in 1999 3. Although purchasers were given the right to buy from whichever supplier of health care they wished, in practice almost all care purchased by NHS purchasers was bought from NHS Trusts. Relatively little business went to the (limited in size and scope) private health care sector. NHS Hospitals competed with other hospitals to secure contracts from buyers. Given the importance of location in the provision of medical services, competition was primarily within geographical areas. Some of the competition took the form of sales of specific services on a cost per case basis, but most of the competition took place through annual negotiations over contracts for blocks of services, including accident and emergency services. In setting prices of these contracts, Trusts were heavily regulated. They were supposed to set price equal to average costs, to earn a certain return on assets, and were not able to carry surpluses across financial years (Propper 1995). However, in spite of these regulation, there is evidence that there is scope for competition from the location of hospitals (Appleby et al. 1994) and, that faced with very low margins between revenues and costs, Trusts had incentives to compete with each other for contracts (Propper 1996). In summary, on the supply side, the hospital market in the UK is characterised by monopolistic competition. The cost of travel for patients, and the lack of full information on the buyers part, means hospitals are not perfect substitutes. But few hospitals have no competitors with 30 minute travel distance (Propper, 1996). On the buyer side, buyers are not individual patients but agents (the GPFHs and the DHAs) who place contracts on behalf of patients. These agents are cash constrained, and have relatively hard budget 3 These data were 30 day in-hospital death rates (from surgery, AMI and FNF), rates of discharge following a stroke or FNF and rates of emergency readmission within 28 days of discharge from hospital. See (www.doh.gov.uk) 7

constraints in the case of DHAs, and incentives to make savings from their budgets in the case of GPFHs. Patients are interested in quality, since they pay zero price at point of demand as care is free. Agents, on the other hand, are interested in price, and, to the extent that they are constrained by the wishes of patients, also quality. So the net effect is that agents are interested in both price and quality, though they may give considerably less weight to the latter if there is no monitoring of their behaviour (since patients can not change agents very easily and there is little scope for voice') 4. This market can broadly be characterised as one in which the demand curve facing each hospital is downward sloping. The impact of competition in such a market has been analysed for a profit-maximising hospital whose demand is a function of price and quality by Dranove & Satterthwaite (1998). They show the impact on quality depends on the effect of competition on the price and quality elasticities of demand. If competition increases the price elasticity alone, then the effect of competition will be to decrease quality. If competition increases the sensitivity to both price and quality, then the effect on quality is ambiguous. If competition increases the elasticity of the quality signal more than that of the price signal then quality will rise. If quality signals are measured with greater noise than price signals this will decrease the elasticity with regard to quality relative to the elasticity with regard to price. Investigation of the effect of a change in one of the parameters (say the cost of producing a unit of quality) on one choice variable will result in biased results unless the analysis takes into account the fact that both are chosen simultaneously. So the typical approach in the literature to the analysis of competition, which is a single equation estimation of costs, price or price-cost mark up on competition may give biased results. Similarly (though less commonly estimated in the literature) single equation estimates of quality on costs and competition will give biased results. The Dranove and Sattherthwaite model assumes profit maximisation and that hospitals are free to set price and quality. While there is no profit in the UK case, surpluses can be used within year for NHS hospitals, and deficits were seen as evidence of failure on the part of hospital management 5. But UK hospitals were regulated with respect to price. 4 Kessler and McClellan s (1998) study uses data on Medicare patients where there is no price competition. 5 Note profit maximisation is often put forward as a maximand even for not-for-profits in the US. 8

Prices for each service were not set by a central government body, as in the DRG based system used for Medicare/Medicaid reimbursement used in the USA. Instead, hospitals were required to set price equal to average cost for each service. At a specialty level there is evidence that hospitals were probably not bound by this rule (Propper 1996, Propper et al 1998), as abiding by the rule is difficult to observe at this level. However, at the whole hospital level the rule probably did more or less bind, as at this level it is easy to monitor. If price equals average cost then hospitals can choose only choose quality (equivalent to cost). Quality will again be a function of both price and quality elasticities. The impact of differences in competition on quality could go either way: competition forces hospitals to cut prices and cut quality, or to improve quality. However, the simultaneity of price and quality choice is no longer an issue. To investigate the relationship between quality and competition, the appropriate reduced form model is to regress quality on competition and other factors affecting cost, where compet ition is hypothesised to affect both price and quality elasticities. The expected impact of competition would depend on the effect of competition on the two elasticities and the relative noise in the two signals. This is the approach taken here. (b) Our econometric approach Competition in health care markets is geographically defined. It therefore primarily changes only as new hospitals enter a geographical area or exit through mergers or closures. There was both merger and the establishment of new hospitals during the NHS internal market. However, there were very few entrants into the provision of accident and emergency services and most of the new hospitals that were established were the result of a split-off of a specialist unit providing care for the mentally ill and for long term care from a hospital providing a large range of services, including accident and emergency services. Similarly, there were mergers, but most of these were between specialist units and hospitals providing accident and emergency services. 6 Therefore, to a large extent, the number of competitors in any one local market was fixed over time. 6 Between 1991 and 1997 there were around major 12 reconfigurations that led to a within area reduction of one hospital providing accident and emergency services, and there were less than 5 that increased the number of such providers by one. 9

However, competition over time was not fixed, as competition in this market was introduced by policy change. Policy change also affected the operation of the market. Competition was introduced in 1991. For the first four or so years after that the Department of Health actively promoted competition, for example, setting up structures to regulate anti-competitive behaviour 7. So as the internal market developed, competition grew, though it could only grow in those markets in which there were sufficient numbers of hospitals for it to exist. But from 1995 or so there was some concern that constraints on hospital managers behaviour limited the gains from competition (Le Grand et al 1998). In 1997, the government changed and the incoming Labour administration both built on these sentiments and wished to bring about ideological change. It therefore sought to reduce the importance of competition. It issued policy documents that stressed the promotion of co-operation over competition (Le Grand (1999), The New NHS, (1997)). While retaining the split between buyers and sellers it gave signals that competition for services was less important post-1998 than prior to 1997. We use these changes in policy to identify the impact of competition in a data set of hospitals covering 1991-1999. We divide hospitals into two groups: those located in markets in which competition was possible and the rest. (The specific measures of competition that we used are discussed below.) We interact this dummy variable with time. The interaction identifies the effect of competition. We also allow for hospital fixed effects. We estimate: m it = α +γ t + βx it +Σ 1999 τ=1991δ t I(t=τ)*compi + µ i + ξ it (1) where m is the mortality from AMI for hospital i at time t, t is time (or a set of time dummies), X it is a vector of observed hospital characteristics which vary over time (primarily case mix), I(.) is the indicator function with value 1 if true and 0 otherwise, comp is a dummy indicating whether or not the geographical area the hospital is located can support competition, µ i is a unobserved hospital effect and ξ it is random noise. 7 In 1994 for example, the Department of Health issued a document to all Trusts and Health Authorities entitled National Responsibilities, Local Freedoms that set out a merger and anti-competition policy for 10

This is essentially a difference-in-difference estimator, in which the impact of competition is derived from comparison of the death rates of hospitals in years in which competition was possible with their behaviour when it was not (1991) with the behaviour of hospitals where competition was not possible in any years. Given the discussion below, we might expect the coefficient on the time interaction to increase prior to 1997 and fall thereafter. As for all difference-in-difference estimators, we have to assume that the control group do not change to being the treated, and that any macro changes affect both groups equally. In our case, the treated and the controls are defined by geographical location and hence groups are fixed, given the limited amount of entry and exit. We allow for common macro changes through a set of fully flexible time dummies. Treatment for AMI has been subject to technological change in various OECD countries (McClellan & Kessler (2001)). Use of a fixed effects estimator controls for the impact of any fixed observed or unobserved factors that may be spatially associated with competition but are not due to competition. So a fixed effect approach controls for the possible correlation between location and unobservable patient health: for example, the positive correlation between inner city location and a population with poorer health. It will also control for differential investment in technology by size of hospital. Controls will still be needed for factors that may change over time. In summary, if competition has an effect what we would expect to see is an increasing divergence between the outcomes for hospitals located in places where competition is possible and where it is not for the period 1992 to 1995 or 1996, and a decreasing divergence thereafter. 4. Data (a) Measurement of Quality NHS hospitals. 11

The issue of how to measure quality in health care is long-standing and contentious. Various potential proxies for quality have been put forward, including length of stay and mortality rates. Since the United States Health Care Financing Administration began publishing hospital mortality data in 1986 a large literature has appeared on its usefulness and reliability as a measure of quality: Thomas and Hofer (1998) provide a comprehensive review. They cite evidence that poor quality care increases patients risk of mortality and that, on average the quality of care provided in hospitals identified as highmortality rate outliers is poorer than that of low-mortality rate outliers, but conclude from the existing evidence that when used as a measure of quality for individual hospitals, riskadjusted mortality rates can be seriously inaccurate. However, more recent work by McClellan and Staiger (1999) argues that suitably adjusted measures of death rate correlate well with other measures of quality. In this paper we use death rates from acute myocardial infarction (AMI). AMI was chosen on the basis that the nature of such care is, in part, under the control of hospital management and senior physicians within the hospitals, and so outcomes are in part a choice decision of the hospital. Thomas et al (1993) model mortality risks from AMI (amongst other measures) in the US, and use a database of quality findings to determine whether the ratio of observed to expected deaths relates validly to quality. Their results provide some support for AMI as a quality indicator. AMI has also been used in recent studies of quality and competition in the US (Kessler & McClellan 1998). To derive our death rates we use UK panel data from the hospital episode statistics (HES) database over the financial years 1991/2 through 1999/00. The measure of AMI deaths we use is a 30- day rate and measures in-hospital deaths within 30 days of emergency admission with a myocardial infarction for patients aged 50 and over 8, 9. Use of emergency admissions reduces the problem of patient selection. 30-day rates, adjusted to reduce noise, have 8 Deaths occuring after transfer to another provider are credited to the provider where the patient was first admitted. Deaths following discharge are omitted. Deaths following readmission are not included. 9 Many of the actions to reduce deaths from emergency admissions for AMI need to be taken soon after an attack, and so the performance of a hospital in terms of AMI reflects the performance of its accident and emergency unit. Around half the patients admitted to an acute English hospital are admitted through the accident and emergency department, so this quality measure is an important aspect of hospital quality. 12

been shown to be good predictors of 7 day, and one-year death rates in US data (McClellan and Staiger, 1999). One problem with using mortality as an indicator of hospital quality is that death rates are quite variable over time trust-by-trust, reflecting, in part, the issue of small denominators (hospitals may treat relatively few patients for this condition in any one year). This noise in the measures of death rates can lead to misclassification of the quality of hospitals. This is a problem that is common in the analysis of AMI death rates (McClellan and Staiger, 1999) One indication of the amount of noise is to examine the change in ranking of hospitals over time. Table 1 takes the best (in the lowest 10% of death rates) hospitals in the first year of the data window (1991/2) and examines their ranking in later years 1993/4, 1995/6 and 1997/8. The table shows that of hospitals ranked as best in 1991/2, 45% are still ranked as in the best 10% in 1993/4, 33.3% are still in this group in 1995/6 and 13.64% are still in this group in 1997/8. Only 5% of the hospitals ranked as best in 1991/2 had shifted into the worst group after 2 years, 14.29% had shifted into the worst group after four years and 4.55% had moved into this group after 6 years. Mean mortality difference between these hospitals and all others was negative and significant in 1993/4 and 1997/8. McClellan and Staiger (1999) present this analysis for a sample of nearly 4000 hospitals in the USA. Our data exhibit less variability than the US data. For the US data, hospitals in the best ranking were, two years later, nearly as likely to be ranked amongst the worst (14.7%) as amongst the best (16.7%). Average mortality amongst these hospitals was in fact higher than the average of all others after 2 years. McClellan and Staiger (1999) suggest a method of filtering out the noise in annual estimates. They ha ve at their disposal 10 years of data at patient level. Using their filtered estimates they find that 52% of hospitals ranked in the best group were still ranked in the top decile two years later, and less than one percent were ranked in the bottom decile. Clearly, our data lie somewhere between the US unadjusted data and the filtered data. This may be due to the fact that the hospitals in our data set are on average larger than those in the USA. The mean annual number of admissions for AMI in our data set is 380, while in the US sample used in McClellan and Staiger the average hospital 13

admits between 50-60 AMI patients per year. The method we use to reduce the noise inherent in our annual death rate measures is in similar spirit to the shrinkage technique proposed originally by Stein (1955). We obtain a shrunken estimate for hospital j in year t by calculating a weighted average of the hospitals own observed death rate in year t (M jt ) and the mean of the other hospitals in the sample in year t (Mt). The shrunken death rate estimator can be expressed as follows: M ) jt = M jt S j + M t (1- S j ) (2) The shrinkage weight for hospital j (S j ) reflects the level of reliability in hospital j s point estimate. It is equal to σ b /(σ w j + σ b ), where σ b is the between group (hospital) variance w and σ j is the within group (hospital) variance. The less noisy the death rate series for a given hospital the lower the proportion of total variance that is within hospital variance and thus the larger is the shrinkage weight for that hospital. The larger the shrinkage weight the closer is the estimate to the hospitals observed death rate. When the within hospital variance is relatively high (e.g. when the hospital admits few patients) and when then there is less variation in death rates across hospitals the shrinkage weight for hospital j will be close to zero. The smaller this coefficient the more weight is given to the mean mortality rate across hospitals and hence the greater the shrinkage towards the overall mean (an estimate in which there is more confidence). (b) Measures of competition Our measures of competition are geographically based since treatment for AMI requires the physical presence of the patient at the hospital. These are calculated only once for each hospital, as there is relatively little change in the number of hospitals or the population of an area in the nine-year window. To derive these requires a definition of each hospital s catchment area. In general it is argued that administrative boundaries do not measure catchment areas well (e.g. Kessler and McClellan, 1998), and the obvious administrative area in the UK case, the health authority, is also likely to be a poor candidate, especially in more competitive areas. The reforms were introduced in part because health authority boundaries were not co-terminous with patient flows, leading to 14

cross-boundary flows that were not easily remunerated in the pre-reform NHS. Instead, we use a definition of catchment area that reflects patient costs. Any measure that is based on actual hospital choices may produce biased estimators: unobservable hospital heterogeneity in hospital quality may affect individual choice and may also affect the mortality of the hospitals. For this reason, the measures used in our analysis are based on potential, rather than actual, patient travel times to each hospital. In contrast with data used in recent US analyses, we do not have access to individual patient addresses. Instead, we assume that individuals are potential patients of any trust that they are close to. To be specific, we draw a boundary around each trust that defines the area within 30 minutes drive from the trust. Clearly, the choice of 30 minutes is arbitrary. This boundary delineates the service area or catchment area of the trust. The details of the construction of this are as follows. We extracted a postcode for each Trust from NHS Yearbooks, and then converted this to a map grid reference using Postzon software. This allows us to locate each trust on an electronic map; we then superimpose on that the road network 10. Using assumed speeds for three different road types, we can locate a set of points exactly 30 minutes drive time away. Joining these up gives us a catchment area for each hospital. Finally, we superimpose these with the small electoral area boundaries (wards). These are 1991 census wards, of which there are approximately 8000, compared to some 250 trusts. We tag a ward as belonging to the service area of a particular trust if any portion of the ward falls within the 30-minute zone. The simplest measure of competition is the number of trusts located in the catchment area of hospital j: 0 C j = T j This measures the number of potential competitors that j faces, but doesn t take into account the population to be served by the hospital. The smaller this population for a given number of trusts, the more spare capacity and so the larger the potential amount of competition. To allow for this, we normalise the number of trusts in an area by the population of the area (P j ) 15

C = T 1 j j P j. The higher this is, the more competitive the environment. Our third measure of competition measures the extent to which the population of a hospital s catchment area can choose between different hospitals. First, we determine the population of the wards that fall into each hospital s catchment area and the number of trusts each ward population has within a 30-minute radius. Then for eac h trust j we can calculate the share of the total population in all the wards it serves that have a choice between different numbers of hospitals. That is, for each particular hospital we calculate the proportion of its catchment area population that have access to only that hospital, or that can access only 2 hospitals etc. This is measure C 2 j. This is not a single variable but a distribution, which we can cut in a number of different ways in our empirical analysis. Note that, unlike measure C 1 j, this second measure is independent of the size of the population in the catchment area. The measures are obviously related, but are by no means identical. Figure 1 presents histograms of the distribution of the three measures of competition over hospitals in the sample. Figure 1(a) presents measure C 0, Figure 1(b) presents C 1, and Figures 1(c)-(e) present three cuts of C 2. The first cut is the proportion of the hospital s catchment area population that can reach at least three hospitals. The second is the proportion that can reach at least 6 hospitals and the third is the proportion that can reach at least 11 hospitals. The measures show quite a range in competitiveness of hospital market. The histogram of C 0 shows the number of hospitals in each hospital s catchment area. There is a relatively large proportion of hospitals that have fewer than x competitors in their service area, while a small number of trusts have lots of competitors, with the largest number being 46. The distribution of C 1 shows a similar pattern to C 0, but also shows that the effect of standardising the number of competitors in the catchment area by the population of the areas is to shift more weight to the bottom end of the distribution. Fig 1(c) illustrates that travel times are such that lack of potential choice is relatively rare: for the 10 Using Arcview software. 16

vast majority of hospitals, the proportion of their service area population that can reach 3 or more hospitals (the first cut of C 2 ) is close to 1. This distribution is also slightly bimodal. Figs 1(d) shows the distribution of the second cut of C 2. This is clearly bimodal: there is a large group of hospitals that have a very high proportion of their service area population able to reach at least 6 trusts whilst there is also a fairly large group that have a very low proportion. Fig 1(e) shows a very similar distribution for the third cut of C 2. It is even more bimodal, and has more weight in the lower tail of the distribution. The proportion of a hospital's catchment area population that can reach 11 or more hospitals is generally either close to zero or close to 1. In table X0 we categorise these competition measures into 3 quantiles and present the correlations between them. There is a relatively high correlation between all the measures with the exception of C 1. The effect of the normalisation of C 1 by the service area population is that there are some areas that have both a low number of hospitals and a low population and therefore fall into the upper two thirds of the distribution of C 1. This reduces the correlation between this and the other measures of competition. (c) Controls We exploit the panel nature of our data and estimate fixed effects models. Therefore several of the controls that we would want in a cross sectional analysis get absorbed into the fixed effect. Our time -varying controls are controls for case-mix (we do not have data on patient co-morbidity so use the distribution of AMI admissions by age and by gender ) and controls for size/throughput (measured by the number of total admissions, and the number of emergency AMI admissions ). Higher volumes of patients have been shown to be associated with better success rates. To compare our work to our previous crosssectional analyses (Propper et al 2002) we can examine the relationship between the estimated fixed effects and observed, fixed, characteristics of the hospital and its catchment area. The fixed characteristics we measure include dummies for whether the trust is a teaching hospital, or a heart specialist, or is in London, region, and proxies for population health of the catchment area. Teaching hospitals are often thought to have better facilities but also to attract harder cases. The London dummy is to ensure that any 17

special features of hospitals in the capital do not drive our results. The definition of region is the geographically based administrative region of the NHS. 11 As controls for the severity of the potential population of the hospital we use area (1991 Census ward) characteristics that might affect the general level of health of the potential patients of the trust. For each ward, we have all cause mortality and AMI mortality (both split by age and gender), and the proportion of the population with long-term limiting illness. We have demographic data on the age and gender structure of the population. We also have data on unemployment and inactivity rates (by gender) and measures of wealth or deprivation such as proportion of homes owner-occupied, or proportion of homes without indoor bathrooms. These measures of deprivation are quite collinear, and in our analyses we use only a subset of these. 12 Table A1 provides details of the dependent variable, the measures of competition and the controls. Our data set contains 252 hospitals: this is the population of all English hospitals that provide any acute service. Where a trust admits less than 10 AMI cases in any one year we exclude this datapoint from the analysis. We do this as using such small denominators in the calculation of the death rate means that very few deaths can create a high overall rate. After exclusions because of missing controls and small admissions the sample size is 226 hospitals. Details of all data sources are provided in table A2. 5. Results (a) The effect of competition Figure 2 presents the aggregate AMI death rate over the 8 years of the sample. This shows a clear downward trend in death rates in our data. This downward trend is evident in the data for a number of OECD countries and has been attributed to the adoption of 11 These are not fully coterminous with, but overlap considerably with, other geographically-based definitions of English regions. 12 There are several studies of England and the UK which show strong relationships between measures of mortality and deprivation at a local level (e.g. Eames et al, 1993, Ben-Schlomo et al, 1996, Drever and Whitehead, 1995). 18

new technology in the treatment of AMI (McClellan & Kessler, 2001). The trend in figure 2 is not dissimilar to the trend for Scotland during the 1990s. 13 Figure 3 splits the hospitals in the sample on the basis of three quantiles of competition measure C 1. Those hospitals in the bottom third of this distribution face little/no competition throughout the whole of the period 1991-99 (for example, 18% are monopolies) while the rest faced some. The figure plots the average death rate by each quantile for 1991-1999. The results show a more or less continuous decline in death rates for hospitals in the least competitive markets. Death rates for those hospitals in the more competitive markets do not fall much up to 1995 and then fall more sharply from then onwards, with a blip in 1998. The rates for the two higher competition groups are quite similar. So these raw data show first a divergence between death rates of hospitals facing little/no competition and those facing some (those in the top two thirds of the distribution) and a pattern in this divergence which corresponds to the policy introduction of competition, its promotion upto the mid 1990s and its reduction in importance thereafter. Table 3 presents estimates of the difference in death rates between non-competitive and competitive hospitals. Competition is defined in three ways: as dummy variables based on measure C 1, based on the total number of hospitals in a service area, and based on the measure C 2. In columns 1 and 2 hospitals are classified as facing competition if they are in the top two thirds of C 1 and as facing no competition otherwise. Column 1 uses all hospitals, column 2 omits those hospitals, which have no competitors in their catchment area but have small populations and so fall into the top 66 percentile of competition measure C 1. In column three all hospitals which have at least one other hospital in their catchment area are classified as facing competition. Columns 4-6 are based on competition measure C 2, with the number of hospitals classified as facing competition falling from column 4 to 6. In column 4 hospitals for which 100 percent of their catchment areas population can reach 3 or more hospitals are classified as facing competition. In column 5 hospitals for which 100 percent of their catchment areas population can reach 6 or more hospitals are classified as facing competition. In column 6 13 See McGuire and Windmeijer (2002). 19

hospitals for which 100 percent of their catchment areas population can reach 11 or more hospitals are classified as facing competition. The proportion of hospitals classified as facing competition is 44 percent of the sample in column 4, 21 percent in column 5 and 7 percent in column 6. Equation (1) is estimated using these different definitions of competition. The impact of competition is identified from the interaction of the year dummies with the competition dummy. The omitted year is 1991, the year of the introduction of the competition policy. Our prior is an increase in the impact of competition upto the mid-1990s and a fall thereafter. The results, with the single exception of column (4), support this prior. The coefficients on the interactions of year dummies with competition rise from 1992 to plateau in 1995 and 1996, then fall in 1997, rise in most of the columns in 1998 and then fall in 1999. They are generally not significantly different from zero in the early one or two years of the operation of the competition policy, or in 1997 and 1999, when the policy was beginning to be reversed, but are well defined for the mid-1990s and sometimes for 1998. The blip in 1998 is present in most but not all of the columns. A clear time trend is present in all columns and is very similar across all definitions of competition. The estimates also show a clear pattern across the different measures of competition/no competition. The estimates of columns (1), (2) and (5) are broadly the same. The estimates of column (3) are smaller. In this column, no-competition is defined as the presence of only one seller in a market, whereas the definitions used in the other columns include hospitals with more competitors in the group defined as facing no competition. It may be the case that monopoly itself is associated with higher death rates. In contrast, the estimates of column (6) are approximately twice the size of those in columns (1), (2) and (5). In this column, we define competition as existing only if patients can reach many hospitals; i.e. there are many potential sellers in the market. Clearly, the effect of this high competition on death rates is large. The exception to these results, column (4), is probably due to the definition of competition. Having a catchment area in which the all population can reach 3 or more trusts within 30 minutes does not appear to distinguish between the competitive and the 20

non-competitive: the definition splits the sample into two more or less equal size groups and so does not allow us to identify either monopolies or those hospitals where a great deal of competition is possible (policy permitting). Figure 4 plots the coefficients on the time*competition interactions and their standard errors from all the estimates in Table 3. This shows that the divergence in death rates between hospitals facing some- and no-competition reaches a plateau in the mid 1990s, then falls, rises in 1998 and then falls in 1999. With the exception of the rise in 1998 the pattern supports our hypothesis that the impact of competition, where it could operate for geographic reasons, would increase and then operate more weakly after the election of the Labour government in 1997. The fixed characteristics of hospitals that are associated with high death rates can be examined by regressing the fixed effects from the estimates in Table 3 (the µ i in equation (1)) against fixed characteristics of the hospitals, including their catchment areas. These results (not presented here) 14 show that hospitals with higher numbers of beds and which are heart specialists have lower death rates, that there are no differences between teaching and non-teaching hospitals, that there are regional differences in the hospital fixed effects and there is some indication that hospitals located in areas of higher social deprivation have lower death rates. These differences are the same as those found in the crosssectional analyses of AMI death rates presented in Propper et al (2002). (b) The impact of case mix The results in Table 3 control for case mix differences which are fixed over time, but do not control for changes in case mix. If case-mix changes as a response to competition, the differences in death rates might be due in part to differences in patient type and our finding that death rates are higher in more competitive areas may therefore be the result of hospitals which are in located in low competition markets receiving fewer more ill patients. While this may occur for elective patients, it seems less likely to occur in the case of emergency AMI admissions. Hospitals that face few competitors would seem to 14 Results available from the authors on request. 21

be less, rather than more, able to refuse patients. In our sample, hospitals that have higher admissions for AMI are more likely to be low competition, suggesting that this, in fact, is the case so perhaps case mix is not a major issue 15. However, while risk-adjusted death rates are not yet published for the UK, to have some control for case mix, the model was re-estimated including controls for the proportion of patients admitted each year in 36 age-gender groups. 16 Inclusion of these controls slightly decreased the standard errors on some of the competition*time interactions, but the controls themselves were not statistically significant. These controls are admittedly somewhat crude. While we cannot make more detailed adjustment, one test of robustness of the results is to estimate the model on one particular age group only. Table 4 presents the estimates of model (1) for individuals aged 50-69, males and females separately. These two groups account for a high proportion of all AMI admissions: males are 29% and females are 11% of total AMI admissions. The measure of competition used is that from column 2 of table 3. The table shows that the results for males are very similar to the overall results: competition appears to raise death rates and there is a significant downward time trend. Given the importance of this group to total AMI admissions, this is perhaps not surprising. The results for female are rather different: while the downward time trend exists there appears to be no impact of competition. (c) The effect of size Table 3 includes a control for activity, total hospital admissions. This is weakly associated with lower death rates, but the coefficient is not well defined. We found no impact of AMI activity or of hospital size (number of beds). This contrasts with a literature that suggests practice makes perfect in medical care, but is a finding that is similar to that found in the earlier analyses of English data in Propper et al (2002). 17 15 The mean number of AMI admissions for the `no competition' group is 453, whilst the mean for all others is 342. 16 Male and female AMI admissions are broken down into 5-year age bands (age 0-4 through to age 80-84, with an additional band for the 85 plus age group) 17 Given our estimates use panel data, average size/activity is differenced out, and we might not expect much of an impact from year-on-year fluctuations in activity. 22