Quality Improvement in Public Health: Moving From Knowing the Path to Walking the Path

Similar documents
Disclosure Statement. Learning Objectives 4/11/2017. Practical Improvement Science in Medication Safety. Jason Timothy Wong, PharmD

The Scottish Patient Safety Programme

Quality Improvement Developing Psychology s QI Capability

North Carolina Local Health Department Accreditation. Stakeholder Evaluation Report FY

Healthcare Improvement in Nursing - NU3661 (2014/2015)

Evidence-based Practice, Research, and Quality Improvement What s the Difference?

Quality Improvement in Health and Social Care

ABMS Organizational QI Forum Links QI, Research and Policy Highlights of Keynote Speakers Presentations

National Programme to Prevent Central-Line Associated Bacteraemia. Project Charter October 2011 to April 2013

3/24/2016. Value of Quality Management. Quality Management in Senior Housing: Back to the Basics. Objectives. Defining Quality

Primary Care Quality Improvement Whakakotahi. Nelson Marlborough Health & Harley Street Medical Health Quality & Safety Commission

Nurse Author & Editor

Community Paramedic Toolkit REVIEW OF EXISTING COMMUNITY PARAMEDIC TOOLKITS

Quality Improvement From the Ground Up : The Co-Design Model in Action

Integrating quality improvement into pre-registration education

Community Paramedic Toolkit REVIEW OF EXISTING COMMUNITY PARAMEDIC TOOLKITS

The Clinical Investigation Policy and Procedure Manual

LEADERSHIP CHALLENGES IN PATIENT SAFETY

Journal of Nursing & Interprofessional Leadership in Quality & Safety

Opportunity Knocks: Population Health in State Innovation Models

EXECUTIVE SUMMARY. The Military Health System. Military Health System Review Final Report August 29, 2014

Continuous Quality Improvement Efforts for MCAH Populations

How Many Doctors, Nurses, and Other Health Professionals Do You Need?

APNS and Program Planning: An Example of a Primary Care Provider Educational Program on TB in the US Foreign Born

Public Health Accreditation: Advancing Quality, Improving Health

The impact of our Experts by Experience Group (ExE) at the University of Derby on student mental health nurse education

Improving Patient Flow & Reducing Emergency Department (ED) Crowding

Part 4. Change Concepts for Improving Adult Cardiac Surgery. In this section, you will learn a group. of change concepts that can be applied in

Academic medical centers are under considerable pressure to reduce costs Caregiver Perceptions of the Reasons for Delayed Hospital Discharge

Public Health Department Accreditation and the Public Health Nurse

East Gippsland Primary Care Partnership. Assessment of Chronic Illness Care (ACIC) Resource Kit 2014

The New Population Health Division Transforming Public Health in San Francisco

M&M on a 15 Year History of a Merger of Gundersen Clinic and Lutheran Hospital: Struggles and Successes. Jeff Thompson, MD Chief Executive Officer

A Continuous Quality Improvement Project to Improve the Workflow and Patient Throughput at a Digestive Disease Institute.

ADOPTION AND IMPLEMENTATION OF LEAN PHILOSOPHY, PRACTICES AND TOOLS IN U.S. HOSPITALS

Rapid Cycle Improvement

Community Health Centers (CHCs)

Using Quality Improvement to Measure and Assess Public Health Emergency Preparedness Programs: Current Strategies, Opportunities, and Recommendations

Activities, Accomplishments, and Impact. Report on the Implementation of the School Based Health Center Quality Improvement Initiative

Quality Management and Accreditation

Adopting a Care Coordination Strategy

Writing Manuscripts About Quality Improvement: SQUIRE 2.0 and Beyond

SNC BRIEF. Safety Net Clinics of Greater Kansas City EXECUTIVE SUMMARY CHALLENGES FACING SAFETY NET PROVIDERS TOP ISSUES:

IHI Expedition. Improving Care for Frail Older Adults with Complex Needs Session 3

Update on ACG Guidelines Stephen B. Hanauer, MD President American College of Gastroenterology

Plan, do, Study, Act Cycles, as an Alternate to Action Research for Clinically Based Inquiry

Long term commitment to a new vision. Medical Director February 9, 2011

Implementing Medicaid Value-Based Purchasing Initiatives with Federally Qualified Health Centers

The impact of government s ICT savings initiatives. The Cabinet Office

Transdisciplinary Care: Opportunities and Challenges for Behavioral Health Providers

Pursuing the Triple Aim: CareOregon

2014 Request for Proposals

Washington County Public Health

Product and Network Innovation: Strategies to Achieve Triple Aim Success. Patrick Courneya, MD Medical Director, HealthPartners October 31, 2013

Tips and Tools for Learning Improvement. Developing Changes

Maryland Patient Safety Center s Call for Solutions Submission. Organization: Atlantic General Hospital

JULY 2012 RE-IMAGINING CARE DELIVERY: PUSHING THE BOUNDARIES OF THE HOSPITALIST MODEL IN THE INPATIENT SETTING

National League for Nursing February 5, 2016 Interprofessional Education and Collaborative Practice: The New Forty-Year-Old Field

PPS Performance and Outcome Measures: Additional Resources

The Future of Nursing: Are the Stars Aligning?

Accountable Care Organizations (ACO) Draft 2011 Criteria

Table of Contents. Introduction: Letter to managers... viii. How to use this book... x. Chapter 1: Performance improvement as a management tool...

Healthcare Workforce to Promote

Medical Home Renovations: A Patient-centered Medical Home Case Study

programs and briefly describes North Carolina Medicaid s preliminary

siren Social Interventions Research & Evaluation Network Introducing the Social Interventions Research and Evaluation Network

Inland Empire Health Plan Quality Management Program Description Date: April, 2017

MAXIMIZING IN YOUR PRACTICE

medicaid commission on a n d t h e uninsured May 2009 Community Care of North Carolina: Putting Health Reform Ideas into Practice in Medicaid SUMMARY

2ab and 3cd. BTS Topic Selection:

LEGAL NEEDS BY JENNIFER TROTT, MPH AND MARSHA REGENSTEIN, PHD

TAMESIDE & GLOSSOP SYSTEM WIDE SELF CARE PROGRAMME

from bench to bedside

WHITE PAPER. Transforming the Healthcare Organization through Process Improvement

Building a Safe Healthcare System

To ensure these learning environments across the nation, some type of payment reform that

Continuous Value Improvement in Health Care

Wisconsin Public Health Research Network Priority Research Questions Update August 2015

MINISTRY OF HEALTH PATIENT, P F A A TI MIL EN Y, TS C AR AS EGIVER PART AND NER SPU BLIC ENGAGEMENT FRAMEWORK

Mental Health URGENT CARE AND ASSESSMENT Business Case. CCG Summary paper

Global Healthcare Accreditation Standards

THE UNIVERSITY OF NORTH CAROLINA SYSTEM INTER-INSTITUTIONAL PLANNING GRANT REQUEST FOR PROPOSALS

Supporting Leadership for Quality Improvement and Safety. AN ATTRIBUTES FRAMEWORK for HEALTH AND SOCIAL CARE

NCQA WHITE PAPER. NCQA Accreditation of Accountable Care Organizations. Better Quality. Lower Cost. Coordinated Care

February 24, TRAIN Learning Network: Managing, Sharing, Disseminating Public Health Training Content for Today s Workforce

5D QAPI from an Operational Approach. Christine M. Osterberg RN BSN Senior Nursing Consultant Pathway Health Pathway Health 2013

Report on a QI Project Eligible for Part IV MOC

2017 National Standards for Diabetes Self-Management Education and Support INTERPRETIVE GUIDANCE

North Carolina Local Health Department Accreditation. July 2011-June 2012 Stakeholder Evaluation Report

Accountable Care Organizations. What the Nurse Executive Needs to Know. Rebecca F. Cady, Esq., RNC, BSN, JD, CPHRM

Management Response to the International Review of the Discovery Grants Program

WHITE PAPER. NCQA Accreditation of Accountable Care Organizations

The Breakthrough Series: IHI s Collaborative Model for Achieving Breakthrough Improvement

External retrospective Validation of BIG criteria. An example of PDSA for Neurotrauma patients.

Identifying key components of Professional Practice Models for nursing: A synthesis of the literature

Evaluation of Project Implementation Modalities

Supporting Leadership for Quality Improvement and Safety. An Attributes Framework for Health and Social Care

University of Cincinnati Patient Centered Medical Home Leadership Decisions

10/16/2013. Presenter Disclosure. Today s Learning Objectives. Creating Learning Circles in Public Health:

Leveraging Technology to Advance Critical Thinking Skills in Nursing Students

Transcription:

Editorial Quality Improvement in Public Health: Moving From Knowing the Path to Walking the Path Greg D. Randolph, MD, MPH; C. Suzanne Lea, PhD This issue of the Journal of Public Health Management and Practice, the second to focus on quality improvement in public health, moves from knowing the path, described in the January/February 2010 issue, to actually walking the path. The 2010 issue outlined important components of transformation (eg, leadership to give clear vision, breaking down silos, and creating a work environment to sustain continuous quality improvement [CQI]) and set forth an ambitious challenge for adoption of quality improvement (QI) by public health. 1 The foundation of this issue is a series of case studies, addressing not only how public health agencies are conducting QI projects but also how they are sustaining their QI efforts by creating the necessary infrastructure and culture to support CQI. These case studies demonstrate how and under what conditions QI and CQI succeed. Recognizing that many agencies throughout the country are performing exemplary QI work, the local health departments and projects highlighted in these case studies were primarily selected for pragmatic reasons. Many of these agencies are located in North Carolina, which made it easier for the authors to efficiently develop the case studies with little travel and with the necessary relationship building already accomplished. However, several other factors guided the selection of these case studies. North Carolina s public health system enabled the selection of several rural and smaller agencies to highlight. Most literature to date has focused on urban and larger agencies. It is important to address this gap because there is potentially greater impact for QI in agencies with fewer resources, and there is concern about the feasibility of QI in smaller agencies. 2,3 Agencies using common QI methods, such as Lean and Model for Improvement, were pur- J Public Health Management Practice, 2012, 18(1), 4 8 Copyright C 2012 Wolters Kluwer Health Lippincott Williams & Wilkins posefully chosen because these methods are routinely used by public health system partners. Using the same QI methods will facilitate collaboration between public health departments and their system partners as they jointly attempt to improve population health in communities across the United States. In addition, these widely used methods have a well-established track record of effectiveness within numerous industries. Finally, the included QI projects highlight the breadth of public health practice, including clinical, environmental, health promotion, and population health. Clarifying Key Terms and Concepts in This Issue As more public health agencies have applied QI, an abundance of puzzling terminology has emerged. Even in this issue, readers will encounter a collection of confusingly similar terms such as quality assurance, quality improvement, performance improvement, quality management, performance management, and performance measurement. Thus, we have attempted to clarify some of the most important terms and concepts to assist readers as they navigate this issue (see the Table). 4 12 Author Affiliations: North Carolina Center for Public Health Quality, Raleigh (Dr Randolph); Associate Professor, Department of Pediatrics, UNC School of Medicine (Dr Randolph); Adjunct Associate Professor, Public Health Leadership Program, UNC Gillings School of Global Public Health (Dr Randolph); Department of Public Health, Brody School of Medicine, East Carolina University (Dr Lea). Disclosure: The authors declare no conflicts of interest. Correspondence: Greg D. Randolph, MD, MPH, NC Center for Public Health Quality, PO Box 18763, Raleigh, NC 27619 (randolph@unc.edu); C. Suzanne Lea, PhD, Department of Public Health, Brody School of Medicine, 600 Moye Boulevard, mailstop 660, East Carolina University, Greenville, NC 27834 (leac@ecu.edu). DOI: 10.1097/PHH.0b013e31823c7995 4

Quality Improvement in Public Health 5 TABLE Key Terms and Concepts in This Issue Term Definition Comments QI Performance management CQI QA Public Health Accreditation The use of a deliberate and defined improvement process, which is focused on activities that are responsive to community needs and improving population health. 4 Performance management in public health can best be described as what other industries generally refer to as CQI see the following definition. An organizational commitment to systems change to execute a continuous flow of improvements that meets or exceeds the expectations of the customer (communities) and generally includes a link to the organization s strategic plan and goals; a quality council made up of the organization s top leadership; QI training for staff; a mechanism for prioritizing QI projects based on performance data; and supporting and recognizing staff for their QI activities. 9 The systematic monitoring and evaluation of the performance of an organization or its programs to ensure that standards (usually set by outside experts) of quality are being met. 10 The periodic issuance of credentials or endorsement to organizations that meet a specified set of performance standards. 11 Abbreviations: CQI, continuous quality improvement; PDSA, Plan-Do-Study-Act; QA, quality assurance; QI, quality improvement. The reference to the Plan-Do-Check-Act improvement framework is omitted because it adds little to the definition, and worse, may cause confusion. The Plan-Do-Check-Act framework (often called Plan-Do-Study-Act or PDSA ) shares the same name as a tool, the PDSA cycle, a vital tool used with the Model for Improvement and other common QI frameworks. Though they share the same name, using PDSA as a framework is very different from the tool, a PDSA cycle. 5-7 In this issue you will see PDSA referred to as both a tool (a PDSA cycle ) and a framework (often listed as PDCA or PDSA ), and the reader should note which is being referred to in each situation. Performance management in public health is related to QI in that it includes 4 components, one of which is QI (the other 3 components are performance measurement, performance standards, and reporting of progress). 8 Continuous quality improvement was also referred to as Big QI or organizational level QI (vs small QI or project-level QI) in the 2010 Journal of Public Health Management and Practice QI issue. 4 In contrast to QI, the focus is on standards set by experts rather than the expectations of customers/communities. Another distinction is in philosophy. When QA is applied broadly to organizations, the focus is on identifying the poor performers and helping, or more often, requiring them to improve to the level of the standard. In contrast, QI focuses on all organizations improving, regardless of their current level of performance. The Public Health Accreditation Board is attempting to promote CQI through the national voluntary accreditation program. 12 Ascendency of QI in Public Health Drivers and Constraints This issue vividly illustrates many of the drivers and constraints to wider adoption of QI in public health. The topics addressed in this editorial will be recurring themes in this issue s case studies, research articles, and commentaries. In describing the spread of QI in public health, it is instructive to compare to and contrast with the adoption of QI in health care public health s journey has been and will likely continue to be very similar to health care s trek. Indeed, one of the major drivers of QI adoption in public health is the success of QI in health care. And, just as in health care, public health has a long history of heavy investment in QA, with few results to show for these investments. In health care, many respected, influential national organizations have been vital to the promotion of QI, including the Institute for Healthcare Improvement, Institute of Medicine, Accreditation Council for Graduate Medical Education, and American Board of Medical

6 Journal of Public Health Management and Practice Specialties. Similarly, in public health, the Robert Wood Johnson Foundation (eg, via the Multistate Learning Collaborative), Centers for Disease Control and Prevention (eg, via the National Public Health Improvement Initiative), US Department of Health and Human Services (eg, via the Consensus Statement on Quality and Quality Aims), Public Health Accreditation Board (PHAB), and Public Health Foundation (eg, via supporting efforts like the Multistate Learning Collaborative and the National Public Health Improvement Initiative) are playing major roles in facilitating the spread of QI in public health. 13 In addition, the Association of State and Territorial Health Officials, the National Association of County and City Health Officials, the National Association of Local Boards of Health, and the American Public Health Association are providing tremendous QI resources for practitioners in the field. One area of contrast is accreditation s role in driving QI. Accreditation has traditionally been a quality assurance activity in health care; because of this, accreditation has played a lesser role in driving QI adoption in health care. However, in public health, accreditation is being honed to serve as a driver of QI and CQI by PHAB s national voluntary accreditation program. According to PHAB, unlike some health-related agencies and services that are accredited or otherwise regulated, the PHAB board of directors has set the public health accreditation work solidly on the cornerstone of continuous QI. In other words, accreditation is a means to an end, not an end unto itself. 12 Indeed, emerging evaluation results suggest that North Carolina s local health department accreditation program, which is quite similar to PHAB s program, has been a positive force for driving QI adoption in local health departments. 14 What constraints are slowing the adoption of QI? First, and likely foremost, is the public health workforce s general lack of knowledge and experience related to QI. Because QI requires empowering frontline staff to make changes to improve their work each day, workforce QI capacity is essential. As is the case with health care organizations, very few of the thousands of public health agencies nationally have a workforce well versed in QI and they also lack internal experts who can provide training and support for QI projects. These shortcomings are compounded by little to no inclusion of QI in curricula by graduate and undergraduate programs in public health. Thus, with each graduating class, new public health graduates deficient in QI knowledge and skills add to the burden of retooling the public health workforce. Sustaining CQI within an agency is also a major challenge. 15 Transforming organizational culture, a prerequisite for long-term sustainability of CQI, is a lengthy process (perhaps up to 5-10 years based on this issue s case studies). Thus, cultural transformation requires not only commitment by leadership, but also the good fortune of the leadership and its vision remaining stable over the long duration of transformation. 16,17 Similarly, creating the supporting infrastructure for CQI is time consuming it requires creating performance measurement systems, processes for leadership to oversee and help prioritize QI efforts, processes to train staff, and processes to recognize staff for their efforts and communicate about successes. Furthermore, measurement for the purposes of organizational improvement vs measurement for other purposes such as for research or accountability is a challenge for health departments. Organizational improvements must be supported by health data that are meaningful (thus health outcomes are needed), directly attributable to the work of health departments and their community partners (a challenge for important public health issues that have multiple social determinants), and not only available in a timely fashion, but also demonstrate improvement in a timely fashion (thus process measures or intermediate outcomes are needed). 18 Paradigms (also called mental models) can be major barriers to adoption of new and innovative approaches like QI. 19 In health care, a strong research paradigm, wherein changes in patient care should occur only after randomized controlled trials and systematic reviews demonstrate effectiveness, has been a constraint to QI adoption; this level of evidence for organizational interventions such as QI is sparse and will likely always be. 20 Public health shares this research paradigm and thus is affected by it as well. However, the traditional program planning and evaluation paradigm in public health is likely the single most important paradigm limiting the effectiveness of QI. The default for many public health professionals is to plan and gather data extensively, implement the plan, then study the impact post hoc (usually months or years later), and compare results to baseline measurements. At this point, program planners learn how well the plan worked. Effective QI projects are of a very different paradigm a continuous learning approach involving ongoing, rapid cycles of change (ie, Plan-Do-Study-Act cycles) with embedded measurements to promote team learning immediately. In addition, teams use ongoing measurement to assess progress toward the project s goals and make adjustments accordingly. Public health professionals often struggle with shifting to this approach of rapid testing (vs going straight to implementing) and ongoing measurement (vs before-after measurements). Looking to the Future Important Opportunities Many of the aforementioned drivers and constraints will continue to influence the adoption of QI. However, 3 factors will likely dominate the future

Quality Improvement in Public Health 7 spread of QI and CQI in public health. The first (already mentioned) is the urgent need to build QI capacity within the public health workforce. This must include not only general workforce training, but also developing internal experts to facilitate and help lead QI efforts within agencies. Training to equip leadership and management with strategies to effectively support CQI is also a necessity. In this issue, a statewide training program for local public health departments in North Carolina is included to illustrate one model of general workforce QI training. The Centers for Disease Control and Prevention s recently launched the National Public Health Improvement Initiative will provide an enormous opportunity for many state, large city, territorial, and tribal agencies to build workforce QI capacity going forward. In addition, it will also be important for graduate and undergraduate programs in public health to incorporate QI knowledge and skills into their curricula more broadly. The University of Minnesota is leading in this area with the launch of a new certificate program addressing QI. 21 Opportunity exists for the Association of Schools of Public Health and the Association of Prevention Reaching and Research Council of Graduate Programs in Public Health to lead in building the workforce s capacity to successfully execute QI as well, just as the Accreditation Council for Graduate Medical Education has in health care. Given that nurses comprise the majority of the public health workforce, nursing schools and programs can also have a substantial impact on the public health workforce s QI capacity. 22 A second major opportunity is the increasing focus on improving population health due to unabated increases in health care costs. This is evident in the recent health reform legislation and in the growing influence of the Institute for Healthcare Improvement s Triple Aim initiative, wherein one of the 3 aims is improving population health (in addition to lowering per capita health care costs and improving patients / citizens satisfaction). 23 The Triple Aim framework is already being embedded into many aspects of federal policy related to health care reform. The increasing need to improve population health to lower heath care costs will propel the need for public health agencies to collaborate with health care partners much more around population health improvement. An important corollary of this development is that successful agencies in the future must be able to jointly conduct QI efforts with health care partners in their communities. Thus, it will be important for effective agencies to understand and use common QI methods (such as Lean and Model for Improvement) and tools (such as process maps, run charts, and Plan-Do-Study-Act cycles) that are widely used in health care and among other partners. Finally, governmental fiscal austerity, unlikely to change for a long time, will place enormous pressure on all agencies to do more with less. 24 Declining funding will likely serve as a powerful driver of QI in all public health agencies. In particular, Lean methods are likely to be the most direct beneficiary since this method focuses on relentlessly reducing waste and increasing efficiency. Austerity will also certainly increase the already brisk pace of change in public health, and thus the need for change management skills by public health care leaders and managers. Rapid change should further position QI positively because QI is fundamentally a set of evidence-based change management tools. In the future, the overall success of many health departments may largely be determined by their ability to adopt and sustain CQI as agencies face rapid change, are under pressure to improve population health, and are provided far less resources to accomplish their mission. With this in mind, this timely issue of the Journal of Public Health Management and Practice illustrates how health departments are already walking this path. REFERENCES 1. Fallon MM, Jarris PE, Pestronk RM, Smith HS, Russo PG. Achieving a culture of quality improvement: the vision for public health 2026. J Public Health Manag Pract. 2010;16(1): 3-4. 2. Gunzenhauser JD, Eggena ZP, Fielding JE, Smith KN, Jacobson DM, Bazini-Barakat N. The quality improvement experience in a high-performing local health department: Los Angeles County. J Public Health Manag Pract. 2010;16(1):39-48. 3. Mason M, Schmidt R, Gizzi C, Ramsey S. Taking improvement action based on performance results: Washington State s experience. J Public Health Manag Pract. 2010;16(1): 24-31. 4. Riley WJ, Moran JW, Corso LC, Beitsch L, Bailek R, Cofsky A. Defining quality improvement in public health. J Public Health Manag Pract (Suppl). 2010;16(1):5-7. 5. Langley GJ, Nolan KM, Norman CL, Provost LP, Nolan TW. The Improvement Guide: A Practical Approach to Enhancing Organizational Performance. San Francisco, CA: Jossey-Bass Publishers; 1996. 6. Bialek RG, Duffy GL, Moran JW. The Public Health Quality Improvement Handbook. Milwaukee, WI: ASQ Quality Press; 2009:10-11. 7. Moen RD, Norman CL. Circling back: clearing up myths about the Deming cycle and seeing how it keeps evolving. Qual Prog. 2010;42(11):23-28. 8. Turning Point. Performance improvement collaborative. http://turningpointprogram.org/pages/perfmgt.html. Accessed September 12, 2011.

8 Journal of Public Health Management and Practice 9. McLaughlin CP, Kaluzny AD. Defining quality improvement. In: McLaughlin CP, Kaluzny AD, eds. Continuous Quality Improvement in Health Care: Theory, Implementations, and Applications. 3rd ed. Sudbury, MA: Jones and Bartlett Publishers Inc; 2006:3-40. 10. Lesneski CD, Massie SE, Randolph GD. Continuous quality improvement in U.S. public health organizations: moving beyond quality assurance. In: McLaughlin CP, Kaluzny AD, eds. Continuous Quality Improvement in Health Care. 4th ed. Burlington, MA: Jones and Bartlett Publishers Inc; 2013:453-480. 11. Novick LE, May GP, eds. Public Health Administration, Principles for Population-Based Management. Gaithersburg, MD: Aspen Publishers Inc; 2001. 12. Bender K, Halverson PK. Quality improvement and accreditation: what might it look like? J Public Health Manag Pract. 2010;16(1):70-82. 13. Honoré PA, Wright D, Berwick DM, et al. Creating a framework for getting quality into the public health system. Health Aff. 2011;30(4):737-745. 14. Davis MV, Cannon MM, Stone DO, Wood BW, Reed J, Baker EL. Informing the national public health accreditation movement: lessons from NC accredited local health departments. Am J Public Health. 2011;101(9):1543-1548. 15. Morfaw JN. Project Sustainability a Comprehensive Guide to Sustaining Projects Systems and Organizations in a Competitive Market Place. Bloomington, IN: iuniverse; 2011. 16. Riley WJ, Parsons HM, Duffy GL, Moran JW, Henry B. Realizing transformational change through quality improvement in public health. J Public Health Manag Pract. 2010;16(1):72-78. 17. Kotter JP. Leading change: why transformation efforts fail. Harvard Bus Rev. March-April 1995:1-10. 18. Randolph GD, Esporas MH, Provost L, Massie S, Bundy DG. Model for improvement Part Two: Measurement and feedback for quality improvement efforts. Pediatr Clin N Am. 2009;56(4):779-798. 19. Senge PM. The Fifth Discipline: The Art & Practice of the Learning Organization. 2nd ed. New York, NY: Crown Publishing Group; 2006. 20. Smith G, Pell JP. Parachute use to prevent death and major trauma related to gravitational challenge: systematic review of randomised controlled trials. BMJ. 2003;327:1459-1461. 21. University of Minnesota Web site. http://www.sph. umn.edu/programs/certificate/piph/index.asp. Accessed September 12, 2011. 22. Hajat A, Cilenti D, Harrison L, et al. What predicts local public health agency performance improvement? A pilot study in North Carolina. J Public Health Manag Pract. 2009;15(2): E22-E33. 23. Institute for Health Care Improvement (IHI) Web site. http://www.ihi.org/offerings/initiatives/tripleaim/pages/ Approach.aspx. Accessed September 12, 2011. 24. Oberlander J. Health care policy in an age of austerity. NEng JMed. 2011;365(12):1075-1077.