All rights reserved. No part of this publication may be reproduced in any form or by any means without written permission from the publisher.

Similar documents
Fundamentals of Health Care Improvement

Health Quality Management

INSERT ORGANIZATION NAME

Targeted Solutions Tools

ADOPTION AND IMPLEMENTATION OF LEAN PHILOSOPHY, PRACTICES AND TOOLS IN U.S. HOSPITALS

EHR Enablement for Data Capture

Operational Excellence at Lifespan. Sharon Tripp RN, MS, CPHQ Director of Clinical Excellence

This transition guide serves to outline the updates and new content found in Management and Leadership for Nurse Administrators, Seventh Edition.

The Joint Commission's Performance Measurement Journey

Measuring Value and Outcomes for Continuous Quality Improvement. Noelle Flaherty MS, MBA, RN, CCM, CPHQ 1. Jodi Cichetti, MS, RN, BS, CCM, CPHQ

Introduction Patient-Centered Outcomes Research Institute (PCORI)

EXECUTIVE SUMMARY. The Military Health System. Military Health System Review Final Report August 29, 2014

Quality Management and Accreditation

Creating a Lean Culture in Healthcare

Mandatory Public Reporting of Hospital Acquired Infections

Back to the Future: Moving Towards Real-Time, Actionable Outcome Measures

9/27/2017. Getting on the Path to Excellence. The path we are taking today! CMS Five Elements

Bundled Payments to Align Providers and Increase Value to Patients

Contents. Contributors. Introduction Kathleen M. White, PhD, RN, NEA-BC, FAAN and Ann O Sullivan, MSN, RN, NE-BC, CNE

Connect HF Solution. Case Study. Reducing 30-Day Heart Failure. How Process Optimization and Peer-to-Peer Connections Standardized HF Care

UT Health Science Center at Houston School of Nursing

JOINT COMMISSION INTERNATIONAL ACCREDITATION STANDARDS FOR LONG TERM CARE. 1st Edition

LESSONS LEARNED IN LENGTH OF STAY (LOS)

Leveraging Health IT to Risk Adjust Patients Session ID: QU2; February 19 th, 2017

Transformational Patient Care Redesign Project

Gantt Chart. Critical Path Method 9/23/2013. Some of the common tools that managers use to create operational plan

The Affordable Care Act

UNC2 Practice Test. Select the correct response and jot down your rationale for choosing the answer.

Leadership: Simple Strategies to Engage and Sustain

Gayle Bielanski, RN, BS, CPHQ, CSHA CORE. Practical Guide to MEASURES IMPROVEMENT

Quality Assessment and Performance Improvement in the Ophthalmic ASC

JEFFERSON COLLEGE COURSE SYLLABUS HIT 115. Healthcare Statistics. 3 Credit Hours

Engaging Students Using Mastery Level Assignments Leads To Positive Student Outcomes

Quality Measures in Healthcare Facilities for Patient Family Advisory Council members

Incorporating Clinical Outcomes. Plan. Barbara S. Prosser, RPh V.P. Clinical Services, Critical Care Systems. Kevin L.

A strategy for building a value-based care program

Bad Data s Effect on Population Health Performance

Strategic Plan Our Path to Providing Excellence in Health Care

Quality Improvement and Quality Improvement Data Collection Methods used for Medical. and Medication Errors

For Public Comment June 13 July 15 Comments due 11:59pm ET July 15, Patient-Centered Medical Home 2017 Updates. Overview

Problem The Joint Commission (JC) and Institute of Medicine (IOM) identify inpatient falls as a significant patient safety risk However research regar

The Management and Control of Hospital Acquired Infection in Acute NHS Trusts in England

Accountable Care Organizations (ACO) Draft 2011 Criteria

A Multi-Phased Approach to Using Clinical Data to Drive Evidence-Based EMR Redesign. Kulik, Carole Marie; Foad, Wendy; Brown, Gretchen

Reconciling Abstracted to Electronic Quality Measures

NATIONAL QUALITY FORUM

Session 74X Leveraging Your Hospital's Hidden Assets to Drive Meaningful Change

Case-mix Analysis Across Patient Populations and Boundaries: A Refined Classification System

Hospital Readmissions

Reducing Preventable Hospital Readmissions in Post Acute Care Kim Barrows RN BSN

Informatics, PCMHs and ACOs: A Brave New World

Creating Care Pathways Committees

Product and Network Innovation: Strategies to Achieve Triple Aim Success. Patrick Courneya, MD Medical Director, HealthPartners October 31, 2013

7/7/17. Value and Quality in Health Care. Kevin Shah, MD MBA. Overview of Quality. Define. Measure. Improve

American Medical Group Association Optimizing a Patient-Focused Approach to Primary Care

1/22/2014. Defining Quality in Healthcare. Objectives. Topics of discussion. Quality for the non-quality Manager Session 1

together in Total Health 2011 Annual Report At-A-Glance

Catherine Porto, MPA, RHIA, CHP Executive Director HIM. Madelyn Horn Noble 3M HIM Data Analyst

Healthcare Solutions Nuance Clintegrity Quality Management Solutions. Quality. The Discipline to Win.

UPMC St. Margaret Nursing Division Strategic Planning Retreat September 20, 2013

Implementing QAPI: Translating Data into Action. Objectives

CMS TRANSPLANT PROGRAM QUALITY WEBINAR SERIES. James Ballard, MBA, CPHQ, CPPS, HACP Eileen Willey, MSN, BSN, RN, CPHQ, HACP

uncovering key data points to improve OR profitability

5D QAPI from an Operational Approach. Christine M. Osterberg RN BSN Senior Nursing Consultant Pathway Health Pathway Health 2013

UNITED STATES HEALTH CARE REFORM: EARLY LESSONS FROM ACCOUNTABLE CARE ORGANIZATIONS

American Academy of Ambulatory Care Nursing

Scaling Up and Validating a Nursing Acuity Tool to Ensure Synergy in Pediatric Critical Care

THIS WEEK IN MEDICAL TRAVEL TODAY Volume 4, Issue 18. by Amanda Haar, Editor

HIMSS 2013 Davies Enterprise Award Application Texas Health Resources. Core Case Study Clinical Value

July 2, 2010 Hospital Compare: New ED and Outpatient. Information; Annual Update to Readmission and Mortality Rates

Community Care Management efrontiers: Patient-Centered Coordination and Communications

Allison J. Terry, PhD, MSN, RN

Jumpstarting population health management

National Learning Competencies to Support Excellence in CEhp

GUIDELINES FOR CRITERIA AND CERTIFICATION RULES ANNEX - JAWDA Data Certification for Healthcare Providers - Methodology 2017.

ABMS Organizational QI Forum Links QI, Research and Policy Highlights of Keynote Speakers Presentations

ACCOUNTABILITY. Eileen Lavin Dohmann, MBA, BSN, RN, NEA-BC STRATEGIES FOR NURSES. Author of Accountability in Nursing

Implementing Medicaid Value-Based Purchasing Initiatives with Federally Qualified Health Centers

Quality Improvement Plan

Banner Health Friday, February 20, 2015

The dawn of hospital pay for quality has arrived. Hospitals have been reporting

First Felt, Then Measured

Clinical Quality Payment Policies Impact to Finance and Operations

Rapid-Learning Healthcare Systems

A Battelle White Paper. How Do You Turn Hospital Quality Data into Insight?

The STAAR Initiative

2013 Health Care Regulatory Update. January 8, 2013

Hardwiring Processes to Improve Patient Outcomes

Choosing and Prioritizing QI Project

State Medicaid Directors Driving Innovation: Continuous Quality Improvement February 25, 2013

2016 DNP Faculty Conference: Moving Nursing Practice Forward

Introduction: The Need for Effective Execution in Healthcare

40,000 Covered Lives: Improving Performance on ACO MSSP Metrics

Analysis of Nursing Workload in Primary Care

Priceless Partners: Common Patients, Common Goals

AHRQ Quality Indicators. Maryland Health Services Cost Review Commission October 21, 2005 Marybeth Farquhar, AHRQ

Operating Divisions and Staff Divisions

RN to BSN Completion Program Practicum Handbook: NSG 442A NSG 444A NSG 447A

NURSING (MN) Nursing (MN) 1

CLOSING THE DIVIDE: HOW MEDICAL HOMES PROMOTE EQUITY IN HEALTH CARE

Transcription:

Senior Editor: Maria R. Aviles, M.A. Project Manager: Bridget Chambers Manager, Publications: Paul Reis Associate Director, Production: Johanna Harris Executive Director: Catherine Chopp Hinckley, M.A., Ph.D. Joint Commission/JCR Reviewers: Maureen Carr, Caroline Christensen, Linda Faber, Linda Hanold, Kimo Hemmes, Cathy Hinckley, Helen Hoesing, Barbara Holland, Jerod Loeb, Paul Reis, Sharon Sprenger, Paul vanostenberg, John Wallin Joint Commission Resources Mission The mission of Joint Commission Resources (JCR) is to continuously improve the safety and quality of health care in the United States and in the international community through the provision of education, publications, consultation, and evaluation services. Joint Commission Resources educational programs and publications support, but are separate from, the accreditation activities of The Joint Commission. Attendees at Joint Commission Resources educational programs and purchasers of Joint Commission Resources publications receive no special consideration or treatment in, or confidential information about, the accreditation process. The inclusion of an organization name, product, or service in a Joint Commission Resources publication should not be construed as an endorsement of such organization, product, or service, nor is failure to include an organization name, product, or service to be construed as disapproval. This publication is designed to provide accurate and authoritative information in regard to the subject matter covered. Every attempt has been made to ensure accuracy at the time of publication; however, please note that laws, regulations, and standards are subject to change. Please also note that some of the examples in this publication are specific to the laws and regulations of the locality of the facility. The information and examples in this publication are provided with the understanding that the publisher is not engaged in providing medical, legal, or other professional advice. If any such assistance is desired, the services of a competent professional person should be sought. 2012 The Joint Commission Joint Commission Resources, Inc. (JCR), a not-for-profit affiliate of The Joint Commission, has been designated by The Joint Commission to publish publications and multimedia products. JCR reproduces and distributes these materials under license from The Joint Commission. All rights reserved. No part of this publication may be reproduced in any form or by any means without written permission from the publisher. Printed in the U.S.A. 5 4 3 2 1 Requests for permission to make copies of any part of this work should be mailed to Permissions Editor Department of Publications and Education Joint Commission Resources One Renaissance Boulevard Oakbrook Terrace, Illinois 60181 U.S.A. permissions@jcrinc.com ISBN: Library of Congress Control Number: 2011943547 For more information about Joint Commission Resources, please visit http://www.jcrinc.com. For more information about Joint Commission International, please visit http://jointcommissioninternational.org.

(x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1 +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0 any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) Table of Contents ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx d (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y Introduction Content of the Book.....................................................viii Target Audience.......................................................... x Acknowledgements....................................................... x vii Chapter 1: Benchmarking: A Tool for Performance Improvement 1 What Is Benchmarking?................................................... 1 Types of Benchmarking.................................................... 1 Internal Benchmarking................................................. 1 External Benchmarking................................................ 3 External Benchmarking in the Era of Health Care Reform...................... 6 A Combination Approach: Internal and External Benchmarking................. 8 Benchmarking and the Transition to emeasures.............................. 8 Keys to Benchmarking Success............................................. 10 A Standardized Approach to Benchmarking................................ 10 Leadership Support and Involvement..................................... 11 Organization Resources............................................... 12 A Well-Planned Approach to Benchmarking................................ 13 Joint Commission Standards Related to Benchmarking........................... 13 Joint Commission International Standards Related to Benchmarking................ 15 Chapter 2: Planning a Benchmarking Project 19 Choosing a Topic to Study................................................ 19 Understanding the Benchmarking Topic................................... 20 Deciding What to Benchmark.......................................... 21 Prioritizing Benchmarking Topics........................................ 22 Obtaining Leadership Support............................................. 25 Engaging Clinical Leaders.............................................. 25 Providing Access to Information......................................... 26 Organizing a Benchmarking Team........................................... 26 Deciding Who Should Be on the Benchmarking Team........................ 27 The Role of the Team Leader........................................... 29 The Role of the Facilitator............................................. 29 iii

Establishing Ground Rules............................................. 29 Training Team Members............................................... 30 Developing a Plan....................................................... 31 Chapter 3: Selecting Appropriate Benchmarking Partners 35 Traits of Appropriate External Benchmarking Partners........................... 36 Finding Appropriate Benchmarking Partners................................... 37 The Screening Process.................................................... 41 Avoiding Problems During Partner Selection................................... 43 Establishing Ground Rules................................................ 44 Case Study 1: Texas Children s Hospital, Houston........................... 44 Potential Benchmarking Databases and Partners................................ 58 Benchmarking Sources and Partners in the United States......................... 59 The Joint Commission................................................ 59 Core Measure Sets................................................ 59 Accountability Measures........................................... 60 ORYX........................................................ 60 Quality Reports and Quality Check.................................. 65 Joint Commission Library of Other Measures........................... 66 Strategic Surveillance System....................................... 66 Center for Transforming Healthcare and the Targeted Solutions Tool........ 67 Using Joint Commission Initiatives for Benchmarking.................... 69 Centers for Medicare & Medicaid Services................................. 69 Hospital Inpatient Quality Reporting Program........................... 69 Hospital Outpatient Quality Reporting Program......................... 76 Physician Quality Data Reporting System.............................. 76 Hospital Compare................................................ 76 Medicare Provider Analysis and Review................................ 78 Quality Care Finder............................................... 78 Agency for Healthcare Research and Quality................................ 78 AHRQ Quality Indicators.......................................... 80 National Quality Measures Clearinghouse.............................. 80 Healthcare Cost and Utilization Project................................ 82 Health.Data.gov..................................................... 83 Health Indicators Warehouse............................................ 83 National Quality Forum............................................... 83 Institute for Healthcare Improvement..................................... 84 Collaboratives.................................................... 84 Improvement Map................................................ 84 Improvement Tracker Tool.......................................... 85 Physician Consortium for Performance Improvement......................... 85 National Committee for Quality Assurance................................. 86 Healthcare Effectiveness Data and Information Set........................ 86 Quality Compass................................................. 88 National Healthcare Safety Network...................................... 88 Surgical Care Improvement Project....................................... 88 iv

The Leapfrog Group.................................................. 91 Leapfrog Hospital Survey........................................... 91 Comparative Performance Assessment for Hospitals...................... 91 International Benchmarking Sources and Partners............................... 92 Joint Commission International......................................... 92 International Library of Measures.................................... 92 Using the International Library of Measures for Benchmarking.............. 97 Joint Commission International Cardiac Surgery Benchmarking Project....... 97 World Health Organization............................................ 98 Global Health Observatory Database.................................. 98 The Global InfoBase.............................................. 98 Communicable Disease Global Atlas.................................. 98 European Health for All Database.................................... 99 Targeted Benchmarking Interventions................................. 99 Eurostat.......................................................... 100 The Australian Council on Healthcare Standards Clinical Indicator Program......... 100 Essence of Care 2010.................................................... 101 Organization for Economic Co-Operation and Development Health Care Quality Indicators Project.............................................. 101 Chapter 4: Selecting Benchmarks and Collecting Data 105 Selecting Specific Performance Measures..................................... 105 Characteristics of Effective Measures..................................... 106 Using Predefined Measures or Creating Customized Measures................. 106 Understanding Selected Performance Measures................................ 107 Types of Data...................................................... 107 The Structure of a Measure............................................ 109 Inclusion and Exclusion Criteria........................................ 110 Sampling......................................................... 110 Stratification....................................................... 111 Determining Where to Collect Performance Measure Data....................... 112 Determining How to Collect Performance Measure Data........................ 113 Supporting an Effective Data Collection Process............................... 125 Creating an Operational Definition..................................... 125 Identifying Who Will Collect Data...................................... 126 Training Data Collectors............................................. 127 Supporting Data Security............................................. 129 Verifying Data Quality and Validity..................................... 130 Case Study 2: Kaiser Permanente, Oakland, California....................... 132 Chapter 5: Analyzing Benchmarking Data 137 Planning for Data Analysis............................................... 137 Performing a Risk Adjustment............................................. 138 Why Adjust for Risk?................................................ 138 What Types of Measures Should Be Risk Adjusted?......................... 139 Risk Adjustment Methods............................................ 139 Limitations of Risk Adjustment........................................ 141 v

Compiling Benchmarking Data............................................ 141 Data Analysis Tools..................................................... 141 Boxplot........................................................... 141 Radar Chart....................................................... 142 Control Chart..................................................... 143 Histogram........................................................ 147 Line Graph........................................................ 147 Run Chart........................................................ 147 Pareto Chart....................................................... 148 Determining Data Distribution............................................ 149 Determining Central Tendency........................................ 149 Calculating Variation and Standard Deviation............................. 151 Presenting Comparative Data............................................. 151 Determining Reasons for a Gap in Performance............................... 153 Presenting Analyzed Data................................................ 153 Making It Visual.................................................... 154 Balanced Scorecards................................................. 154 Dashboards........................................................ 155 Providing Clear Explanations of Data.................................... 157 Case Study 3: Ministry of Health Singapore............................... 158 Chapter 6: Using Benchmarking Data to Improve Performance 165 Setting a Goal for Improvement........................................... 165 Obtaining Leadership Support............................................ 169 Creating and Participating in a Performance Improvement Team............... 169 Allocating Resources................................................. 170 Identifying Possible Interventions for Improvement............................ 170 Interventions for Performance Improvement............................... 171 Redesigning an Existing Process....................................... 172 Implementing an Intervention............................................. 172 Plan-Do-Study-Act.................................................. 172 Lean Thinking..................................................... 174 Six Sigma......................................................... 174 Combining Lean and Six Sigma........................................ 175 Robust Process Improvement.......................................... 175 Empowering Staff to Support Change and Implement Interventions................ 176 Educating Staff on a New Process....................................... 176 Ensuring Effective Communication About a New Process.................... 178 Measuring Improvement................................................. 178 Case Study 4: Bangkok Hospital Medical Center, Bangkok, Thailand........... 179 Conclusion 186 Index 189 vi

(x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d) ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y Introduction = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d)ny(n) = ky. y(6) + ay = 0. any(n) + an 1y(n 1) +... + a1y + a0y = 0. (x a)3(x b)3y cy = 0. (ax + b)n(cx + d To measure is to know. This famous quote by Lord Kelvin underscores the importance of measuring performance. To expand on this idea, one could say, To know is to improve. An organization cannot improve its performance if it does not know first how it is performing. Without first measuring, organizations cannot gauge whether their efforts are adequate or exceptional or whether things could be improved. One effective and frequently used method for measuring and analyzing performance is benchmarking. This proven process involves comparing oneself to a benchmark (or target) or to other performance standards or organizations whether internally or externally particularly those organizations that are the best at what they do. Almost anything can be benchmarked to establish thresholds of what constitutes best performance or practice, and benchmarking can be performed within or outside the health care industry. Over the past 20 years, benchmarking has gone from being a little-known performance measurement philosophy to a standard of practice across numerous industries. Health care organizations are employing benchmarking in many aspects of their performance improvement programs to compare internal and external performance, identify best practices, and reveal opportunities for improvement. Organizations can use benchmarking anywhere along the performance improvement continuum, from launching a program to measuring its final outcome. This dynamic tool can be helpful particularly in meeting the fluid regulatory requirements, which stipulate that health organizations must quantify their performance. Regardless of how organizations use benchmarking, the ultimate goal of this process should be to improve performance. Although some individuals view benchmarking as focusing only on understanding individual problems (for example, mortality rates, infection rates, patient satisfaction rates), others understand that it presents opportunities to solve larger issues, such as providing better care, increasing customer satisfaction, and gaining a competitive edge. The concepts behind benchmarking are deceptively simple identify a problem, collect data, compare data, and respond to those comparisons. However, the intricacies involved in each of these steps can present challenges. Benchmarking in Health Care, second edition, offers potential solutions to these challenges by presenting step-by-step instructions for creating and implementing benchmarking projects, as well as improving performance. This book demonstrates how benchmarking is a continual Benchmarking: A Tool Planning a Selecting Appropriate Selecting Benchmarks Analyzing Using Benchmarking Data Introduction for Performance Improvement Benchmarking Project Benchmarking Partners and Collecting Data Benchmarking Data to Improve Performance vii

Benchmarking in Health Care process improvement activity that must be embedded in an organization s culture and that benchmarking is applicable to any type of health care organization anywhere in the world. Content of the Book Each chapter of this book covers a critical step in a benchmarking project. Chapter 1 establishes a foundation by defining benchmarking and the different types of benchmarking (internal and external, both within and outside health care) and lists the keys to success in benchmarking projects, particularly standardization, leadership support and involvement, adequate resources, and planning. It also explains Joint Commission standards related to benchmarking, including the new accountability measures standard, and Joint Commission International benchmarking standards, including the standard that requires organizations to choose clinical measures from the International Library of Measures. Readers will find the discussion on health care reform requirements related to benchmarking such as pay-for-performance, value-based purchasing, hospital-acquired conditions, and reducing readmissions particularly useful and applicable. Chapter 2 outlines the planning phase of a benchmarking project. When planning a benchmarking project, it is important for organizations to clearly define and understand the topic they are going to benchmark, and then to select the variables they ultimately decide to benchmark by prioritizing topics using a variety of tools (such as Pareto charts, cause-and-effect diagrams, affinity diagrams, multivoting, and prioritization matrices). After selecting an appropriate topic to benchmark, it is critical for an organization to create a benchmarking team with clearly defined roles and responsibilities and for that team to obtain leadership support and to develop a project plan that will realize the benchmarking project s goals and objectives. Chapter 3 provides a discussion of factors that organizations need to take into consideration when selecting appropriate partners for external benchmarking projects, including identifying salient characteristics of partners, determining appropriate places to locate partners, screening partners, and establishing ground rules among partners for a mutually beneficial benchmarking project. The first half concludes with a case study from Texas Children s Hospital, Houston, Texas, which implemented a project to benchmark pediatric patient falls. The second half of Chapter 3 provides a comprehensive list of 44 databases and partners that organizations can use in their benchmarking projects. These are divided according to databases and organizations that are located in the United States and those located in other regions of the world. U.S. based sources include the Centers for Medicare & Medicaid Services, the Agency for Healthcare Research and Quality, the National Quality Forum, and the Institute for Healthcare Improvement, to name a few. Joint Commission benchmarking initiatives, such as accountability measures, ORYX, and The Center for Transforming Healthcare, are included in this group. Among the most notable international databases and partners are Joint Commission International, the World Health Organization, Eurostat, and the Australian Council on Healthcare Standards Clinical Indicator Program. Chapter 4 covers the next steps in a benchmarking project: selecting benchmarks and collecting data. These steps require organizations to have viii

Introduction consistent, well-defined, and reliable measures and data collection processes. Organizations can learn about how to select appropriate performance measures, how to decide whether to use predefined or customized measures, and how to differentiate among the different types of data (process measures, outcomes measures, and structural measures). Organizations also need to take numerous factors into consideration when collecting data, including how the data are structured (that is, the numerator and denominator) and whether to use inclusion or exclusion criteria, sampling, and stratification. Tips on where organizations can find appropriate benchmarking data are also provided; these include various types of records, forms, and electronic health records. Of central importance in any benchmarking project is ensuring that organizations collect valid, reliable, and useful data that will achieve the project goals. Chapter 4 discusses effective tools that organizations can use to collect data as well as appropriate data collection strategies, including using operationalized and standardized definitions, identifying data collection personnel and ensuring that they receive necessary training, and securing data against privacy breaches. And although all these concepts are important, ensuring that data collected are valid and reliable is a key data collection strategy covered in Chapter 4. Also included in the chapter is a case study focusing on Kaiser Permanente in Oakland, California. The case study describes how the organization identified and benchmarked against best practices in performance improvement to develop a systematic performance improvement approach that could be used across the entire Kaiser Permanente organization. The next chapter, Chapter 5, discusses the importance of analyzing benchmarking data to transform them into information useful to improve performance. Important steps in the data analysis phase of a benchmarking project include adequate planning and performing a risk adjustment, if necessary, prior to data compilation followed by data analysis and data presentation. The chapter describes numerous tools organizations can use to analyze benchmarking data, including box plots, radar charts, control charts, histograms, line graphs, run charts, and Pareto charts. After data have been compiled and analyzed, these results need to be presented in a clear, concise, and informative manner to a variety of audiences. A discussion of some of the most effective tools organizations can use to display data is presented, including balanced scorecards and dashboards. A case study from the Ministry of Health Singapore is presented, which describes the agency s project to benchmark the quality of health care in Singapore. Chapter 6 discusses the culmination of an organization s benchmarking project: translating the data collected, analyzed, and displayed to real performance improvement. Organizations realize this last step in the benchmarking journey by setting realistic improvement goals, obtaining leadership support, identifying targeted interventions aimed at improving performance, successfully implementing these interventions using a variety of performance improvement methodologies (including Lean, Six Sigma, and Robust Process Improvement ), and empowering staff to implement the interventions. After implementation of the interventions when the wheels of change and improvement have been set in motion it is imperative for organizations to continually measure and monitor them to verify ix

Benchmarking in Health Care that improvement is indeed occurring. A continuous feedback cycle is thereby established in which interventions are monitored, any necessary adjustments are made to the processes, and the results of the revised processes are measured again, all of which lead to performance improvement. Therefore, benchmarking and performance improvement are continuous and constant parts of an organization s day-to-day operations. The book concludes with a case study from Bangkok Hospital Medical Center, Thailand, which outlines the efforts of two hospitals to benchmark rates of breast conserving therapy and share best practices for breast cancer treatment. Target Audience Benchmarking in Health Care is designed to appeal to the novice benchmarker as well as researchers with more experience, covering both the most basic concepts and more advanced practices. Health care professionals who may find this book to be useful include performance improvement directors, quality managers, risk managers, patient safety officers, nursing and other clinical leaders, medical staff leaders, and others interested in using benchmarking in their work. Hospital staff will find this book particularly applicable because they perform the bulk of benchmarking projects in their clinical activities, through participation in clinical research activities, and due to health care reform legislation that requires them to carry out numerous performance measurement related activities. This book can be of value to all types of health care organizations as they continuously engage in performance improvement projects, which necessitates their knowledge of benchmarking practices. Acknowledgements Every book represents the collaboration of a great team of individuals who contribute their knowledge, expertise, and personal experience to the final products, and this book is no exception. This book would not have been possible without the hard work and talent of a large number of individuals, and Joint Commission Resources (JCR) would like to express its gratitude to them. JCR gratefully acknowledges the following organizations that served as case studies for this book. Their willingness to participate, desire to share their knowledge, and eagerness to contribute various resources and materials have greatly enhanced the quality of this book. These organizations serve as role models and provide important benchmarking lessons that other facilities can learn from. Bangkok Hospital Medical Center, Bangkok, Thailand Virginia Maripolsky, B.S.N., M.S.W., assistant chief executive officer, Nursing Affairs Chanpong Tangkanakul, M.D., medical director, Bangkok Neuroscience Center Children s Hospitals and Clinics of Minnesota, Minneapolis and St. Paul Laure K. Orgon, M.A., R.N., clinical education specialist Children s Medical Center, Dallas Kathy Speer, Ph.D., R.N., P.N.P.-B.C., director, Evidence Based Practice and Research Institute for Healthcare Improvement, Cambridge, Massachusetts Robert Lloyd, Ph.D., executive director, Performance Improvement x

Introduction Kaiser Permanente, Oakland, California Lisa Schilling, R.N., M.P.H., vice president, Healthcare Performance Improvement, Department of Care and Service Quality Alide Chase, senior vice president, Quality and Safety Ministry of Health, Singapore Lee Chien Earn, M.B.B.S. M.Med. (PH), F.A.M.S., deputy director of medical services (Health Care Services and Health Care Performance), Singapore Ministry of Health Lim Eng Kok, M.B.ChB., MSc.H.S.M., deputy director, Clinical Benchmarking St. Louis Children s Hospital, St. Louis Heidi W. Fields, M.S.N., R.N., C.P.N.P.-P.C., advance practice nurse, Professional Practice and Systems Texas Children s Hospital, Houston Francine Kingston, Dr.PH., M.S.N., R.N.- B.C., director Angela R. Jones, M.N., R.N., C.N.A.-B.C., nursing quality specialist Wattanosoth Hospital/Bangkok Cancer Hospital and Siriraj Hospital, Bangkok, Thailand Kris Bhothisuwan, M.D., patient care unit director, Breast Center, Member of Breast Surgery International; Emeritus Clinical Professor, Siriraj Hospital Thanks are also due to the following reviewers at The Joint Commission, JCR, and health care organizations around the world who reviewed multiple drafts of the manuscript, provided invaluable comments and edits, and greatly enhanced the quality of the book: Maureen Carr, M.B.A., project director, Department of Standards and Survey Methods, The Joint Commission Caroline Christensen, project director, Department of Standards and Survey Methods, The Joint Commission Lee Chien Earn, M.B.B.S. M.Med. (PH), F.A.M.S., deputy director of medical services (Health Care Services and Health Care Performance), Ministry of Health, Singapore Linda Faber, Ph.D., R.N., M.N., F.A.C.H.E., senior consultant, Joint Commission Resources Helen Glenister, R.N., M.B.A., Ph.D., chief operating officer, The Learning Clinic, London Linda Hanold, M.H.S.A., C.P.H.Q., director, Quality Measurement, Division of Healthcare Quality Evaluation, The Joint Commission Kimo Hemmes, M.S., associate director, Department of Standards and Survey Methods, The Joint Commission Catherine C. Hinckley, M.A., Ph.D., executive director, Publications and Education, Joint Commission Resources Helen Hoesing, R.N., M.P.H., Ph.D., senior consultant, Joint Commission International Barbara Holland, R.N., M.S.N., C.P.H.Q., C.C.M., associate director, Measurement and Quality Monitoring, Joint Commission International Claudia Jorgenson, R.N., M.S.N., associate director, Standards Development and Interpretation, Joint Commission International Jerod M. Loeb, Ph.D., executive vice president, Division of Healthcare Quality Evaluation, The Joint Commission Virginia Maripolsky, B.S.N., M.S.W., assistant chief executive officer, Nursing Affairs, Bangkok Hospital Medical Center, Bangkok, Thailand Paul Reis, manager, Publications and Education, Joint Commission Resources Sharon Sprenger, M.P.A., R.H.I.A., C.P.H.Q., director, External Measurement Relations, Division of Healthcare Quality Evaluation, The Joint Commission xi

Benchmarking in Health Care Paul R. vanostenberg, D.D.S., M.S., vice president, International Accreditation, Standards and Measurement, Joint Commission International John Wallin, M.S., R.N., Division of Healthcare Improvement, The Joint Commission Patricia A. Craig, M.S. M.I.S., associate project director, Division of Healthcare Quality Evaluation, The Joint Commission, provided knowledge, expertise, and invaluable assistance in writing the section on emeasures and their relationship to benchmarking. Thanks so much for fitting this book into your busy schedule. And last, but certainly not least, the author of this book, Kathy Vega, deserves a big thank you for her hard work, dedication, and mastery of everything benchmark. Thanks for being committed to this project through the ups and downs. xii