Understanding Variation in Public Report Cards Mercy Springfield Communities Mercy Springfield Story We have previously tended to ignore public report cards, until. US News & World Report publication Common Conditions June 2015 A major payer for our destination care program for knee and hip replacement called the next week We had done our analysis from published methodology but lacked the data and proprietary risk adjustment (Dr. Foster s) 1
US News & World Report Common Conditions Mercy Springfield COPD (High Performing) Heart Failure (High Performing) Knee Replacement (Average) Hip replacement (Below Average) Coronary Artery Bypass (Average) Common Conditions Domains Unique to Condition/Procedure Survival (aggregated for hip & knee and applied to both) Knee/Hip revision Readmissions for any reason within 30-days Readmission within 30 days specific to condition Readmission for any reason within 7-days Patient Volume Complications Hospital Wide (Does not change by procedure) Intensivist on staff Cardiac ICU Hospital Acquired Infections Survival after multiple procedures (16 procedures) Nurse staffing Nurse Magnet Hospital 2
Lower is Better 30 Day Mortality Review 2009-2012 USN&WR versus our EHR data 10% difference in denominator in data set provided? Difference in numerator actual number not provided 30 day survival all payer 0.998, Medicare 0.995 M&M reviewed individually Aggregate review suggested case selection, aspiration and post operative pneumonia more so than DVT prophylaxis opportunities 2013-April 2015 30 day survival 0.999 all payer Medicare 0.996 all deaths post discharge Two home deaths cause unknown Two in SNF respiratory 1.8 Hospital Infections Standardized Infection Ratio Healthcare Associated Infections Public Report from WhyNotTheBest.org 1.6 1.4 1.2 1 0.8 0.6 0.4 0.2 0 CLABSI CAUTI COLO SSI HYST SSI MRSA CDI Mercy Hospital Springfield Barnes Jewish Hospital Cleveland Clinic Foundation St. Mary's (Mayo) Hospital The Johns Hopkins Hospital National Average 3
So Who s Right? US News & World Report 2015 Average for knee and below average for hip repair Healthgrades 2015 America s 100 Best Hospitals for Orthopedic surgery 2013, 2014 and 2015 Truven 2015 Top 100 Hospital (large community) Carechex 2015 1 st in Missouri for overall care and surgical care Leapfrog 2015 A grade for safety Round Up the Usual Suspects! Classes of data Weighting of data classes Denominator exclusions Data timeframes Numerator variance Data reporting consistency Probably a lot of other factors Risk adjustment methodology 4
US New and World Report Common Conditions (2015) Data Source MEDPAR 2009 2012 MEDPAR 2011 2013 CDC NHSN HCAHPS AHA Survey American Nurse Credentialing Center Society Thoracic Surgery Healthgrades (2015) CareChex (2015) All Payer Database for Appendectomy Hospital Quality Alliance Hospital Compare All Payer Database for core process measures HCAHPS MEDPAR for mortality, complications, PSI, IQI mortality rate Metrics US New and World Report Common Conditions (2015) Healthgrades (2015) CareChex (2015) Mortality 30 day Mortality Inpatient Mortality Overall Readmissions all cause/specific in 30-days Mortality 30-day (not for Orthopedics) Complication Readmission all cause within 7-days Complications Core Processes Patient Volume Readmission rates (not for Orthopedics) Patient Safety (PSI) Hospital Acquired Infections Core Process Measures Patient Satisfaction (HCAHPS)* Complications Inpatient Quality Hip Revisions Survival in multiple procedures Nurse Staffing Nurse Magnet recognition Intensivists Patient Experience *Not included for Orthopedic Award Reproduced with permission, Healthcare Association of New York State. (2013). HANYS report on report cards. Retrieved September 23, 2015, from http://www.hanys.org/quality/data/report_cards/2013/docs/2013_hanys_report_card_book.pdf 5
HANYS Guiding Principles Transparent methodology Evidence-based measures Measure alignment Appropriate data source Most current data Risk-adjusted data Data quality Consistent date Hospital preview HANYS Report on Report Cards Key Findings Using the defined set of guiding principles, report cards receiving lower scores relied heavily on: Administrative claims data and/or unvalidated survey data Comparative data points from different sources and time frames to generate a composite score or ranking Did not use measures aligned with NQF, CMS, or national accrediting organizations Credit was given if publicly reported their methodology Publicly reported methodology does not necessarily correlate with ability of a provider to replicate 6
Reproduced with permission, Healthcare Association of New York State. (2013). HANYS report on report cards. Retrieved September 23, 2015, from http://www.hanys.org/quality/data/report_cards/2013/docs/2013_hanys_report_card_book.pdf Lessons Learned M&M individual case review may miss aggregate findings Case selection pre operative risk score Pre-operative medical assessment Pre-operative medication reconciliation The value of accurate data in multiple surveys that may be shared (AHA) Understand the variation in rating agencies and how to respond to payers Calls to the editor US News & World Report 7
Summary Limited value from vendor produced public report cards, but Mercy Springfield s destination care program, reputation, consumer choice is at stake Opportunity for public response is limited Understanding the variation in data content, denominator exclusions, weighting of variables and risk adjustment is important Advocate for common (CMS?) methodology Advocate for the HANY s principles 8