2017 LEAPFROG HOSPITAL SURVEY TOWN HALL CALL May 10, 2017 Matt Austin, PhD, Armstrong Institute for Patient Safety and Quality, Johns Hopkins Medicine
2 Leapfrog Hospital Survey Overview Annual Survey Process Goals for the Survey Content Overview
Annual Survey Process 3 Steps in the process to revise the survey have included: August - September: Survey team and expert panelists set goals, review latest measures, review changes to endorsement status, consider member and hospital recommendations from the previous year. November: Publish proposed changes for a 30-day public comment period. Hospitals and other stakeholders are invited to share comments and feedback on the proposed changes for the new survey. This year we received over 200 comments. January: Pilot test the new survey with ~30 hospitals nationwide. Participating hospitals are asked to test a draft of the survey and scoring algorithms (hard copies only) and provide feedback. February March: Online survey tool is programmed and survey materials are updated. April 1: Survey launches at http://leapfroggroup.org/survey.
Goals for the Survey 4 1. Keep the reporting burden as low as possible. Removed the survival predictor measures, 3 of the 8 Safe Practices, and the readmissions measures. NHSN Group to automatically pull healthcare associated infection data. 2. Continue alignment with other performance measurement groups (such as the CDC/NHSN, CMS, The Joint Commission, and applicable registries). About one-third of the measures on the 2017 survey are in use by other national measurement groups (see National Measures Crosswalk). 3. Include cutting-edge measures that improve the safety, quality, and efficiency of care delivery. Updated and improved CPOE Evaluation Tool v3.0 was released on April 15 4. Maintain consistent measurement structure for benchmarking and for improvement purposes. About one-third of the measures on the 2017 survey are in use by other national measurement groups (see National Measures Crosswalk). 5. Update measures and specifications based on changes to the evidence or guidelines. 6. Add new performance measures that are meaningful to purchasers and consumers. Added two Inpatient Surgery measures (Hospital and Surgical Volume, Surgical Appropriateness), Medication Reconciliation measure, CAHPS Child Hospital Survey measure, and Pediatric CT Dose measure 7. Maintain measures that meaningful to purchasers and consumers.
Content Overview 5 The survey includes nine sections, and each of the sections is organized in the same format in the hard copy of the survey and the online survey, unless otherwise noted: General information about The Leapfrog Group standard [hard copy only]. SURVEY SECTION Profile 1 Basic Hospital Information 2 Medication Safety - CPOE Reporting periods to provide hospitals with specific periods of time for each set of questions. Survey questions which may include references to endnotes. The survey questions and endnotes match the online survey tool exactly. Affirmation of accuracy by your hospital s CEO/Chief Administrative Officer or by an individual that has been designated by the hospital CEO. These statements affirm the accuracy of your hospital s responses. Reference Information which includes What s New and Change Summaries, important measure specifications, answers to frequently asked questions, and other notes that must be carefully reviewed before providing responses to any of the survey questions [hard copy only]. 3 Inpatient Surgery 4 Maternity Care 5 ICU Physician Staffing 6 NQF Safe Practices 7 Managing Serious Errors 8 Medication Safety 9 Pediatric Care
6 Submission Guidelines Deadlines Ensuring Data Accuracy
Deadlines 7 Only surveys that have been affirmed and submitted via the online survey tool will be accepted. The first reporting deadline is June 30. Hospitals that do not submit a survey by June 30 will be reported as Declined to respond for each measure when survey results are published on July 25. Hospitals can continue to submit/re-submit surveys (including CPOE test) until December 31. The month of January is a correction period reserved for hospitals that submit a survey by December 31. No new surveys or CPOE tests can be submitted after December 31. More information about deadlines is available at http://www.leapfroggroup.org/surveymaterials/deadlines/. Please carefully review additional deadlines for joining Leapfrog s NHSN Group at http://www.leapfroggroup.org/survey-materials/join-nhsn.
Ensuring Data Accuracy 8 Affirmation The CEO, or their designee, completes an Affirmation of Accuracy for each section, affirming that the information the hospital has submitted is indeed accurate. Leapfrog reserves the right to require documentation before certifying and/or publishing any hospital s survey results and does exercise this right at random. Electronic Data Review Warnings The online Survey Tool requires hospitals to check for data review warnings before they are able to submit a survey. This gives hospitals an opportunity to correct potential errors before submission. Monthly Data Review Quantitative responses are assessed using empirically driven, normative data quality standards. An e-mail is sent to the hospital s primary survey contact and system contact (if listed) from the Help Desk with any potential issues. Any serious reporting issues must be corrected within 30 days or risk the applicable section s results removal from public reporting. Onsite Data Verification In 2017, DHG Healthcare randomly selected a small number of hospitals for on-site data verification. The selected hospitals have already been notified. Hospitals that have not received notification will not be selected for on-site data verification this year. More information about these programs can be found at http://www.leapfroggroup.org/surveymaterials/data-accuracy.
9 What s New in 2017
10 Profile and Section 1: Basic Hospital Information Profile Hospitals must enter a valid NHSN ID in the Profile so that Leapfrog can access their NHSN data used in Section 7B Healthcare-associated Infections. Hospitals can now add an additional system contact for PR as many hospitals manage Top Hospital announcements through their system office. Section 1 This year hospitals are asked to separate admissions into total adult and total pediatric admissions. (Please refer to endnotes for more information.) Hospitals will also report if they operate any specialty ICUs and/or NICUs. This information will be used to perform cross-section data review.
CPOE Evaluation Tool v3.0 11 The updated Tool incorporates much of the feedback we have received from hospitals regarding formulary issues, lab value issues, and outdated alerts. The new Tool includes updated test patients, updated test orders, and an updated user interface, as well as a redesigned orders and observation sheet that more closely matches the online answer form. New time limits: 3 hours to complete Steps 1 and 2 (Print and Set Up Test Patients) 3 hours to complete Steps 3 6 (Print Test Orders, Enter Test Orders, Record Responses, Submit Affirmation) New scoring: Hospitals will be scored on their overall performance across all order checking categories, rather than having to pass certain categories such as drug:drug and drug:allergy. Hospitals will need to test a minimum number of orders to receive a score Lastly, hospitals will be able to retake a test after 4 months (120 days), rather than having to wait 6 months.
12 Section 3A: Hospital and Surgeon Volume Hospital and surgeon volume for the following 10 procedures specified with diagnosis and procedure codes : Carotid endarterectomy Mitral valve repair and replacement Open aortic aneurysm repair Lung resection Esophageal resection Pancreatic resection Rectal cancer surgery Hip replacement Knee replacement Bariatric surgery for weight loss Hospitals will only report on: Those surgeries they perform electively. Those procedures they have been performing for the entire reporting period. Responses will not be scored or publicly reported in 2017.
13 Section 3B: Preventing Surgical Overuse Leapfrog will ask hospitals about processes they have in place to ensure surgery is only being performed on patients that meet evidence-based, hospital-defined criteria, thereby decreasing the opportunities for inappropriate surgeries and balancing Leapfrog s volume standard. Examples include: Engaging employed and non-employed surgeons to review clinical guidelines and develop appropriateness criteria Processes and structures to support surgeons in adhering to appropriateness criteria Retrospective review of cases to identify the extent to which the criteria is met or not met prior to surgery This section will only apply to the 10 surgeries from Section 3A. Will not be scored or publicly reported in 2017.
Sections 4, 5, and 6 14 Section 4D and 4F: Maternity Care Target rate for clinical process measures increased from 80% to 90% for: Newborn Bilirubin Screening Appropriate DVT Prophylaxis Antenatal Steroids Section 5: ICU Physician Staffing Question #11 from Section 5, which asked whether hospitals had a board approved budget to fully meet Leapfrog s standard in the next survey cycle, was removed. Scoring requirements for Some Progress have been updated. Section 6: NQF Safe Practices Leapfrog removed 3 safe practices: Safe Practice 3 Teamwork Training and Skill Building Safe Practice 17 Medication Reconciliation Safe Practice 23 Healthcare-Associated Complications in Ventilated Patients The remaining 5 Safe Practices were reweighted based on their impact to overall patient safety. See the Scoring Algorithm posted here: http://www.leapfroggroup.org/surveymaterials/scoring-and-results
15 Section 7A: Never Events 4 new policy principles Interview patients and/or families who are willing and able to gather evidence for the RCA Inform the patient and/or family of the action(s) that your hospital will take to prevent future reoccurrences of similar events based on the findings from the RCA Have a protocol in place to provide support for caregivers involved in a never event Perform an annual review to ensure compliance with each element of the policy when a never event occurred In 2017, hospitals will only be scored on their responses to Leapfrog s original 5 principles. The new principles will not be scored until 2018.
16 Section 7B: Join our NHSN Group In 2017, Leapfrog removed the ICU-only CLABSI and CAUTI measure and add the ICU & select ward CLABSI and CAUTI measures from NHSN. Hospitals will no longer enter information into the online survey. Instead, Leapfrog will obtain the data for CLABSI, CAUTI, MRSA, CDI, and SSI Colon directly from CDC s National Healthcare Safety Network (NHSN). In order for Leapfrog to access hospital data, hospitals will need to elect to join Leapfrog s NHSN Group. Instructions and important deadlines to join Leapfrog s NHSN Group are available at http://www.leapfroggroup.org/survey-materials/join-nhsn. A recording of the May 4 NHSN Town Hall Call is available here: http://www.leapfroggroup.org/surveymaterials/town-hall-calls Hospitals that will submit a survey by June 30 th should join the NHSN Group by June 22 nd. Due to NHSN s changes to the standardized infection ratio (SIR) methodology and updated baselines, Leapfrog will recalculate the scoring algorithm cut points used to assign performance categories for these 5 infection measures. Hospitals that submit a survey by June 30 th will be able to review their NHSN data by accessing their Hospital Details page on July 12 th prior to the first publication of 2017 Leapfrog Hospital Survey Results.
17 Section 8A: Bar Code Medication Administration Based on a recommendation from Leapfrog s Maternity Care and BCMA Expert Panels, hospitals will be asked to report on the use of BCMA in Labor and Delivery Units. Telemetry Units will be also be added to the definition of Medical/Surgical Units. No changes to the scoring algorithm for this section are proposed.
18 Section 8B: Medication Reconciliation Measure focuses on the accuracy of the hospital s medication reconciliation process, and replaces Safe Practice 17 Medication Reconciliation. The measure will not be scored or publicly reported in 2017. Hospitals will sample at least 10 patients in one three month period. Hospitals will report on the number of unintentional medication discrepancies (history errors or reconciliation errors) identified between Gold Standard Medication List and the admission and discharge orders. Leapfrog hosted a Town Hall Call for pharmacists listen to the recording at http://www.leapfroggroup.org/survey-materials/town-hall-calls. Toolkits for hospitals that want to use their data for QI are available on the Survey and CPOE Materials webpage.
19 Section 9A: CAHPS Child Hospital Survey Currently, only hospitals with at least 1,000 pediatric inpatient admissions during the reporting period will be asked to complete this section. Asks for the Top Box score for each of the 18 measures of patient experience, which include 10 composite measures and 8 single-item measures. All responses are available on a standard vendor report. Will not be scored or publicly reported in 2017
20 Section 9B: Pediatric CT Radiation Dose Dose Length Product (DLP) The dose length product (DLP) is the CTDI vol multiplied by the scan length (slice thickness number of slices) in centimeters. The Volume Computed Tomography Dose Index (CTDI vol ) is a standardized parameter to measure Scanner Radiation Output 4 anatomical regions: head, chest, abdomen/pelvis, and chest/abdomen/pelvis 5 age strata: <1, 1-4, 5-9, 10-14, 15-17 Hospitals are asked to report on the number of scans within each age strata and anatomic region, and their own 25 th percentile, 50 th percentile, and 75 th percentile doses. Data collection: ACR National Radiology Data Registry Dose monitoring software Dose reports from the CT machine (worksheet provided to track and store data) Will not be scored or publicly reported in 2017
21 How Results are Used
Public reporting 22 Leapfrog s purchaser members use the survey responses to: Educate and inform enrollees about patient safety and the importance of comparing provider performance on Leapfrog s safety, quality, and resource standards, and Recognize and acknowledge providers that have met the standards. This means that purchasers will share the survey results with their employees and use the survey results in their contracting discussions with health plans and providers. The Leapfrog Group will share the results from all hospitals at http://leapfroggroup.org/compare-hospitals. The Web display of hospitals results is made available to aid consumers in their decisions about where to receive care. External organizations that wish to use the data, for other purposes such as consumer education tools, market analysis, or contracting decisions, must license the data from The Leapfrog Group for a fee. The revenue from data licenses is used to support the ongoing administration of the Leapfrog Hospital Survey and Leapfrog s data dissemination efforts. For those hospitals that choose not to respond to a request to complete the survey, the publicly reported survey results will read: Declined to Respond.
Leapfrog Top Hospitals 23 Leapfrog recognizes the highest performers on the Leapfrog Hospital Survey through its annual Top Hospital designation. Top Hospital awards are given in four categories: Top General Hospitals, Top Teaching Hospitals, Top Rural Hospitals, and Top Children s Hospitals. To be considered for a Top Hospital award, hospitals must submit a survey by August 31. Hospitals receiving the award are notified in late October, and are announced publicly at Leapfrog s Annual Meeting in December. The criteria for the Top Hospital awards are determined each year by a committee evaluating hospital performance across all areas of the Leapfrog Hospital Survey. For more information visit http://www.leapfroggroup.org/ratings-reports/tophospitals.
Competitive Benchmarking Reports 24 Hospitals that submit a Leapfrog Hospital Survey by the June 30 first reporting deadline will receive a free Summary Competitive Benchmarking Report. These Summary Reports illustrate how a hospital compares to others in the nation on those measures included in the Leapfrog Hospital Survey. The reports are generated by applying the Leapfrog Value Based Purchasing Platform Methodology to 2017 Leapfrog Hospital Survey responses. The Summary Reports are emailed to the hospital CEO using the contact information provided by the hospital in the profile section of their survey. Obtain more information about Competitive Benchmarking Reports, the Leapfrog Value Based Purchasing Platform Methodology, and more detailed performance reports at http://www.leapfroggroup.org/ratings-reports/competitivebenchmarking.
Hospital Safety Grade 25 The Hospital Safety Grade is a letter grade that represents a hospital s performance on 30 different measures of patient safety (i.e. measure of accidents, injuries, harm, and errors). Only general, acute care hospitals are eligible to receive a Hospital Safety Grade. While the Hospital Safety Grade is a separate program administered by Leapfrog, it does use some data from the Leapfrog Hospital Survey, in addition to data from other publicly available sources such as, the American Hospital Association and Centers for Medicare and Medicaid Services. For more information on the measures included and to download a copy of the methodology, visit http://www.hospitalsafetyscore.org/for-hospitals. Hospitals that would like Leapfrog Hospital Survey Results included in the Fall 2017 Hospital Safety Grade should plan to submit a survey by June 30.
26 Get Ready for 2017
Resources 27 Recordings of previous Town Hall Calls available at: http://www.leapfroggroup.org/survey-materials/town-hall-calls. Medication Reconciliation NHSN CPOE Tool v. 3.0 2017 Users Group: http://www.leapfroggroup.org/surveymaterials/users-group Hospitals looking for additional information and technical support on the Leapfrog Hospital Survey should join the Users Group. The Users Group meets monthly from March to December for a webinar and live Q&A.
Get Started 28 Request a 16-digit security code at http://www.leapfroggroup.org/survey-materials/getsecurity-code Review 2017 deadlines at http://www.leapfroggroup.org/surveymaterials/deadlines Questions about the Leapfrog Hospital Survey can go to our Help Desk at https://leapfroghospitalsurvey.zendesk.com
29 Questions?