Driving Quality Improvement: Development and Implementation of a Small/Rural Hospital P4P Program

Similar documents
Aligning Hospital and Physician P4P The Q-HIP SM /QP-3 SM Model. Rome H. Walker MD February 28, 2008

Core Metrics for Better Care, Lower Costs, and Better Health

Medicare Value Based Purchasing August 14, 2012

NEW JERSEY HOSPITAL PERFORMANCE REPORT 2014 DATA PUBLISHED 2016 TECHNICAL REPORT: METHODOLOGY RECOMMENDED CARE (PROCESS OF CARE) MEASURES

Hospital Inpatient Quality Reporting (IQR) Program Measures (Calendar Year 2012 Discharges - Revised)

NEW JERSEY HOSPITAL PERFORMANCE REPORT 2012 DATA PUBLISHED 2015 TECHNICAL REPORT: METHODOLOGY RECOMMENDED CARE (PROCESS OF CARE) MEASURES

SCORING METHODOLOGY APRIL 2014

An Overview of the. Measures. Reporting Initiative. bwinkle 11/12

National Patient Safety Goals & Quality Measures CY 2017

HIT Incentives: Issues of Concern to Hospitals in the CMS Proposed Meaningful Use Stage 2 Rule

MEDICARE BENEFICIARY QUALITY IMPROVEMENT PROJECT (MBQIP)

August 1, 2012 (202) CMS makes changes to improve quality of care during hospital inpatient stays

Scoring Methodology FALL 2016

Objectives. Integrating Performance Improvement with Publicly Reported Quality Metrics, Value-Based Purchasing Incentives and ISO 9001/9004

Improving quality of care during inpatient hospital stays

Quality Care Amongst Clinical Commotion: Daily Challenges in the Care Environment

National Provider Call: Hospital Value-Based Purchasing

Scoring Methodology SPRING 2018

Understanding Patient Choice Insights Patient Choice Insights Network

Centers for Medicare & Medicaid Services (CMS) Quality Improvement Program Measures for Acute Care Hospitals - Fiscal Year (FY) 2020 Payment Update

2018 Press Ganey Award Criteria

(202) or CMS Proposals to Improve Quality of Care during Hospital Inpatient Stays

Scoring Methodology FALL 2017

National Hospital Inpatient Quality Reporting Measures Specifications Manual

Value-based incentive payment percentage 3

NOTE: New Hampshire rules, to

Financial Policy & Financial Reporting. Jay Andrews VP of Financial Policy

Minnesota Statewide Quality Reporting and Measurement System: Appendices to Minnesota Administrative Rules, Chapter 4654

Hospital Compare Quality Measures: 2008 National and Florida Results for Critical Access Hospitals

OHA HEN 2.0 Partnership for Patients Letter of Commitment

FINAL RECOMMENDATION REGARDING MODIFYING THE QUALITY- BASED REIMBURSEMENT INITIATIVE AFTER STATE FY 2010

Rural-Relevant Quality Measures for Critical Access Hospitals

Proposed Meaningful Use Incentives, Criteria and Quality Measures Affecting Critical Access Hospitals

The 5 W s of the CMS Core Quality Process and Outcome Measures

Value based Purchasing Legislation, Methodology, and Challenges

MBQIP ABBREVIATIONS. Angiotensin Converting Enzyme Inhibitor. American Congress of Obstetricians and Gynecologists

Quality Based Impacts to Medicare Inpatient Payments

Clinical Operations. Kelvin A. Baggett, M.D., M.P.H., M.B.A. SVP, Clinical Operations & Chief Medical Officer December 10, 2012

June 24, Dear Ms. Tavenner:

CENTERS FOR MEDICARE AND MEDICAID SERVICES (CMS) / PREMIER HOSPITAL QUALITY INCENTIVE DEMONSTRATION PROJECT

Accreditation, Quality, Risk & Patient Safety

The dawn of hospital pay for quality has arrived. Hospitals have been reporting

Additional Considerations for SQRMS 2018 Measure Recommendations

Minnesota Statewide Quality Reporting and Measurement System: Appendices to Minnesota Administrative Rules, Chapter 4654

Overview of the Spring 2016 Hospital Safety Score March 7, Missy Danforth, Vice President of Hospital Ratings, The Leapfrog Group

HIMSS Davies Enterprise Application --- COVER PAGE ---

Physician and Hospital Collaboration: Reducing Harm & Improving Care Delivery Through Quality-based Incentives!

CMS Quality Initiatives: Past, Present, and Future

Performance Scorecard 2009

IMPROVING HCAHPS, PATIENT MORTALITY AND READMISSION: MAXIMIZING REIMBURSEMENTS IN THE AGE OF HEALTHCARE REFORM

Goals and Objectives for Fiscal Year 2012

June 27, Dear Ms. Tavenner:

FY 2014 Inpatient PPS Proposed Rule Quality Provisions Webinar

Olutoyin Abitoye, MD Attending, Department of Internal Medicine Virtua Medical Group New Jersey,USA

Performance Scorecard 2013

K-HEN Acute Care/Critical Access Hospitals Measures Alignment with PfP 40/20 Goals AEA Minimum Participation Full Participation 1, 2

CMS in the 21 st Century

PATIENT SAFETY KNOWLEDGEBASE. How to prepare for a Survey

N ATIONAL Q UALITY F ORUM. Safe Practices for Better Healthcare 2006 Update A CONSENSUS REPORT

Our Hospital s Value Based Purchasing (VBP) Journey

Quality Matters. Quality & Performance Improvement

Medicare Value-Based Purchasing for Hospitals: A New Era in Payment

State of the State: Hospital Performance in Pennsylvania October 2015

The Leapfrog Hospital Survey Scoring Algorithms. Scoring Details for Sections 2 9 of the 2017 Leapfrog Hospital Survey

MBQIP Quality Measure Trends, Data Summary Report #20 November 2016

Overview of the Hospital Safety Score September 24, Missy Danforth, Senior Director of Hospital Ratings, The Leapfrog Group

Medicare Beneficiary Quality Improvement Project

CMS Quality Program- Outcome Measures. Kathy Wonderly RN, MSEd, CPHQ Consultant Developed: December 2015 Revised: January 2018

Minnesota Statewide Quality Reporting and Measurement System: Appendices to Minnesota Administrative Rules, Chapter 4654

Value Based Purchasing: Improving Healthcare Outcomes Using the Right Incentives

PATIENT SAFETY OVERVIEW

A comprehensive reference guide for Aetna members, doctors and health care professionals Aetna Institutes of Quality facilities fact book

NORTHWESTERN LAKE FOREST HOSPITAL. Scorecard updated May 2011

PATIENT SAFETY OVERVIEW

SAN FRANCISCO GENERAL HOSPITAL and TRAUMA CENTER

Minnesota Statewide Quality Reporting and Measurement System: Appendices to Minnesota Administrative Rules, Chapter 4654

Healthcare Reform Hospital Perspective

The Patient Protection and Affordable Care Act of 2010

Medicare Value Based Purchasing Overview

Consumers Union/Safe Patient Project Page 1 of 7

WA Flex Program Medicare Beneficiary Quality Improvement Program

2017 LEAPFROG TOP HOSPITALS

Quality and Health Care Reform: How Do We Proceed?

NORTHWESTERN LAKE FOREST HOSPITAL. Scorecard updated September 2012

Sandra Trotter, MBA, MPHA, CPHQ PATIENT SAFETY PROGRAM LUCILE PACKARD CHILDREN S HOSPITAL STANFORD UNIVERSITY MEDICAL CENTER

2018 LEAPFROG HOSPITAL SURVEY ORGANIZATIONAL BINDER

Competitive Benchmarking Report

General information. Hospital type : Acute Care Hospitals. Provides emergency services : Yes. electronically between visits : Yes

Improving Quality of Care for Medicare Patients: Accountable Care Organizations

New York State Department of Health Innovation Initiatives

Value Based Purchasing

The Wave of the Future: Value-Based Purchasing & the Impact of Quality Reporting Within the Revenue Cycle

National Priorities for Improvement:

Medicare Beneficiary Quality Improvement Project (MBQIP)

AHRQ Quality Indicators. Maryland Health Services Cost Review Commission October 21, 2005 Marybeth Farquhar, AHRQ

Linking Supply Chain, Patient Safety and Clinical Outcomes

Quality Health Indicators: Measure List. Clinical Quality: Monthly

CME Disclosure. HCAHPS- Hardwiring Your Hospital for Pay-for-Performance Success. Accreditation Statement. Designation of Credit.

Medicare Payment Strategy

FY 2014 Inpatient Prospective Payment System Proposed Rule

Transcription:

Driving Quality Improvement: Development and Implementation of a Small/Rural Hospital P4P Program Brent Higgins Anthem Blue Cross and Blue Shield of Virginia March 10, 2009

Take Home Messages Challenges facing small and low volume hospitals in P4P How Anthem utilized small/rural/community (SRC) hospital input and experiences to build a consensus P4P program Anthem s innovative approach measuring and scoring quality in SRC hospitals

Q-HIP SM -Overview Q-HIP SM is a performance based incentive program that financially rewards hospitals for practicing evidence-based medicine and implementing industry recognized bestpractices in patient safety, health outcomes and member satisfaction. Patient Safety Member Satisfaction Continuous Quality Improvement & Excellence Clinical Outcomes

Q-HIP Why it Works Q-HIP is Voluntary hospitals decide to participate Measurement methodology, metric specifications & targets are transparent to participants Adoption of national quality metrics Aligns with accreditation and internal quality assessment tools Mitigates the administrative and collection burden Third party trusted intermediary Collection and unbiased validation and evaluation of data All payer data Financial incentives can lead to a higher organizational prioritization No financial penalty

2009 Q-HIP Scorecard Components Patient Safety Section (35% of total Q-HIP SM Score) Joint Commission National Patient Safety Goals Computerized Physician Order Entry (CPOE) System ICU Physician Staffing (IPS) Standards NQF Recommended Safe Practices IHI 5 Million Lives Campaign MRSA Active Surveillance Cultures and ADE Medication Reconciliation CDC/APIC Flu and Pneumonia Vaccine Guidelines Member Satisfaction Section (10% of Total Q-HIP SM Score) H-CAHPS Survey Results Hospital-Based Physician Contracting Patient Health Outcomes Section (55% of total Q-HIP SM Score) Percutaneous Coronary Intervention Indicators (PCI) 5 ACC-NCDR/NNECDSG Indicators for Cardiac Catheterization/PCI Joint Commission / CMS National Hospital Quality Measures Acute Myocardial Infarction (AMI) Indicators Heart Failure (HF) Indicators Pneumonia (PN) Indicators Surgical Care Improvement Project (SCIP) Nursing Sensitive Care (NSC) Indicators 4 JC/NQF Nursing Sensitive Care Indicators Coronary Artery Bypass Graft Indicators 5 STS/NNECDSG Coronary Artery Bypass Graft (CABG) Measures

Q-HIP Award Winning 2006 Blue Cross and Blue Shield Association (BCBSA) Best of Blues Award 2007 BCBSA / Harvard Medical School Department of Health Care Policy BlueWorks Award And most recently... 2008 Joint Commission / National Quality Forum John M. Eisenberg Award for Patient Safety and Quality

Progression of Q-HIP Year 1 Pilot Phase Virginia Only 16 Total Hospitals (3 small, 4 med, 9 large) Year 5 151 Total Hospitals 69 Virginia Hospitals ME/CT/NH/GA 53 Hospitals California 26 Hospitals New York 5 Hospitals 2003-2004 2004-2005 2005-2006 2006-2007 2007-2008 2008-2009 Year 3 92 Total Hospitals 48 Virginia Hospitals Expansion to ME, CT, NH

Q-HIP Model Adoption in WellPoint States

General Underpinnings Q-HIP not a perfect fit for some participating hospitals Becoming difficult to engage small hospitals Desire to increase quality in all hospital settings

Rationale Small/Rural/Community Program (SRC) Q-HIP is most applicable to large and higher volume hospitals Relevance of clinical areas Predominance of rate-based outcome metrics Q-HIP does not reflect type and level of services at SRC hospitals Rarely provide elective cardiac services SRC hospitals treat more chronic care SRC hospitals participating in Q-HIP had a significant number of rate based metrics with denominator less than 25 cases Samples <25 places a greater value on each case 1 outlier case can greatly impact performance SRC hospitals have greater sampling variability Unjustified reward or penalization

Rationale SRC Program Several metrics have little variation at the national level Smoking cessation counseling 70 th & 90 th percentile at 100% Member satisfaction concerns for SRC hospitals Low survey response rate More variability Less reliable Lack of history/adverse effects unknown

Other Small Hospital Challenges SRC hospitals have fragile resources Limited technology budget Limited FTE usage for administrative requirements Geographic disparities Fewer professionals/caregivers Hours of operation Older populations Population health status More chronic care

SRC Program Development Reviewed current Q-HIP metrics and other possible metrics from IHI, JC and NQF, etc. Removed problematic/volume sensitive indicators Identified metrics to impact a wide patient population Considerations made to ongoing issues, regardless of hospital size Conducted focus group meetings in Portland, Maine and Roanoke, Virginia: Reviewed the starter set of potential metrics and identify best practices Discussed metrics and areas of care not represented in proposed starter set Identified metrics that SRC hospitals can impact Received general feedback Feedback analysis and scorecard development Follow-up and scorecard review meetings

Small Hospital Experience in P4P Most knowledge about small hospital performance in P4P has come from their participation in one-size-fits-all programs CMS/Premier HQID Private insurance Q-HIP Rural Healthcare Associations Lack of programs dedicated to small hospital P4P Carved out Critical Access Hospitals and stipulated bed limits Limited metrics with narrow clinical focus ED/Documenting transfer HAI: UTI, Central Line Bloodstream, hand hygiene Reward contingent on participation with little focus on performance (Pay-for-Reporting)

Focus Group Feedback Highlights Confirmation of Challenges Volume Unpredictable, seasonal e.g. winter/summer travelers FTE usage for data gathering Hospital services (24/hr pharmacy) Mitigate program administration Technology/Resource limitations CPOE/EMR/Pharmacy ICU physician staffing

Focus Group Feedback Highlights Recommendations: Don t overload program with too many metrics Highlight importance of quality Continue to align metrics when possible NSC measures instead of IHI ulcer metrics Addition of ED indicators Educational campaign metrics around hygiene and infection control JC Sentinel Event Alert (Pediatric Medication) Community initiatives

SRC Bundle Approach Composite bundles Allow for new types of metrics Bundles highlight different aspects of quality care Bundles will contain a variety of measures For example, the Medication Safety bundle contains 5 policy/procedure driven metrics and 1 data (num/den) driven metric Relative bundle weighting

Scoring Methodology

Scoring Methodology Transition from 3 large sections to several smaller bundles Hospitals scored on the applicable indicators The use of Bundle Weights will maintain the ratio of the bundle values to the total score (Communication 15%, Medication Safety 20%, Infection Control 22%, All Other 12%, JC/NHQM 26%, Community Improvement 5%) regardless of how many indicators a hospital is measured against in each bundle. Hospital A Hospital B All Other Bundle Bundle weight - 12.00 Available section points - 12.00 Points Earned - 10.00 Bundle Score Calculation 10.00 (12.00/12.00) = 10.00 All Other Bundle Bundle weight - 12.00 Available section points - 7.00 Points Earned - 6.00 Bundle Score Calculation 6.00 (12.00/7.00) = 10.28

Benchmarking / Targets Benchmarks/Targets will be set using national data sources (Hospital Compare / QualityCheck) Multiple target levels will be available when possible Targets will be set using the 50th, 70th and 90th national percentiles for individual measures

Data Submission Examples

Submission of NQF Safe Practices Metric type: policy and procedures Submission requirement: documentation only Submission timeframe: Annual Example: SP 11 (Discharge Planning and Communication) Copy of standardized discharge summary sheet Policy/procedure for forwarding patient care information to next provider Committee minutes outlining the complete discharge process including discharge summary and process for forwarding patient care information to the next provider

Submission of JC NPSG s Metric type: policy and procedures Submission requirement: documentation only Submission timeframe: bi-annual Example: NPSG.08.02.01 (Medication Reconciliation) Submit bi-annual report using the template (on web tool) Committee minutes outlining quarterly the NPSG Electronic version/screen shot bi-annually that outlines the NPSG

Submission of IHI metrics Metric type: rate (no targets) Submission requirement: data submission only Submission timeframe: annual Examples: Hospital will provide data according to specified criteria Compliance will be determined based on complete submission of data for the entire measurement period

Submission of JC/NHQM Metric type: rate (targets set) Submission requirement: data submission Submission timeframe: quarterly Examples: Submit the vendor reports for the current quarter to validate the numerators and denominators for each measure CHF, Pneumonia, Pregnancy and SCIP (NO AMI) Submit either a CDAC abstraction validation rate or submitting a vendor generated IRR for each quarter when it is available

Scorecard

2009 SRC Q-HIP Scorecard Components Communication Bundle (15% of Total SRC Q-HIP SM Score) NQF Recommended Safe Practices Joint Commission National Patient Safety Goals Medication Safety Bundle (20% of Total SRC Q-HIP SM Score) NQF Recommended Safe Practices Joint Commission National Patient Safety Goals IHI 5 Million Lives Campaign Medication Reconciliation Joint Commission Pediatric Medication Safety Infection Control Bundle (22% of Total SRC Q-HIP SM Score) IHI 5 Million Lives Campaign MRSA Active Surveillance Cultures MRSA Bloodstream Infections Joint Commission National Patient Safety Goals 4 JC/NQF Nursing Sensitive Care Indicators (NSC) CDC/APIC Flu and Pneumonia Vaccine Guidelines All Other (12% of Total SRC Q-HIP SM Score) Joint Commission Universal Protocols NQF Perinatal Metrics JC / CMS National Hospital Quality Measures Bundle (26% of Total SRC Q-HIP SM Score) Heart Failure (HF) Indicators Pneumonia (PN) Indicators Surgical Care Improvement Project (SCIP) Local Community Initiative Bundle (5% of Total SRC Q-HIP SM Score) Community Initiative

Communication Bundle Communication Bundle NQF SP 4 Timely, Clear and Transparent Communication Regarding Adverse Events Documentation NQF SP 8 Care Information Continuity and Coordination Documentation NQF SP 9 Critical Test Result Communication Documentation NQF SP 11 Discharge Planning and Communication Documentation NPSG.08.03.01 Medication Reconciliation Documentation

Medication Safety Bundle Medication Safety Bundle NQF SP 13 Unsafe Abbreviations, Acronyms, etc Documentation NQF SP 17 High Alert Drugs Documentation NQF SP 15 Pharmacist Active Participation Documentation NPSG.08.02.01 Medication Reconciliation Documentation IHI Unreconciled Medications per 100 Admissions Data Submission Only JC Pediatric Medication Error Prevention Documentation

Infection Control Bundle Infection Control Bundle NPSG.07.03.01 Evidence Based Infection Control Program Documentation IHI IHI NSC NSC NSC NSC Compliance with Active Surveillance Cultures on Admission MRSA Bloodstream Infections per 100 Admissions Pressure Ulcer Prevalence Urinary Tract Infections Central-Line Associated Bloodstream Infections (CLABSI) Ventilator Associated Pneumonia (VAP) Data Submission Only Data Submission Only Data Submission Only Data Submission Only Data Submission Only Data Submission Only

Infection Control Bundle Cont. Infection Control Bundle IHI Educational Campaign Hospital implements an educational campaign around the following: Hand Hygiene Room Cleaning MRSA Contact Precautions IHI Hospital must meet the following criteria: Post recommended guideline in facilities Provide educational sessions for employees Educational material is made available to employees Designate champions Documentation CDC/APIC Pneumonia and Influenza Immunization Protocols Documentation

All Other Bundle All Other Bundle JC/UP.01.01.01 Conduct a pre-procedure verification process Documentation JC/UP.01.02.01 Mark the procedure site Documentation JC/UP.01.03.01 Time Out Prior to Start of Procedure Documentation Perinatal 1 Elective Delivery Prior to 39 Weeks Gestation Documentation Perinatal 2 Recommended DVT/VTE Prophylaxis with C-Section Delivery Documentation Perinatal 3 Corticosteroid Treatment for Preterm Labor/Birth Documentation Perinatal 4 Universal Bilirubin Screening Documentation

JC/NHQM Bundle Indicators: The JC National Hospital Quality Measures Heart Failure (HF) Pneumonia (PN) Discharge Instructions Evaluation for LVS Function ACEI or ARB for LVSD Pneumococcal Vaccination Initial Antibiotic Received Within 6 Hours of Hospital Arrival Influenza vaccination Target Driven Target Driven Surgical Care Improvement Project (SCIP) Prophylactic Antibiotic Received Within One Hour Prior to Surgical Incision Prophylactic Antibiotics Discontinued Within 24 Hours After Surgery End Time Surgery Patients Who Received Appropriate Venous Thromboembolism Prophylaxis Within 24 Hours Prior to Surgery to 24 Hours After Surgery Target Driven

Local Community Initiative Recognize SRC hospitals play a pivotal role in community Cornerstone in terms of health resources Showcase quality and improvement initiatives in local community Allows hospital to target specific community needs Constructed in such a way to allow for a diverse group of qualifying community interventions/improvements Requirements Documented need assessment Clearly defined goals/targets Plan, timeline, evaluation Example: Childhood obesity educational seminars in schools

Bonus Bundle

Bonus Technology Integration Electronic Medical Record Achieved EMR certification from Certification Commission on Healthcare Information Technology (CCHIT) Decision support tool using evidence based medicine for pharmacy management Formulary management tool Chronic disease management tool OR Preventive medicine tool Ability to link diagnostic providers Database capability with ability to query OR Telemedicine: Full Compliance with Standard Hospital provides documentation that demonstrates compliance Hospital will earn 1 point for each telemedicine specialty (up to a maximum of 4 points) Select standards adopted from the American Telemedicine Association (ATA): Performance management process that complies with any regulatory or accrediting requirements Necessary and ongoing training to ensure providers possess necessary competencies Process to ensure safety and effectiveness of equipment Redundant systems to ensure: availability of network for critical connectivity and clinical video and exam equipment for critical clinical encounters

Bonus Technology Integration IPS: Full Compliance with Standard Intensivists manage or co-manage all ICU patients Intensivists exclusively present 8 hours/day 7 days/week When not present, return 95% of pages w/n 5 minutes FCCS-certified non physician can reach patients w/n 5 minutes in more than 95% cases OR Functioning CPOE in one unit IHI Medical Harm Collect and submit data for IHI Rate of Medical Harm Quarterly Sampling Methodology No Target / Data Collection Only OR CPOE At least 75% hospital inpatient medication orders are entered via a CPOE that includes DSS, links to pharmacy, lab, ADT information, and requires electronic documentation before an intercept can be overridden OR

Bonus Section Cont. Emergency Care metrics (based on NQF Candidate Consensus Standards) added to the Bonus Bundle of the scorecard hospitals must have a policy/procedure or standard order set in place addressing the following to receive points (individually scored): ED Wait Time Severe Sepsis and Septic Shock Management Bundle Confirmation of Endotracheal Tube Placement Anticoagulation for Acute Pulmonary Embolus Pediatric Weight Recorded in Kilograms

Bonus Tobacco Free Campus Adoption of a Tobacco Free Campus hospitals will receive bonus points for adopting a tobacco free campus policy, with the following characteristics: Completely tobacco free campus (not just within the immediate hospital facility) Oversight clearly defined and signage/enforcement Compliance corrective action plan identified Overall goal of providing a safe and healthy environment for patients, visitors and employees while setting a positive example

Final Product Volume Reduced focus on outcome metrics Shift weight from where SRC hospitals see low volume to metrics that allow for a fairer assessment of quality Type and Level of Service Focus on basic quality domains that affect all patients, regardless of hospital size Recognize SRC hospital role in community Resources Mitigate data collection and administration burden where possible Accommodate levels technology integration Reciprocity Complementary metrics and bundles

Metric Interplay J.C. Pediatric Error Prevention Metric Medication Reconciliation Pediatric Medication Safety Pharmacist Active Participation (NQF SP15) CPOE & EMR ED Pediatric Weight Recorded

SRC Eligibility Considerations: Bed size not a good indicator Reported differently Mid-size hospitals with lower volume in some services Eligibility criteria for SRC Q-HIP are as follows: 1. Hospital does not offer cardiac surgery and/or elective PCI services (excluding emergency procedures) AND 2. Hospital had two or more Q-HIP NHQM measures (out of those included in the Q-HIP scorecard) with a denominator of less than 25 cases

SRC Q-HIP Anticipated Rollout Phase I Jan.1, 2009 Phase II July 1, 2009 Phase III 2010 and Beyond

Take Home Messages Challenges facing small and low volume hospitals in P4P How Anthem utilized small/rural/community (SRC) hospital input and experiences to build a consensus P4P program Anthem s innovative approach measuring and scoring quality in SRC hospitals

Questions and Comments