Session 74 PD, Innovative Uses of Risk Adjustment Moderator: Joan C. Barrett, FSA, MAAA Presenters: Jill S. Herbold, FSA, MAAA Robert Anders Larson, FSA, MAAA Erica Rode, ASA, MAAA SOA Antitrust Disclaimer SOA Presentation Disclaimer
Innovative Uses of Risk Adjustment Jill S. Herbold, FSA, MAAA Principal and Consulting Actuary Anders Larson, FSA, MAAA Consulting Actuary Erica S. Rode, PhD, ASA, MAAA Associate Actuary June 13, 2017
Agenda Moderator introduction Case study 1: PCP Panel Size Background Technical challenges and approach Key learnings Case study 2: Sub-capitation for Medicare Advantage beneficiaries Background Technical challenges and approach Key learnings Conclusion and questions 2
Limitations The views expressed in this presentation are those of the presenters, and not those of Milliman. Nothing in this presentation is intended to represent a professional opinion or be an interpretation of actuarial standards of practice. 3
Case Study 1: Business Problems PCP Capacity Rules for Open vs Closed Panel Incentive Compensation 4
Project Solutions/Results Algorithm to predict primary care utilization Risk adjusted patients by physician practice Estimated new patient capacity by physician practice 5
Constraints of Algorithm to Predict PCP Office Visit Utilization Intuitive and explainable to physicians Simple to implement and update Stability in predictions by patient 6
Data available Billing data 3 years Primary Care Visits Specialist Visits Inpatient admissions and emergency room visits Primary care panel 2 reports, 1 year apart Listing of all patients currently considered active by the primary care network Demographic information Primary payer New patient flag 7
Creating appropriate training data - Definitions Training data set: Set of records used to calibrate predictive model and determine relationships between characteristics (features) and outcome (response). Data is divided into two subsets, often based on a time or date variable. Feature: Data used to gather characteristics to be used as features in model (e.g., clinical conditions, historical costs, and historical utilization of services). Data generally comes from an earlier time period than the response set described below. Response: Data used to observe the outcome you are looking to predict. Data generally comes from a later time period than the feature set described above. Prediction data set: Set of records used to make new predictions using the model calibrated on the training data set. This data set is similar to the training feature data, but likely for a more recent time period (often the most recent time period). It is used to gather the same characteristics as the feature portion of the training data above. 8
Creating appropriate training data - Challenges Billing data had no corresponding eligibility listing Snapshots of patient panel report could be used to limit the patients Recent utilization led to inclusion in patient panel Predictions on new data would only be for patients on current panel All patients on panel at January 2016 had at least one office visit between January 2014 and December 2016. Using this same list of patients to train the model and to make new predictions would create bias. Prediction Feature Period Prediction Response Period Training Feature Period Training Response Period 1/2014 7/2014 1/2015 7/2015 1/2016 7/2016 9
Selecting predictive algorithm - Considerations Option 1 Generalized Linear Model Well known and fairly easy to understand Relationships are interpretable Modest run-time Does not handle interactions and multicollinearity well Linear relationships not necessarily appropriate (e.g., age) Option 2 Decision-tree Based Model Less familiar to many clients Relationships between features not as easy to interpret Longer run-time Handles interactions and multicollinearity Captures non-linearity 10
Selecting predictive algorithm - Accuracy Generalized Linear Model (GLM) Gradient Boosting Machine (GBM) 11
Balancing interpretability with accuracy Limited the number of clinical conditions used as features Focused on common conditions Conditions with intuitive relationships to physicians Balance with desire for greatest accuracy Final conditions Diabetes, asthma/copd, heart arrhythmias, CHF, pulmonary embolism, major depressive disorders, unstable angina, respiratory arrest Also included simple count of all HCC 1 conditions Error Metric Mean Absolute Percentage Error 30 Conditions + HCC Count 15 Conditions + HCC Count 8 Conditions + HCC Count HCC Count Only No Conditions 10.46% 10.47% 10.46% 10.61% 11.07% 1 HCC = Hierarchical Condition Category. These are groups of related clinical conditions identified using ICD diagnosis codes. Categories defined by CMS and are used in Medicare Advantage and ACA Exchange markets. 12
Interpreting relationships and feature importance Evaluate univariate or bivariate relationships on actual predictions Does not isolate effect of each feature, but shows general relationship Easy to understand Chart below shows relative predicted PCP visits (average set to 1.00) for patients with various counts of conditions and unique providers visited Count of In-Network PCPs and Specialists Visited In Feature Period 0 1 2 3 4 5 6+ 0 0.18 0.79 1.00 1.18 1.28 1.42 1.60 Count 1 0.87 1.24 1.34 1.50 1.62 1.73 1.86 of 2 1.67 1.69 1.80 1.90 2.02 2.13 Clinical 3 2.14 1.97 2.12 2.11 2.20 2.32 Conditions 4 2.29 2.20 2.48 5 2.52 6+ 2.56 13
Illustrating interactions/non-linearity For person with 1 PCP/spec visit and 0 conditions, marginal value of adding one condition = (1.24 0.79) = 0.45 For person with 6+ PCP/spec visit and 2 conditions, marginal value of adding one condition = (2.32 2.13) = 0.19 Count of In-Network PCPs and Specialists Visited In Feature Period 0 1 2 3 4 5 6+ 0 0.18 0.79 1.00 1.18 1.28 1.42 1.60 Count 1 0.87 1.24 1.34 1.50 1.62 1.73 1.86 of 2 1.67 1.69 1.80 1.90 2.02 2.13 Clinical 3 2.14 1.97 2.12 2.11 2.20 2.32 Conditions 4 2.29 2.20 2.48 5 2.52 6+ 2.56 14
Illustrating interactions/non-linearity Chart below shows the marginal value of one additional clinical condition at each point on the previous chart Value of additional conditions generally decrease with each additional condition (top-to-bottom) Value also decreases for patients with more providers (left-to-right) Count of In-Network PCPs and Specialists Visited In Feature Period 0 1 2 3 4 5 6+ 0 0.69 0.45 0.34 0.32 0.34 0.31 0.25 Count 1 0.44 0.35 0.30 0.27 0.29 0.27 of 2 0.46 0.28 0.32 0.22 0.17 0.19 Clinical 3 0.18 0.00 0.16 Conditions 4 0.04 5 0.04 6+ 15
Risk Adjusted Patients by Physician Practice Minutes for short and long OVs Number of short and long OVs by patient Average OV minutes per patient Risk-Adjusted patients by PCP/practice 16
Incentive Compensation PMPM per risk- adjusted patient, PCP OV risk adjustment PMPM per total cost Fee-forservice X PMPM X per X Patient risk-adjusted patient 17
PCP Capacity: Predicted Hours Relative to Scheduled Hours 12 10 Number of Practices 8 6 4 2 0 0-60% 60-70% 70-80% 80-90% 90-100% 100%-110% 110%+ Estimated new patient capacity by physician and practice 18
PCP Capacity: Rules for Open vs Closed Panel Physician discretion Appointment times Nurse practitioners Monthly fluctuations 19
Case Study 2: The Business Problem A Medicare Advantage MCO who has historically transferred risk to contracting providers through global capitation arrangements. They have been using CMS-HCC risk scores to adjust capitation payments to providers who are taking global risk. They ve been approached by new provider groups who want to take risk, but only for a subset of services. How can they use risk scores to adjust capitation payments to newer partners taking only partial risk? 20
Medicare Covered and Non-Covered Services Medicare covered = covered under FFS Medicare Supplemental = non-covered under FFS Medicare Examples: Dental, non-emergency transport Plans compete to offer the best benefits Paid for by supplemental member premium and savings on Medicare covered benefits 21
Graphic depictions of bid forms ahead that may be disturbing to some Medicare actuaries 22
Key Bid Values II. Benchmark and Bid Development Total 1. Member Months (Section VI) 114,000 2. Standardized A/B Benchmark (@ 1.000) $830.79 3. Medicare Secondary Payer Adjustment 0.27% 4. Weighted Avg Risk Factor 1.2493 5. Conversion Factor 1.2502 6. Plan A/B Benchmark $1,038.62 7. Plan A/B Bid $667.40 8. Standardized A/B Bid (@ 1.000) $603.79 Cost of FFS benefits, paid to MCO if less than bid. CMS-HCC Risk Score Benchmark x Risk Score MCO s cost to provide FFS benefits, including NBE and gain Paid to MCO if less than risk-adjusted benchmark III. Savings/Basic Member Premium Development 1. Savings $371.21 2. Rebate $278.41 3. Basic Member Premium $0.00 *All values in this presentation are illustrative Risk-adjusted benchmark - Bid Paid to MAO for supplemental benefits (percentage of savings) 23
A Global Cap Approach Expense Medicare Medicare Category Covered Non-Covered Total Medical Expenses $599.20 $78.50 $677.70 Admin $38.24 $5.01 $43.25 Margin $29.96 $3.93 $33.89 Total $667.40 $87.44 $754.84 Paid to Providers as Capitation 24
A Global Cap Approach Member CMS-HCC Risk Score Cost of FFS Benefits (riskadjusted) Cost of Supplemental Benefits Total Cost A 1.25 $599.20 $78.50 $677.70 B 0.90 $431.67 $78.50 $510.17 C 1.30 $623.52 $78.50 $702.02 D 2.20 $1,055.18 $78.50 $1,133.68 E 0.60 $287.78 $78.50 $366.28 Total 1.25 $599.20 $78.50 $677.70 25
Recall: The Business Problem A Medicare Advantage MCO who has historically transferred risk to contracting providers through global capitation arrangements. They have been using CMS-HCC risk scores to adjust capitation payments to providers who are taking global risk. They ve been approached by new provider groups who want to take risk, but only for a subset of services. How can they use risk scores to adjust capitation payments to newer partners taking only partial risk? 26
Milliman Advanced Risk Adjusters TM (MARA) background Several different types of models Prospective and concurrent Based on diagnosis data, drug data, or both Commercial and Medicare (diagnosis only) Outputs total risk score and service category scores Inpatient Outpatient Physician Emergency Other Prescription Drug (commercial only) 27
Score Interpretation Average in service category is proportion of allowed in category for calibration sample Commercial Medicare Service Category Concurrent Prospective Concurrent Prospective Inpatient 0.21 0.20 0.45 0.45 Physician 0.32 0.32 0.26 0.26 Outpatient 0.25 0.25 0.16 0.16 Other 0.02 0.02 0.12 0.12 Emergency 0.02 0.02 0.01 0.01 Prescription Drugs 0.18 0.19 N/A N/A Total 1.00 1.00 1.00 1.00 28
Example Female Age 73 Total Risk Score 11.63 3.06 2.02 2.04 4.01 0.50 Inpatient Emergency Room Outpatient Physician Other
Uses of Service Category Scores Risk adjusted trends Care management Predicting IP admits/er visits Revenue Allocation 30
Service Category Revenue Allocation Calculate MA revenue for each member month Carve out admin and gain Split claim costs between Medicare covered and non-covered Medicare covered claim costs are aggregated across members and reallocated between providers and service categories, using MARA scores Claim costs for Medicare non-covered are not risk adjusted and added to the risk adjusted amounts. 31
Key Bid Values II. Development of Projected Revenue Requirement Medicare Covered A/B Mand Suppl (MS) Benefits Net Net PMPM for Reduction of MARA Service Category PMPM Add'l Svcs. A/B Cost Sh. Total Category a. Inpatient Facility $210.00 $1.50 $12.00 $13.50 IP b. Skilled Nursing Facility 16.00 0.00 2.00 2.00 IP c. Home Health 22.00 0.50 0.00 0.50 Other d. Ambulance 5.85 0.00 (2.00) (2.00) Other e. DME/Prosthetics/Diabetes 14.10 0.00 1.00 1.00 Other f. OP Facility - Emergency 12.00 0.00 1.00 1.00 ER g. OP Facility - Surgery 43.20 0.00 5.00 5.00 OP h. OP Facility - Other 52.10 0.00 5.00 5.00 OP i. Professional 175.20 0.00 30.00 30.00 Phy j. Part B Rx 47.25 0.00 7.00 7.00 OP k. Other Medicare Part B 1.50 0.00 0.50 0.50 Other l. Transportation (Non-Covered) 0.00 2.00 0.00 2.00 Other m. Dental (Non-Covered) 0.00 5.00 0.00 5.00 Other n. Vision (Non-Covered) 0.00 3.00 0.00 3.00 Other o. Hearing (Non-Covered) 0.00 1.00 0.00 1.00 Other p. Suppl. Ben. Chpt 4 (Non-Covered) 0.00 4.00 0.00 4.00 Other q. Other Non-Covered 0.00 0.00 0.00 0.00 Other r. ESRD 0.00 0.00 0.00 0.00 Other s. 0.00 0.00 0.00 0.00 Other t. COB/Subrg. (outside claim system) 0.00 0.00 0.00 0.00 Allocate u. Total Medical Expenses $599.20 $17.00 $61.50 $78.50 32
Capitation by Service Category MARA Medicare Medicare Category Type Covered Non-Covered Total Inpatient Facility $226.00 $15.50 $241.50 Outpatient Facility $142.55 $17.00 $159.55 Emergency Facility $12.00 $1.00 $13.00 Physician Professional $175.20 $30.00 $205.20 Other Various $43.45 $15.00 $58.45 Subtotal $599.20 $78.50 $677.70 Admin NBE $38.24 $5.01 $43.25 Margin Gain/(Loss) $29.96 $3.93 $33.89 Total $667.40 $87.44 $754.84 33
Provider Groups Group Services Covered MARA Risk Scores Member Months Total IP OP ER PHY Other X Facility 50,000 1.21 0.59 0.21 0.04 0.35 0.02 Y Non-Facility 50,000 1.21 0.59 0.21 0.04 0.35 0.02 Z All 64,000 1.28 0.7 0.23 0.04 0.3 0.01 Total 114,000 1.25 0.65 0.22 0.04 0.32 0.01 Revenue Allocated (PMPM) FFS $599.20 $226.00 $142.55 $12.00 $175.20 $43.45 Supp $78.50 $15.50 $17.00 $1.00 $30.00 $15.00 Total $677.70 $241.50 $159.55 $13.00 $205.20 $58.45 34
Revenue Allocation Group Services Covered Revenue Allocated Member Months Total IP OP ER PHY Other X Facility 50,000 $384.54 $220.09 $151.45 $13.00 Y Non-Facility 50,000 $304.35 $223.09 $81.26 Z All 64,000 $668.96 $258.23 $165.88 $13.00 $191.22 $40.63 Total 114,000 $677.70 $241.50 $159.55 $13.00 $205.20 $58.45 Relative Risk Score/Revenue Group Services Covered Member Months Total IP OP ER PHY Other X Facility 50,000 0.905 0.949 1.000 Y Non-Facility 50,000 1.087 1.390 Z All 64,000 1.074 1.040 1.000 0.932 0.695 35
Questions for discussion 36