Identification of physicians providing comprehensive primary care in Ontario: a retrospective analysis using linked administrative data

Similar documents
Primary health care is facing a number of serious challenges

Primary Care Physician Groups in Ontario.

About the Data: Adult Health and Disease - Chronic Illness 2016/17, 2014/15 (archived) Last Updated: August 29, 2018

Comparison of. PRIMARY CARE MODELS IN ONTARIO by Demographics, Case Mix and Emergency Department Use, 2008/09 to 2009/10

Physician Workforce Fact Sheet 2016

Nursing Practice In Rural and Remote Nova Scotia: An Analysis of CIHI s Nursing Database

Nursing Practice In Rural and Remote Ontario: An Analysis of CIHI s Nursing Database

Provincial Dialysis Capacity Assessment Executive Summary. April 2012

Nursing Practice In Rural and Remote Newfoundland and Labrador: An Analysis of CIHI s Nursing Database

Rural Family Physicians in Patient Centered Medical Homes Have a Broader Scope of Practice

Periodic Health Examinations: A Rapid Economic Analysis

A Statistical Anatomy of Ontario Family Physicians Practices Logan McLeod, Gioia Buckley, Arthur Sweetman Abstract (updated January 25, 2016)

Nursing Practice In Rural and Remote New Brunswick: An Analysis of CIHI s Nursing Database

Telephone triage systems in UK general practice:

Measuring Comprehensiveness of Primary Care: Past, Present, and Future

Health Quality Ontario

The Advantages and Disadvantages for a Rural Family Physician Practicing Obstetrical Care

Evaluation of NHS111 pilot sites. Second Interim Report

Evaluation of an independent, radiographer-led community diagnostic ultrasound service provided to general practitioners

Comprehensive Primary Care: What Patient Centred Medical Home models mean for Australian primary health care

A Submission to the House of Commons Standing Committee on Finance. Pre-Budget 2012 Consultations

Analyzing Readmissions Patterns: Assessment of the LACE Tool Impact

THE COLLEGE OF LE COLLÈGE DES FAMILY PHYSICIANS MÉDECINS DE FAMILLE OF CANADA DU CANADA A VISION FOR CANADA

Primary Care Workforce Survey Scotland 2017

Licensed Nurses in Florida: Trends and Longitudinal Analysis

Alice B. Aiken 1*, Alyson L. Mahar 2, Paul Kurdyak 3, Marlo Whitehead 4 and Patti A. Groome 2

The Workforce Needed to Staff Value-Based Models of Care

Access to primary health care for immigrants: results of a patient survey conducted in 137 primary care practices in Ontario, Canada

Issue Brief. EHR-Based Care Coordination Performance Measures in Ambulatory Care

How Can We Create a Cost-Effective System of Primary and Community Care Built Around Interdisciplinary Teams?

Disposable, Non-Sterile Gloves for Minor Surgical Procedures: A Review of Clinical Evidence

Re: Rewarding Provider Performance: Aligning Incentives in Medicare

Draft Ohio Primary Care Workforce Plan

2014 MASTER PROJECT LIST

Collaborating to better measure physician supply in Ontario: the Ontario Physician Workforce Database (OPWD)

Implementing Medicaid Value-Based Purchasing Initiatives with Federally Qualified Health Centers

Community Health Centre Program

Full-time Equivalents and Financial Costs Associated with Absenteeism, Overtime, and Involuntary Part-time Employment in the Nursing Profession

1. Working as a primary health care NP Please complete the entire questionnaire

Chicago Scholarship Online Abstract and Keywords. U.S. Engineering in the Global Economy Richard B. Freeman and Hal Salzman

Can Physicians Be Induced To Resume Obstetric Practice?

Case study O P E N A C C E S S

The Impact of Medicaid Primary Care Payment Increases in Washington State

Chronic Obstructive Pulmonary Disease in Ontario

Careers in Patient Care: A Look at Former Students from Nursing and other Health Programs that Focus on Patient Care

Community Health Centers (CHCs)

The adult social care sector and workforce in. Yorkshire and The Humber

Navy and Marine Corps Public Health Center. Fleet and Marine Corps Health Risk Assessment 2013 Prepared 2014

GEM UK: Northern Ireland Summary 2008

The number of patients admitted to acute care hospitals

A Primer on Activity-Based Funding

Freestanding Emergency Care Centers

Minnesota Department of Health (MDH) Health Care Homes (HCH) Initial Certification. Reviewed: 03/15/18

Dual Eligibles: Medicaid s Role in Filling Medicare s Gaps

Linkage between the Israeli Defense Forces Primary Care Physician Demographics and Usage of Secondary Medical Services and Laboratory Tests

Appendix #4. 3M Clinical Risk Groups (CRGs) for Classification of Chronically Ill Children and Adults

2012 Physician Services Agreement Primary Care Changes

The adult social care sector and workforce in. North East

Hospitals Voice Their Opinions: Core Recommendations for the 2012 Physician Services Agreement. November 2011

Fleet and Marine Corps Health Risk Assessment, 02 January December 31, 2015

Patterns of Reserve Officer Attrition Since September 11, 2001

Ninth National GP Worklife Survey 2017

Organizational and System Factors the Influence NP Patient Panel Size in Primary Care

Residential aged care funding reform

PA Education Worldwide

Thank you for joining us today!

WHITE PAPER. NCQA Accreditation of Accountable Care Organizations

Post-retirement intentions of nurses and midwives living and working in the Northern Territory of Australia

A REVIEW OF NURSING HOME RESIDENT CHARACTERISTICS IN OHIO: TRACKING CHANGES FROM

Ontario s Family Health Teams. Comprehensive Interprofessional Family Patient-Centred Health Care Team

PATIENT ATTRIBUTION WHITE PAPER

2006 SURVEY OF ORTHOPAEDIC SURGEONS IN ONTARIO

Update on ACG Guidelines Stephen B. Hanauer, MD President American College of Gastroenterology

Incentive-Based Primary Care: Cost and Utilization Analysis

Foundation for New Jersey Healthcare Transformation The Patient Centered Medical Home the Future

Medicare Quality Payment Program: Deep Dive FAQs for 2017 Performance Year Hospital-Employed Physicians

Report on the Pilot Survey on Obtaining Occupational Exposure Data in Interventional Cardiology

The effect of socioeconomic status on access to primary care: an audit study

Florida Post-Licensure Registered Nurse Education: Academic Year

Are You Undermining Your Patient Experience Strategy?

Report on the APNA National Psychiatric Mental Health Advanced Practice Registered Nurse Survey

Final Report No. 101 April Trends in Skilled Nursing Facility and Swing Bed Use in Rural Areas Following the Medicare Modernization Act of 2003

Using An APCD to Inform Healthcare Policy, Strategy, and Consumer Choice. Maine s Experience

Secondary Care. Chapter 14

Cause of death in intensive care patients within 2 years of discharge from hospital

2018 Capitation Rate in Ukraine

Dietitians of Canada (Ontario) Response to. The Health Professions Regulatory Advisory Council. Interprofessional Collaboration Discussion Guide

Physiotherapy outpatient services survey 2012

Briefing on Shaping Our Future urgent care work stream progress

NCQA WHITE PAPER. NCQA Accreditation of Accountable Care Organizations. Better Quality. Lower Cost. Coordinated Care

2013 Physician Inpatient/ Outpatient Revenue Survey

Medicare Spending and Rehospitalization for Chronically Ill Medicare Beneficiaries: Home Health Use Compared to Other Post-Acute Care Settings

AUSTRALIA S FUTURE HEALTH WORKFORCE Nurses Detailed Report

Case-mix Analysis Across Patient Populations and Boundaries: A Refined Classification System

Aging in Place: Do Older Americans Act Title III Services Reach Those Most Likely to Enter Nursing Homes? Nursing Home Predictors

The NMC register 31 MARCH 2018

How BC s Health System Matrix Project Met the Challenges of Health Data

community clinic case studies professional development

T he National Health Service (NHS) introduced the first

3.11. Physician Billing. Chapter 3 Section. 1.0 Summary. Ministry of Health and Long-Term Care

Transcription:

Identification of physicians providing comprehensive primary care in Ontario: a retrospective analysis using linked administrative data Susan E. Schultz MA MSc, Richard H. Glazier MD MPH Abstract Background: Given the changing landscape of primary care, there may be fewer primary care physicians available to provide a broad range of services to patients of all age groups and health conditions. We sought to identify physicians with comprehensive primary care practices in Ontario using administrative data, investigating how many and what proportion of primary care physicians provided comprehensive primary care and how this changed over time. Methods: We identified the pool of active primary care physicians in linked population-based databases for Ontario from 1992/93 to 14/15. After excluding those who saw patients fewer than 44 days per year, we identified physicians as providing comprehensive care if more than half of their services were for core primary care and if these services fell into at least 7 of 22 activity areas. Physicians with 50% or less of their services for core primary care but with more than 50% in a single location or type of service were identified as being in focused practice. Results: In 14/15, there were 12 891 physicians in the primary care pool: 1254 (9.7%) worked fewer than 44 days per year, 1619 (12.6%) were in focused practice, and 09 (7.8%) could not be classified. The proportion in comprehensive practice ranged from 67.5% to 74.9% between 1992/93 and 14/15, with a peak in 02/03 and relative stability from 09/ to 14/15. Over this period, there was an increase of 8.8% in population per comprehensive primary care physician. Interpretation: We found that just over two-thirds of primary care physicians provided comprehensive care in 14/15, which indicates that traditional estimates of the primary care physician workforce may be too high. Although implementation will vary by setting and available data, this approach is likely applicable elsewhere. Health human resource planning is challenging, given the need to project patient demand for service as well as the supply of different types of health care workers, their roles and their distribution in a jurisdiction. 1 Primary care physicians are among the most commonly visited health care providers in most developed countries, and it is important to understand how to balance supply with future demand. The Institute of Medicine definition of primary care is understood as the provision of integrated, accessible health care services by clinicians who are accountable for addressing a large majority of personal health care needs, developing a sustained partnership with patients and practicing in the context of family and community. 2 Primary care physicians roles are many. Past research has focused on urban rural and remote distribution of these physicians 3 and on roles across settings such as offices, homes, hospitals, delivery rooms, emergency departments and longterm care homes. 4 7 However, over the past 2 3 decades, there has been a well-documented exodus of primary care physicians from many roles outside of the primary care office. 4,5,7 In that context, comprehensiveness has also come to focus on the range of services provided within the office setting, where Competing interests: None declared. This article has been peer reviewed. Correspondence to: Richard Glazier, rick.glazier@ices.on.ca CMAJ Open 17. DOI:.9778/cmajo.170083 E856 CMAJ OPEN, 5(4) 17 Joule Inc. or its licensors

some primary care physicians limit their practice to services such as psychotherapy or sports medicine, with several focused areas of practice supported by professional bodies. 8 Although these services are needed, there may consequently be fewer primary care physicians available to provide a broad range of services to patients of all age groups and health conditions. Health care planners need to take these patterns of care provision into account. Given the changing landscape of primary care, we propose an empirical approach to the definition of comprehensive primary care using administrative data. We could not rely on previous definitions as they focused only on settings 7 or depended on self-reported services or coding limited to specific payers and not available for the entire population. 6 We investigated how many and what proportion of primary care physicians in Ontario provided comprehensive primary care and how this changed over time. We also sought to investigate what roles physicians who did not provide comprehensive primary care played. Methods Data sources We carried out this study using data sets that were linked with the use of unique, encoded identifiers and analyzed at the Institute for Clinical Evaluative Sciences. The Ontario Health Insurance Plan (OHIP) is a database of physician billings and shadow-billings based on the fee-for-service model. Shadow billings are submitted by physicians paid through alternative funding arrangements for which they may receive incentives of % 30% of the full fee. The OHIP Corporate Provider Database provides physician characteristics, including affiliation with a primary care patient enrolment model. In Ontario, these models represent types of patient-centred medical homes with the common characteristics of blended payments, formal patient enrolment, and incentives and bonuses for preventive care and chronic disease management. 9 The Institute for Clinical Evaluative Sciences Physician Database comprises information from the Ontario Physician Human Resource Data Centre, the OHIP Corporate Provider Database and OHIP billings. We used it to determine physician specialty and active status. Definitions Pool of primary care physicians The process of identifying primary care physicians in comprehensive practice began with defining the pool of primary care physicians. Using the specialty information available in Institute for Clinical Evaluative Sciences administrative data, we determined that the primary care pool included 1) all physicians whose self-reported specialty was general practitioner or family physician plus 2) those whose self-reported specialty was not general practitioner/family physician but whose functional specialty, that is, their practice pattern as defined by their fee-for-service billings, most closely matched those of a general practitioner/family physician. Also included with this latter group were specialists with full-time affiliation with a patient enrolment model. Other specialists such as general internists or gynecologists were not included, as previous work showed that they do not provide primary care in Ontario. Core primary care services and activity areas To identify comprehensive primary care practice, we began by examining the pattern of billing by primary care physicians in order to identify core primary care services. We set 2 criteria that a billing code had to meet to be included in the list of core primary care services for a given year: 1) 80% or more of all billings for that code had to be submitted by physicians in the primary care pool and 2) total primary care billings for the code had to represent at least 0.1% of all billings by primary care physicians for that year. This represents 70% 80% of all services provided by primary care physicians, depending on the year. A separate list was generated for each year from 1992/93 to 14/15, usually consisting of 30 40 billing codes. The combined list for all years can be found in Appendix 1 (available at www.cmajopen.ca/content/5/4/e856/suppl/dc1). Twenty-three billing codes were included in every year. A further 45 billing codes were included in some years but not others, generally because they were new or had been discontinued. A physician billing more than 50% for core primary care services could still be providing a narrow range of services and thus not be truly providing comprehensive care. To address this issue, we grouped core primary care services into 22 activity areas. Codes that could not be classified were excluded. These areas are roughly comparable to both those developed by the American Board of Family Medicine, which were derived from Medicare claims, 6 and those reported by Canadian primary care physicians, 11 but in this case they reflect billing codes and patterns in Ontario. Comprehensiveness threshold Finally, it was necessary to define a threshold for number of activity areas necessary for a physician to be considered to be providing comprehensive primary care. We plotted the proportion of physicians with billings in each activity area according to their total number of activity areas. Figure 1 shows the results for the most common service-related activity areas plus the 4 location-related activity areas across all years. A minimum threshold of 7 activity areas was chosen. It would be unlikely for a physician to be practising in a limited range of venues (e.g., hospitalists) or providing a narrow range of services (e.g., general practitioner psychotherapists) and meet the threshold of 7 activity areas. The detailed steps for identifying physicians in comprehensive primary care practice are found in Appendix 2 (available at www.cmajopen.ca/content/5/4/e856/suppl/dc1). Ethics approval The Ethics Board of Sunnybrook Health Sciences Centre approved this study. CMAJ OPEN, 5(4) E857

0 90 80 % of physicians in group 70 60 50 40 30 1 (9432) 2 (7222) 3 (7176) 4 (7156) 5 (6540) 6 (5662) 7 (65) 8 (8088) 9 (11 686) (18 8) 11 (26 538) 12 (39 364) 13 (52 722) 14 (64 270) No. of activity areas (no. of physicians in group) 15 (64 970) 16 (49 464) 17 (28 832) 18 (14 816) 19 (4496) (494) Intermediate assessment Minor assessment Mental health/addiction General assessment Injection Immunization Papanicolaou smear Periodioc health examination Allergy shots Anticoagulant therapy House call Hospital Emergency department Long-term care Figure 1: Proportion of primary care physicians with billings in selected activity areas, grouped by total number of primary care activity areas. Blue vertical line represents minimum threshold of activity areas necessary for a physician to be considered to be providing comprehensive primary care. Results In addition to tracing the decision pathway used to define physicians providing comprehensive primary care, Figure 2 shows the number of physicians who met or did not meet the criteria at each step in 14/15, distinguishing between those in medical home models (patient enrolment model) and those who were not. A total of 29 467 physicians were active at the beginning of 14/15. The initial primary care pool consisted of 12 891 physicians who were general practitioners/family physicians by either self-report or functional specialty plus 149 specialists with full-time affiliation with patient enrolment model. Of the 12 891 general practitioners/family physicians, 1254 (9.7%) were excluded because they had not worked the minimum 44 days during the year, and a further 2252 (17.5%) did not have more than 50% of their services defined as core primary care, leaving 9385 general practitioners/family physicians. The core primary care billings fell into 7 or more activity areas for 8828 (68.5%) of the 12 891 general practitioners/family physicians, representing the total number of primary care physicians in comprehensive practice in 14/15. After checking for focused practice, we found that 1619 (57.6%) of the remaining 2809 physicians met this definition; the remainder did not meet any of our thresholds. Figure 3 and Appendix 3 (available at www.cmajopen.ca/ content/5/4/e856/suppl/dc1) show how the distribution of active physicians by type and year changed between 1992/93 and 14/15. The proportion in comprehensive practice ranged from 67.5% to 74.9% over the study period, with a peak in 02/03 and relative stability from 09/ to E858 CMAJ OPEN, 5(4)

Ontario physicians active Apr. 1, 14 Mar. 31, 15 n = 29 467 Self-reported specialty GP/ FP* n = 12 742 Self-reported specialty not GP/FP n = 16 725 Functional specialty GP/FP n = 12 718 Functional specialty not GP/FP n = 24 Functional specialty GP/FP n = 0 Functional specialty not GP/FP n = 16 725 Primary care pool n = 12 891 PEM n = 81 Non-PEM n = 4781 In PEM* n = 149 Not in PEM n = 16 576 Worked < 44 d n = 1254 PEM n = 125 Non-PEM n = 1129 Worked 44 d n = 11 637 PEM n = 7985 Non-PEM n = 3652 > 50% services or payments for core primary care n = 9385 PEM n = 7094 Non-PEM n = 2291 50% of services or payments for core primary care n = 2252 PEM n = 891 Non-PEM n = 1361 Billings in 7 activity areas n = 8828 Billings in < 7 activity areas n = 557 Not in focused practice n = 09 In focused practice n = 1243 PEM n = 7064 Non-PEM n = 1764 PEM n = 30 Non-PEM n = 527 PEM n = 506 Non-PEM n = 503 PEM n = 385 Non-PEM n = 858 Comprehensive primary care n = 8828 PEM n = 7064 Non-PEM n = 1764 Not in focused practice n = 181 PEM n = 16 Non-PEM n = 165 In focused practice n = 376 PEM n = 14 Non-PEM n = 362 Not comprehensive and not focused practice n = 1190 PEM n = 522 Non-PEM n = 668 GPs/FPs in focused practice n = 1619 PEM n = 399 Non-PEM n = 12 Psychotherapy n = 248 Hospital n = 525 Surgery n = 149 Emergency department Anesthesiology n = 123 n = 338 Multiple/other n = 79 Long-term care n = 49 Figure 2: Flow diagram showing identification of physicians providing comprehensive primary care. *Primary care pool. Note: GP/FP = general practitioner/family physician, PEM = patient enrolment model. CMAJ OPEN, 5(4) E859

0 90 80 70 736 26 403 711 2485 346 712 22 329 336 14 758 337 1935 745 356 70 732 334 1758 691 334 1668 707 328 1647 800 351 1616 755 349 1551 778 388 1608 806 429 1641 821 444 1632 938 493 16 988 611 1636 12 653 1737 1130 767 1596 1278 886 1671 1196 970 1642 1300 1135 1213 1414 1318 1211 1511 1190 1254 1619 No. of physicians 60 50 40 30 7427 7562 7626 7574 7633 7629 7618 7641 7894 7922 8002 8096 8111 8169 8138 8025 8078 8147 8184 8234 8268 8376 8828 0 1992/93 1993/94 1994/95 1995/96 1996/97 1997/98 1998/99 1999/00 00/01 01/02 02/03 03/04 04/05 05/06 Year 06/07 07/08 08/09 09/ /11 11/12 12/13 Comprehensive primary care Focused practice Worked < 44 d Other 13/14 14/15 Figure 3: Distribution of primary care physicians by practice type, Ontario, 1992/93 14/15. 14/15, at or slightly below 70%. Of note, the primary care pool itself as a proportion of all active Ontario physicians declined from 51.9% to 43.7% over the study period. Although the total number of active physicians in Ontario increased by 39.8%, most of this increase was among specialists, whose numbers increased by 63.3%, compared to 17.9% for the primary care pool and 18.9% for those in comprehensive primary care practice. The population per active physician decreased by 7.4%, whereas there was an increase of 8.8% in population per comprehensive primary care physician. The proportion who worked fewer than 44 days during the year declined over time, whereas the proportion in focused practice and Other groups increased. The distribution of primary care physicians by practice type and age group for 3 selected years (1993/94, 03/04 and 13/14) is shown in Figure 4. Between 1993/94 and 13/14, the proportion of physicians aged less than 40 years declined, from 45.3% to 23.5%, whereas the proportion older than 60 grew, from 13.7% to 26.6% (data not shown). The proportion in comprehensive practice fluctuated over time in each age group but was generally lower in 13/14 than in the other 2 years, whereas the proportion in focused practice increased in all age groups. Figure 5 shows the distribution by practice type and sex in 1993/94, 03/04 and 13/14. The proportion of physicians who provided comprehensive care was nearly identical for men and women across all 3 years. However, there tended to be a higher proportion of women working fewer than 44 days in the year and a higher proportion of men in focused practice. For both sexes, the proportion in focused practice increased over time. Interpretation This study s major contribution is its attempt to categorize primary care physicians according to whether they provide comprehensive care. We found that, in a large Canadian single-payer setting, just over two-thirds of primary care physicians provided comprehensive care, a proportion that declined from about 75% after 03/04. The main implication of these results is for health human resources planning, as a head-count approach to planning 1 would have E860 CMAJ OPEN, 5(4)

0 90 80 70 7 87 67 82 321 190 1423 172 328 127 284 129 75 123 5 84 450 373 288 387 197 174 259 175 347 358 338 275 183 189 440 399 332 347 339 493 % of physicians 60 50 40 30 37 2378 1122 949 1979 2597 2250 1269 1680 29 2419 2248 0 < 40 40 49 50 59 60 < 40 40 49 50 59 60 < 40 40 49 50 59 60 1993/94 03/04 13/14 Year; age, yr Comprehensive primary care practice Focused practice Worked < 44 d Other Figure 4: Distribution of primary care physicians by practice type and age group, 1993/94, 03/04 and 13/14. overestimated physician capacity to provide comprehensive primary care by about a third in our setting. Many physicians who would traditionally be counted in primary care were in fact in focused practice such as hospitalist care, emergency medicine or psychotherapy, and a substantial proportion were relatively inactive. We also found similar growth over time in the overall primary care pool and in physicians providing comprehensive primary care, with both groups lagging behind the overall increase in physician supply, which was largely driven by specialists. Despite an increase in physician numbers, population growth has meant that the availability of physicians providing comprehensive primary care to the Ontario population declined substantially over time. Comprehensiveness is an imprecise concept in primary care, given the broad range of care provided in community and institutional settings and increasingly by telephone, email and other electronic means. Not surprisingly, numerous methods have been used to define and measure comprehensiveness that have focused on settings of care, 7 types of care provided 12 14 or a mix of settings, types of care and procedures. 6 Comprehensiveness can also be measured from a number of perspectives, including provider report, patient report and administrative claims. Each of these methods has strengths but also methodological shortcomings, 11,12,14 16 and data derived from different perspectives may not correlate well. 6,15,16 Nonetheless, measurement from different perspectives has had similar relations with outcomes. 6 Although challenging to measure, comprehensiveness of care is a cornerstone of primary care provision 17,18 and has been shown to be associated with decreased health costs and hospital admissions. 6 The activity areas used in this paper included locations of care such as the hospital and the patient s home, but most related to the scope of office-based care. A decrease in primary care physician roles outside of the primary care office in the last 2 3 decades has been reported. 4,5,7 Office-based care also relates strongly to the concept of the Triple Aim of enhancing patient experience, improving population health and reducing costs, 19 as well as to the Patient-Centered Medical Home in the United States and the Patient s Medical Home in Canada. 21 Quality-improvement efforts in primary care also tend to be focused on office redesign and organization of health care teams in office settings. 19 CMAJ OPEN, 5(4) E861

% of physicians 0 67 274 9 277 90 678 1456 623 850 80 2 585 544 165 70 60 50 40 26 5428 2793 5296 30 578 740 570 623 544 967 3714 4662 0 Female Male Female Male Female Male 1993/94 03/04 13/14 Year; sex Comprehensive primary care practice Focused practice Worked < 44 d Other Figure 5: Distribution of primary care physicians by practice type and sex, Ontario, 1993/94, 03/04, 13/14. Limitations This study used population-based data from a large singlepayer jurisdiction and has the strength of being relatively complete for physician billing claims and population coverage. Nonetheless, administrative data such as these have several important limitations. In this setting, claims data cover only the permanent resident population of Ontario, and, as such, some recent immigrants and refugees, temporary visitors and those without documentation of their residency status may have been missed. The available data also did not include primary care nurse practitioners or physician assistants, nor did they include physicians at community health centres, who are salaried and provide primary care to about 2% of Ontario s population. 22 In addition, the data did not include most patient contacts by telephone, email or other electronic means, as billing codes do not exist for most of these services. Diagnostic coding in administrative data has been shown to be inadequate for measuring comprehensiveness. 15 For that reason, we chose to establish primary care activity areas using fee codes that are expected to be fairly complete, as they are the basis for physician payment. The 22 activity areas used in this research were developed with the use of Ontario s core primary care fee codes, and, although this approach is likely applicable elsewhere, the details of coding and claims data would need to be adapted to other settings. Our approach classified primary care physicians as providing or not providing comprehensive care, in contrast to the use of scales or scores. 6,12,16 This dichotomous approach was designed to inform health human resource planning but did not include part-time comprehensive care provided by physicians who spend their time in multiple settings and may therefore have underestimated the total amount of comprehensive care. Conclusion We found that just over two-thirds of Ontario primary care physicians provided comprehensive care in 14/15 and that this proportion declined slightly over the previous decade, along with a substantial decline in the availability of primary care physicians in comprehensive practice to the growing Ontario population. The implication of these findings for health human resource planning is that traditional primary care estimates may be too high if the goal is to provide comprehensive primary care. Further analyses would be valuable for establishing the supply of providers of comprehensive primary care, including interprofessional team members, in E862 CMAJ OPEN, 5(4)

relation to population health needs and for understanding the applicability of our approach using linked administrative data to other jurisdictions. We conclude that it is feasible to identify which primary care physicians provide comprehensive primary care and that the findings are likely to be of value in health human resource planning for population needs. References 1. Physicians in Canada, 14: summary report. Ottawa: Canadian Institute for Health Information; 15. Available: https://secure.cihi.ca/free_products/ Summary-PhysiciansInCanadaReport14_EN-web.pdf (accessed 17 Nov. 1). 2. Donaldson M, Yordy K, Vanselow N. Defining primary care: an interim report. Washington: National Academy Press; 1994. Available: https://www. nap.edu/read/9153/chapter/1 (accessed 17 Nov. 1). 3. Viscomi M, Larkins S, Gupta TS. Recruitment and retention of general practitioners in rural Canada and Australia: a review of the literature. Can J Rural Med 13;18:13-23. 4. Petterson S, Peterson L, Phillips RL, et al. One in fifteen family physicians principally provide emergency or urgent care. J Am Board Fam Med 14;27: 447-8. 5. Rayburn WF, Petterson SM, Phillips RL. Trends in family physicians performing deliveries, 03. Birth 14;41:26-32. 6. Bazemore A, Petterson S, Peterson LE, et al. More comprehensive care among family physicians is associated with lower costs and fewer hospitalizations. Ann Fam Med 15;13:6-13. 7. Chan BT. The declining comprehensiveness of primary care. CMAJ 02;166: 429-34. 8. Section of communities of practice in family medicine. Toronto: College of Family Physicians of Canada; 15. Available: www.cfpc.ca/cpfm/ (accessed 17 May 27). 9. Hutchison B, Glazier R. Ontario s primary care reforms have transformed the local care landscape, but a plan is needed for ongoing improvement. Health Aff (Millwood) 13;32:695-703.. Manuel DG, Maaten S, Thiruchelvam D, et al. Primary care in the health care system. In: Jaakkimainen L, Upshur REG, Klein-Geltink JE, et al., editors. Primary care in Ontario: ICES atlas. Toronto: Institute for Clinical Evaluative Sciences; 06. Available: https://www.ices.on.ca/flip-publication/primary -care-06/files/assets/basic-html/index.html#1 (accessed 17 Nov. 1). 11. Wong E, Stewart M. Predicting the scope of practice of family physicians. Can Fam Physician ;56:e219-25. 12. Ie K, Ichikawa S, Takemura YC. Development of a questionnaire to measure primary care physicians scope of practice. BMC Fam Pract 15;16:161. 13. Bazemore AW, Petterson S, Johnson N, et al. What services do family physicians provide in a time of primary care transition? J Am Board Fam Med 11; 24: 635-6. 14. Shi L, Starfield B, Xu J. Validating the Adult Primary Care Assessment Tool. J Fam Pract 01;50:61W-75W. 15. Katz A, Halas G, Dillon M, et al. Describing the content of primary care: limitations of Canadian billing data. BMC Fam Pract 12;13:7. 16. Haggerty JL, Beaulieu MD, Pineault R, et al. Comprehensiveness of care from the patient perspective: comparison of primary healthcare evaluation instruments. Healthc Policy 11;7:154-66. 17. Starfield B. Primary care: balancing health needs, services and technology. New York: Oxford University Press; 1998. 18. Bodenheimer T, Ghorob A, Willard-Grace R, et al. The building blocks of high-performing primary care. Ann Fam Med 14;12:166-71. 19. Triple Aim for populations. Toronto: Institute for Healthcare Improvement; 15. Available: www.ihi.org/topics/tripleaim/pages/default.aspx (accessed 17 May 27).. The patient-centered medical home (PCMH). Leawood (KS): American Academy of Family Physicians; 16. Available: www.aafp.org/practice-management/ transformation/pcmh.html (accessed 17 May 27). 21. A vision for Canada: family practice the patient s medical home. Mississauga (ON): College of Family Physicians of Canada; 11. Available: www.cfpc. ca/a_vision_for_canada_family_practice_11/ (accessed 17 May 27). 22. Glazier RH, Rayner J, Kopp A. Examining community health centres according to geography and priority populations served, 11/12 to 12/13: an ICES chartbook. Toronto: Institute for Clinical Evaluative Sciences; 15. Available: https://www.ices.on.ca/publications/atlases-and-reports/15/ Examining-Community-Health-Centres (accessed 17 Nov. 1). Affiliations: Institute for Clinical Evaluative Sciences (Schultz, Glazier); Department of Family and Community Medicine (Glazier), University of Toronto and St. Michael s Hospital, Toronto, Ont. Contributors: Susan Schultz was primarily responsible for data analysis. Both authors contributed to the study conception and design, and interpretation of the data, drafted the manuscript, revised the manuscript critically for important intellectual content, gave final approval of the version to be published and agreed to be accountable for all aspects of the work. Funding: Richard Glazier is supported as a Clinical Scientist in the Department of Family and Community Medicine at the University of Toronto and at St. Michael s Hospital. Disclaimer: This study was supported by the Institute for Clinical Evaluative Sciences (ICES), which is funded by an annual grant from the Ontario Ministry of Health and Long-Term Care (MOHLTC). The opinions, results and conclusions reported in this article are those of the authors and are independent from the funding sources. No endorsement by the ICES or the MOHLTC is intended or should be inferred. Supplemental information: For reviewer comments and the original submission of this manuscript, please see www.cmajopen.ca/content/5/4/ E856/suppl/DC1. CMAJ OPEN, 5(4) E863