The association between patients’ timely access to their usual primary care physician and use of walk-in clinics in Ontario, Canada: a cross-sectional study ============================================================================================================================================================== * Bahram Rahman * Andrew P. Costa * Anastasia Gayowsky * Ahmad Rahim * Tara Kiran * Noah Ivers * David Price * Aaron Jones * Lauren Lapointe-Shaw ## Abstract **Background:** Challenges in timely access to one’s usual primary care physician and the ongoing use of walk-in clinics have been major health policy issues in Ontario for over a decade. We sought to determine the association between patient-reported timely access to their usual primary care physician or clinic and their use of walk-in clinics. **Methods:** We conducted a cross-sectional study of Ontario residents who had a primary care physician by linking population-based administrative data to Ontario’s Health Care Experience Survey, collected between 2013 and 2020. We described sociodemographic characteristics and health care use for users of walk-in clinics and nonusers. We measured the adjusted association between self-reported same-day or next-day access and after-hours access to usual primary care physicians or clinics and the use of walk-in clinics in the previous 12 months. **Results:** Of the 60 935 total responses from people who had a primary care physician, 16 166 (weighted 28.6%, unweighted 26.5%) reported visiting a walk-in clinic in the previous 12 months. Compared with nonusers, those who used walk-in clinics were predominantly younger, lived in large and medium-sized urban areas and reported a tight, very tight or poor financial situation. Respondents who reported poor same-day or next-day access to their primary care physician or clinic were more likely to report having attended a walk-in clinic in the previous 12 months than those with better access (adjusted odds ratio [OR] 1.23, 95% confidence interval [Cl] 1.13–1.34). Those who reported being unaware that their primary care physician offered after-hours care had a higher likelihood of going to a walk-in clinic (adjusted OR 1.14, 95% Cl 1.07–1.21). **Interpretation:** In this population-based health survey, patient-reported use of walk-in clinics was associated with a reported lack of access to same-day or next-day care and unawareness of after-hours care by respondents’ usual primary care physicians. These findings could inform policies to improve access to primary care, while preserving care continuity. Walk-in clinics have been a part of Canada’s health care systems for more than 4 decades, functioning on a fee-for-service basis and providing episodic care.1,2 These clinics provide services without an appointment to patients who are typically not known to the physician or clinic.3 Since 2003, a series of reforms to primary care funding were implemented to improve access, comprehensiveness, and continuity of primary care in Ontario, Canada’s most populous province.4,5 However, walk-in clinics were left unchanged.6 It is estimated that 30% of Ontario residents visit a walk-in clinic every year, even though 94% of them have a primary care provider.7 In Ontario, walk-in clinic physicians most often work in a fee-for-service model, which incentivizes high-volume, episodic care.8,9 Walk-in clinics have been criticized for reducing continuity of care, which is associated with greater patient satisfaction and better clinical outcomes.9,10 Research of patterns of walk-in clinic use in Ontario has been limited as walk-in clinic encounters are not uniquely identifiable in the health administrative billing system.11,12 In 2012, Ontario launched the Health Care Experience Survey (HCES) to capture patients’ experiences with different aspects of the health care system, including timely access to care, use of walk-in clinics, ability to get a referral to a specialist when needed and integration of care across the health care system.13,14 Since its launch, the survey has been widely used by Ontario’s health care sector14 and has opened new research opportunities in primary care.15–18 Previously reported factors that contribute to patients’ use of walk-in clinics instead of their usual primary care physician include a lack of access to their enrolled physician, the convenience of walk-in clinics, the perceived urgency of health conditions and a desire to be assessed within the same day.19–25 However, earlier studies had limitations such as small or convenience sampling and exclusion of the patient’s perspective, and most were conducted before Ontario’s primary care reforms. The lack of population-based research has left a substantial gap in understanding the function and impact of walk-in clinics in Ontario. We sought to determine whether an association exists between patient-reported measures of timely access to their primary care physician and their use of walk-in clinics in the previous 12 months. We hypothesized a priori that lack of same-day or next-day access and after-hours access to one’s own primary care physician or clinic would be associated with a greater use of walk-in clinics. ## Methods ### Study design and setting We conducted a cross-sectional study of Ontario residents who had a primary care physician by linking population-based administrative data to Ontario’s HCES, collected between 2013 and 2020. These data sets were linked using unique encoded identifiers and analyzed at ICES. Ontario had more than 14.5 million residents in 2019 and is the most populous province in Canada.26 Primary care in Ontario is publicly funded and, in most cases, delivered by private physician practices through different payment models. Patients insured by the Ontario Health Insurance Plan (OHIP) are not charged for seeing a primary care physician or for using a walk-in clinic; these services are entirely publicly funded. More than 81% of the population is formally enrolled with a primary care physician practising in a primary care enrolment model.27 The remaining population receives care from fee-for-service primary care physicians, salaried primary care physicians or nurse practitioner–led clinics, or are unattached. 27 Primary care enrolment models combine formal patient registration and blended funding that consists of a varying proportion of capitation payments and bonuses for meeting preventive care targets, as well as contractual obligations and financial incentives to provide after-hours coverage to enrolled patients.5,27 Physician practices with capitated payment models also receive an access bonus, which is reduced if patients visit a physician outside the enrolling group.5,16,27 ### Data sources and study population The HCES is a large cross-sectional population-based survey of Ontario residents created by the Ministries of Health and Long-Term Care.13,14 It was implemented by the Institute for Social Research at York University and has been active from 2012 to the present.13,14 The survey design, including questions and target population, was informed by an earlier provincial survey called the Primary Care Access Survey (2006–2011), as well as the Commonwealth Fund’s International Health Policy Survey of the General Population and the Canadian Community Health Survey, to ensure comparability. 13 Before implementation, the HCES was piloted between October 2012 and December 2012, and expert panels were consulted throughout the implementation process.13 The HCES is voluntary and administered by telephone (cellphone or landline) in English or French to a target population aged 16 years and older living in private dwellings in Ontario.13,14 The survey’s total sample size is 11 200 each year, selected from the Registered Persons Database (RPDB) by a multistage, stratified design of all current and previous health plan registrants in Ontario, and is collected in 3-month waves.13 The province is divided into 76 strata and households are randomly selected from each stratum; 1 respondent is randomly selected from each household. Once a household has been sampled, they are removed from the sampling frame for 2 years.13 People living in institutions and households without telephones are excluded from the survey.13 The overall response rate was 47.3% for our study period and ranged from 29% to 54% in each survey year.13 Our study population included all individuals surveyed from wave 2, January 2013 (the first complete survey wave after the pilot) to wave 29, February 2020 (the last survey wave before pausing because of COVID-19). We excluded those younger than 16 years, those who were uninsured by OHIP, those who reported not having a primary care provider and those who could not be linked to a primary care physician using health administrative data on Apr. 1 of the interview year. We restricted the study population to those who responded either yes or no to the question, “Have you been to a walk-in clinic because you were sick or for a health-related problem in the last 12 months?” and excluded those who responded that they did not know or who refused to answer. ### Outcome Our primary outcome was a response of yes to the question, “Have you been to a walk-in clinic because you were sick or for a health-related problem in the last 12 months?”. The survey clarified, “We do not mean a drop-in or walk-in clinic that is offered by your provider’s practice. We are only asking about separate walk-in clinics that your provider is not affiliated with.”13 ### Access measures The key variables of interest were responses to the questions related to timely access, namely, “How many days did it take from when you first tried to see your provider to when you actually saw him/her or someone else in the office?” and “Not including hospital emergency departments, does your provider have an after-hours clinic where patients can be seen by or talk to a doctor or nurse when the practice is closed?” Given the survey design, a response to the question on same-day or next-day access question is conditional on a yes answer to the questions, “Not counting yearly check-ups or monitoring of an ongoing health issue, in the last 12 months did you want to see a doctor because you were sick or were concerned that you had a health problem?” and “Did you actually see your provider?” We categorized respondents into groups as those who saw their physician or clinic in less than 2 days (had same-day or next-day access), those who saw their physician or clinic in 2 or more days (did not have same-day or next-day access), those who wanted medical care but did not see their own primary care provider and not applicable (those who did not seek any medical care). We treated responses of “refused” and “I don’t know” as missing values. For the variable on after-hours access, we coded responses of “don’t know” together with “no,” to indicate a lack of knowledge of after-hours options. We treated responses of “refused” as missing values. ### Other variables We reported respondents’ age, sex, self-reported level of education and self-reported financial situation. We determined rurality using the Rurality Index for Ontario (large urban = 0, medium urban = 1–9, small urban = 10–39 and rural ≥ 40).16 We determined respondent’s multimorbidity (having ≥ 3 chronic conditions) at the time of the interview using a standard ICES algorithm28 (Appendix 1, Appendix A, available at [www.cmajopen.ca/content/11/5/E847/suppl/DC1](http://www.cmajopen.ca/content/11/5/E847/suppl/DC1)). We obtained respondents’ primary care model and usual primary care physician type — including formally enrolled and virtually rostered to the physician with the highest total value of fee-for-service billing claims for primary care services over the previous 2 years29,30 (Appendix 1, Appendix B) — from the ICES-derived Primary Care Population data set. We calculated the total number of visits to the usual primary care physician using physician billing data over the previous 2 years. We also included respondents’ self-reported attempts to call their primary care physician with a medical question or concern during the day on a Monday to Friday in the previous 12 months. For descriptive purposes only, we included the total number of visits to any primary care physician, the number of primary care visits to a physician outside the usual primary care physician, patient-reported quality of care received in walk-in clinics, whether their medical condition could have been managed by their primary care physician if they were available and respondents’ reported main reason for going to a walk-in clinic. The latter indicator was added to HCES in 2014 (present only for waves 6–29). The complete description of variables and data sources can be found in Appendix 1, Appendix C and Appendix D. ### Statistical analysis We compared demographic characteristics and primary care use of survey respondents who reported using walk-in clinics to those who did not use walk-in clinics within the previous 12 months using standardized mean differences (SMDs), with differences greater than 10% considered meaningful.31 For categorical variables, we reported raw counts and weighted proportions. We used a multivariable logistic regression model to test the association between patient-reported use of walk-in clinics and measures of timely access to a patient’s own primary care physician or clinic (same-day or next-day and after-hours). We used generalized estimating equations with an exchangeable correlation structure to account for clustering at the level of the enrolling physician. We adjusted for age, sex, self-reported education, self-reported financial situation, rurality, multimorbidity, patients’ attempt to call their primary care physician or clinic during office hours (Monday to Friday), patients’ type of primary care model and the number of primary care visits to their usual primary care physician within the previous 2 years. We reported the results as adjusted odds ratios (ORs) with 95% confidence intervals (CIs). We weighted all results using the sampling weight determined during the implementation of the survey. We considered a 2-tailed *p* value of less than 0.05 significant. We conducted all analysis using SAS Enterprise Guide software, version 7.1. ### Subgroup analysis Given that most walk-in clinics in Ontario are in urban areas,12,32 we analyzed the subgroup of respondents living in large and medium urban areas (Rurality Index for Ontario score 0–9). We then stratified results by respondents’ sex and type of primary care enrolment model to further evaluate whether this affected the relationship between access indicators and self-reported use of walk-in clinics. We conducted sensitivity analyses (best–worst method) to assess the impact of missing values for the variables of same-day or next-day care and after-hours care and whether the results from the waves with the lowest response rates (waves 28 and 29) were in concordance with our entire sample. ### Ethics approval The use of data in this study was authorized under section 45 of Ontario’s *Personal Health Information Protection Act, 2004* and did not require ethics review board approval. ## Results After exclusions (Figure 1), we included 60 935 responses (60 430 unique respondents and 505 respondents who were sampled twice) in this study. We treated the repeated responses as unique individuals within the cohort for analysis. In the cohort, 56.9% (*n* = 35 633) were female and the mean age was 53.9 (standard deviation 17.3) years; 40.2% (*n* = 20 915) of the respondents lived in large urban areas and 26.7% (*n* = 15 906) lived in medium urban areas (Table 1). ![Figure 1:](http://www.cmajopen.ca/https://www.cmajopen.ca/content/cmajo/11/5/E847/F1.medium.gif) [Figure 1:](http://www.cmajopen.ca/content/11/5/E847/F1) Figure 1: Inclusion and exclusion criteria for the study cohort. Note: HCES = Health Care Experience Survey, OHIP = Ontario Health Insurance Plan, PCPOP = Primary Care Population. View this table: [Table 1:](http://www.cmajopen.ca/content/11/5/E847/T1) Table 1: Cohort baseline characteristics Overall, 28.6% (*n* = 16 166) of the cohort had visited a walk-in clinic within the previous 12 months, which gradually declined over the years (the highest being 31.3% in 2013 and the lowest being 24.7% in 2020) (Appendix 1, Appendix E). Compared with nonusers, walk-in users were more often young adults (38.9% v. 21.8% respondents aged 16–39 yr, SMD 0.37), lived in large (44.5% v. 38.5%, SMD 0.12) and medium urban areas (35.2% v. 23.2%, SMD 0.27) and reported tight, very tight or poor financial situations (22.7% v. 18.8%, SMD 0.1). A lower proportion of walk-in users reported same-day or next-day access to their primary care physician or clinic when sick (36.9% v. 40.3, SMD 0.08), compared with nonusers. More walk-in users reported that their primary care physician did not offer an after-hours clinic (62.9% v. 57.3%, SMD 0.11) (Table 2). View this table: [Table 2:](http://www.cmajopen.ca/content/11/5/E847/T2) Table 2: Descriptive comparison of those who did and did not report using a walk-in clinic in the previous 12 months Among walk-in users, 50.8% (*n* = 6970) stated that their main reason for going to a walk-in clinic was that their primary care provider was unavailable or that they could not get an appointment with their provider. Another 23.1% (*n* = 3196) reported that it was faster to go to the walk-in clinic, and 18.3% (*n* = 2339) reported that the walk-in clinic was closer to them. Most walk-in users (*n* = 14 511, 89.9%), reported that their last walk-in visit was for a condition that could have been treated by their primary care provider, if they had been available. Only 6.9% (*n* = 1053) of walk-in clinic users reported that the care they received in a walk-in clinic was poor (Table 1). ### Association of self-reported access and walk-in use We found that respondents who wanted medical care but did not see their own physician or clinic had a much greater likelihood of going to a walk-in clinic than those with same-day or next-day access (adjusted OR 2.77, 95% Cl 2.49–3.09). Respondents who reported that it took 2 days or more to access their primary care physician or clinic also had a higher likelihood of going to a walk-in clinic than those who had same-day or next-day access (adjusted OR 1.23, 95% Cl 1.13–1.34). Those who reported that their primary care physician or clinic did not offer an after-hours clinic were similarly more likely to report attending a walk-in clinic (adjusted OR 1.14, 95% Cl 1.07–1.21). Respondents with a tight, very tight or poor financial situation had a higher likelihood of going to a walk-in clinic than those who reported a very comfortable financial situation (adjusted OR 1.22, 95% Cl 1.11–1.35). Those with a high school education had a lower likelihood of going to a walk-in clinic than those with graduate or professional degrees (adjusted OR 0.84, 95% Cl 0.75–0.94). Respondents enrolled in a team capitation model had the lowest likelihood of going to a walk-in clinic, compared with those in other patient enrolment models. Finally, respondents living in medium-sized urban areas had a higher likelihood of using a walk-in clinic than those living in larger urban, small urban and remote areas (Table 3). View this table: [Table 3:](http://www.cmajopen.ca/content/11/5/E847/T3) Table 3: Unadjusted and adjusted measures of association between self-reported walk-in use and other variables (*n* = 56 297)* ### Subgroup analysis: residents of large and medium urban areas The subgroup that resided in large or medium urban areas included 36 821 participants (66.9% of the total sample). In this subgroup, respondents who did not see their primary care physician or clinic (adjusted OR 3.01, 95% CI 2.64–3.44) or who waited 2 or more days to see their primary care physician or clinic (adjusted OR 1.25, 95% Cl 1.13–1.38) had a higher likelihood of going to a walk-in clinic than those who had same-day or next-day access. Those who reported that their primary care physician did not offer an after-hours clinic also had a higher likelihood of going to a walk-in clinic (adjusted OR 1.23, 95% Cl 1.14–1.32) (Table 4). The association between access indicators and walk-in use was not statistically different for females and males (Appendix 1, Appendix F). View this table: [Table 4:](http://www.cmajopen.ca/content/11/5/E847/T4) Table 4: Association between measures of access and walk-in clinic use among residents of large and medium-sized urban areas (*n* = 34 110)* We found variability in self-reported measures of access across primary care model types, with the proportion that reported same-day or next-day access ranging from 38.4% in non-team capitation models to 46.6% in fee-for-service models; after-hours access ranged from 22.1% in fee-for-service models to 58.2% in team capitation models (Appendix 1, Appendix G). After stratifying by patient enrolment model, we found that in both capitation models (non-team and team), the likelihood of going to a walk-in clinic increased substantially for those who did not see their own physician or clinic or were unable to access their physician or clinic on the same day or next day, as well as for those who reported that their usual physician or clinic did not offer after-hours care. In contrast, there was no such relationship between same-or next-day access or after-hours care with walk-in use for respondents virtually enrolled to a fee-for-service model (Table 5). The results from the sensitivity analyses were also concordant with our main findings (Appendix 1, Appendix H and Appendix I). View this table: [Table 5:](http://www.cmajopen.ca/content/11/5/E847/T5) Table 5: Association between measures of access and walk-in clinic use, stratified by respondent’s primary care model, in large and medium-sized urban areas* ## Interpretation We evaluated 2 patient-reported measures of timely access and the use of walk-in clinics among Ontario residents who had a primary care physician. We found that patients who had poor same-day or next-day access to their primary care physician or clinic had a greater likelihood of having used a walk-in clinic in the previous 12 months. We also found that respondents who wanted medical care but did not see their own physician or clinic at all had a much greater likelihood of going to a walk-in clinic. This could reflect inability to reach clinic staff to make an appointment, excessive delay to an appointment or, if patients did not even attempt to connect with their usual primary care provider, choosing a walk-in clinic as their point of first contact. Most respondents reported that their physician did not offer after-hours care, and these people also had a higher likelihood of going to a walk-in clinic. In addition, we found that most walk-in clinic users were younger, lived in large-or medium-sized urban areas and reported a tight, very tight or poor financial situation. Our findings are aligned with previous studies that reported that the perception of physician unavailability led to a patient’s decision to go to a walk-in clinic or emergency department for services that could be managed by their primary care physician.1,2,21,22,25 Indeed, in our study, half of walkin users cited an inability to see their primary care provider as the main reason they chose to visit a walk-in clinic. Despite more than 81% of Ontario residents being enrolled in primary care enrolment models that are required to offer after-hours clinics (i.e., non-team capitation, team capitation and enhanced fee-for-service),5,27,33 we found that most respondents were unaware of whether their primary care physician offered after-hours care. In 2014/15, the Auditor General of Ontario reported that 60% of primary care physicians in capitated models and 36% in enhanced fee-for-service models failed to meet their contractual obligations to deliver after-hours care, highlighting a gap in policy implementation.34 We found that the relationship between timely access to primary care and walk-in clinic use differed according to the patient’s primary care model. Others have reported on the link between primary care models, geography and access to primary care.35–37 Financial penalties are built into team capitation and non-team capitation models to encourage physicians to offer after-hours access.5,16,27,33 Patients enrolled in these models report higher levels of after-hours access, but lower levels of same-or next-day access than patients enrolled in enhanced fee-for-service models.16 We found that reduced access of either type (after-hours or same-or next-day access) was associated with walk-in clinic use. Perceived lack of timely access to their usual primary care physician or clinic can contribute to a patient’s decision to use a walk-in clinic. Primary care physicians should be supported with improved mechanisms to manage patients’ access to their practice. This should be supplemented with improved monitoring and communication about after-hours clinic availability and patient education on which conditions require urgent assessment and which conditions can wait. Another policy suggestion is to connect walk-in clinics with patients’ regular source of primary care. Since greater distance to one’s primary care provider was the main reason for visiting a walk-in clinic for 18% of walk-in users in our study, primary care offices and partnering walk-in clinics would ideally be in close proximity, and responsible for the medical care of patients residing within the same neighbourhood. Tools such as integrated funding and information sharing between the patient’s usual primary care physician and the walk-in clinic could reduce duplication of services and improve continuity and quality of care. Canadian studies comparing the costs of health care delivery in walk-in versus other settings are lacking, and the results of an ongoing study will be informative in this regard.38 There is also a need for a registration process for walk-in clinics, which would make them identifiable in health administrative data. This would assist in accurately capturing all the services provided by walk-in physicians and, thereby, enable further research on patients’ continued use of walk-in clinics instead of their own primary care physicians. ### Limitations By using a population-based approach and multiyear patient-reported data, we have addressed many of the limitations of earlier studies. However, the survey design is limited to those households with a valid health insurance card, community dwellers and those with an active phone number. This could exclude refugees, people experiencing homelessness, those who are unable to speak English or French and some Indigenous peoples. Although survey results were weighted with the aim of representing the overall population, we cannot rule out the potential risk of non-response bias as the survey’s overall response rate was below 50%. We included only data before the COVID-19 pandemic in this study. With the expanded use of virtual care, there has been a major shift in how primary care is delivered in Ontario39–41 and more Ontario residents are reporting increasing difficulties accessing primary care.42 We suspect that this survey may underestimate the current use of walkin (either in-person or virtual) clinics.41 As with all survey studies, our findings are subject to recall bias (e.g., as shaped by patients’ previous health care experiences) and social desirability bias, with a resulting possible risk of misclassification. Further, perceived access to primary care is multifaceted and could be influenced by various factors, including patients’ behaviour and expectations, the quality of patients’ experiences with the broader health care system and geographic proximity of patients to a walk-in clinic or to their primary care physician, as well as other characteristics of the patient’s primary care physician and clinic. Many of these factors were not measurable using the existing health administrative data sets or the HCES; thus, they could not be included in this study. Our findings are generalizable to Ontario, a setting with a high level of primary care enrolment. 43 However, they may not reflect other contexts where most of the population has no regular source of primary care or settings without public health insurance to cover the cost of walk-in clinic visits. ### Conclusion Patients who reported being unable to see their primary care physician or clinic on the same day or next day and those who were unaware that their physician or clinic offered after-hours clinics were more likely to have visited a walk-in clinic in the previous year. Improved availability of same-day or next-day appointments and after-hours services in primary care may reduce unnecessary use of walk-in clinics. Findings from this study could inform future policies to integrate walk-in clinics into Ontario’s broader primary care system. ## Footnotes * **Competing interests:** None declared. * This article has been peer reviewed. * **Contributors:** Bahram Rahman, Andrew P. Costa and Lauren Lapointe-Shaw were responsible for the study concept and design. Bahram Rahman, Andrew P. Costa, Anastasia Gayowsky and Lauren Lapointe-Shaw were responsible for the acquisition of data. Bahram Rahman analyzed the data. Bahram Rahman, Andrew P. Costa, Tara Kiran, Noah Ivers, David Price, Aaron Jones and Lauren Lapointe-Shaw contributed to data interpretation. Bahram Rahman was responsible for drafting the manuscript; All of the authors revised it critically for important intellectual content, gave final approval of the version to be published and agreed to be accountable for all aspects of the work. * **Funding:** Andrew P. Costa is supported by the Schlegel Chair in Clinical Epidemiology and Aging at McMaster University. Tara Kiran is the Fidani Chair of Improvement and Innovation at the University of Toronto. She is supported as a Clinician Scientist by the Department of Family and Community Medicine at St. Michael’s Hospital and the University of Toronto. Noah Ivers is supported by a Canada Research Chair in Implementation of Evidence-based Practice and a Clinician Scholar award from the Department of Family and Community Medicine at Women’s College Hospital and the University of Toronto. Lauren Lapointe-Shaw is supported by the University of Toronto Department of Medicine, the Toronto General Hospital Research Institute, the Women’s College Institute for Health System Solutions and Virtual Care and the Peter Gilgan Centre for Women’s Cancers at Women’s College Hospital, in partnership with the Canadian Cancer Society. This project is supported by a Canadian Institutes of Health Research project grant (no. 175285). * **Data sharing:** The data set from this study is held securely in coded form at ICES. Although legal data sharing agreements between ICES and data providers (e.g., health care organizations and government) prohibit ICES from making the data set publicly available, access may be granted to those who meet pre-specified criteria for confidential access, available at [www.ices.on.ca/DAS](http://www.ices.on.ca/DAS) (email: das{at}ices.on.ca). The full data set creation plan, underlying analytic code, the complete questionnaire and technical guidelines are available from the authors upon request, understanding that the computer programs may rely upon coding templates or macros that are unique to ICES and are, therefore, either inaccessible or may require modification. * **Supplemental information:** For reviewer comments and the original submission of this manuscript, please see [www.cmajopen.ca/content/11/5/E847/suppl/DC1](http://www.cmajopen.ca/content/11/5/E847/suppl/DC1). * **Disclaimer:** This study was supported by ICES, which is funded by an annual grant from the Ontario Ministries of Health (MOH) and of Long-Term Care (MLTC). The opinions, results and conclusions reported in this article are those of the authors and are independent from the funding sources. No endorsement by ICES or the Ontario MOH or MLTC is intended or should be inferred. Parts of this material are based on data and information compiled and provided by the MOH, the Canadian Institute for Health Information and Cancer Care Ontario. The analyses, conclusions, opinions and statements expressed herein are solely those of the authors and do not reflect those of the funding or data sources; no endorsement is intended or should be inferred. This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY-NC-ND 4.0) licence, which permits use, distribution and reproduction in any medium, provided that the original publication is properly cited, the use is noncommercial (i.e., research or educational use), and no modifications or adaptations are made. See: [https://creativecommons.org/licenses/by-nc-nd/4.0/](https://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. Miller GB, Nantes S (1989) Walk-in clinics and primary care: review of the literature. Can Fam Physician 35:2019–22. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=21249079&link_type=MED&atom=%2Fcmajo%2F11%2F5%2FE847.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=A1989AY84400009&link_type=ISI) 2. Hutchison B, Østbye T, Barnsley J, et al., Ontario Walk-In Clinic Study (2003) Patient satisfaction and quality of care in walk-in clinics, family practices and emergency departments: the Ontario Walk-In Clinic Study. CMAJ 168:977–83. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czo5OiIxNjgvOC85NzciO3M6NDoiYXRvbSI7czoyMToiL2NtYWpvLzExLzUvRTg0Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 3. (2019) Walk-in clinics (College of Physicians and Surgeons of Ontario, Toronto) Available: [https://www.cpso.on.ca/Physicians/Policies-Guidance/Policies/Walk-in-Clinics](https://www.cpso.on.ca/Physicians/Policies-Guidance/Policies/Walk-in-Clinics). accessed 2022 June 30. 4. Aggarwal M, Williams AP (2019) Tinkering at the margins: evaluating the pace and direction of primary care reform in Ontario, Canada. BMC Fam Pract 20:128. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1186/s12875-019-1014-8&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fcmajo%2F11%2F5%2FE847.atom) 5. Glazier RH, Kopp A, Schultz SE, et al. (2012) All the right intentions but few of the desired results: lessons on access to primary care from Ontario’s patient enrolment models. Healthc Q 15:17–21. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.12927/hcq.2013.23041&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=22986561&link_type=MED&atom=%2Fcmajo%2F11%2F5%2FE847.atom) 6. (2001) Evaluation of primary care reform pilot in Ontario: Phase 2 interim report (Ontario Ministry of Health and Long-Term Care, Toronto) Available: [https://collections.ola.org/mon/4000/10304896.pdf](https://collections.ola.org/mon/4000/10304896.pdf). accessed 2022 June 30. 7. Health Care Experience Survey results: January 2014 to June 2017 (Ontario Ministry of Health and Long-Term Care, Toronto). 8. Barnsley J, Williams AP, Kaczorowski J, et al. (2002) Who provides walk-in services? Survey of primary care practice in Ontario. Can Fam Physician 48:519–26. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiY2ZwIjtzOjU6InJlc2lkIjtzOjg6IjQ4LzMvNTE5IjtzOjQ6ImF0b20iO3M6MjE6Ii9jbWFqby8xMS81L0U4NDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 9. Starfield B (2011) Primary care: balancing health needs, services, and technology (Oxford University Press, New York), pp 143–51. 10. Salisbury C, Munro J (2003) Walk-in centres in primary care: a review of the international literature. Br J Gen Pract 53:53–9. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiYmpncCI7czo1OiJyZXNpZCI7czo5OiI1My80ODYvNTMiO3M6NDoiYXRvbSI7czoyMToiL2NtYWpvLzExLzUvRTg0Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 11. OHIP Technical Bulletin no 20.001 (Ontario Ministry of Health and Long-Term Care, Toronto) modified 2020 Feb. 5. Available: [https://www.health.gov.on.ca/en/pro/programs/ohip/bulletins/technical/20-001.aspx](https://www.health.gov.on.ca/en/pro/programs/ohip/bulletins/technical/20-001.aspx). accessed 2022 Dec. 14. 12. Lapointe-Shaw L, Kiran T, Salahub C, et al. (2023) Walk-in clinic patient characteristics and utilization patterns in Ontario, Canada: a cross-sectional study. CMAJ Open 11:E345–56. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiY21ham8iO3M6NToicmVzaWQiO3M6OToiMTEvMi9FMzQ1IjtzOjQ6ImF0b20iO3M6MjE6Ii9jbWFqby8xMS81L0U4NDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 13. (2021) Health Care Experience Survey (HCES) user’s guide and technical documentation (Ontario Ministry of Health and Long-Term Care, Toronto). 14. The Health Care Experience Survey (Ontario Ministry of Health and Long-Term Care, Toronto) modified 2023 Mar. 21. Available: [https://www.health.gov.on.ca/en/common/healthcareexperiencesurvey.aspx](https://www.health.gov.on.ca/en/common/healthcareexperiencesurvey.aspx). accessed 2022 June 30. 15. Hutchison B, Haj-Ali W, Dobell G, et al. (2020) Prioritizing and implementing primary care performance measures for Ontario. Healthc Policy 16:43–57. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.12927/hcpol.2020.26291&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fcmajo%2F11%2F5%2FE847.atom) 16. Premji K, Sucha E, Glazier RH, et al. (2021) Primary care bonus payments and patient-reported access in Urban Ontario: a cross-sectional study. CMAJ Open 9:E1080–96. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiY21ham8iO3M6NToicmVzaWQiO3M6OToiOS80L0UxMDgwIjtzOjQ6ImF0b20iO3M6MjE6Ii9jbWFqby8xMS81L0U4NDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 17. Kiran T, Green ME, DeWit Y, et al. (2020) Association of physician payment model and team-based care with timely access in primary care: a population-based cross-sectional study. CMAJ Open 8:E328–37. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiY21ham8iO3M6NToicmVzaWQiO3M6ODoiOC8yL0UzMjgiO3M6NDoiYXRvbSI7czoyMToiL2NtYWpvLzExLzUvRTg0Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 18. Jaakkimainen L, Bayoumi I, Glazier RH, et al. (2021) Development and validation of an algorithm using health administrative data to define patient attachment to primary care providers. J Health Organ Manag 35:733–43. 19. Jaakkimainen L, Upshur REG, Klein-Geltink JE, et al. (2006) Primary care in Ontario: ICES Atlas (ICES, Toronto) Available: [https://www.ices.on.ca/Publications/Atlases-and-Reports/2006/Primary-care-in-Ontario](https://www.ices.on.ca/Publications/Atlases-and-Reports/2006/Primary-care-in-Ontario). accessed 2022 June 30. 20. Bell NR, Szafran O (1992) Use of walk-in clinics by family practice patients: Who is using this health care service? Can Fam Physician 38:507–13. [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=A1992HJ47700013&link_type=ISI) 21. Brown JB, Sangster Bouck LM, Østbye T, et al. (2002) Walk-in clinics in Ontario. An atmosphere of tension. Can Fam Physician 48:531–6. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiY2ZwIjtzOjU6InJlc2lkIjtzOjg6IjQ4LzMvNTMxIjtzOjQ6ImF0b20iO3M6MjE6Ii9jbWFqby8xMS81L0U4NDcuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 22. Farmer R, Patel R (2021) Workload and patterns of care in the Timmins Family Health Team in Ontario. Can Fam Physician 67:e121–9. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiY2ZwIjtzOjU6InJlc2lkIjtzOjk6IjY3LzUvZTEyMSI7czo0OiJhdG9tIjtzOjIxOiIvY21ham8vMTEvNS9FODQ3LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 23. Rizos J, Anglin P, Grava-Gubins I, et al. (1990) Walk-in clinics: implications for family practice. CMAJ 143:740–5. [Abstract](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czo5OiIxNDMvOC83NDAiO3M6NDoiYXRvbSI7czoyMToiL2NtYWpvLzExLzUvRTg0Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 24. Ssendikaddiwa J, Lavergne R (2019) Access to primary care and internet searches for walk-in clinics and emergency departments in Canada: observational study using Google trends and population health survey data. JMIR Public Health Surveill 5:e13130. 25. Chen CE, Chen CT, Hu J, et al. (2017) Walk-in clinics versus physician offices and emergency rooms for urgent care and chronic disease management. Cochrane Database Syst Rev 2:CD011774. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=28211045&link_type=MED&atom=%2Fcmajo%2F11%2F5%2FE847.atom) 26. Table 17-10-0009-01: Population estimates, quarterly (Statistics Canada, Ottawa) Available[https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=1710000901](https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=1710000901). accessed 2022 June 30. 27. Kiran T, Kopp A, Moineddin R, et al. (2015) Longitudinal evaluation of physician payment reform and team-based care for chronic disease management and prevention. CMAJ 187:E494–502. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czoxMToiMTg3LzE3L0U0OTQiO3M6NDoiYXRvbSI7czoyMToiL2NtYWpvLzExLzUvRTg0Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 28. Mondor L, Maxwell CJ, Bronskill SE, et al. (2016) The relative impact of chronic conditions and multimorbidity on health-related quality of life in Ontario long-stay home care clients. Qual Life Res 25:2619–32. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fcmajo%2F11%2F5%2FE847.atom) 29. Stukel TA, Glazier RH, Schultz SE, et al. (2013) Multispecialty physician networks in Ontario. Open Med 7:e40–55. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=24348884&link_type=MED&atom=%2Fcmajo%2F11%2F5%2FE847.atom) 30. Schultz SE, Glazier RH (2017) Identification of physicians providing comprehensive primary care in Ontario: a retrospective analysis using linked administrative data. CMAJ Open 5:E856–63. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToiY21ham8iO3M6NToicmVzaWQiO3M6ODoiNS80L0U4NTYiO3M6NDoiYXRvbSI7czoyMToiL2NtYWpvLzExLzUvRTg0Ny5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 31. Austin PC (2009) Using the standardized difference to compare the prevalence of a binary variable between two groups in observational research. Commun Stat Simul Comput 38:1228–34. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1080/03610910902859574&link_type=DOI) 32. Williams AP, Barnsley J, Vayda E, et al. (2002) Comparing the characteristics and attitudes of physicians in different primary care settings: the Ontario Walk-in Clinic Study. Fam Pract 19:647–57. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1093/fampra/19.6.647&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=12429669&link_type=MED&atom=%2Fcmajo%2F11%2F5%2FE847.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000179252500014&link_type=ISI) 33. Glazier RH, Klein-Geltink J, Kopp A, et al. (2009) Capitation and enhanced fee-for-service models for primary care reform: a population-based evaluation. CMAJ 180:E72–81. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czoxMDoiMTgwLzExL0U3MiI7czo0OiJhdG9tIjtzOjIxOiIvY21ham8vMTEvNS9FODQ3LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 34. (2018) *Physician billing*. Chapter 1, section 1.11, Ministry of Health and Long-Term Care (Queen’s Printer for Ontario, Toronto) Available: [https://auditor.on.ca/en/content/annualreports/arreports/en18/v2_111en18.pdf](https://auditor.on.ca/en/content/annualreports/arreports/en18/v2_111en18.pdf), pp 169–84. accessed 2022 June 30. 35. Glazier RH, Zagorski BM, Rayner J (2012) Comparison of primary care models in Ontario by demographics, case mix and emergency department use, 2008/09 to 2009/10 (ICES, Toronto). 36. Glazier RH, Gozdyra P, Kim M, et al. (2018) Geographic variation in primary care need service use and providers in Ontario 2015/16 (ICES, Toronto) Available: [https://www.ices.on.ca/Publications/Atlases-and-Reports/2018/Geographic-Variation-in-Primary-Care](https://www.ices.on.ca/Publications/Atlases-and-Reports/2018/Geographic-Variation-in-Primary-Care). accessed 2022 June 30. 37. Haj-Ali W, Hutchison B, Moineddin R, et al. (2021) Comparing primary care Interprofessional and non-interprofessional teams on access to care and health services utilization in Ontario, Canada: a retrospective cohort study. BMC Health Serv Res 21:963. 38. Berthelot S, Breton M, Guertin JR, et al. (2021) A value-based comparison of the management of ambulatory respiratory diseases in walk-in clinics, primary care practices, and emergency departments: protocol for a multicenter prospective cohort study. JMIR Res Protoc 10:e25619. 39. Glazier RH, Green ME, Wu FC, et al. (2021) Shifts in office and virtual primary care during the early COVID-19 pandemic in Ontario, Canada. CMAJ 193:E200–10. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czoxMDoiMTkzLzYvRTIwMCI7czo0OiJhdG9tIjtzOjIxOiIvY21ham8vMTEvNS9FODQ3LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 40. Matthewman S, Spencer S, Lavergne MR, et al. (2021) An environmental scan of virtual “walk-in” clinics in Canada: comparative study. J Med Internet Res 23:e27259. 41. Lapointe-Shaw L, Salahub C, Bird C, et al. (2023) Characteristics and health care use of patients attending virtual walk-in clinics in Ontario, Canada: cross-sectional analysis. J Med Internet Res 25:e40267. 42. Ivers N, Newbery S, Eissa A, et al. Science Briefs of the Ontario COVID-19 Science Advisory Table, Brief on Primary Care Part 3: lessons learned for strengthened primary care in the next phase of the COVID-19 pandemic. Available: [https://covid19-sciencetable.ca/sciencebrief/brief-on-primary-care-part-3-lessons-learned-for-strengthened-primary-care-in-the-next-phase-of-the-covid-19-pandemic/](https://covid19-sciencetable.ca/sciencebrief/brief-on-primary-care-part-3-lessons-learned-for-strengthened-primary-care-in-the-next-phase-of-the-covid-19-pandemic/). accessed 2022 Dec. 13. 43. OECD interactive tool: international comparisons — peer countries, Ontario (Canadian Institute for Health Information, Ottawa) Available: [https://www.cihi.ca/en/oecd-interactive-tool-international-comparisons-peer-countries-ontario](https://www.cihi.ca/en/oecd-interactive-tool-international-comparisons-peer-countries-ontario). accessed 2022 Dec. 13. * © 2023 CMA Impact Inc. or its licensors