Quality of clinicians’ conversations with patients and families before and after implementation of the Serious Illness Care Program in a hospital setting: a retrospective chart review study =============================================================================================================================================================================================== * Christina Ma * Lauren E. Riehm * Rachelle Bernacki * Joanna Paladino * John J. You ## Abstract **Background:** Seriously ill patients in hospital have indicated that better communication with practitioners is vital for improving care. The aim of this study was to assess whether the quality of conversations about serious illness improved after implementation of the Serious Illness Care Program (SICP). **Methods:** In this retrospective chart review study, we evaluated patients who were admitted to a medical ward at Hamilton General Hospital, had a stay of at least 48 hours, and were at risk for a lengthy stay or increased need for community-based services (inter-RAI Emergency Department Screener score of 5 or 6). The SICP study period was from Mar. 1, 2017, to Jan. 19, 2018. We used a validated codebook to assess the quality of documented conversations regarding serious illness for eligible patients before (usual care [control group]) and after SICP implementation (intervention group), specifically examining the following domains: patients’ values and goals, understanding of prognosis and illness, end-of-life care planning, and code status or desire for other life-sustaining treatments. **Results:** The study sample included 56 patients in the control group and 56 patients in the intervention group. The overall quality of documented conversations about serious illness was significantly higher in the intervention group than in the control group (*p* < 0.001) and was significantly higher in the subdomains of values and goals (*p* < 0.001), understanding of prognosis and illness (*p* < 0.001) and life-sustaining treatments (*p* = 0.03) but not end-of-life care planning (*p* = 0.48). **Interpretation:** Implementation of the SICP in a hospital setting was associated with higher quality of documented conversations regarding serious illness with patients at high risk for clinical or functional deterioration. The SICP is transferable and adaptable to a hospital setting, and was associated with an increase in adherence to best practices compared to usual care. Current communication practices often do not meet the needs of seriously ill patients in hospital. For example, there is a lack of honest discussion surrounding prognosis and insufficient exploration of patients’ values.1–3 According to inpatients and their families, however, discussion of these issues is important to support high-quality care.2 As a result of these gaps in communication, patients may receive invasive treatments that are discordant with their values and goals.3–5 Inadequate communication during serious illness also has a negative impact on patients’ satisfaction with care and can create distress for surrogate decision-makers.6 Evidence suggests that improved communication earlier in the illness trajectory about the patient’s values, goals and priorities can substantially ameliorate some of this emotional burden.6 The Serious Illness Care Program (SICP) is a multicomponent communication intervention that aims to build capacity to have more frequent, earlier and more person-centred conversations about serious illness with patients facing life-limiting illness.7–9 The rationale for this program is that scalable solutions are needed to equip non–palliative-care clinicians with communication skills that can enable them to initiate a palliative approach to care earlier in the illness trajectory without needing to involve palliative care practitioners. Although the SICP was originally designed for outpatient oncology practice and has been implemented successfully in primary care,10 we judged that it addressed many of the communication gaps in the hospital setting.3,4 Therefore, we adapted the SICP for an inpatient setting and implemented it on the medical wards of our hospital. Specifically, we sought to determine whether the quality of conversations was higher during the SICP implementation period compared to historical controls among medical patients in hospital at increased risk for a lengthy hospital stay or need for community-based services with whom clinicians had had a conversation about serious illness. We hypothesized that the quality of conversations would be higher in the intervention group than in the control group. ## Methods ### Design and setting We conducted a retrospective chart review to assess the quality of conversations regarding serious illness during implementation of the SICP compared to historical controls (i.e., usual care). In this article, we define a conversation regarding serious illness as any conversation between a practitioner and a patient with serious life-limiting illness or the surrogate decision-maker(s) about understanding of the illness and prognosis, values, fears and sources of strength, with the intent to inform current or future decisions about treatment. 9 The SICP was implemented on the general internal medicine wards at Hamilton General Hospital, in Hamilton, Ontario. The average number of patients admitted monthly to the Internal Medicine program at the hospital in 2017 was 388. The SICP study period was from Mar. 1, 2017, to Jan. 19, 2018. The Hamilton General Hospital was the vanguard site in ongoing multisite implementation of the SICP at 3 other Canadian hospitals. This paper reports the results of a focused assessment of the quality of conversations about serious illness before and after SICP implementation at this site. ### Intervention and its adaptation to hospital setting The SICP was originally designed for the outpatient oncology setting. It includes tools for clinicians and family, an educational component and a system change component. Tools include a previsit letter for patients (which introduces the topics to consider before the conversation with their clinician), the Serious Illness Conversation Guide (Appendix 1, available at [www.cmajopen.ca/content/8/2/E448/suppl/DC1](http://www.cmajopen.ca/content/8/2/E448/suppl/DC1)), the Clinician Reference Guide (which summarizes information provided in the training and offers guidance on challenging scenarios) and a Family Communication Guide for patients and their families (which suggests an approach for discussing their illness and care preferences with their family). The primary educational component consists of a 2.5-hour interactive clinician training workshop. System change refers to the design and implementation of the following processes to enable conversations about serious illness in practice: identifying suitable patients, prompting clinicians to have the conversation with eligible patients, having the conversation using the guide and documenting the conversation in the medical record. Clinicians were eligible for training if they were full-time attending physicians or nurse practitioners on participating medical wards. Although the tools and clinician training components of the SICP did not require modification (other than adjusting the previsit letter to reflect the hospital setting rather than a clinic visit), we made adjustments to the original program to tailor processes for a hospital setting more generally and for our local context more specifically (Table 1). View this table: [Table 1:](http://www.cmajopen.ca/content/8/2/E448/T1) Table 1: Adaptation of the Serious Illness Care Program to the hospital medical ward setting ### Control group Before the SICP study period, we had conducted 2 planned cross-sectional sampling exercises that collected data on basic demographic characteristics (age, sex, comorbidities [using the Charlson Comorbidity Index11]) and score on the interRAI Emergency Department Screener12 at the time of admission for all medical inpatients at Hamilton General Hospital, on a single arbitrarily chosen day in December 2016 and on a single arbitrarily chosen day in February 2017. The interRAI Emergency Department Screener is a brief, validated, proprietary instrument.12 Possible scores range from 1 to 6, with higher scores predicting an increased risk of a lengthy hospital stay or need for community-based services. To enable comparison of the quality of conversations about serious illness during implementation of the SICP and with usual care, we identified a control group (i.e., unexposed to the SICP) consisting of any patients from these 2 cross-sectional samples who had a length of stay of at least 48 hours and had a score of 5 or 6 on the interRAI Emergency Department Screener. This process yielded a sample of 56 control patients. ### Intervention group Patients were eligible to be enrolled in the SICP if they were admitted to a medical ward at Hamilton General Hospital, had a stay of at least 48 hours, and received a score of 5 or 6 on the interRAI Emergency Department Screener, administered by a trained nurse at the time of hospital admission. A unit champion was hired to support our quality-improvement initiative. The roles of the unit champion were to trigger clinicians to have a conversation about serious illness with eligible patients, prepare the patient and family for the conversation by reviewing the content in the previsit letter, and schedule a formal meeting. The attending medical team delivered the intervention to a convenience sample of patients. We used a convenience sample for the following reasons: the intervention could not be delivered to all eligible patients because of limitations on the maximum number of conversations a clinician could feasibly hold during a typical workweek (e.g., 1–2 per week, in our experience); some patients were discharged from hospital, transferred to another service or facility, or died before a conversation could be arranged; and some eligible patients declined to participate in the program. For this retrospective chart review study, we abstracted data for consecutive patients with whom the conversation about serious illness was held during the study period to reach a target ratio of intervention to control patients of 1:1. ### Data extraction We extracted the following information from the medical records of patients in the intervention and control groups: baseline characteristics (demographic characteristics, comorbidities [summarized using the Charlson Comorbidity Index score], use of health care services and laboratory test results on admission), quality of the conversation about serious illness, how the conversation was documented (dictated, transcribed note v. handwritten progress note) and type of clinician who led the conversation. To train assessors for data extraction, the senior investigator (J.J.Y.) and 2 coinvestigators (C.M., L.R.) participated in a calibration exercise to enhance interrater reliability of chart abstraction. The 3 investigators abstracted data from the medical records of both patient groups independently using a structured, validated codebook that was developed to rate the quality of conversations about serious illness10 (Appendix 2, available at [www.cmajopen.ca/content/8/2/E448/suppl/DC1](http://www.cmajopen.ca/content/8/2/E448/suppl/DC1)). The codebook uses 4 domains to evaluate the quality of the conversations: patient values and goals (scored on a scale of 0–7), understanding of prognosis and illness (scored on a scale of 0–4), planning for end-of-life care (scored on a scale of 0–4), and code status or desire for other life-sustaining treatments (scored on a scale of 0–2). The maximum score is 17, with higher scores indicating higher-quality conversations. The investigators abstracted data independently from the same 6 randomly selected charts (3 from the intervention group and 3 from the control group) and compared their results to reach consensus and ensure consistency. The trained assessors (C.M., L.R.) used a structured data collection form and the codebook to independently evaluate one-half each of the control and intervention group charts. To maintain consistency, every 10th chart was coded in duplicate by the second assessor, and the assessors’ results were compared at regular intervals. When assessing the quality of documented conversations about serious illness, dictated and written progress notes from patient charts were eligible to be coded. There was a substantial amount of heterogeneity in how conversations were documented in the control charts. To capture all potential conversations in this group, we used a low threshold to include notes as conversations about serious illness: conversations were considered conversations about serious illness if they were scored 1 point or more with the use of the codebook. Furthermore, some control charts had more than 1 documented conversation that were scored at least 1 point. In these cases, we used the conversation with the highest score in the analysis. Control charts without documented conversations regarding serious illness were excluded from the analysis. The type of clinician who led the conversation was determined and based on who was explicitly stated in the clinical note as having led the conversation or, if this information was not included, the type of clinician who signed the note. ### Statistical analysis We used descriptive statistics to summarize the distributions of demographic and clinical characteristics of the intervention and control patients and compared the distributions using an unpaired *t* test for continuous variables and the χ2 test for categoric variables. The significance level was set at *p* ≤ 0.05. We used the Mann–Whitney test to compare the difference in codebook scores of the intervention and control groups, and the χ2 test or Fisher exact test to compare individual codebook items (present/not present) between the 2 groups. #### Sensitivity analysis We also conducted a sensitivity analysis to compare the quality of documented conversations about serious illness in the intervention and control groups, stratified by conversations that were led by attending physicians versus those that were led by other clinicians (residents or nurse practitioners). ### Ethics approval Ethics approval was obtained for this retrospective chart review study from the Hamilton Integrated Research Ethics Board. ## Results Of the 26 eligible clinicians (22 attending physicians and 4 nurse practitioners), 21 (81%) (17 attending physicians and 4 nurse practitioners) took part in the SICP training session. During the implementation period, the unit champion screened 391 medical inpatients for eligibility and identified 275 eligible patients, of whom 219 were excluded owing to clinician time limits; the patient was discharged from hospital, transferred or died; or the patient declined to participate. There were no statistically significant differences in baseline characteristics between the intervention and control groups (Table 2). View this table: [Table 2:](http://www.cmajopen.ca/content/8/2/E448/T2) Table 2: Baseline characteristics of inpatients who took part in the Serious Illness Care Program and the control group Fifty-five patients (98%) in the intervention group had a conversation about serious illness documented in the medical record, of which 39 (71%) were documented as dictated, transcribed notes in the electronic medical record, and 16 (29%) were documented as written progress notes in the paper chart. Of the 56 patients in the control group, 28 (50%) had a conversation documented in the medical record, of which 5 (18%) were dictated and transcribed in the electronic medical record, and 23 (82%) were documented as written progress notes. All the transcribed notes in the intervention group were dedicated notes containing information pertinent to the conversation, whereas all the transcribed notes in the control group contained additional information that was not directly pertinent to the conversation. Conversations about serious illness were more likely to be led by attending physicians (v. residents or nurse practitioners) in the intervention group (48 v. 7) than the control group (12 v. 16) (*p* < 0.001). ### Quality of conversations about serious illness The overall quality of the conversations about serious illness was significantly higher in the intervention group than in the control group (*p* < 0.001) (Figure 1; Appendix 3, Supplemental Table S1, available at [www.cmajopen.ca/content/8/2/E448/suppl/DC1](http://www.cmajopen.ca/content/8/2/E448/suppl/DC1)). Domain scores were also significantly higher in the intervention group than in the control group except for the end-of-life care planning domain (*p* = 0.48). Furthermore, most individual codebook items were present significantly more often in the intervention group than in the control group (Appendix 3, Supplemental Table S2). ![Figure 1:](http://www.cmajopen.ca/https://www.cmajopen.ca/content/cmajo/8/2/E448/F1.medium.gif) [Figure 1:](http://www.cmajopen.ca/content/8/2/E448/F1) Figure 1: Median scores for quality of conversations about serious illness in the intervention and control groups. Life-sustaining treatments scored on a scale of 0–2, prognosis and illness understanding scored on a scale of 0–4, values and goals scored on a scale of 0–7, and end-of-life care planning scored on a scale of 0–4 (total 17). Note: NS = not significant. **p* = 0.03, †*p* < 0.001. In the sensitivity analysis comparing the quality of documented conversations regarding serious illness in the intervention and control groups, we found that the quality of conversations was higher in the intervention group than in the control group for both conversations that were led by attending physicians and those that were led by other clinicians (residents or nurse practitioners) (Table 3). View this table: [Table 3:](http://www.cmajopen.ca/content/8/2/E448/T3) Table 3: Quality of conversations about serious illness in the intervention and control groups, stratified by the type of clinician who led the conversation ## Interpretation In this single-centre retrospective chart review study, we found that the quality of documented conversations regarding serious illness after implementation of the SICP was significantly higher than during usual care. In particular, after SICP implementation, the clinician and patient more often discussed patient values and goals, and understanding of prognosis and illness. We also found that conversations about serious illness were more clearly documented and more retrievable after SICP implementation. A recent multicentre study showed that patients on internal medicine wards are at risk for inappropriate end-of-life care, which is related to poor communication and poor documentation of conversations about serious illness.13 The improved accessibility and clarity of documentation we observed as a result of SICP implementation may increase the likelihood that these conversations will affect future care and reduce medical error related to interventions discordant with patient preferences. In the present study, there was no significant difference between the intervention and control groups in the end-of-life care planning domain, and the difference in the life-sustaining treatments domain was not as pronounced as that in the domains of understanding of prognosis and illness, and values and goals. These findings are consistent with what Paladino and colleagues14 found with SICP implementation in the oncology setting. We hypothesize that conversations about serious illness are more values-oriented when clinicians follow the Serious Illness Conversation Guide. An important focus of the clinician training component of the SICP is to reorient clinicians to elicit values and goals during conversations regarding serious illness and to communicate prognostication with patients and their families, rather than lead procedure-focused conversations, which are typical of current practice. Our study adds to the existing body of work that has studied the use of interventions to aid clinicians in having better conversations about serious illness. In particular, it expands on the use of the SICP in other clinical settings. For example, a similar analysis conducted after implementation of the SICP in the primary care setting showed an increased number of conversations regarding serious illness, and improved comprehensiveness of and accessibility to these conversations.10 Our findings are consistent with that study and suggest that the SICP is a flexible model that can be adapted successfully to inpatient and outpatient settings as well as to oncology and nononcology populations. Although we found that SICP implementation was associated with statistically significantly higher scores for conversation quality compared to usual care, to our knowledge, there are no data correlating absolute differences in scores to other outcomes. This represents an opportunity for future research in this field. In addition, our study did not address the sustainability or cost-effectiveness of SICP implementation. Future work should focus on identifying sustainable, cost-effective strategies to implement the SICP or similar best practices in communication about serious illness into clinical practice and to increase their uptake by clinicians. This paper reports the results of focused assessment of the quality of conversations about serious illness before and after SICP implementation at a single centre. We plan to report data from all 3 participating sites on process measures, patient-reported measures and clinician-reported measures, and on lessons learned during implementation. ### Limitations Owing to the nature of the intervention, researchers could not be blinded during data extraction, and coding of clinical notes summarizing conversations about serious illness required subjective interpretation. However, we used several strategies to mitigate against this risk of bias, such as having a second assessor code every 10th chart in duplicate and comparing assessors’ results at regular intervals. In addition, our study did not use a randomized design, and because of differences in the sampling frames (including differences in seasonality), we cannot exclude the possibility that the intervention and control groups may have had some dissimilarities. However, we used the same eligibility criteria for the 2 groups and did not note any appreciable differences in demographic characteristics, comorbidities, use of health care services or laboratory values between the groups. The use of historical controls may have also overestimated the treatment benefit. We did not deliver the intervention to all eligible patients identified. To the extent that missed patients were systematically different in ways that would have affected the quality of conversations about serious illness, this introduces a risk of bias into our findings. We used the quality of documentation of conversations regarding serious illness as a surrogate for the quality of the conversations. As such, our study design is limited by the completeness and quality of documentation during the control and intervention periods. We also used the conversation with the highest codebook score, as opposed to taking the sum of scores from multiple conversations, in our analysis. However, in our experience performing the chart abstraction, different components of conversations about serious illness were not commonly documented over multiple different encounters. In addition, we excluded charts without a documented conversation in order to conduct a fair comparison of quality; therefore, our findings are a comparison of the quality of conversations before and after SICP implementation, conditional on a conversation’s having occurred, and are not an assessment of the frequency of conversations during the intervention and control periods. Finally, our study findings are based on the implementation of the SICP at a single academic teaching hospital. As a result, our results may not be transferable to other health care settings or other jurisdictions. ### Conclusion In this single-centre retrospective chart review study, we found that the SICP, when implemented in a hospital setting, was associated with a higher quality of documented conversations regarding serious illness compared to usual care. Our findings suggest that a structured approach to triggering, conducting and documenting such conversations can enhance both the quality of the conversation and the retrievability of the documentation. ## Acknowledgements The authors thank Marilyn Swinton for her assistance with project coordination and Shelley Weniger for her activities as unit champion for the implementation of the Serious Illness Care Program at Hamilton General Hospital. ## Footnotes * **Competing interests:** None declared. * This article has been peer reviewed. * **Contributors:** John You supervised the work. Christina Ma and Lauren Riehm contributed equally to the work. Christina Ma, Lauren Riehm and John You analyzed and interpreted the data and drafted the manuscript. All of the authors conceived and designed the study, revised the manuscript critically for important intellectual content, approved the final version to be published and agreed to be accountable for all aspects of the work. * **Funding:** This work was supported by research grant TG2013-03 from the Canadian Frailty Network, a Hamilton Health Sciences Research Administration, McMaster University Department of Medicine Medical Student Research Award, and Michael G. deGroote School of Medicine McMaster Medical Student Research Excellence Scholarships. Rachelle Bernacki and Joanna Paladino are supported by the Sojourns Scholar Leadership Program. * **Data sharing:** Deidentified raw data will be made available on request to the corresponding author, John You, John.You{at}thp.ca. * **Disclaimer:** None of the funders had a role in the conduct of the study, the decision to submit the work for publication or the writing of the manuscript. * **Supplemental information:** For reviewer comments and the original submission of this manuscript, please see [www.cmajopen.ca/content/8/2/E448/suppl/DC1](http://www.cmajopen.ca/content/8/2/E448/suppl/DC1). ## References 1. Davison SN (2010) End-of-life care preferences and needs: perceptions of patients with chronic kidney disease. Clin J Am Soc Nephrol 5:195–204. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiY2xpbmphc24iO3M6NToicmVzaWQiO3M6NzoiNS8yLzE5NSI7czo0OiJhdG9tIjtzOjIwOiIvY21ham8vOC8yL0U0NDguYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 2. Heyland DK, Allan DE, Rocker G, et al., Canadian Researchers at the End-of-Life Network (CARENET) (2009) Discussing prognosis with patients and their families near the end of life: impact on satisfaction with end-of-life care. Open Med 3:e101–10. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=19946391&link_type=MED&atom=%2Fcmajo%2F8%2F2%2FE448.atom) 3. You JJ, Dodek P, Lamontagne F, et al., ACCEPT Study Team and the Canadian Researchers at the End of Life Network (CARENET) (2014) What really matters in end-of-life discussions? Perspectives of patients in hospital with serious illness and their families. CMAJ 186:E679–87. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czoxMToiMTg2LzE4L0U2NzkiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzgvMi9FNDQ4LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 4. Heyland DK, Barwich D, Pichora D, et al., ACCEPT (Advance Care Planning Evaluation in Elderly Patients) Study Team; Canadian Researchers at the End of Life Network (CARENET) (2013) Failure to engage hospitalized elderly patients and their families in advance care planning. JAMA Intern Med 173:778–87. 5. Yung VY, Walling AM, Min L, et al. (2010) Documentation of advance care planning for community-dwelling elders. J Palliat Med 13:861–7. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1089/jpm.2009.0341&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=20618087&link_type=MED&atom=%2Fcmajo%2F8%2F2%2FE448.atom) 6. Wendler D, Rid A (2011) Systematic review: the effect on surrogates of making treatment decisions for others. Ann Intern Med 154:336–46. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.7326/0003-4819-154-5-201103010-00008&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=21357911&link_type=MED&atom=%2Fcmajo%2F8%2F2%2FE448.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000287799900006&link_type=ISI) 7. Bernacki R, Hutchings M, Vick J, et al. (2015) Development of the Serious Illness Care Program: a randomised controlled trial of a palliative care communication intervention. BMJ Open 5:e009032. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiNS8xMC9lMDA5MDMyIjtzOjQ6ImF0b20iO3M6MjA6Ii9jbWFqby84LzIvRTQ0OC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 8. Bernacki RE, Block SD, American College of Physicians High Value Care Task Force (2014) Communication about serious illness care goals: a review and synthesis of best practices. JAMA Intern Med 174:1994–2003. 9. Bernacki R, Paladino J, Neville BA, et al. (2019) Effect of the Serious Illness Care Program in outpatient oncology: a cluster randomized clinical trial. JAMA Intern Med 179:751–9. 10. Lakin JR, Koritsanszky LA, Cunningham R, et al. (2017) A systematic intervention to improve serious illness communication in primary care. Health Aff (Millwood) 36:1258–64. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6OToiaGVhbHRoYWZmIjtzOjU6InJlc2lkIjtzOjk6IjM2LzcvMTI1OCI7czo0OiJhdG9tIjtzOjIwOiIvY21ham8vOC8yL0U0NDguYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 11. Charlson ME, Pompei P, Ales KL, et al. (1987) A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis 40:373–83. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1016/0021-9681(87)90171-8&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=3558716&link_type=MED&atom=%2Fcmajo%2F8%2F2%2FE448.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=A1987G855900002&link_type=ISI) 12. Hirdes JP, Curtin-Telegdi N, Poss JW, et al. (2010) interRAI Contact Assessment (CA) form and user’s manual: a screening level assessment for emergency department and intake from community/hospital (Open Book Systems, Rockport (MA)). 13. Heyland DK, Ilan R, Jiang X, et al. (2016) The prevalence of medical error related to end-of-life communication in Canadian hospitals: results of a multicentre observational study. BMJ Qual Saf 25:671–9. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoicWhjIjtzOjU6InJlc2lkIjtzOjg6IjI1LzkvNjcxIjtzOjQ6ImF0b20iO3M6MjA6Ii9jbWFqby84LzIvRTQ0OC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 14. Paladino J, Bernacki R, Neville BA, et al. (2019) Evaluating an intervention to improve communication between oncology clinicians and patients with lifelimiting cancer: a cluster randomized clinical trial of the Serious Illness Care Program. JAMA Oncol 5:801–9. * Copyright 2020, Joule Inc. or its licensors