Determination of the optimal case definition for the diagnosis of end-stage renal disease from administrative claims data in Manitoba, Canada =============================================================================================================================================== * Paul Komenda * Nancy Yu * Stella Leung * Keevin Bernstein * James Blanchard * Manish Sood * Claudio Rigatto * Navdeep Tangri ## Abstract **Introduction** End-stage renal disease (ESRD) is a major public health problem with increasing prevalence and costs. An understanding of the long-term trends in dialysis rates and outcomes can help inform health policy. We determined the optimal case definition for the diagnosis of ESRD using administrative claims data in the province of Manitoba over a 7-year period. **Methods** We determined the sensitivity, specificity, predictive value and overall accuracy of 4 administrative case definitions for the diagnosis of ESRD requiring chronic dialysis over different time horizons from Jan. 1, 2004, to Mar. 31, 2011. The Manitoba Renal Program Database served as the gold standard for confirming dialysis status. **Results** During the study period, 2562 patients were registered as recipients of chronic dialysis in the Manitoba Renal Program Database. Over a 1-year period (2010), the optimal case definition was any 2 claims for outpatient dialysis, and it was 74.6% sensitive (95% confidence interval [CI] 72.3%–76.9%) and 94.4% specific (95% CI 93.6%–95.2%) for the diagnosis of ESRD. In contrast, a case definition of at least 2 claims for dialysis treatment more than 90 days apart was 64.8% sensitive (95% CI 62.2%–67.3%) and 97.1% specific (95% CI 96.5%–97.7%). Extending the period to 5 years greatly improved sensitivity for all case definitions, with minimal change to specificity; for example, for the optimal case definition of any 2 claims for dialysis treatment, sensitivity increased to 86.0% (95% CI 84.7%–87.4%) at 5 years. **Conclusion** Accurate case definitions for the diagnosis of ESRD requiring dialysis can be derived from administrative claims data. The optimal definition required any 2 claims for outpatient dialysis. Extending the claims period to 5 years greatly improved sensitivity with minimal effects on specificity for all case definitions. Administrative claims data represent an important repository of information on health care utilization in a single-payer health care system.1 Administrative databases have several potential advantages over traditional sources of clinical data (i.e., patient charts, disease-specific registries and electronic medical records) because they represent a more universal source of population-level data and document every interaction in the health care system uniformly.2–4 Despite these advantages, administrative databases must be validated against traditional sources of clinical data to develop robust case definitions.3,5,6 These definitions can then allow a variety of innovative epidemiologic applications, including linkage with other existing population-level datasets, and can help researchers and policy-makers gain new insights into the burden of disease.2,3 End-stage renal disease (ESRD) is a major public health problem associated with high rates of morbidity and mortality and significant costs to the health care system.7–10 Patients with ESRD who receive chronic dialysis typically engage the health care system thrice weekly (for facility-based hemodialysis), and peritoneal dialysis and hemodialysis have unique procedural codes. This disease state therefore provides an ideal situation to validate administrative case definitions against program-level data or data from a disease registry. Previous investigators have developed case definitions for ESRD and earlier stages of chronic kidney disease.3,4 These definitions were internally validated in single jurisdictions over a limited period and in dialysis populations that were older and largely white. External validation of previously developed definitions, as well as exploration of accuracy over different time horizons, is needed to determine the most generalizable case definition for use across provinces and countries. We conducted this study to determine the optimal case definition for ESRD requiring chronic dialysis using administrative claims data in the province of Manitoba over a 7-year period. ## Methods ### Study population The province of Manitoba, Canada, has a population of 1.2 million people. It has a universal health care system (Manitoba Health), which processes and maintains all claims for health care use in the province in a secured, centralized repository.11 The study cohort consisted of all patients covered by Manitoba Health who were more than 18 years of age from Jan. 1, 2004, to Mar. 31, 2011. ### Sources of data #### Physician claims database Each physician claim includes the patient’s identification number, the date of service and a 3-digit International Classification of Diseases, 9th revision, clinical modification (ICD-9-CM) code for the physician-assigned diagnosis. Each record of admission to hospital includes the patient’s identification number, the dates of admission and discharge, and the diagnostic codes listed on the discharge abstract. Before 2004, up to 16 diagnoses were recorded using 5-digit ICD-9-CM codes; beginning in 2004, up to 25 diagnoses were recorded using codes from the Canadian enhancement of the International Statistical Classification of Diseases and Related Health Problems, 10th revision (ICD-10-CA). In addition, Manitoba Health maintains a population registry that is updated when a person moves into or out of the province, changes marital or family status, or dies.11,12 To identify residents receiving dialysis in the Manitoba Health database, we searched all physician claims from Jan. 1, 2004, through Mar. 31, 2011, by tariff codes for initial dialysis (9798, 9801, 9805, 9806), subsequent dialysis (9799, 9802, 9807, 9819) and home dialysis (9821). #### Manitoba Renal Program Dialysis Registry The Manitoba Renal Program is the sole provider of dialysis and kidney health prevention services in the province. The program consists of more than 800 employees, including 23 actively practising nephrologists. Since January 2004, it has maintained a comprehensive database of all patients receiving chronic (> 90 d) outpatient dialysis, including start and end dates, and detailed demographic and comorbidity data. The quality of these data is adjudicated at formal interprofessional rounds on a weekly basis. The validation of this database has been described elsewhere,13 and the database has been used extensively in published epidemiologic studies.13–15 #### Case definitions Definitions of disease states and diagnoses based on administrative data sources must be validated with the use of traditional sources of clinical data (i.e., patient charts, disease-specific registries, electronic medical records).12 We developed the following 4 administrative case definitions for the diagnosis of ESRD, varying the number of claims for continuous outpatient dialysis used to define the diagnosis: (a) at least 1 claim; (b) any 2 claims; (c) any 2 claims at least 90 days apart; and (d) any 2 claims at least 90 days apart with no gaps in treatment greater than 21 days. The definitions were based on a previous validation study that used administrative data to define ESRD.3 These case definitions are a conventional standard in administrative algorithms for defining ESRD.3,16 We chose the study period of Jan. 1, 2004, to Dec. 31, 2010, based on the available, high-quality data from the Manitoba Renal Program for validation purposes. ### Statistical analysis We computed the sensitivity, specificity, and positive and negative predictive values for each case definition, using the Manitoba Renal Program data as the reference standard. In addition, we selected the optimal case definition based on sensitivity (> 80%) and specificity (> 90%) and determined the area under the receiver operating characteristic (ROC) curve for each case definition. We used the definition with the highest area under the curve to examine secular trends in ESRD in Manitoba; our findings are reported in a companion article.17 For each case definition, we first evaluated its accuracy over a 1-year period by matching patients registered in the Manitoba Renal Program in a calendar year (2010) with administrative claims for dialysis in the same year. We then extended the time horizon to identify claims over 3, 5 and 7 years. In sensitivity analyses, we examined performance by subgroups of age, sex, ethnicity (First Nations v. non–First Nations) and primary diagnosis of ESRD (diabetes v. glomerulonephritis). Ethnicity was self-reported in the Manitoba Renal Program registry or through registration at Manitoba Health, and diabetes and glomerulonephritis were defined using previously developed case definitions and ICD-9 and ICD-10 codes.18,19 We performed all analyses using SAS version 9. ### Ethics approval This study received approval from the health research ethics boards of the University of Manitoba and the Winnipeg Regional Health Authority. Approval from the Health Information Privacy Committee of Manitoba Health was also obtained, and data-sharing agreements were signed between these institutions. ## Results During the study period of January 2004 to December 2010, the Manitoba Renal Program database had 2582 registered patients (Table 1), including 1661 patients who had prevalent disease at the start of 2004. The mean age of the study population was 59.7 (standard deviation 15.9) years, and 40.9% of the patients were 65 years or older. Overall, 54.1% of the patients were male, and the male:female ratio appeared to increase with age. View this table: [Table 1:](http://www.cmajopen.ca/content/3/3/E264/T1) Table 1: Age and sex distribution of patients in the Manitoba Renal Program Dialysis Registry, 2004–2010 The performance of the 4 case definitions for the diagnosis of ESRD over a 1-year period is shown in Table 2. The most sensitive case definition was any 1 claim for outpatient dialysis (sensitivity 77.0%, 95% confidence interval [CI] 74.7–79.2; specificity 93.8%, 95% CI 92.9–94.7). The most specific and least sensitive case definition was any 2 claims for continuous outpatient dialysis more than 90 days apart with no gaps in treatment greater than 21 days (53% sensitive (95% CI 50.06–55.35), 98% specific (95% CI 96.93–98.06)). The case definition of any 1 claim had the highest accuracy (88.5%, 95% CI 87.4%–89.6%) and agreement (kappa) score (0.73 (95% CI 0.70–0.75) in calendar year 2010. View this table: [Table 2:](http://www.cmajopen.ca/content/3/3/E264/T2) Table 2: Performance of candidate case definitions of end-stage renal disease (ESRD)* using administrative data over 1 year (2010), with data from the Manitoba Renal Program (MRP) registry database as the reference standard When we increased the time horizon for dialysis claims by 1-year increments, the sensitivity of the case definitions improved considerably. Marked increases in sensitivity were noted after we extended the interval to 5 years (Table 3). In particular, for any 2 dialysis claims, the sensitivity increased from 74.6% (95% CI 72.3%–76.9%) to 86.0% (95% CI 84.7%–87.4%). There was a slight decline in specificity for this definition, from 94.4% (95% CI 93.6%–95.2%) to 93.4% (95% CI 92.9%–93.9%) when the interval was extended to 5 years. View this table: [Table 3:](http://www.cmajopen.ca/content/3/3/E264/T3) Table 3: Performance of candidate case definitions of end-stage renal disease (ESRD)* using administrative data over 5 years (2004–2008), with data from the Manitoba Renal Program (MRP) registry database as the reference standard Overall accuracy and agreement increased for all case definitions as the time intervals were extended (Appendix 1, available at [www.cmajopen.ca/content/3/3/E264/suppl/DC1](http://www.cmajopen.ca/content/3/3/E264/suppl/DC1)). The area under the ROC curve also improved when time intervals were extended, with the definition of any 2 outpatient dialysis claims having the highest value overall (area under the curve 0.8972, 95% CI 0.8898–0.9045) (Appendix 2, available at [www.cmajopen.ca/content/3/3/E264/suppl/DC1](http://www.cmajopen.ca/content/3/3/E264/suppl/DC1)). All of the case definitions were robust when analysed by age, sex, ethnicity and primary diagnosis of renal disease (Appendices 3 and 4, available at [www.cmajopen.ca/content/3/3/E264/suppl/DC1](http://www.cmajopen.ca/content/3/3/E264/suppl/DC1)). According to our predefined criteria of sensitivity greater than 80% and specificity greater than 90%, the optimal case definition was any 2 dialysis claims (overall accuracy of greater than 90% in all tested subgroups). ## Interpretation Our study showed that valid case definitions of ESRD can be derived from administrative claims data. These claims data may serve as a valuable tool to track the epidemiology of kidney failure at a population level. We found that extending the time interval (up to 7 years) improved the sensitivity and overall accuracy of the case definitions for chronic dialysis status, with a minimal change in specificity. Accuracy and agreement scores were suboptimal compared with the gold standard Manitoba Renal Program database when only a 1-year period was used. As such, we recommend that a 5- or 7- year interval for claims be used in case-finding for patients with ESRD in administrative datasets. Over a 1-year period, the most sensitive case definition (any 1 claim for outpatient dialysis) achieved a sensitivity of 77%, specificity of 94% and an overall accuracy of 88%. Conversely, the most specific definition (at least 2 claims for dialysis treatment at least 90 days apart, with no gaps in treatment greater than 21 d) had a sensitivity of 53%, specificity of 98% and an overall accuracy of 83%. Our findings were slightly inferior to the sensitivity and accuracy of similar case definitions in the province of Alberta,3 which highlights the need for external validation in individual jurisdictions where coding and billing practices, as well as registry accuracy, may differ. In contrast to the findings from Alberta, we found minimal gains in specificity with the addition of a 21-day gap limit to one of the case definitions that spanned 90 days, and a significant loss in sensitivity and overall accuracy. The loss in sensitivity was notable at 1 year but became even more pronounced when the time interval was extended to 5 and 7 years. This suggests that researchers seeking the most specific case definition of ESRD (to avoid false-positive cases) would not benefit from including a 21-day gap limit and should simply include all patients with at least 2 outpatient claims at least 90 days apart. However, if the most sensitive case definition is desired, a definition based on any 1 outpatient dialysis treatment may be preferable, with the caveat that cases of acute kidney injury (false-positive ESRD) requiring a single dialysis treatment might be identified. Our findings on the accuracy of the case definitions for ESRD were similar to those from other provinces3,20 when examined over a 1-year period, but they were markedly superior when we extended the period to 3, 5 and 7 years. Extending these periods allowed us to achieve a high degree of accuracy (> 90%) for multiple case definitions, which could be used if sensitivity or specificity was primarily desired. We suspect that these increases in accuracy were likely due to data-entry delays in the capture of incident cases in the patient registry, and to billing errors in administrative data. Errors in entering personal health identifiers for medical billing are common and often result in claims being rejected and returned to the submitting physician. The claims are corrected and resubmitted in a subsequent billing cycle. Given that billing submissions and cycles are monthly in most provinces, including Manitoba, a delay of several months between original claim submission and final approval is not uncommon and may explain the improved sensitivity of the case definitions when we extended the time periods. Similarly, errors in data entry of personal health identifiers may also occur in the registry database and may not be corrected until routine audits are performed, thereby causing a delay in the accurate registration of a dialysis patient in the ESRD registry. The combination of these events can result in the frequent mismatch of incident treatment dates, which can likely be overcome only by extending the window of claims or registry entry beyond a calendar year. There are several implications of our findings. First, our results show that administrative case definitions developed in one province or jurisdiction can be reliably reproduced in another province and achieve a similar degree of accuracy. Provincial and national public health organizations can now use these case definitions for surveillance of ESRD rates across the country. Comparisons across provinces, however, may be limited by differences in coding practices and data-entry standards. Second, we also found that the accuracy of the case definitions was substantially improved by extending the time interval for dialysis claims, and entry into the registry. These findings are likely generalizable to other jurisdictions and may improve the accuracy of case definitions for other chronic diseases. Finally, the high accuracy of the case definitions suggests that they can be used to establish an incident ESRD cohort, which could be linked with other administrative databases (e.g., prescription drug databases), thereby enabling larger studies to examine the effectiveness and safety of medical treatments in this population. This is especially important because randomized controlled trials of drug therapy are uncommon in patients with ESRD, and evidence is urgently needed to inform best medical practice.21,22 ### Strengths and limitations Strengths of our study include an independent validation of case definitions for defining ESRD requiring chronic dialysis that were developed in another Canadian province. Another strength was the demonstration of improvements in accuracy with the extension of the time horizon for registry entry and dialysis claims. In addition, Manitoba has a single dialysis provider (the Manitoba Renal Program), and therefore it is an ideal province for the development and validation of case definitions that need to be verified against program-level data. Like other studies that have explored these case definitions, our study has limitations. A case definition that requires 1 claim for dialysis will overestimate the incidence of chronic dialysis, because it captures patients who require only a single dialysis treatment and then recover kidney function. Conversely, case definitions that require patients to have claims separated by at least 90 days will introduce a survivor bias, because many patients receiving chronic dialysis may die within the first 3 months from other comorbidities. Although patients often may miss or skip dialysis treatments, we chose the 21-day gap to avoid capturing patients with recurrent acute kidney injury who received sporadic dialysis treatments but who should not be characterized as requiring life-sustaining chronic dialysis. Our study cohort included patients from the regions of northwestern Ontario and rural Saskatchewan, who receive care in Manitoba but for whom dialysis claims are likely submitted and reimbursed in their home provinces. The inclusion of these patients limits the sensitivity of the administrative case definitions but should not affect specificity. Another limitation was that the administrative case definitions rely on physicians or their practices to code and claim fees for dialysis services appropriately; as such, human errors and oversights in medical billing and coding may have occurred. Nonetheless, we suspect that these errors were limited, because dialysis treatment occurs thrice weekly for most patients, and dialysis fees represent a substantial portion of physician earnings for patients with ESRD. Finally, the case definitions are reliable only for the diagnosis of ESRD, not for non-dialysis chronic kidney disease. Previous studies aimed at developing a case definition for non-dialysis chronic kidney disease have shown poor sensitivity (< 30%), thereby limiting application.4 ### Conclusion Our study showed that accurate case definitions derived from administrative claims data can be developed and validated to identify patients with ESRD receiving chronic dialysis. The optimal case definition of any 2 claims for outpatient dialysis over a 5-year period achieved greater than 90% accuracy and could be used to examine long-term trends in disease prevalence. Longer intervals for entry into disease registries and collection of claims data may improve the accuracy of case definitions derived from administrative claims data to identify patients with other chronic disease states. ### Supplemental information For reviewer comments and the original submission of this manuscript, please see [www.cmajopen.ca/content/3/3/E264/suppl/DC1](http://www.cmajopen.ca/content/3/3/E264/suppl/DC1). See related research article by Komenda and colleagues at [www.cmajopen.ca/lookup/doi/10.9778/cmajo.20130034](http://www.cmajopen.ca/lookup/doi/10.9778/cmajo.20130034) ## Footnotes * Competing interests: None declared. * Contributors: Paul Komenda, Nancy Yu, Keevin Bernstein, James Blanchard, Manish Sood, Claudio Rigatto and Navdeep Tangri conceived the idea for the study. Nancy Yu and Stella Leung performed the statistical analysis. Paul Komenda, Nancy Yu and Navdeep Tangri drafted the manuscript. All of the authors contributed to the interpretation of results and the revising of the manuscript, approved the final version of the manuscript to be published and agreed to act as guarantors of the work. ## References 1. Fetter RB, Shin Y, Freeman JL, et al. Case mix definition by diagnosis-related groups. Med Care 1980;18(Suppl):1-53. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=7354668&link_type=MED&atom=%2Fcmajo%2F3%2F3%2FE264.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=A1980JG48400001&link_type=ISI) 2. Quan H, Khan N, Hemmelgarn BR, et al. Validation of a case definition to define hypertension using administrative data. Hypertension 2009;54:1423-8. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1161/HYPERTENSIONAHA.109.139279&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=19858407&link_type=MED&atom=%2Fcmajo%2F3%2F3%2FE264.atom) 3. Clement FM, James MT, Chin R, et al. Validation of a case definition to define chronic dialysis using outpatient administrative data. BMC Med Res Methodol 2011;11:25. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1186/1471-2288-11-25&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=21362182&link_type=MED&atom=%2Fcmajo%2F3%2F3%2FE264.atom) 4. Ronksley PE, Tonelli M, Quan H, et al. Validating a case definition for chronic kidney disease using administrative data. Nephrol Dial Transplant 2012;27:1826-31. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoibmR0IjtzOjU6InJlc2lkIjtzOjk6IjI3LzUvMTgyNiI7czo0OiJhdG9tIjtzOjIwOiIvY21ham8vMy8zL0UyNjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 5. James RC, Blanchard JF, Campbell D, et al. A model for non-communicable disease surveillance in Canada: the prairie pilot diabetes surveillance system. Chronic Dis Can 2004;25:7-12. [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=15554606&link_type=MED&atom=%2Fcmajo%2F3%2F3%2FE264.atom) 6. Marrie RA, Yu BN, Leung S, et al. Rising prevalence of vascular comorbidities in multiple sclerosis: validation of administrative definitions for diabetes, hypertension, and hyperlipidemia. Mult Scler 2012;18:1310-9. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NToic3Btc2oiO3M6NToicmVzaWQiO3M6OToiMTgvOS8xMzEwIjtzOjQ6ImF0b20iO3M6MjA6Ii9jbWFqby8zLzMvRTI2NC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 7. Yoshino M, Kuhlmann MK, Kotanko P, et al. International differences in dialysis mortality reflect background general population atherosclerotic cardiovascular mortality. J Am Soc Nephrol 2006;17:3510-9. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiam5lcGhyb2wiO3M6NToicmVzaWQiO3M6MTA6IjE3LzEyLzM1MTAiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzMvMy9FMjY0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 8. Zoccali C, Kramer A, Jager K. The databases: renal replacement therapy since 1989–the European Renal Association and European Dialysis and Transplant Association (ERA-EDTA). Clin J Am Soc Nephrol 2009;4(Suppl 1):S18-22. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiY2xpbmphc24iO3M6NToicmVzaWQiO3M6MTg6IjQvU3VwcGxlbWVudF8xL1MxOCI7czo0OiJhdG9tIjtzOjIwOiIvY21ham8vMy8zL0UyNjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 9. van de Luijtgaarden MW, Jager KJ, Stel VS, et al. Global differences in dialysis modality mix: the role of patient characteristics, macroeconomics and renal service indicators. Nephrol Dial Transplant 2013;28:1264-75. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoibmR0IjtzOjU6InJlc2lkIjtzOjk6IjI4LzUvMTI2NCI7czo0OiJhdG9tIjtzOjIwOiIvY21ham8vMy8zL0UyNjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 10. Noordzij M, Jager KJ. Increased mortality early after dialysis initiation: a universal phenomenon. Kidney Int 2014;85:12-4. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1038/ki.2013.316&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=24380902&link_type=MED&atom=%2Fcmajo%2F3%2F3%2FE264.atom) 11. *Manitoba Health and Healthy Living Report, June 1, 2008*. Winnipeg: Health Information Management Branch; 2008. 12. Glouberman S, Millar J. Evolution of the determinants of health, health policy, and health information systems in Canada. Am J Public Health 2003;93:388-92. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.2105/AJPH.93.3.388&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=12604478&link_type=MED&atom=%2Fcmajo%2F3%2F3%2FE264.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000181207500011&link_type=ISI) 13. Strijack B, Mojica J, Sood M, et al. Outcomes of chronic dialysis patients admitted to the intensive care unit. J Am Soc Nephrol 2009;20:2441-7. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiam5lcGhyb2wiO3M6NToicmVzaWQiO3M6MTA6IjIwLzExLzI0NDEiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzMvMy9FMjY0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 14. Sood MM, Komenda P, Sood AR, et al. Adverse outcomes among Aboriginal patients receiving peritoneal dialysis. CMAJ 2010;182:1433-39. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czoxMToiMTgyLzEzLzE0MzMiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzMvMy9FMjY0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 15. Khan A, Rigatto C, Verrelli M, et al. High rates of mortality and technique failure in peritoneal dialysis patients after critical illness. Perit Dial Int 2012;32:29-36. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoicGRpIjtzOjU6InJlc2lkIjtzOjc6IjMyLzEvMjkiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzMvMy9FMjY0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 16. Lok CE, Oliver MJ, Rothwell DM, et al. The growing volume of diabetes-related dialysis: a population based study. Nephrol Dial Transplant 2004;19:3098-103. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoibmR0IjtzOjU6InJlc2lkIjtzOjEwOiIxOS8xMi8zMDk4IjtzOjQ6ImF0b20iO3M6MjA6Ii9jbWFqby8zLzMvRTI2NC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 17. Komenda P, Yu N, Leung S, et al. Secular trends in end-stage renal disease requiring dialysis in Manitoba, Canada: a population-based study. CMAJ Open 2014;3:E8-E14. 18. Blanchard JF, Ludwig S, Wajda A, et al. Incidence and prevalence of diabetes in Manitoba, 1986-1991. Diabetes Care 1996;19:807-11. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiZGlhY2FyZSI7czo1OiJyZXNpZCI7czo4OiIxOS84LzgwNyI7czo0OiJhdG9tIjtzOjIwOiIvY21ham8vMy8zL0UyNjQuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 19. Winkelmayer WC, Schneeweiss S, Mogun H, et al. Identification of individuals with CKD from Medicare claims data: a validation study. Am J Kidney Dis 2005;46:225-32. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1053/j.ajkd.2005.04.029&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=16112040&link_type=MED&atom=%2Fcmajo%2F3%2F3%2FE264.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000230926100005&link_type=ISI) 20. Quinn RR, Laupacis A, Austin PC, et al. Using administrative datasets to study outcomes in dialysis patients: a validation study. Med Care 2010;48:745-50. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1097/MLR.0b013e3181e419fd&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=20613656&link_type=MED&atom=%2Fcmajo%2F3%2F3%2FE264.atom) [Web of Science](http://www.cmajopen.ca/lookup/external-ref?access_num=000280115700012&link_type=ISI) 21. Strippoli GF, Craig JC, Schena FP. The number, quality, and coverage of randomized controlled trials in nephrology. J Am Soc Nephrol 2004;15:411-9. [Abstract/FREE Full Text](http://www.cmajopen.ca/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6ODoiam5lcGhyb2wiO3M6NToicmVzaWQiO3M6ODoiMTUvMi80MTEiO3M6NDoiYXRvbSI7czoyMDoiL2NtYWpvLzMvMy9FMjY0LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 22. Boulware LE, Tangri N, Ephraim PL, et al. Comparative effectiveness studies to improve clinical outcomes in end stage renal disease: the DEcIDE patient outcomes in end stage renal disease study. BMC Nephrol 2012;13:167. [CrossRef](http://www.cmajopen.ca/lookup/external-ref?access_num=10.1186/1471-2369-13-167&link_type=DOI) [PubMed](http://www.cmajopen.ca/lookup/external-ref?access_num=23217181&link_type=MED&atom=%2Fcmajo%2F3%2F3%2FE264.atom) * © 2015, 8872147 Canada Inc. or its licensors