Skip to main content

Main menu

  • Home
  • Content
    • Current issue
    • Past issues
    • Collections
  • Authors & Reviewers
    • Overview for authors
    • Preparing manuscripts
    • Submission checklist
    • Publication fees
    • Forms
    • Editorial policies
    • Editorial process
    • Patient-Oriented Research
    • Manuscript progress
    • Submitting a letter
    • Information for reviewers
    • Open access
  • Alerts
    • Email alerts
    • RSS
  • About
    • General information
    • Staff
    • Editorial board
    • Contact
  • CMAJ JOURNALS
    • CMAJ
    • CJS
    • JAMC
    • JPN

User menu

Search

  • Advanced search
CMAJ Open
  • CMAJ JOURNALS
    • CMAJ
    • CJS
    • JAMC
    • JPN
CMAJ Open

Advanced Search

  • Home
  • Content
    • Current issue
    • Past issues
    • Collections
  • Authors & Reviewers
    • Overview for authors
    • Preparing manuscripts
    • Submission checklist
    • Publication fees
    • Forms
    • Editorial policies
    • Editorial process
    • Patient-Oriented Research
    • Manuscript progress
    • Submitting a letter
    • Information for reviewers
    • Open access
  • Alerts
    • Email alerts
    • RSS
  • About
    • General information
    • Staff
    • Editorial board
    • Contact
  • Subscribe to our alerts
  • RSS feeds
  • Follow CMAJ Open on Twitter
Research

Iron deficiency screening for children at 18 months: a cost-utility analysis

Sarah Carsley, Rui Fu, Cornelia M. Borkhoff, Nadine Reid, Eva Baginska, Catherine S. Birken, Jonathon L. Maguire, Rebecca Hancock-Howard, Patricia C. Parkin and Peter C. Coyte
December 03, 2019 7 (4) E689-E698; DOI: https://doi.org/10.9778/cmajo.20190084
Sarah Carsley
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rui Fu
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Cornelia M. Borkhoff
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Nadine Reid
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Eva Baginska
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Catherine S. Birken
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jonathon L. Maguire
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Rebecca Hancock-Howard
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Patricia C. Parkin
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Peter C. Coyte
Health Promotion, Chronic Disease and Injury Prevention (Carsley), Public Health Ontario; Institute of Health Policy, Management and Evaluation (Fu, Borkhoff, Reid, Baginska, Birken, Maguire, Hancock-Howard, Parkin, Coyte), Dalla Lana School of Public Health, University of Toronto; Child Health Evaluative Sciences (Borkhoff, Birken, Parkin), Peter Gilgan Centre for Research and Learning, The Hospital for Sick Children; Division of Pediatric Medicine and the Pediatric Outcomes Research Team (Borkhoff, Birken, Maguire, Parkin), Department of Pediatrics, Faculty of Medicine, University of Toronto, The Hospital for Sick Children; Department of Pediatrics (Maguire), St. Michael’s Hospital and Li Ka Shing Knowledge Institute; Department of Nutritional Sciences (Birken, Maguire), University of Toronto, Toronto, Ont.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Article
  • Figures & Tables
  • Related Content
  • Responses
  • Metrics
  • PDF
Loading

Abstract

Background: The peak prevalence of iron deficiency is in children 6 months to 3 years of age, a sensitive period for neurodevelopment. Our study objective was to examine the cost-utility of a proposed iron deficiency screening program for 18-month-old children.

Methods: We used a decision tree model to estimate the costs in 2019 Canadian dollars and quality-adjusted life years (QALYs) associated with 3 iron deficiency screening strategies: no screening, universal screening and targeted screening for a high-risk population. We used a societal perspective and assessed lifetime QALY gains. We derived outcomes from the literature and prospectively collected data. We performed one-way and probabilistic sensitivity analyses to assess parameter uncertainty.

Results: The incremental costs to society of universal and targeted screening programs compared to no screening were $2286.06/QALY and $1676.94/QALY, respectively. With a willingness-to-pay threshold of $50 000/QALY, both programs were cost-effective. Compared to a targeted screening program, a universal screening program would cost an additional $2965.96 to gain 1 QALY, which renders it a cost-effective option. The study findings were robust to extensive sensitivity analyses.

Interpretation: A proposed universal screening program for iron deficiency would be cost-effective over the lifespan compared to both no screening (current standard of care) and a targeted screening program for children at high risk. Policy-makers and physicians may consider expanding the recommended 18-month enhanced well-baby visit to include screening for iron deficiency.

Iron deficiency is the world’s most prevalent micronutrient disorder, with a peak prevalence in children aged 6 months to 3 years.1 Early childhood is a sensitive period for neurodevelopment and overlaps with a period of rapid growth and transitions in feeding, which may result in inadequate daily iron intake.2 In developed countries, the prevalence of iron deficiency in young children is about 10%–15%, and, in roughly 1 in 6 children, iron deficiency may progress to iron deficiency anemia, with a prevalence of about 2%.3,4 Iron deficiency in infancy is associated with poor long-term neurocognitive and functional outcomes that may persist into adulthood.5–9 The current standard of care for children with iron deficiency anemia is diet advice and oral iron treatment for 3–6 months, which is effective in improving laboratory and developmental outcomes.10–12 Given the potential for nonanemic iron deficiency to progress to iron deficiency anemia, early detection and intervention may be beneficial.13

There is no current Canadian recommendation for screening for iron deficiency. The American Academy of Pediatrics recommends universal screening for anemia through measurement of hemoglobin at 12 months of age, but this approach has limitations, as the rapidly developing brain may be exposed to chronic iron deficiency by the time anemia is detected.2,14 We recently assessed a strategy to screen for iron deficiency through measurement of serum ferritin at 18 months;15 however, the cost of this strategy has not been assessed.16 The purpose of the present study was to model the long-term cost-utility of a proposed iron deficiency screening program using measurement of serum ferritin in 18-monthold children during a scheduled health supervision visit in the general population and in a targeted high-risk population in Ontario.

Methods

Target population

The target population for this cost-utility analysis was children 18 months of age attending a scheduled 18-month health visit in a developed-country setting such as Canada.

Model structure

We used a decision tree model (Figure 1) to estimate the costs and quality-adjusted life years (QALYs) to obtain incremental cost-effectiveness ratios (ICERs) associated with 3 iron deficiency screening strategies: no screening, a universal screening program and a targeted screening program for a high-risk population (defined below). We selected the inputs of the decision tree model to reflect a general framework for evaluating the cost-effectiveness of screening programs.17 With the understanding that iron deficiency during the sensitive period for neurodevelopment may lead to long-term poor functional outcomes, we chose a lifetime time horizon in our analysis.18,19

Figure 1:
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 1:

Decision tree model (universal screening branch only; full decision tree is available in Appendix 1, Supplemental Figure 1, available at www.cmajopen.ca/content/7/4/E689/suppl/DC1).

The model included health states at 4 terminal nodes: 1) “healthy, untreated” if iron deficiency was not present and treatment unnecessary, 2) “healthy, after treatment” if iron deficiency was detected and treated successfully, 3) “poor functional outcomes, after treatment” if iron deficiency was detected and treatment was unsuccessful and 4) “poor functional outcomes, untreated” if iron deficiency was not detected and not treated. The analysis was conducted from a societal perspective, wherein all costs irrespective of payer were included. We used an annual discounting rate of 1.5%.19 We followed guidelines for economic evaluations of newborn screening20 and performed analyses using TreeAge Pro Software 18.2.1.

Data sources

We populated the model with data from the literature and prospectively collected data from our ongoing Optimizing Early Child Development (OptEC) study.13 This study is embedded in our pediatric primary care research network called TARGet Kids! (www.targetkids.ca).3 The recruitment process for OptEC simulates our proposed iron deficiency screening program because blood is obtained from young children attending a scheduled health supervision visit in primary care. As of December 2018, about 1500 children had had questionnaire data and laboratory measures (including hemoglobin, serum ferritin and C-reactive protein) collected.

Base-case model inputs

Prevalence of iron deficiency

We derived a prevalence of iron deficiency in the general population of young children of 12% from a published review of 10 studies in Canadian children21 and from our contemporary urban OptEC cohort (Table 1). We defined children at high risk as those with 2 or more risk factors for iron deficiency (younger age [12–36 mo], longer breast-feeding duration, high body mass index z-score and drinking > 500 mL of cow’s milk daily) (Table 1).26–34 Iron deficiency was defined as a serum ferritin level less than 12 μg/L2,35 in the base-case analysis and as a serum ferritin level less than 18 μg/L in the sensitivity analysis; the latter cut-off was derived from our recent analysis of data from the OptEC study (Appendix 1, Supplemental Table S1, available at www.cmajopen.ca/content/7/4/E689/suppl/DC1).13

View this table:
  • View inline
  • View popup
Table 1:

Clinical parameter inputs for the base-case scenario

Sensitivity and specificity of screening test

Under both screening strategies, we proposed screening for iron deficiency by means of serum ferritin measurement, a commonly available test. Guyatt and colleagues22 analyzed data from 55 studies in adults that examined laboratory tests of iron status and histologic examination of bone marrow, and concluded that serum ferritin measurement is the most accurate test for the diagnosis of iron deficiency. As we did not identify any similar study in children, we used estimates from that study.

Probability of poor functional outcomes

We considered poor functional outcomes as a direct consequence of iron deficiency or due to causes other than iron deficiency. We also considered whether children with iron deficiency received oral iron treatment. The estimates used for our base case came from 2 published randomized controlled trials and a long-term observational study (Table 1).6,12,15 Untreated iron deficiency in infancy is associated with poor neurodevelopmental and functional outcomes. 5,11,12,36 Lozoff and colleagues6 reported that, at 10 years of age, compared to children with good iron status in infancy, children with chronic, severe iron deficiency in infancy had higher rates of grade repetition (26% v. 12%) and referral for special services (21% v. 7%). We used the average of these rates as estimates of the probability of poor functional outcomes in children with untreated iron deficiency (23.5%) and due to causes other than iron deficiency (9.5%). These estimates were more conservative than those reported by Lozoff and colleagues9 in the same cohort at 25 years of age, when rates of incompletion of secondary school were compared (58% v. 20%).

To estimate the probability of poor functional outcomes in children with treated iron deficiency in infancy, we referred to data from the randomized trials of infants with iron deficiency anemia and nonanemic iron deficiency, which showed that mental development scores reversed in those who received 4 months of oral iron treatment but not in those who received placebo.11,12 Therefore, we used the same rate as for children with good iron status in the cohort followed by Lozoff and colleagues6 (9.5%).

Utility scores

A QALY is calculated by multiplying the utility score by life expectancy (Table 2). We assumed that cognitive deficits beginning in infancy leading to poor functional outcomes in adulthood do not lead to early death; therefore, we assumed all children to have a life expectancy of 80.5 years at 18 months of age.37

View this table:
  • View inline
  • View popup
Table 2:

Calculation of effectiveness

We assigned a utility score of 1.0 to children who did not screen positive for iron deficiency and were assumed to have lifelong health. We assigned a utility score of 0.84 to children with poor functional outcomes, derived from the average of 2 sources by means of different instruments, to capture utilities across the life course (childhood to adulthood). First, a median utility of 0.87 was reported in a study of parents of children aged 3–36 months in which parents were presented with a scenario describing a child’s illness and resulting poor functional outcomes such as problems with learning, problems with behavioural, attentional or social skills, and slightly lower intelligence. 24 Second, a mean utility of 0.82 was reported in a study of healthy adults who were presented with vignettes and asked to imagine what it would be like to experience mild impairments in cognitive and functional performance.25

Treatment of iron deficiency with oral iron supplementation may be associated with minor gastrointestinal adverse events.10 Therefore, we assigned a utility score of 0.82 to a 4-month treatment period.23 We did not consider disutility due to venipuncture, as a median utility of 1.0 has previously been identified.24

Costs

We considered both direct and indirect costs in our analysis (Table 3). We obtained the direct medical cost of the screening test from the Ontario Health Insurance Plan Laboratory Test Schedule of Benefits (effective April 2017)45 and adjusted it to present value (January 2019) using the Canadian Consumer Price Index.39 Although screening for iron deficiency may be based on serum ferritin measurement alone, to derive a conservative cost estimate, we included the additional cost for hemoglobin and C-reactive protein (C-reactive protein is recommended to exclude the possibility of acute inflammation). In the base-case analysis, we assumed an urban location for the specimen collection fee under both screening strategies. Alternative patient locations associated with different fees were assessed in sensitivity analyses. The unit price of targeted screening was $6.52 more expensive than the universal strategy to account for increased clinician time to identify children at high risk. We estimated the direct 4-month treatment cost of a commonly prescribed oral iron supplement (ferrous sulfate) from the Ontario Drug Benefit Formulary/Comparative Drug Index.44

View this table:
  • View inline
  • View popup
Table 3:

Cost parameter inputs for the base-case scenario

We included the indirect (or time) cost paid by parents to attend a laboratory for phlebotomy. Estimation of salary loss was based on Statistics Canada labour statistics on the average weekly wage in January 2019 and 0.5 days off work.40 Parents were assumed to drive to the laboratory and park for 1 hour. Arrival by public transportation and taking up to a full day off work were considered in sensitivity analyses. We did not include the cost of the 18-month visit, as this visit is currently recommended for all children and is covered by the Ontario Health Insurance Plan. To be conservative, we did not include direct or indirect lifetime costs of poor functional outcomes.

Sensitivity analysis

We conducted extensive one-way sensitivity analyses to assess the uncertainty of the ICERs by varying the single-parameter values (Appendix 1, Supplemental Table S1). We performed probabilistic sensitivity analyses using 100 000 Monte Carlo simulations to assess the simultaneous uncertainty around multiple variables (Appendix 1, Supplemental Table S2).

Ethics approval

Ethics approval was not required for this study. Ethics approval for the OptEC study was obtained from the research ethics boards at The Hospital for Sick Children and St. Michael’s Hospital, Toronto.

Results

Base case

The marginal cost per child of each screening strategy was $144.81 for universal, screen negative; $314.81 for universal, screen positive; $151.33 for targeted, screen negative; $321.33 for targeted, screen positive; and $0.00 for no screening.

In the base-case scenario, compared to no screening, a universal and a targeted screening program cost society an additional $162.98 and $63.06, respectively, in exchange for 0.07 and 0.04 QALY gains, respectively, in a lifetime (Table 4, Appendix 1, Supplemental Figure 2). The ICERs for the universal and the targeted screening programs relative to no screening were $2286.06/QALY and $1676.94/QALY, respectively. With 2 common willingness-to-pay thresholds of $50 000 and $100 000 per QALY,46 both screening strategies were cost-effective over no screening. The universal program was $99.92 more expensive than the targeted program while producing 0.03 additional QALYs in a lifetime, giving an ICER of $2965.96/QALY. Therefore, the universal screening program is cost-effective compared to the targeted program.

View this table:
  • View inline
  • View popup
Table 4:

Cost-utility analysis results under base-case assumptions

Figure 2:
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 2:

One-way sensitivity analyses comparing (A) universal screening versus no screening, (B) targeted screening versus no screening and (C) universal screening versus targeted screening. Note: EV = expected value (equivalent to the base-case incremental cost-effectiveness ratio [ICER]), ID = iron deficiency, prob = probability.

Sensitivity analyses

One-way sensitivity analyses

Figure 2 shows the tornado diagrams of the one-way sensitivity analyses. The base-case conclusions were robust to all single-parameter variations. When the probability of iron-deficiency–associated poor functional outcomes was as low as 8.4%, the ICERs of universal and targeted screening programs reached $11 679.36/QALY and $8888.30/QALY, respectively, compared to no screening, and the ICER of the universal program reached $14 565.99/QALY compared to targeted screening, still far below the threshold of $50 000/QALY.

Probabilistic sensitivity analyses

Probabilistic sensitivity analyses showed that, 98.8% and 99.0% of the time, the ICER for universal screening or targeted screening as compared to no screening would be below the threshold of $50 000 (Figure 3). When universal screening was compared to targeted screening, the former was cost-effective 98.5% of the time.

Figure 3:
  • Download figure
  • Open in new tab
  • Download powerpoint
Figure 3:

Probabilistic sensitivity analyses results comparing (A) universal screening versus no screening, (B) targeted screening versus no screening and (C) universal screening versus targeted screening. Note: WTP = willingness to pay.

Interpretation

Our findings suggest that a universal screening program for iron deficiency is cost-effective compared to the current practice of no screening or a targeted screening program for children at high risk. These results were robust to extensive sensitivity analyses. In our analysis, we chose parameters that would result in conservative estimates of cost-effectiveness. These included assuming that no further costs would be incurred owing to poor functional outcomes, as there may be direct costs or indirect costs, or both, associated with public or private assessments and interventions for people with developmental difficulties, at any time from childhood to adulthood. We assumed no additional societal costs owing to lower school completion or early death, and included a cost for parents’ taking time off work for an additional laboratory visit. The diagnostic accuracy of the screening test was based on serum ferritin measurement alone despite including the cost of a complete blood count, which would improve the sensitivity and specificity of iron deficiency detection, thereby increasing cost-effectiveness. In our model, once the present value of the lifetime cost associated with poor functional outcomes exceeded $12 000, both screening programs would be cost-saving compared to no screening.

Our results suggest that the costs saved by restricting the program to children at high risk would be offset by the loss of QALYs for unscreened children at average risk. This is likely driven by the small incremental cost difference between the universal program and the targeted program ($99.92). Hence, an additional $100 spent in a universal program would be exchanged for $1500 worth of effectiveness (0.03 extra QALYs × $50 000/QALY = $1500), which is highly cost-effective.

We identified 1 published economic analysis of anemia prevention, by Shaker and colleagues,47 in infants aged 9–12 months in the United States, where anemia screening (with hemoglobin) is currently recommended. They concluded that screening by means of an alternative test called reticulocyte hemoglobin content was an affordable strategy compared to hemoglobin alone. Their analysis differed from ours in several ways. Shaker and colleagues47 did not include a no-screening strategy, used reticulocyte hemoglobin content (rather than serum ferritin, which is more widely available and well known to physicians2) and proposed screening at 9–12 months. We selected the 18-month visit, as our previous analysis showed that the serum ferritin level is lowest between 15 and 24 months and that the hemoglobin level does not change substantially between 12 and 24 months.15 Finally, Shaker and colleagues47 included the cost of use of additional health care services for children with untreated iron deficiency, whereas we did not.

In keeping with the World Health Organization principles, 48 the goal of screening for iron deficiency is early detection and treatment before progression to chronic, severe iron deficiency or iron deficiency anemia. A Cochrane systematic review identified 8 trials of iron treatment in young children with iron deficiency anemia; however, only 1 study used a duration of treatment (4 mo) consistent with the current standard of care.36 That randomized trial showed that developmental scores were reduced in the infants with iron deficiency anemia before treatment and reversed after iron treatment, with follow-up scores similar to those for healthy children with iron sufficiency.12 Another randomized trial in infants with nonanemic iron deficiency similarly showed that developmental scores were reduced before treatment and improved after treatment.11 Lozoff and colleagues5–9 followed a cohort of Costa Rican children to 25 years of age and found that those with chronic, severe iron deficiency in infancy had poorer long-term cognitive and functional outcomes than those who were iron sufficient in infancy (before or after iron therapy). Together, these studies suggest that early detection of iron deficiency followed by a good response to oral iron treatment may lead to more favourable outcomes and that late detection of iron deficiency may be accompanied by slow response to oral iron treatment and poor long-term outcomes.

The Canadian Paediatric Society and the College of Family Physicians of Canada recommend an 18-month enhanced well-baby visit in primary care, which has been implemented in Ontario with a physician fee incentive.49,50 This may be an ideal visit for screening for iron deficiency, is aligned with the goal of improving child developmental outcomes, and is feasible owing to the high uptake of this visit for vaccinations and health surveillance.51

Strong recommendations have been made for investment in early childhood, considering the evidence supporting the developmental origins of health and disease. Heckman developed the “Heckman equation,” which describes a high return on investment for preventive initiatives early in the life course.52–54 In keeping with this theory, screening and treatment for iron deficiency in early childhood has the potential to improve outcomes throughout the life course, with a modest economic investment.

Opportunities for future research include understanding the values and preferences of parents and practitioners for screening for iron deficiency; conducting a budget impact analysis to assess system-level costs associated with screening; developing a risk-stratification tool to be used for targeted screening (similar to tools for assessing risk of diabetes in adults);55 and validating a point-of-care tool for serum ferritin to improve convenience and reduce cost.16,56

Limitations

Our analysis has limitations common in cost-effectiveness analyses.57,58 First, we could not identify any sources to estimate the accuracy of serum ferritin measurement in children (and therefore used data from adults) and iron-deficiency– specific utility scores (and therefore used data from similar scenarios). Sources to estimate the probability of poor functional outcomes were methodologically strong and included randomized controlled trials and a long-term observational study; however, these studies were conducted in developing countries. Second, we did not include future costs that might be incurred as a result of poor functional outcomes, which led to a conservative estimate of costs. However, the inclusion of these costs in our model would increase the cost-effectiveness of the 2 screening programs compared to no screening.

Conclusion

A proposed universal screening program for iron deficiency would be cost-effective over the lifespan compared to both no screening (current standard of care) and a targeted screening program for children at high risk. Policy-makers and physicians may consider expanding the recommended 18-month enhanced well-baby visit to include screening for iron deficiency.

Footnotes

  • Competing interests: Patricia Parkin reports a grant from the Canadian Institutes of Health Research (FRN 115059) for an ongoing investigator-initiated trial of iron deficiency in young children, for which Mead Johnson Nutrition provided nonfinancial support (2011–2017), related to this study. She reports peer-reviewed grants for completed investigator-initiated studies from the Danone Institute of Canada (2002–2004 and 2006–2009) and Dairy Farmers of Ontario (2008–2010), unrelated to this study. Eva Baginska is the current director of Health Economics and Outcomes Research at BD-Canada. No other competing interests were declared.

  • This article has been peer reviewed.

  • Contributors: Sarah Carsley and Rui Fu contributed equally as co-first authors. Patricia Parkin and Peter Coyte contributed equally as co-senior authors. Sarah Carsley, Patricia Parkin, Nadine Reid and Eva Baginska conceived and designed the study. Rui Fu analyzed the data. Rui Fu, Sarah Carsley and Patricia Parkin drafted the manuscript. Cornelia Borkhoff, Nadine Reid, Eva Baginska, Catherine Birken, Jonathon Maguire, Rebecca Hancock-Howard and Peter Coyte contributed to the study design and data interpretation. Cornelia Borkhoff, Catherine Birken and Jonathon Maguire provided data. All of the authors reviewed the manuscript critically for important intellectual content, approved the final version to be published and agreed to be accountable for all aspects of the work.

  • Funding: The Optimizing Early Child Development study is supported by grant FRN 115059 from the Canadian Institutes of Health Research. The Pediatric Outcomes Research Team is supported by a grant from The Hospital for Sick Children Foundation.

  • Disclaimer: The funding agencies and BD-Canada had no role in the design, collection, analyses or interpretation of the results of this study or in the preparation, review or approval of the manuscript.

  • Supplemental information: For reviewer comments and the original submission of this manuscript, please see www.cmajopen.ca/content/7/4/E689/suppl/DC1.

References

  1. ↵
    (2001) Iron deficiency anemia assessment, prevention and control: a guide for programme managers (World Health Organization, Geneva) Available: http://whqlibdoc.who.int/hq/2001/WHO_NHD_01.3.pdf. accessed 2018 Nov 30.
  2. ↵
    1. Baker RD,
    2. Greer FR,
    3. Committee on Nutrition American Academy of Pediatrics
    (2010) Diagnosis and prevention of iron deficiency and iron-deficiency anemia in infants and young children (0–3 years of age). Pediatrics 126:1040–50.
    OpenUrlAbstract/FREE Full Text
  3. ↵
    1. Carsley S,
    2. Borkhoff CM,
    3. Maguire JL,
    4. et al.,
    5. TARGet Kids! Collaboration
    (2015) Cohort profile: The Applied Research Group for Kids (TARGet Kids!). Int J Epidemiol 44:776–88.
    OpenUrlCrossRefPubMed
  4. ↵
    1. Gupta PM,
    2. Hamner HC,
    3. Suchdev PS,
    4. et al.
    (2017) Iron status of toddlers, nonpregnant females, and pregnant females in the United States. Am J Clin Nutr 106(Suppl 6):1640S–6S.
    OpenUrlAbstract/FREE Full Text
  5. ↵
    1. Lozoff B,
    2. Brittenham GM,
    3. Wolf AW,
    4. et al.
    (1987) Iron deficiency anemia and iron therapy effects on infant developmental test performance [erratum in Pediatrics 1988;81:683]. Pediatrics 79:981–95.
    OpenUrlAbstract/FREE Full Text
  6. ↵
    1. Lozoff B,
    2. Jimenez E,
    3. Hagen J,
    4. et al.
    (2000) Poorer behavioral and developmental outcome more than 10 years after treatment for iron deficiency in infancy. Pediatrics 105:E51.
    OpenUrlCrossRefPubMed
    1. Lozoff B,
    2. Jimenez E,
    3. Smith JB
    (2006) Double burden of iron deficiency in infancy and low socioeconomic status: a longitudinal analysis of cognitive test scores to age 19 years. Arch Pediatr Adolesc Med 160:1108–13.
    OpenUrlCrossRefPubMed
    1. Lozoff B,
    2. Jimenez E,
    3. Wolf AW
    (1991) Long-term developmental outcome of infants with iron deficiency. N Engl J Med 325:687–94.
    OpenUrlCrossRefPubMed
  7. ↵
    1. Lozoff B,
    2. Smith JB,
    3. Kaciroti N,
    4. et al.
    (2013) Functional significance of early-life iron deficiency: outcomes at 25 years. J Pediatr 163:1260–6.
    OpenUrlCrossRefPubMed
  8. ↵
    1. Powers JM,
    2. Buchanan GR,
    3. Adix L,
    4. et al.
    (2017) Effect of low-dose ferrous sulfate vs iron polysaccharide complex on hemoglobin concentration in young children with nutritional iron-deficiency anemia: a randomized clinical trial. JAMA 317:2297–304.
    OpenUrlCrossRefPubMed
  9. ↵
    1. Akman M,
    2. Cebeci D,
    3. Okur V,
    4. et al.
    (2004) The effects of iron deficiency on infants’ developmental test performance. Acta Paediatr 93:1391–6.
    OpenUrlCrossRefPubMed
  10. ↵
    1. Idjradinata P,
    2. Pollitt E
    (1993) Reversal of developmental delays in iron-deficient anaemic infants treated with iron. Lancet 341:1–4.
    OpenUrlCrossRefPubMed
  11. ↵
    1. Abdullah K,
    2. Thorpe KE,
    3. Mamak E,
    4. et al.
    (2015) Optimizing early child development for young children with non-anemic iron deficiency in the primary care practice setting (OptEC): study protocol for a randomized controlled trial. Trials 16:132.
    OpenUrl
  12. ↵
    1. Georgieff MK
    (2017) Iron assessment to protect the developing brain. Am J Clin Nutr 106(Suppl 6):1588S–93S.
    OpenUrlAbstract/FREE Full Text
  13. ↵
    1. Oatley H,
    2. Borkhoff CM,
    3. Chen S,
    4. et al.
    (2018) Screening for iron deficiency in early childhood using serum ferritin in the primary care setting. Pediatrics 142:e20182095.
    OpenUrlAbstract/FREE Full Text
  14. ↵
    1. Cohen AR
    (2018) Looking behind the iron curtain. Pediatrics 142:e20183068.
    OpenUrlFREE Full Text
  15. ↵
    1. Flaherman VJ,
    2. Porco TC,
    3. Marseille E,
    4. et al.
    (2007) Cost-effectiveness of alternative strategies for tuberculosis screening before kindergarten entry. Pediatrics 120:90–9.
    OpenUrlAbstract/FREE Full Text
  16. ↵
    1. Basu A,
    2. Maciejewski ML
    (2019) Choosing a time horizon in cost and cost-effectiveness analyses. JAMA 321:1096–7.
    OpenUrl
  17. ↵
    (2017) Guidelines for the economic evaluation of health technologies: Canada (Canadian Agency for Drugs and Technologies in Health, Ottawa) Available: www.cadth.ca/sites/default/files/pdf/guidelines_for_the_economic_evaluation_of_health_technologies_canada_4th_ed.pdf. accessed 2019 Feb 11. 4th ed..
  18. ↵
    1. Langer A,
    2. Holle R,
    3. John J
    (2012) Specific guidelines for assessing and improving the methodological quality of economic evaluations of newborn screening. BMC Health Serv Res 12:300.
    OpenUrlCrossRefPubMed
  19. ↵
    1. Hartfield D
    (2010) Iron deficiency is a public health problem in Canadian infants and children. Paediatr Child Health 15:347–50.
    OpenUrlPubMed
  20. ↵
    1. Guyatt GH,
    2. Oxman AD,
    3. Ali M,
    4. et al.
    (1992) Laboratory diagnosis of iron-deficiency anemia: an overview. J Gen Intern Med 7:145–53.
    OpenUrlCrossRefPubMed
  21. ↵
    1. National Collaborating Centre for Women’s and Children’s Health (UK)
    (2010) Constipation in children and young people: diagnosis and management of idiopathic childhood constipation in primary and secondary care (RCOG Press, London (UK)).
  22. ↵
    1. Bennett JE,
    2. Sumner W 2nd.,
    3. Downs SM,
    4. et al.
    (2000) Parents’ utilities for outcomes of occult bacteremia. Arch Pediatr Adolesc Med 154:43–8.
    OpenUrlCrossRefPubMed
  23. ↵
    1. Ekman M,
    2. Berg J,
    3. Wimo A,
    4. et al.
    (2007) Health utilities in mild cognitive impairment and dementia: a population study in Sweden. Int J Geriatr Psychiatry 22:649–55.
    OpenUrlCrossRefPubMed
  24. ↵
    1. Abdullah K,
    2. Thorpe KE,
    3. Maguire JL,
    4. et al.
    (2015) Risk factors, practice variation and hematological outcomes of children identified with non-anemic iron deficiency following screening in primary care setting. Paediatr Child Health 20:302–6.
    OpenUrlPubMed
    1. Bayoumi I,
    2. Parkin PC,
    3. Lebovic G,
    4. et al.
    (2018) Iron deficiency among low income Canadian toddlers: a cross-sectional feasibility study in a Community Health Centre and non-Community Health Centre sites. BMC Fam Pract 19:161.
    OpenUrl
    1. Cox KA,
    2. Parkin PC,
    3. Anderson LN,
    4. et al.,
    5. TARGet Kids! Collaboration
    (2016) Association between meat and meat-alternative consumption and iron stores in early childhood. Acad Pediatr 16:783–91.
    OpenUrl
    1. Maguire JL,
    2. Lebovic G,
    3. Kandasamy S,
    4. et al.,
    5. TARGet Kids! Collaboration
    (2013) The relationship between cow’s milk and stores of vitamin D and iron in early childhood. Pediatrics 131:e144–51.
    OpenUrlAbstract/FREE Full Text
    1. Maguire JL,
    2. Salehi L,
    3. Birken CS,
    4. et al.,
    5. TARGet Kids! Collaboration
    (2013) Association between total duration of breastfeeding and iron deficiency. Pediatrics 131:e1530–7.
    OpenUrlAbstract/FREE Full Text
    1. Parkin PC,
    2. DeGroot J,
    3. Maguire JL,
    4. et al.
    (2016) Severe iron-deficiency anaemia and feeding practices in young children. Public Health Nutr 19:716–22.
    OpenUrl
    1. Saunders NR,
    2. Parkin PC,
    3. Birken CS,
    4. et al.,
    5. TARGet Kids! Collaboration
    (2016) Iron status of young children from immigrant families. Arch Dis Child 101:1130–6.
    OpenUrlAbstract/FREE Full Text
    1. Sutcliffe TL,
    2. Khambalia A,
    3. Westergard S,
    4. et al.
    (2006) Iron depletion is associated with daytime bottle-feeding in the second and third years of life. Arch Pediatr Adolesc Med 160:1114–20.
    OpenUrlCrossRefPubMed
  25. ↵
    1. Sypes EE,
    2. Parkin PC,
    3. Birken CS,
    4. et al.,
    5. TARGet Kids! Collaboration
    (2019) Higher body mass index is associated with iron deficiency in children 1 to 3 years of age. J Pediatr 207:198–204.e1.
    OpenUrl
  26. ↵
    (2007) Assessing the iron status of populations: including literature reviews — report of a Joint World Health Organization/Centers for Disease Control and Prevention Technical Consultation on the Assessment of Iron Status at the Population Level, Geneva, Switzerland, 6–8 April 2004 (World Health Organization, Geneva), 2nd ed.
  27. ↵
    1. Wang B,
    2. Zhan S,
    3. Gong T,
    4. et al.
    (2013) Iron therapy for improving psychomotor development and cognitive function in children under the age of three with iron deficiency anaemia. Cochrane Database Syst Rev (6):CD001444.
  28. ↵
    Life tables, Canada, provinces and territories. Cat no 84-537-XOttawaStatistics CanadaAvailable: www150.statcan.gc.ca/n1/pub/84-537-x/2018002/xls/2014-2016_Tbl-eng.xlsxaccessed 2019 May 6
  29. (2016) Highlights of collective agreement changes as a result of the Albertyn Award and items in agreement between ONA and participating hospitals. Term: April 1, 2016 to March 31, 2018 (Ontario Nurses Association, Toronto) Available: www.ona.org/wp-content/uploads/ona_2016hospitalawardhighlights_20160912.pdf?x72008. accessed 2019 Mar 6.
  30. ↵
    Table 18-10-0004-13: Consumer Price Index by product group, monthly, percentage change, not seasonally adjusted, Canada, provinces, Whitehorse, Yellowknife and Iqaluit (Statistics Canada, Ottawa) modified 2019 Oct 29. Available: www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=1810000413. accessed 2019 Feb 11.
  31. ↵
    Table 14-10-0320-02: Average usual hours and wages by selected characteristics, monthly, unadjusted for seasonality (Statistics Canada, Ottawa) modified 2019 Oct 29. Available: www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=1410032002&pickMembers%5B0%5D=3.3. accessed 2019 Feb 11.
  32. Fuel consumption ratings search tool (Natural Resources Canada, Ottawa) Available: https://fcr-ccc.nrcan-rncan.gc.ca/en. accessed 2019 Mar 6.
  33. Motor fuel prices (Government of Ontario), Available: www.ontario.ca/page/motor-fuel-prices. accessed 2019 Feb 11.
  34. SickKids Hospital parking (Precise ParkLink Inc), Available: www.findparkingnearme.ca/sickkids-toronto. accessed 2019 Mar 6.
  35. ↵
    1. Ontario Ministry of Health and Long-Term Care
    Ontario Drug Benefit Formulary/Comparative Drug Index (Queen’s Printer for Ontario, Toronto) updated 2018 Nov 8. Available: www.formulary.health.gov.on.ca/formulary/. accessed 2019 Feb 11.
  36. ↵
    (2018) Schedule of benefits for laboratory services, November 7, 2017 (effective April 1, 2017) (Ministry of Health and Long-Term Care, Toronto) Available: www.health.gov.on.ca/en/pro/programs/ohip/sob/lab/lab_mn2018.pdf. accessed 2019 Feb 11.
  37. ↵
    1. Neumann PJ,
    2. Cohen JT,
    3. Weinstein MC
    (2014) Updating cost-effectiveness — the curious resilience of the $50,000-per-QALY threshold. N Engl J Med 371:796–7.
    OpenUrlCrossRefPubMed
  38. ↵
    1. Shaker M,
    2. Jenkins P,
    3. Ullrich C,
    4. et al.
    (2009) An economic analysis of anemia prevention during infancy. J Pediatr 154:44–9.
    OpenUrlCrossRefPubMed
  39. ↵
    1. Wilson JMG,
    2. Jungner G
    (1968) Principles and practice of screening for disease (World Health Organization, Geneva).
  40. ↵
    1. Williams R,
    2. Clinton J,
    3. Canadian Paediatric Society, Early Years Task Force
    (2011) Getting it right at 18 months: in support of an enhanced well-baby visit. Paediatr Child Health 16:647–54.
    OpenUrlPubMed
  41. ↵
    Your child’s enhanced 18-month well-baby visit (Ontario Ministry of Children, Community and Social Services, Toronto) modified 2017 Apr 24. Available: www.children.gov.on.ca/htdocs/English/earlychildhood/health/your_enhanced_18-month.aspx. accessed 2019 Feb 6.
  42. ↵
    1. Ontario Agency for Health Protection and Promotion (Public Health Ontario)
    (2017) Immunization coverage report for school pupils: 2013–14, 2014–15 and 2015–16 school years (Queen’s Printer for Ontario, Toronto) Available: www.publichealthontario.ca/-/media/documents/immunization-coverage-2013-16.pdf?la=en. accessed 2019 Sept 12.
  43. ↵
    1. Conti G,
    2. Heckman JJ
    (2014) in Handbook of child well-being: theories, methods and policies in global perspective, The economics of child well-being, eds Ben-Arieh A, Casas F, Frønes I, et al. (Springer, Berlin), pp 363–401.
    1. Conti G,
    2. Heckman JJ
    (2013) The developmental approach to child and adult health. Pediatrics 131(Suppl 2):S133–41.
    OpenUrlAbstract/FREE Full Text
  44. ↵
    1. Heckman JJ
    (2012) The developmental origins of health. Health Econ 21:24–9.
    OpenUrlCrossRefPubMed
  45. ↵
    1. Pottie K,
    2. Jaramillo A,
    3. Lewin G,
    4. et al.,
    5. Canadian Task Force on Preventive Health Care
    (2012) Recommendations on screening for type 2 diabetes in adults. CMAJ 184:1687–96.
    OpenUrlFREE Full Text
  46. ↵
    1. Srinivasan B,
    2. O’Dell D,
    3. Finkelstein JL,
    4. et al.
    (2018) ironPhone: mobile device-coupled point-of-care diagnostics for assessment of iron status by quantification of serum ferritin. Biosens Bioelectron 99:115–21.
    OpenUrlPubMed
  47. ↵
    1. Sanders GD,
    2. Maciejewski ML,
    3. Basu A
    (2019) Overview of cost-effectiveness analysis. JAMA 321:1400–1.
    OpenUrl
  48. ↵
    1. Sanders GD,
    2. Neumann PJ,
    3. Basu A,
    4. et al.
    (2016) Recommendations for conduct, methodological practices, and reporting of cost-effectiveness analyses: second panel on cost-effectiveness in health and medicine. JAMA 316:1093–103.
    OpenUrlCrossRefPubMed
  • Copyright 2019, Joule Inc. or its licensors
PreviousNext
Back to top

In this issue

CMAJ Open: 7 (4)
Vol. 7, Issue 4
1 Oct 2019
  • Table of Contents
  • Index by author

Article tools

Respond to this article
Print
Download PDF
Article Alerts
To sign up for email alerts or to access your current email alerts, enter your email address below:
Email Article

Thank you for your interest in spreading the word on CMAJ Open.

NOTE: We only request your email address so that the person you are recommending the page to knows that you wanted them to see it, and that it is not junk mail. We do not capture any email address.

Enter multiple addresses on separate lines or separate them with commas.
Iron deficiency screening for children at 18 months: a cost-utility analysis
(Your Name) has sent you a message from CMAJ Open
(Your Name) thought you would like to see the CMAJ Open web site.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Citation Tools
Iron deficiency screening for children at 18 months: a cost-utility analysis
Sarah Carsley, Rui Fu, Cornelia M. Borkhoff, Nadine Reid, Eva Baginska, Catherine S. Birken, Jonathon L. Maguire, Rebecca Hancock-Howard, Patricia C. Parkin, Peter C. Coyte
Oct 2019, 7 (4) E689-E698; DOI: 10.9778/cmajo.20190084

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
Share
Iron deficiency screening for children at 18 months: a cost-utility analysis
Sarah Carsley, Rui Fu, Cornelia M. Borkhoff, Nadine Reid, Eva Baginska, Catherine S. Birken, Jonathon L. Maguire, Rebecca Hancock-Howard, Patricia C. Parkin, Peter C. Coyte
Oct 2019, 7 (4) E689-E698; DOI: 10.9778/cmajo.20190084
Digg logo Reddit logo Twitter logo Facebook logo Google logo Mendeley logo
  • Tweet Widget
  • Facebook Like

Related Articles

  • PubMed
  • Google Scholar

Cited By...

  • No citing articles found.
  • Google Scholar

Similar Articles

Content

  • Current issue
  • Past issues
  • Collections
  • Alerts
  • RSS

Authors & Reviewers

  • Overview for Authors
  • Preparing manuscripts
  • Manuscript Submission Checklist
  • Publication Fees
  • Forms
  • Editorial Policies
  • Editorial Process
  • Patient-Oriented Research
  • Submit a manuscript
  • Manuscript Progress
  • Submitting a letter
  • Information for Reviewers

About

  • General Information
  • Staff
  • Editorial Board
  • Advisory Panel
  • Contact Us
  • Advertising
  • Media
  • Reprints
  • Copyright and Permissions
CMAJ Group

Copyright 2023, CMA Impact Inc. or its licensors. All rights reserved. ISSN 2291-0026

All editorial matter in CMAJ OPEN represents the opinions of the authors and not necessarily those of the Canadian Medical Association or its subsidiaries.

To receive any of these resources in an accessible format, please contact us at CMAJ Group, 500-1410 Blair Towers Place, Ottawa ON, K1J 9B9; p: 1-888-855-2555; e: [email protected].

CMA Civility, Accessibility, Privacy

 

 

Powered by HighWire