Abstract
Background: There is a need for better alignment between research on sport and physical activity and the needs of those who are in a position to implement the findings. To facilitate advancement and alignment, we identified the top research priorities of sport and physical activity knowledge users from various sectors.
Methods: For this priority-setting study, we used an iterative process of data collection and analysis. Sport and physical activity knowledge users from multiple sectors participated in a workshop (September 2019), which included small working group exercises followed by large-group syntheses leading to the identification of issues that required better understanding. We then sent an online questionnaire to participants for content validation and interim prioritization, to reduce the number of priorities (December 2019 to January 2020). A new questionnaire containing a shortened list of research priorities was sent to an expanded group of respondents to further streamline the list of priorities (January–March 2020).
Results: The 24 workshop participants identified 68 issues, of which 21 were retained by the 18 participants in the interim priority-setting questionnaire. The final prioritization questionnaire was completed by 33 stakeholder groups; this step produced a final list of 8 top research priorities. The final priorities identified for sport and physical activity research related to financial support, suboptimal promotion, dropout, best interventions, participation among Indigenous populations, volunteer engagement, safe and inclusive experiences, and knowledge exchange.
Interpretation: The 8 priorities identified in this study provide guidance to Canadian sport and physical activity researchers. Research efforts on these priorities will reflect pressing issues as identified by representatives of all sport and physical activity sectors.
Low levels of physical activity contribute to Canada’s overwhelming levels of chronic diseases.1 These suboptimal levels of physical activity represent a national crisis affecting all age groups.2,3 Despite a rise in research pertaining to sport and physical activity policies, programs and practice,4,5 the implementation of this evidence into practice has yet to bring about notable improvements in physical activity levels among Canadians. Both researchers and knowledge users have reported a gap between evidence-based research and policies and programming related to sport and physical activity.4,6–8 Studies have also confirmed that many who work to promote participation in sport and physical activity feel ill-informed by current evidence-based research findings.7,9–11
The gap between knowledge creation and practice can be explained, in part, by researchers not adhering to the guiding principles of the knowledge-to-action framework.12 In particular, researchers may pursue research without first obtaining confirmation that it represents a priority for practitioners. 7,13 Fullagar and colleagues7 recently documented that research questions identified by sport and physical activity researchers may differ from the daily challenges experienced by stakeholders, practitioners and coaches. Similar research findings also indicate the need for more population-specific,5 sport-specific14 and context-sensitive4 research that can be translated into local practices.15
Previous researchers have acknowledged that better alignment is needed between allocation of limited research resources and the priorities of those in a position to implement findings.5,7,13,16 Yet most of the rare attempts to identify sport or physical activity research priorities did not involve consultation with potential knowledge users.8,17,18 In contrast, Holt and colleagues8 engaged in a rigorous consultation process with provincial sport organizations from across Canada to identify topics that these stakeholders viewed as top priorities for research. In addition to identifying useful research questions for the sport sector, Holt and colleagues8 exposed highly ineffective knowledge translation processes, given their finding that the information most sought after by study participants was often already the subject of published research results. Nevertheless, as studies become more tailored to the specific needs of potential knowledge users19 and as researchers involve these key players in their projects from the outset, sport and physical activity programs and practices may in turn become better informed by evidence-based research,4 thus lessening the gap between evidence and practice.16
We aimed to identify top research priorities in sport and physical activity participation through the lenses of knowledge users from various sectors within and beyond sport.
Methods
Design
Although rooted in the James Lind Alliance priority-setting process,20 this study was not intended to lead solely to health-related priorities; as such, it also drew on a variety of other methods of identifying research priorities. Nevertheless, and consistent with the James Lind Alliance, stakeholders were involved in all steps of the process. Specifically, we used a multistep approach that built on the strengths of purposefully sampling stakeholders from multiple sectors,21–27 the Delphi method of congregating expert opinions,21,23,28,29 and an iterative process of data collection and analysis to generate a final short list of research priorities.21,23,28,29
Initially, we generated a long list of issues deserving attention through in-depth discussions with a wide range of stakeholders and then conducted a series of priority-setting steps (Figure 1). This approach has been used in the past to help organizations identify the focus of their research agendas.21,23,25 To facilitate and promote meaningful engagement of knowledge users, we abstained from using scientific jargon during steps 1 to 3.
Research team
The work presented here was led by a core group of 4 researchers with complementary expertise in sport and physical activity participation (M.B., C.M.S., I.D., J.O.), 3 end-users representing nonprofit agencies that promote participation in sport and physical activity (L.M.V. from ParticipACTION, C.T. from Sport for Life and a representative from the Public Health Agency of Canada [PHAC]), 1 research coordinator (J.G.C.) and 2 graduate students (F.G., V.T.) working with M.B.
Data collection
Step 1: Identification of potential priority topics
On Sept. 12, 2019, the research team hosted a group of knowledge users from across the country, who represented all sectors of sport and physical activity promotion in Canada. The goal of this workshop, held in Moncton, NB, was to identify priorities that should be the focus of sport and physical activity research to better inform policies, programs and practices in Canada. The list of invitees was developed in collaboration with the Sport Information Resource Centre, a nongovernmental organization recognized as the country’s leading broker for knowledge related to sport and physical activity research. Specifically, we invited leaders of governmental and nongovernmental organizations that advocate for greater participation in sport or physical activity.
The workshop was moderated by a public health researcher with experience in public speaking and health promotion, who was not a member of the research team. Following the Delphi method of congregating expert opinions, we launched an iterative series of small working group exercises and large-group syntheses. Through this process, workshop attendees identified a list of issues and problems that required better understanding.
To ensure this list represented top priorities from the perspective of knowledge users, our approach capitalized on a priority-mapping exercise template developed by the World Health Organization.30 Specifically, we held 7 iterative, small-group (7 or 8 participants per group) round table exercises during which participants engaged in semistructured discussions, each led by M.B., J.G.C., F.G. or V.T. The discussions, guided by open-ended questions formulated by the research team, progressed from general topics related to problems (defining the challenge), causes (causal agents, factors, determinants of the issues) and solutions (new interventions, policies, campaigns), to more specific issues related to implementation (knowledge translation into policy and practice) and evaluation (monitoring, evaluating the effectiveness of interventions or programs) (Appendix 1, part 1, available at www.cmajopen.ca/content/10/1/E269/suppl/DC1).30 During the small-group discussions, participants were invited to jot down their ideas on adhesive notes and to “park” these ideas on poster boards. The boards were used in presentations during large-group syntheses to highlight topics that warranted more attention from researchers, and they helped the discussion leaders in preparing detailed summaries of their groups’ discussions.
Step 2: Interim prioritization
Following the workshop, we (M.B. and J.G.C., in consultation with the research team) created a questionnaire to allow workshop participants to rate each topic identified, using 3 criteria: relevance, difficulty and current level of knowledge. According to advice that final research priorities be “relevant and represent noteworthy advances,”19 the questionnaire was based on a prioritization methodology31 where relevance measures the extent to which respondents perceive each issue as important in contributing to the low levels of sport and physical activity participation in Canada, difficulty measures the degree of difficulty in addressing each issue, and present knowledge represents the extent to which respondents perceive that more research is needed for each issue.
For this interim priority-setting step,20 we sent a link to the online questionnaire to workshop participants by email and asked them to rate the topics (issues and challenges) identified during the workshop. Specifically, participants were asked, “Considering the current trend of low physical activity and sport participation in Canada, please rate the following issues/problems according to what you perceive to be their level of relevance, difficulty and present knowledge” (Appendix 1, part 2). The criteria (relevance, difficulty, knowledge) were measured using 5-point Likert scales ranging from very low to very high,31 with the aim of identifying topics judged as the easiest and most important to address. The questionnaire was pilot tested by 3 graduate students and 1 knowledge user before workshop participants received the link, which remained active from Dec. 10, 2019, to Jan. 28, 2020.
Step 3: Final prioritization
For the next step,20 we expanded the group of respondents to include other sport and physical activity knowledge users. We invited participation from delegates at the Sport for Life Canadian Summit (held Jan. 28–30, 2020), an event bringing together practitioners, researchers, graduate students, professional athletes, policy-makers and other leaders working to enhance the quality of sport and physical activity in Canada. Specifically, we handed out a pamphlet describing our study to summit attendees, asking them to complete our online questionnaire. We also invited our workshop attendees to share this second questionnaire with other knowledge users. This second online questionnaire was active from Jan. 30 to Mar. 31, 2020, and aimed to identify final research priorities by asking representatives from special interest groups to rate each of the priorities retained from the previous step, and to do so using the same methodology and rating criteria as outlined for step 2 (Appendix 1, part 3).
To present and describe the issues identified by stakeholders, during steps 1 to 3, as deserving the most research attention to the scientific community, the summaries of the step 1 workshop discussions were reread by the group-exercise facilitators (M.B., J.G.C., F.G., V.T.) to obtain clear background information and context relating to each of the priorities retained with results of the final priority-setting questionnaire. The facilitators worked collaboratively to formulate a description and questions for each of the final research priorities, which were then submitted for validation to the other research team members. The final formulation of research priorities and associated questions was achieved during a video-conference (attended by M.B., J.G.C., C.M.S., L.M.V., C.T., F.G., V.T. and the PHAC representative) and then unanimously agreed upon by all authors.
Data analysis
Step 1 (identification of potential priority topics): Because the issues and challenges identified were many and varied, we used thematic analyses to organize and report the potential research priority topics identified at the workshop.32 We (M.B., J.G.C., F.G., V.T.) cleaned and collated statements documented on poster boards and in discussion summaries by combining them into common topics. We then used an inductive approach to identify overarching themes representing the nature of issues within each group of topics. The themes were then used to organize items in subsequent questionnaires and to summarize results.
Step 2 (interim prioritization): We calculated mean levels of relevance, difficulty and knowledge for each of the interim priorities, across all respondents in this step. The relevance, difficulty and knowledge means of each priority were plotted on a 3-dimensional figure, which allowed the identification of priorities that would be easy to address (high relevance, low difficulty) and important (high relevance, low knowledge). Specifically, and consistent with the approach developed by Rondinelli and colleagues,31 easy priorities represented pressing issues for which the level of difficulty associated with implementing the solution was perceived as low (mean relevance score ≥ 2.5 and mean difficulty score ≤ 2.5). Similarly, important priorities represented issues and problems that are relevant and for which the current level of knowledge was perceived as low (mean relevance score ≥ 2.5 and mean knowledge score ≤ 2.5).
Step 3 (final prioritization): For this step, we applied the same process of obtaining the mean levels of relevance, difficulty and knowledge using responses to the final priority-setting questionnaire. We then established the final research priorities using the same process of applying cut-offs of 2.5.
Ethics approval
This project was approved by the Education and Social Sciences Research Ethics Review Board of the Université de Sherbrooke.
Results
Identification of potential priority topics
We invited 24 organizations to participate in step 1, of which 20 were represented by at least 1 of the 24 stakeholders (excluding researchers and students) who attended the workshop (Table 1) (Appendix 2, available at www.cmajopen.ca/content/10/1/E269/suppl/DC1). The summation of priority items identified during the workshop fell within 6 themes: sociocultural factors; external barriers; internal barriers; community knowledge development; policies, resources and training; and interventions. After the process of cleaning and collating topics, 68 potential priorities were included in the interim priority-setting questionnaire used in step 2.
Interim prioritization
Eighteen (75%) of the 24 workshop participants completed the questionnaire in step 2. From the 68 general priorities, 10 emerged as being considered easy to address, while 15 were rated as important to address (Figure 2). Four items were identified as priorities falling within both the easy and important to address categories, resulting in 21 interim priorities carried forward to step 3.
Final prioritization
Representatives from 33 organizations participated in the final prioritization process. From the 21 interim priorities, participants retained 8 items as top research priorities (Figure 3). Our analyses classified 6 priorities as important and 2 as both easy and important to address. The 8 final priorities and their associated research questions are described in detail in Table 2 (in no particular order).
Interpretation
Using a rigorous, multistep process engaging stakeholders from various sectors, we identified 8 top priorities for Canadian sport and physical activity researchers to address. This list provides valuable guidance to researchers in this field, and could help to ensure that their work focuses on and addresses the needs of end-users.
Half of the priorities emerged under the theme of “community knowledge development,” which highlights a general feeling among key sport and physical activity stakeholders in Canada that more needs to be done to improve the public’s understanding about the powerful impact of participation in sport and physical activity and the urgency to intervene to avoid further dropouts from these activities. Partly related to this, 1 of the 2 priorities that emerged from the “policies, resources and training” theme highlighted the need for better communication, given that the gap between researchers and knowledge users was identified as an area requiring prioritization. The other priority that emerged from the “policies, resources and training” theme related to challenges facing practitioner training in terms of action plans to confront bullying and intimidation as well as to promote inclusiveness. Engaging volunteers in the delivery of sport and physical activity initiatives also emerged as a top priority from the “interventions” theme. Finally, the challenge of recruiting and retaining Indigenous populations in sport and physical activity was also identified as a top priority.
Our methodologic approach and target population differed from the ones used by Holt and colleagues,8 yet there was alignment between the studies in terms of the priorities they highlighted. In particular, the approaches and samples of both studies identified the need to conduct more research on dropouts from sport participation, on the promotion of sport and physical activity among specific subgroups, on the outcomes of sport-specific participation and on long-term volunteer engagement.8 Similarly, the priorities that we identified align with those of Howie and colleagues,18 in the sense that they call for more research to identify characteristics of interventions that are effective in promoting greater sport and physical activity participation over a sustained period, as well as more research on the outcomes of sport and physical activity participation from a variety of perspectives (e.g., physical health, mental health, society) and more research to support engagement of volunteers in sports. Finally, although the recommendations for future research published by the World Health Organization’s Physical Activity and Sedentary Behaviour Guideline Development Group36 focus more on methodologic approaches than on research topics, recommendations to pursue more longitudinal research align closely with the priority to gain a better understanding of the impacts of dropout.
Limitations
Although the methods used to identify research priorities adhere to best practice guidelines, the process can be subjective. Indeed, the process we used relies on individuals’ own analysis and value judgments. To keep this influence to a minimum, and to ensure that the prioritization process was grounded in a rigorous approach, we recruited expert knowledge users from a variety of backgrounds and adopted a methodology anchored in interactions between individuals, working groups and iterative procedures to search for and arrive at a consensus. Nevertheless, it is possible that participants identified priorities that are not transformative, given a potential bias toward conserving current systems and infrastructures. Furthermore, it would be possible for researchers and stakeholders to collaboratively identify other relevant research questions to address.
The exact number of participants for step 3 (final prioritization) is unknown, given that many organizations’ representatives completed the questionnaire as a group to avoid having multiple individuals from the same department complete the questionnaire.
Priorities can change over time. In particular, it must be noted that most steps in this study occurred before the onset of the COVID-19 pandemic in Canada. Had the study been undertaken later, it is possible that the identified priorities would have been different.
Conclusion
The 8 high-ranking priorities identified in this study provide much-needed guidance to researchers seeking to engage in meaningful and effective research about sport and physical activity from the perspective of knowledge users in various sectors in Canada. Participants called for more sport and physical activity research on how to reduce financial barriers, better communicate benefits, understand the consequences of dropping out, identify characteristics of effective interventions, engage Indigenous populations, create positive and inclusive experiences, and define successful strategies to engage and retain volunteers. Moreover, participants identified reducing the gap between researchers and end-users as an additional priority. Better implementation of these research findings into practice, while adhering to best practices in terms of knowledge exchange, will reflect the pressing issues identified by representatives of all sectors of sport and physical activity promotion.
Acknowledgements
The authors thank the Maritime SPOR Support Unit for guidance on meaningful engagement of knowledge users and assistance in reviewing the manuscript before submission.
Footnotes
Competing interests: Carolyn Trono received reimbursement of travel expenses from the Centre de formation médicale du Nouveau-Brunswick to attend a workshop for the current study. No other competing interests were declared.
This article has been peer reviewed.
Contributors: Mathieu Bélanger conceived the study objectives, led the data collection and obtained funding. Mathieu Bélanger, Julie Goguen Carpenter, Catherine Sabiston, François Gallant, Véronique Thibault, Isabelle Doré and Jennifer O’Loughlin developed the methodologic approach collaboratively. Julie Goguen Carpenter assisted with data collection, performed analyses (with François Gallant) and wrote the first draft of this manuscript. All authors contributed to the interpretation of results, reviewed the draft manuscript critically for accurate representation of key messages, approved the final version to be published and agreed to be accountable for the work.
Funding: This study was supported by the New Brunswick Health Research Foundation.
Data sharing: The data that support the findings of this study are available from the corresponding author, Mathieu Bélanger, upon request.
Supplemental information: For reviewer comments and the original submission of this manuscript, please see www.cmajopen.ca/content/10/1/E269/suppl/DC1.
This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY-NC-ND 4.0) licence, which permits use, distribution and reproduction in any medium, provided that the original publication is properly cited, the use is noncommercial (i.e., research or educational use), and no modifications or adaptations are made. See: https://creativecommons.org/licenses/by-nc-nd/4.0/
References
- © 2022 CMA Impact Inc. or its licensors