- Open Access
Implementation framework for chronic disease intervention effectiveness in Māori and other indigenous communities
Globalization and Healthvolume 13, Article number: 69 (2017)
About 40% of all health burden in New Zealand is due to cancer, cardiovascular disease, and type 2 diabetes/obesity. Outcomes for Māori (indigenous people) are significantly worse than non-Maori; these inequities mirror those found in indigenous communities elsewhere. Evidence-based interventions with established efficacy may not be effective in indigenous communities without addressing specific implementation challenges. We present an implementation framework for interventions to prevent and treat chronic conditions for Māori and other indigenous communities.
The He Pikinga Waiora Implementation Framework has indigenous self-determination at its core and consists of four elements: cultural-centeredness, community engagement, systems thinking, and integrated knowledge translation. All elements have conceptual fit with Kaupapa Māori aspirations (i.e., indigenous knowledge creation, theorizing, and methodology) and all have demonstrated evidence of positive implementation outcomes.
Applying the framework
A coding scheme derived from the Framework was applied to 13 studies of diabetes prevention in indigenous communities in Australia, Canada, New Zealand, and the United States from a systematic review. Cross-tabulations demonstrated that culture-centeredness (p = .008) and community engagement (p = .009) explained differences in diabetes outcomes and community engagement (p = .098) explained difference in blood pressure outcomes.
Implications and conclusions
The He Pikinga Waiora Implementation Framework appears to be well suited to advance implementation science for indigenous communities in general and Māori in particular. The framework has promise as a policy and planning tool to evaluate and design effective interventions for chronic disease prevention in indigenous communities.
New Zealand faces significant challenges relating to chronic, non-communicable diseases such as diabetes and obesity. Health inequities between Māori (indigenous people of NZ) and non-Māori are particularly concerning . Almost half (47%) of Māori (indigenous people of New Zealand) are obese (Body Mass Index >30) compared to 29% of European/Other New Zealanders . Similarly, 7.2% of Māori have diabetes compared to 5.1% of European/Other New Zealanders . Further, Māori have 1.8 times more health burden (i.e., disability adjusted life years) than non- Māori  and the average life expectancy for Māori is nine years less than that of other New Zealanders . These inequities are explained by racism and the unjust distribution of social determinants of health including income, employment, education, housing, and health service inequities in access to, and quality of, health care. This injustice is underpinned by a lack of commitment by the New Zealand government toward meeting its obligations under Te Tiriti o Waitangi—the founding treaty of New Zealand [5,6,7]. These inequities mirror those found between indigenous and non-indigenous populations in across the globe [8, 9].
In 2012–13 New Zealand Government implemented the National Science Challenges (NSCs) initiative as a mission-led form of research funding to address 11 significant science challenges related to the environment and social/human health . A key goal is to develop innovative scientific approaches with a clear implementation pathway for scalability and larger nationwide impact. The NSCs are guided by the Vision Mātauranga policy which aims “to unlock the innovation potential of Māori knowledge, resources and people to assist New Zealanders to create a better future” (p. 1) . Despite the inclusion of Vision Mātauranga in the NCSs, recent research has critiqued the NSCs for foregrounding scientific knowledge production in the context of neoliberalism, and discussed how Māori researchers reasserted the importance of Māori knowledge production .
One of the NSCs is the Healthier Lives Challenge which aims to improve the prevention and treatment of four of New Zealand’s most significant non-communicable diseases: cancer, cardiovascular disease (CVD), diabetes, and obesity. Its mission is “to deliver the right prevention to the right population and the right treatment to the right patient” in order to reduce the burden of these diseases by 25% by 2025 . Within this purpose and mission is a stated goal to reduce health inequities for Māori and other communities by 25% by 2025. This article describes the theoretical foundation for one of the projects in the Healthier Lives Challenge designed to address these inequities: “He Pikinga Waiora [Enhancing Wellbeing]: Making health interventions work for Māori communities.” He Pikinga Waiora references the whakatauki (traditional proverb), He oranga ngakau, he pikinga waiora, which refers to the relationship between positive feelings and a sense of self-worth, key aspects of well-being.
Despite a strong international evidence base for a range of interventions that have been shown to improve outcomes for chronic diseases, there has been underwhelming progress made in reducing health inequities . The U.S. National Institutes of Health and other researchers recognize the importance of translational research and implementation science for achieving health equity and has identified issues of context and external validity as central to the problem of the utilization of evidenced-based practices [15,16,17]. Efficacy studies and randomized controlled trials, which focus on internal validity, are necessary, but frequently do not translate to real-world settings with high variability in culture, context, and levels of acceptance [16, 18,19,20]. The Canadian Institutes of Health Research (CIHR) have recognised that the creation of new knowledge often does not, on its own, lead to widespread implementation or to positive health outcomes . Translation, dissemination, uptake and implementation are becoming increasingly important to transition innovative health research into health policy and practice and ultimately achieve health equity.
Thus, the challenge of achieving healthier lives for Māori and other indigenous communities needs to move beyond a narrow focus on intervention efficacy to include consideration of effective implementation in specific settings with a focus on prolonging sustainability and facilitating uptake . Our purpose is to describe a theoretical foundation for effective and culturally-appropriate implementation of prevention and treatment interventions for Māori communities. The theoretical framework is introduced and then applied to 13 studies from a systematic review of primary health care interventions for indigenous people with type 2 diabetes .
The implementation framework supports researchers, practitioners and public policy makers to create sustainable and effective intervention pathways to improve health for Māori communities. Given our focus on Māori communities, Kaupapa Māori provides theoretical grounding for successful implementation of interventions and reduction of health inequities. A Kaupapa Māori approach emphasises local context and self-determination by prioritizing indigenous history, development, and aspirations. Kaupapa Māori initiatives have been associated with improved health outcomes and engagement for Māori [24,25,26,27].
The importance of stakeholder knowledge and participation in research, translation, and dissemination of research findings is increasingly acknowledged and contributes toward achieving health equity between indigenous and non-indigenous populations [18, 28]. We identified the culture-centered approach (CCA), community engagement/community-engaged research (CE/CEnR), systems thinking, and integrated knowledge translation (IKT) as areas that provide theoretical relevance to the context of implementation science in indigenous communities and conceptual fit with Kaupapa Māori (see Fig. 1).
E tipu e rea mō ngā rā o tō ao (grow and branch forth for the days destined to you)
The starting line of this well-known whakataukī exhorts us to keep growing and learning. It provides a cultural foundation upon which to consider the value of other disciplinary traditions to Māori development. The Kaupapa Māori approach is reflective of the diverse tikanga (cultural protocols) and mātauranga (indigenous knowledge) that form the basis of both community action and indigenous research methodologies [29, 30]. Mātauranga Māori is the body of knowledge that underpins traditional Māori society and provides the basis of technological and philosophical skills of the community .
Indigenous scholars locate Kaupapa Māori in relation to critical theory with its notions of critique, resistance, struggle and emancipation [29, 32, 33]. The most prominent of these is the seminal writing of Graham Smith who places emphasis on the need for Kaupapa Māori principles to be in an active relationship with practice . Colonial processes have undermined Māori social, economic and political structures resulting in a redistribution of power and resources in favour of Pākehā (European descent) settlers which is reflected in the current economic and socio-political inequities between Māori and Pākehā [6, 7, 34,35,36].
Three key features emerge from the Kaupapa Māori approach: a) addressing unequal power by transforming hegemonic structures and systems; b) reaffirming of the importance of tikanga and mātauranga in the development of relationships and program; and c) promoting greater community participation and control across the spectrum of program design, implementation, and evaluation [29, 30, 33]. The elements of our conceptual framework are consistent with these features.
Ko taku reo taku ohooho, ko taku reo taku mapihi maurea (my language is my awakening, my language is the window to my soul)
We use this whakataukī to emphasise the importance of bringing the voice of the culture into interventions. Kaupapa Māori stresses the importance of cultural protocols and knowledge to develop interventions. The CCA aims to transform “social structures surrounding health through dialogues with cultural members that create spaces for marginalized cultural voices” (p. 305) . The CCA theorizes that domination from various social practices produces communicative erasure through rules, practices, and procedures that limit opportunities for participation and knowledge creation . Centering the discourse with those people most affected empowers them to exercise their own agency; community members can make sense of and create localized health solutions framed by their everyday experiences [39,40,41]. The CCA closely aligns with Kaupapa Māori and the related notion of cultural safety developed by late-Māori scholar Irihapeti Ramsden. Cultural safety recognizes the importance of community members feeling safe and researchers and health professionals being reflexive of power and privilege and adjusting their behavior to enhance safety [42, 43]. Cultural safety and Kaupapa Māori also recognize tino rangatiratanga (self-determination) for constructing knowledge and defining problems and solutions [31, 43, 44]. The CCA asserts indigenous self-determination and ways of knowing, challenges power imbalances and transforms the way in which health interventions are developed and implemented by encouraging greater community voice and control at all levels [38, 40].
Three characteristics underpin cultural centeredness: community “voice” for problems and solutions, reflexivity, and structural transformation and resources. Voice for problems and solutions indicates that affected community members participate in defining the problem and also identifying relevant solutions [37, 38]. Lived experiences and participation are key guides for defining problems, and help to identify the relevant data needed to explain problems . Inherent in participation is listening and shifting of the stance of the researcher to co-construct locally-derived understandings of health that respect local logics [46,47,48,49].
Reflexivity questions the unstated and taken-for-granted power and privilege from outsiders [37, 38]. Reflexivity continually interrogates the ways outsiders participate in the production of knowledge and the politics of knowledge construction and their efforts of collaboration that seek to undo these privileges. Reflexivity ensures that the research and intervention processes are co-constructed and localized through community participation.
Finally, the CCA underscores the role of structures and resources for the successful implementation of effective interventions to achieve health equity. Structure refers to health providers and systems that enable and constrain access to resources . Structural transformation highlights the capacity of communities to interpret structures and to participate in processes of change on the basis of co-created meanings [37, 41]. Community capacities for decision-making and advocacy are developed through the culturally-centered processes during researcher/practitioner-community partnership [40, 50]. These processes equip communities with strategies to leverage relationships with external stakeholders to access resources for the community .
He urunga tangata he urunga pahekeheke, he urunga oneone mau tonu (the support of others is unreliable, the support of your own is sure)
We use this whakataukī to illustrate the need to ground interventions in the community co-developed and supported by the status and self-determination of community members. CE and CEnR are advocated for by indigenous and non-indigenous researchers, community members, and public health practitioners working with indigenous communities as a method for improving health and achieving health equity [52,53,54]. CE is a process of collaborating with groups directly affected by a particular health issue or with groups who are working with those affected . Although it overlaps with CCA in its interest in voice and power sharing, the unique focus of CE is partnership among community members and researchers/health professionals in developing interventions [56, 57]. Especially when guided by principles of shared power, mutual learning, and benefits for the community, CE enables the development of strong relationships that build the capacity of the communities and researchers [57, 58]. When following these principles, CE aligns with the focus on community participation advocated by Kaupapa Māori especially within the context of meeting obligations of the Treaty of Waitangi [24, 32, 59].
A number of recent systematic reviews and meta analyses have found compelling evidence supporting the positive impacts of CE on health outcomes and inequities [60,61,62,63,64,65]. Cyril and colleagues  completed a systematic review of the literature examining the impact of community engagement (CE) on health outcomes in disadvantaged populations. They identified 24 studies that met inclusion criteria and found that 88% of the studies had positive health outcomes. A meta-analytic review of 131 articles by O’Mara-Eves and colleagues  on randomised or non-randomised control trials of CE on a range of health outcomes for disadvantaged communities found that CE had positive impacts on health behaviour outcomes, increasing health consequences, health behaviour self-efficacy, and perceived social support.
A range of CE and CEnR approaches exist and there is a no consensus on an ideal approach. CE has been ranked into five categories, ranging from very limited community involvement to community ownership and management: outreach, consultation, involvement, shared leadership, and community-driven [55, 68]. One of the most popular approaches to CE is community-based participatory research (CBPR), accounting for 62% of CE approaches in a recent systematic review of studies addressing health disparities . CBPR is popular in part because it moves beyond utilitarian engagement to a deeper value-based rationale for engagement [50, 69, 70]. CBPR involves partnership between researchers and community members/organizations in all phases of the research process and is guided by principles of action, social justice and power sharing [57, 58, 71, 72]. These principles are key reasons CBPR and other CE approaches are supported by indigenous scholars [18, 53, 54].
He tina ki runga, he tāmore ki raro (contentment above, firmly rooted below)
We use this whakataukī to highlight the importance of considering the implementation of interventions from a range of perspectives, levels and understandings. “Wicked problems,” such as health inequities, are characterised by high levels of complexity, uncertainty and conflict [73, 74]. These problems are not easily understood or tackled using a reductionist approach which breaks complex problems into smaller problems . A systemic approach is needed to enable an appreciation of the ‘big picture’ and thus is consistent with Kaupapa Māori philosophy with its emphasis on holism and connection among levels, institutions, systems, and people [29, 30]. Several studies illustrate the links of systems thinking and Māori knowledge and health including multiple levels and systems from the individual to the spiritual and political [76, 77].
Systems thinking (especially system dynamics) has been applied to various public health issues including diabetes , obesity , and CVD [80, 81]. The use of systems thinking is relatively novel within public health,  and not without challenge given that it may run counter to some deeply ingrained assumptions and practices . Systems thinking is “a general conceptual orientation concerned with the inter-relationships between parts and their relationships to a functioning whole, often understood within the context of an even greater whole” (italics in original, p. 539) . System ideas, including sub-systems and the supra-system, mirror a socio-ecological understanding that situates the behaviour of individuals in relation to nested social, cultural, economic, political contexts .
Although systems approaches are characterised by a commitment to holism (i.e., the whole is more than the sum of the parts), the meaning and use of particular systems concepts varies depending on the approach . The systems literature is vast and encompasses a wide range of hard, soft and critical traditions including general systems theory , system dynamics , soft systems , and critical systems thinking . Take the concept of the ‘system’ as an example. For a hard systems thinker, a system is an entity that exists in the real world (e.g., health system). The literature on health care strengthening takes this perspective as does much of quality improvement literature [89, 90]. However, a soft systems thinker, cognisant of multiple perspectives and values would regard a system as a “particular way of organising our thoughts” (p. 2) . For instance, Foote et al.  explored the ways in which primary and secondary care clinicians construct problems and solutions associated with a problematic hospital waiting list. Flood  helpfully distinguishes between systems and systemic thinking with the latter providing a set of constructs that can be utilised to address complexity.
System theorists see the diversity of systems approaches as a strength and contemporary systems thinking adopts a constructivist position that embraces both theoretical and methodological pluralism . Although the systems approach is based on taking the ‘whole into account’, Midgley  points out that “there is no such thing as a genuinely comprehensive analysis, so the defining feature of systems thinking is the reflection of the boundaries of inclusion and exclusion” (pp. 7–8). A systemic understanding therefore requires attention to where boundaries are drawn. The act of boundary setting raises the question of who and what is included, and so enables or limits the opportunities for improvement . For this reason, Daellenbach  notes that “an important aspect of systems thinking is the search for appropriate boundaries to the system … [and that] [b]oundary choices always involve some degree of arbitrariness and need to be challenged and justified by way of boundary critique” (p. 273). The process of exploring and critiquing the ‘givens’ of an intervention aligns with CCA’s concern to create spaces for subaltern voices and is often done in partnership with communities who are ‘affected but not involved’ as in CBPR processes . In sum, systems thinking facilitates new framings, strategies and actions by considering what issues or viewpoints should be included in a systems analysis; how different perspectives are shaped by values and assumptions; and what interactions within and across institutional and organisational boundaries could produce better outcomes .
Integrated knowledge translation
Toi te kupu, toi te mana, toi te whenua (hold fast to the language, the culture and the land)
We use this whakataukī to outline the process of taking research and working with community members to bring about positive outcomes for the community. The creation of new knowledge often does not, on its own, lead to widespread implementation or positive health outcomes . Knowledge-translation processes offer the potential to build bridges between researchers/academics and communities to increase the potential for research to lead to improved health outcomes and health equity . To understand and influence change in their practice settings, health care professionals and policy makers need to understand theories and frameworks that support knowledge translation . The CIHR promotes IKT as a co-innovation approach involving knowledge users as equal partners alongside researchers to lead to research that is more relevant to and more useful to knowledge users . The participatory nature of IKT is consistent with the collaborative investment approach of the NSC and Kaupapa Māori research practices [10, 99] although it is less attuned to the power differences expressed by the CCA. For example, the New Zealand Health Research Strategy recognizes the importance of partnership with Māori to achieve effective translation of research into policy and practice .
An important strategy in the context of indigenous communities is “the integration of relevant knowledge translation activities within the context in which the knowledge is to be applied” (p. 142) . Health care environments are complex, so ensuring a fit between context and theory is important for the success of knowledge-translation initiatives . Similarly, planning for knowledge translation is more likely to be successful in specific settings if an assessment of likely barriers and facilitators inform the choice of knowledge translation strategy . Smylie et al.  suggest that due to the fundamental differences between Western scientific and indigenous knowledge systems, modification of current knowledge translation frameworks is necessary before they will be relevant in indigenous communities. In addition, knowledge translation methods for health research should be developed and evaluated specifically within the context of indigenous communities. The type of knowledge translation activity should be negotiated in conjunction with the relevant communities to decide what type of modification and level of support is required.
Gaps between evidence and decision-making exist in all levels of health care, including those of patients, health care professionals and policy-makers . This is especially true for Māori communities which, through structural and resource constraints, have inequitable access to best available evidence . The relevance and importance of IKT though such processes as uptake, implementation and dissemination, are vital to transition asynchronous research, practice, and public policy making processes into health gains for indigenous communities [106, 107].
Turning knowledge into action encompasses processes of knowledge creation and knowledge application. Knowledge creation and application have four levels, each with a growing level of engagement with indigenous communities: transfer, adoption, adaption and co-innovation . Transfer is providing the knowledge or intervention to the community (doing the work for the community). Adoption provides a moderate level of support by providing basic knowledge about an intervention. Adaptation involves tailoring information to the needs of the knowledge user and includes feedback loops for adjusting the intervention. Co-innovation involves the co-design and co-implementation of knowledge and the intervention. Co-innovation reflects IKT and is also reflective of Kaupapa Māori and indigenous self-determination [31, 44].
Applying the framework
A recent systematic review examined primary care interventions for Type 2 diabetes prevention in indigenous communities . The review identified 13 articles with six having positive outcomes on diabetes and five having positive outcomes on blood pressure. The authors identified various factors including setting, location (rural or urban), intervention level, governance (shared, private, community), and study quality. The authors suggested that multifaceted interventions are most effective and need to involve some level of system change (clinical or health). We used the He Pikinga Waiora Implementation Framework to code the interventions in these studies to illustrate the potential post-hoc explanatory power of the framework. We offer this evidence as a preliminary indication rather than definitive proof of the framework given the small sample size.
Coding was completed in several stages. First, a coding scheme for each of the four elements was developed. Table 1 presents the final coding scheme and brief description of the variables and levels. The coding scheme was created in a two-step process involving initial definitions and application of the scheme to the studies by two coders and then a revision and reapplication by the coders. The coding was based only on the details provided in the 13 articles. Details were variable with four articles having limited information, four having moderate information, and five having in-depth information about intervention development. After the initial coding, interrater reliability was low (average ICC = .49). The first set of definitions relied on having specific details about intervention development and some manuscripts were lacking the relevant information. The study authors reviewed the definitions and suggested revisions to create more concrete categories that enabled consistent coding despite the variety of details about the interventions. In the second stage, the two coders independently reviewed the interventions without knowledge of the outcomes of the study. Final interrater reliability was strong (average ICC = .83). All disagreements at this stage were resolved through discussion by the two coders.
Coding results are presented in Table 2 along with the results of two common outcomes across the studies: improved diabetes outcomes (HbA1c or amputation incidence) and improved blood pressure (either diastolic or systolic). Both outcomes were coded as changed or unchanged using significance values provided in the articles. In order to have an equal weighting among the four constructs in the scheme, we recoded the three culture-centeredness variables into a single variable, and the three systems variables into a single variable, based on most common rank or average of ranks if a common rank was not obtained.
Cross-tabulations were calculated using each of the outcome variables and the four elements of the Framework. Table 3 presents the frequencies and the chi-square value and significance for the associations. Culture-centeredness and CE had a significant association with diabetes outcome; system thinking and IKT had a potential association with diabetes outcome (p < .15). For example, the cells for community engagement and diabetes outcome illustrate that five studies with a changed diabetes outcome had a medium-level of engagement and one study has low engagement. In contrast, all seven studies with an unchanged diabetes outcome had a low-level of engagement. Thus, higher levels of community engagement is associated with an improvement in diabetes outcome, χ2 (2, N = 13) = 9.48, p = .009. CE had an association at the .10 level and culture-centeredness at a .20 level with blood pressure. The liberal p value is used for these analysis given the small sample size. In conclusion, the framework appears to distinguish between changed/unchanged diabetes and blood pressure outcomes for primary care interventions in indigenous communities and provides a potential post-hoc explanation to why some interventions had better outcomes than others.
Implications and conclusions
The He Pikinga Waiora Implementation Framework provides a theoretically-sound foundation for enhancing the implementation of health interventions for Māori and other indigenous communities because it centers indigenous knowledge and self-determination. The four elements are wrapped around a center grounded in indigenous critical theory (i.e., Kaupapa Māori) and each element is consistent with, and supportive of, indigenous knowledge creation and use. The four elements are related and yet each adds a distinct component to the framework. Culture-centeredness recognizes the importance of local perspectives, reflexivity, and also the importance of using these elements to leverage resources and create structural change [37, 40]. These elements support indigenous perspectives to define and solve problems which is consistent with Kaupapa Māori.
CE and CEnR emphasize bidirectional learning, power sharing, and collaborative partnerships [57, 66]. Consistent with Kaupapa Māori and culture-centeredness, CE recognizes the importance of voice and community agency and the need to share power. However, CE is the means to which culture-centeredness occurs. CE and CEnR involve clinicians, researchers, and policy makers working with communities rather than introducing top-down interventions. This approach enables co-created interventions to enhance implementation effectiveness and sustainability [52, 71]. Further, a CBPR approach guided by a conceptual model has strong support for outcomes related to health equity [18, 57, 109, 110].
Systems thinking recognizes the importance of holistic and multilevel thinking to address complex public health problems . It avoids a reductionist approach to interventions, which is common in efficacy trials. The emphasis on holism fits well with Kaupapa Māori . Systems thinking provides a unique theoretical element as it looks at the dynamics and connections among elements. Recent research demonstrates the connection between CEnR and systems theory for addressing health inequities [75, 111].
IKT recommends co-creation and co-innovation involving knowledge users as equal partners alongside researchers, policy makers, and practitioners to develop perspectives that are relevant and useful for end users . Co-innovation rather than simply transferring knowledge from researcher to end user is reflective of Kaupapa Māori as it is at least co-driven by Māori. This element also adds a unique component to the model in how knowledge about an intervention is constructed to fit for end users through community feedback. It is similar to recognition of voice in culture-centeredness and yet distinct because it recognizes different levels in how knowledge is shared with others.
Individually, these four elements have an evidence-base demonstrating improved implementation effectiveness for indigenous and other communities experiencing health inequities. Collectively, the elements should provide a more complete picture of implementation effectiveness. The framework suggests participatory approaches of CE and culture-centeredness ensure self-determination and indigenous perspectives are present and also that design attributes are consistent with the perspectives of the various communities being served. The systems thinking reflects a complex understanding of the chronic disease workforce and clinical care pathways and enables a coordinated approach to the intervention. IKT supports the communication of new evidence across the system in a manner appropriate for the community and professional setting to improve the quality of services and outcomes for communities. Further, the framework is consistent with key practices identified in recent reviews of implementation science research [112, 113]. Gibson and colleagues  identified key themes from 23 studies of enablers and barriers to implementing primary healthcare interventions in indigenous communities including intervention design created in partnership with the community, integration of intervention with organizations along with clear clinical care pathways, and culturally safe access to services.
Our coding of primary care interventions for prevention of diabetes tentatively shows that elements of the framework have potentially differential contributions to outcomes. CE was important for blood pressure outcomes, and culture centeredness, CE, and systems thinking were important for diabetes outcomes. Our framework provides a different read than the meta-analysis study authors offered . The authors found a multifaceted systems perspective was a key feature of successful interventions. We found that CE, culture-centeredness, and systems thinking also have explanatory power with a potential influence for IKT. We reiterate that this current study is indicative and not definitive and yet coupled with the extant literature provides support for the usefulness of the collective framework. In addition, this study has a limitation in that we coded information about interventions from the published articles and not the interventions themselves. Although it is likely that authors highlighted key elements on their intervention development in the articles, limitations in publication space sometimes restricts the presentation of full details on interventions.
Further research hopefully will provider stronger evidence of the usefulness and validity of the framework particularly with Māori end-users. We have begun additional research including co-designing health interventions following this framework with two community organisations and also interviewing policy makers, researchers, and practitioners about using the framework as a platform for Māori implementation science. There will also need to be further research to understand the differential contribution of each of the four elements to health outcomes.
The framework also has implications for funders, researchers, and community and public health organizations. Specifically, this framework can be used as a planning tool to guide successful development and implementation of interventions for communities experiencing the burden of health inequities. Funders can use the framework to assess likelihood of effectiveness for proposed interventions or perhaps use this framework to rate applications that address these four elements (e.g., “bonus points” beyond established criteria). Community organizations and indigenous tribal leaders can use these elements to help decide whether to work with researchers or policy makers proposing a specific intervention. These organizations can ask the potential collaborators how they will foster each of the elements in the framework and whether they will work in partnership.
In conclusion, improving health outcomes for Māori and other indigenous communities is a goal shared by governments, agencies, and communities themselves. Despite improvements in health for most populations, continuing health inequities are prominent and of great concern. This study proposes the He Pikinga Waiora Implementation Framework for intervention effectiveness particularly for non-communicable diseases such as diabetes, CVD, and obesity. Our work suggests that centering indigenous perspectives through ensuring community voice, collaborative partnership, systems thinking, and the collaborative creation of knowledge represents a promising approach for improving health and achieving health equity. The Healthier Lives Challenge NSC is implementing the Framework in part, and over the next decade we will have further evidence of the impact of such a framework on health and equity.
Ajwani S, Blakely T, Robson B, Tobias M, Bonne M. Decades of disparity: ethnic mortality trends in New Zealand 1980–1999. Wellington, New Zealand: Ministry of Health & University of Otago; 2003. Available: http://www.otago.ac.nz/wellington/otago024494.pdf
Ministry of Health. Annual update of key results 2014/15: New Zealand health survey. Wellington, New Zealand: Ministry of Health; 2015. Available: http://www.health.govt.nz/publication/annual-update-key-results-2014-15-new-zealand-health-survey
Ministry of Health. Health loss in New Zealand: a report from the New Zealand burden of diseases, injuries and risk factors study, 1990–2013. Wellington: Ministry of Health; 2016. Available: https://www.health.govt.nz/system/files/documents/publications/health-loss-in-new-zealand-1990-2013-aug16.pdf
Hefford M, Crampton P, Foley J. Reducing health disparities through primary care reform: the New Zealand experiment. Health Policy. 2005;72:9–23.
Harris R, Cormack D, Tobias M, Yeh L-C, Talamaivao N, Minster J, Timutimu R. Self-reported experience of racial discrimination and health care use in New Zealand: results from the 2006/07 New Zealand health survey. Am J Public Health. 2012;102:1012–9.
Harris R, Cormack D, Stanley J, Rameka R. Investigating the relationship between ethnic consciousness, racial discrimination and self-rated health in New Zealand. PLoS One. 2015;10(2):e0117343.
Cormack D, Harris R, Stanley J. Investigating the relationship between socially-assigned ethnicity, racial discrimination and health advantage in New Zealand. PLoS One. 2013;8(12):e84039.
Dwyer J, Boulton A, Lavoie JG, Tenbensel T, Cumming J. Indigenous peoples’ health care: new approaches to contracting and accountability at the public administration frontier. Public Manage Rev. 2014;16:1091–112.
Anderson I, Robson B, Connolly M, Al-Yaman F, Bjertness E, King A, et al. Indigenous and tribal peoples’ health (the lancet-Lowitja Institute global collaboration): a population study. Lancet. 2016;388:131–57.
National Science Challenges. n.d. http://www.mbie.govt.nz/info-services/science-innovation/national-science-challenges . Accessed 15 July 2016.
Ministry of Research, Science, and Technolgy. Vision matauranga: unlocking the innovation potential of maori knowledge, resources and people. Wellington, New Zealand: Ministry of Research, Science, and Technolgy; 2007. Available: http://www.mbie.govt.nz/info-services/science-innovation/pdf-library/vm-booklet.pdf.
Prussing E, Newbury E. Neoliberalism and indigenous knowledge: Māori health research and the cultural politics of New Zealand’s national science challenges. Soc Sci Med. 2016;150:57–66.
Healthier Lives National Science Challenge. n.d. https://healthierlives.co.nz/. Accessed 15 July 2016.
Michener L, Cook J, Ahmed SM, Yonas MA, Coyne-Beasley T, Aguilar-Gaxiola S. Aligning the goals of community-engaged research: why and how academic health centers can successfully engage with communities to improve health. Acad Med. 2012;87:285–91.
Kantor LW. NIH roadmap for medical research. Alcohol Res Health. 2008;31:12–3.
Fixsen D, Naoom S, Blase K, Friedman R, Wallace F. Implementation research: a synthesis of the literature. Tampa, FL: University of South Florida Louis de la Parte Florida Mental Health Institute; 2005. Available: http://nirn.fpg.unc.edu/sites/nirn.fpg.unc.edu/files/resources/NIRN-MonographFull-01-2005.pdf
Green LW, Ottoson JM, Garcia C, Hiatt RA. Diffusion theory and knowledge dissemination, utilization, and integration in public health. Annu Rev Publ Health. 2009;30:151–74.
Wallerstein N, Duran B. Community-based participatory research contributions to intervention research: the intersection of science and practice to improve health equity. Am J Public Health. 2010;100(Suppl):40–6.
Glasgow RE, Green LW, Klesges LM, Abrams DB, Fisher EB, Goldstein MG, et al. External validity: we need to do more. Ann Beh Med. 2006;31:105–8.
Wallerstein N. Making traces: evidence for practice and evaluation. In: Reader A, Greene J, Labonte R, editors. Critical public health. London, United Kingdom: Routledge; 2007. p. 80-91.
Canadian Institutes of Health Research. Guide to knowledge translation planning at CIHR: integrated and end-of grant approaches. Ottawa: Canadian Institutes of Health Research; 2012. Available: http://www.cihr-irsc.gc.ca/e/documents/kt_lm_ktplan-en.pdf
Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009;4:50.
Gibson OR, Segal L. Limited evidence to assess the impact of primary health care system or service level attributes on health outcomes of indigenous people with type 2 diabetes: a systematic review. BMC Health Serv Res. 2015;15:154.
Tipene-Leach DC, Coppell KJ, Abel S, Pahau HL, Ehau T, Mann JI. Ngati and healthy: translating diabetes prevention evidence into community action. Ethnicity Health. 2013;18:402–14.
Coppell KJ, Tipene-Leach DC, Pahau HL, Williams SM, Abel S, Iles M, et al. Two-year results from a community-wide diabetes prevention intervention in a high risk indigenous community: the Ngati and healthy project. Diabetes Res Clin Pract. 2009;85:220–7.
Kerr S, Penney L, Moewaka Barnes H, McCreanor T. Kaupapa Māori action research to improve heart disease service in Aotearoa. New Zealand Ethnic Health. 2010;15(1):15–31.
Pitama S, Wells J, Faatoese A, Tikao-Mason K, Robertson P, Huria T, et al. A Kaupapa Māori approach to a community cohort study of heart disease in New Zealand. Aust NZ J Public Health. 2011;35:249–55.
Barkin S, Schlundt D, Smith P. Community-engaged research perspectives: then and now. Acad Pediatr. 2013;13:93.
Smith LT. Decolonizing methodologies: research and indigenous peoples. Dunedin, New Zealand: Zed Books and University of Otago Press; 1999.
Smith GH & International Research Institute for Māori & Indigenous Education. The development of Kaupapa Māori: theory and praxis. Auckland, New Zealand: University of Auckland; 2002.
Durie M. Ngā tai matatū: tides of Māori endurance. Melbourne, Australia: Oxford University Press; 2005.
Bishop R. Collaborative research stories: whakawhanaungatanga. Palmerston North, New Zealand: Dunmore Press; 1996.
Pihama L, Cram F, Walker S. Creating methodological space: a literature review of Kaupapa Maori research. Can J Nativ Educ. 2002;26:30–43.
Robson B, Harris R (eds.). Hauora: Māori standards of health IV: a study of the years 2000–2005. Wellington, New Zealand: Te Ropu Rangahua Hauora a Eru Pomare; 2007.
Robson B: Kaupapa Māori research and quantitative approaches. Auckland, New Zealand: Māori and Indigenous Analysis Ltd; 2004.
Reid P, Robson B, Jones C. Disparities in health: common myths and uncommon truths. Pacific Health Dialogue. 2000;7:38–47.
Dutta MJ. Communicating about culture and health: theorizing culture-centered and cultural sensitivity approaches. Commun Theor. 2007;17:304–28.
Dutta MJ: Communication health: a culture-centered approach. Malden, MA: Polity Press; 2008.
Peterson JC. CBPR in Indian country: tensions and implications for health communication. Health Commun. 2010;25:50–60.
Dutta MJ, Anaele A, Jones C. Voices of hunger: addressing health disparities through the culture-centered approach. J Commun. 2013;63:159–80.
Basu A, Dutta MJ. Sex workers and HIV/AIDS: analyzing participatory culture-centered health communication strategies. Hum Commun Res. 2009;35:86–114.
Ramsden I, Spoonley P. The cultual safety debate in nursing education in Aotearoa. NZ Annu Rev Educ. 1994;3:161–74.
Ramsden I. Cultural safety: implementing the concept. The social force of nursing and midwifery. In: Whait P, McCarthy M, & Durie A, editors. Mai I Rangiatea. Auckland, New Zealand: Auckland University Press, Bridget William Books; 1997. p. 113-125.
Mane J, Māori K. A community approach. MAI Review. 2009;3:1.
Ramadurai V, Sharf BF, Sharkey JR. Rural food insecurity in the United States as an overlooked site of struggle in health communication. Health Commun. 2012;27:794–805.
Smith PC. Everything you know about Indians is wrong. Minneapolis: University of Minnesota Press; 2009.
Taylor R. An indigenous perspective on evaluations in the inter-cultural context: how far can one throw a Moree boomerang? Eval J Australasia. 2003;3:44–53.
Sengupta N. Economic studies of indigenous and traditional knowledge. Academic Foundation: New Delhi; 2007.
Masters-Awatere B. “That’s the price we pay”: Kaupapa Maori programme stakeholder experiences of external evaluation. PhD. Hamilton: University of Waikato; 2015.
Minkler M, Wallerstein N, editors. Community-based participatory research for health: from process to outcomes, 2nd edition. San Francisco, CA Jossey-Bass; 2008.
Sundquist J, Hamano T, Li X, Kawakami N, Shiwaku K, Sundquist K. Neighborhood linking social capital as a predictor of psychiatric medication presciption in the elderly: a Swedish national cohort study. J Psychiat Res. 2014;55:44–51.
Oetzel JG, Villegas M, Zenone H, White Hat ER, Wallerstein N, Duran B. Enhancing stewardship of community-engaged research through governance. Am J Public Health. 2015;105:1161–7.
LaVeaux D, Christopher S. Contextuatlizing CBPR: key principles of CBPR meet the indigenous research context. Pimatisiwin. 2009;7(1):1–25.
Bell R, Tumilty S, Kira G, Smith C, Hale L. Using a community based participatory research model within an indigenous framework to establish an exploratory platform of investigation into obesity. Obesity Med. 2016;2(June):19–24.
CTSA Community Engagement Key Function Committee. Principles of community engagement. 2nd ed. Washington DC: NIH Publication No. 11–7782; 2011.
Wallerstein N, Duran B, Oetzel JG, Minkler M, editors. Community-based participatory research for health: advancing social and health equity, 3rd edition. San Francisco: Jossey-Bass; 2018.
Wallerstein N, Oetzel J, Duran B, Belone L, Tafoya G, Rae R. CBPR: what predicts outcomes? In: Minkler M, Wallerstein N, editors. Community-based participary research for health: from process to outcomes. 2nd ed. San Francisco: Jossey-Bass; 2008. p. 371–92.
Israel BA, Schulz AJ, Parker EA, Becker AB, Guzman JR. Critical issues in developing and following CBPR principles. In: Minkler M, Wallerstein N, editors. Community-based participary research for health: from process to outcomes. 2nd ed. San Francisco: Jossey-Bass; 2008. p. 47–66.
Simpson M, Ake T. Whitiwhiti korero: exploring the researchers’ relationship in cross-cultural research. J Intercultural Commun Res. 2010;39:185–205.
Cook WK. Integrating research and action: a systematic review of community-based participatory research to address health disparities in environmental and occupational health in the USA. J Epidemiol Commun H. 2008;62:668–76.
Carter MW, Tregear ML, Lachance CR. Community engagement in family planning in the U.S.: a systematic review. Am J Prev Med. 49 Suppl 1:S116.
Wolfenden L, Wyse R, Nichols M, Allender S, Millar L, McElduff P. A systematic review and meta-analysis of whole of community interventions to prevent excessive population weight gain. Prev Med. 2014;62:193.
Milton B, Attree P, French B, Povall S, Whitehead M, Popay J. The impact of community engagement on health and social outcomes: a systematic review. Community Dev J. 2012;47:316–34.
Boelsen-Robinson T, Peeters A, Beauchamp A, Chung A, Gearon E, Backholer K. A systematic review of the effectiveness of whole-of-community interventions by socioeconomic position. Obesity Rev. 2015;16:806–16.
Las Nueces D, Hacker K, DiGirolamo A, Hicks LS. A systematic review of community-based participatory research to enhance clinical trials in racial and ethnic minority groups. Health Serv Res. 2012;47:1363–86.
Cyril S, Smith BJ, Possamai-Inesedy A, Andre MNR. Exploring the role of community engagement in improving the health of disadvantaged populations: a systematic review. Glob Health Action. 2015;8:1–12.
O’Mara-Eves A, Brunton G, Oliver S, Kavanagh J, Jamal F, Thomas J. The effectiveness of community engagement in public health interventions for disadvantaged groups: a meta-analysis. BMC Public Health. 2015;15:1352.
Yuen T, Park AN, Seifer SD, Payne-Sturges D. A systematic review of community engagement in the US Environmental Protection Agency’s extramural research solicitations: implications for research funders. Am J Public Health. 2015;105:e44–52.
Israel BA, Eng E, Schulz AJ, Parker E, editors. Methods in community-based participatory research for health. 2nd ed. San Francisco: Jossey-Bass; 2013.
Trickett EJ. Community-based participatory research as worldview or instrumental strategy: is it lost in translation(al) research? Am J Public Health. 2011;101:1353–5.
Oetzel JG, Zhou C, Duran B, Pearson C, Magarati M, Lucero J, et al. Establishing the psychometric properties of constructs in a community-based participatory research conceptual model. Am J Health Promot. 2015;29:e188–202.
Larkan F, Uduma O, Lawal SA, van Bavel B. Developing a framework for successful research partnerships in global health. Glob Health. 2016;12:17.
Horst WJR, Webber MM. Dilemmas in a general theory of planning. Policy Sci. 1973;4:155–69.
Rosenhead J, Mingers J. Rational analysis for a problematic world revisited. Chichester, U.K: John Wiley and Sons; 2001.
Frerichs L, Lich KH, Dave G, Corbie-Smith G. Integrating systems science and community-based participatory research to achieve health equity. Am J Public Health. 2016;106:215–22.
Peet J. Systems thinking and common ground. Int J Transdisciplinary Res. 2006;1:88–99.
Taurima W, Cash M. Te Wanaga: developing a bicultural model using critical systems. In: The 35th annual conference of the operational research Society of new Zealand. Wellington, New Zealand: Operations Research Society of New Zealand; 2000: 1-6. Available: http://orsnz.org.nz/conf35/papers/TaurimaCash.pdf
Jones AP, Homer JB, Murphy DL, Essien JDK, Milstein B, Seville DA. Understanding diabetes population dynamics through simulation modeling and experimentation. Am J Public Health. 2006;96:488–94.
Finegood DT, Merth TDN, Rutter H. Implications of the foresight obesity system map for solutions to childhood obesity. Obesity. 2010;18 Suppl:S13–6.
Hirsch G, Homer J, Evans E, Zielinski A. A system dynamics model for planning cardiovascular disease interventions. Am J Public Health. 2010;100:616–22.
Loyo HK, Batcher C, Wile K, Huang P, Orenstein D, Milstein B. From model to action: using a system dynamics model of chronic disease risks to align community action. Health Promot Pract. 2013;14:53–61.
Mabry PL, Bures RM. Systems science for obesity-related research questions: an introduction to the theme issue. Am J Public Health. 2014;104:1157–9.
Trochim WM, Cabrera DA, Milstein B, Gallagher RS, Leischow SJ. Practical challenges of systems thinking and modeling in public health. Am J Public Health. 2006;96:538–46.
Foster-Fishman PG, Nowell B, Yang H. Putting the system back into systems change: a framework for understanding and changing organizational and community systems. Am J Commun Psychol. 2007;39:197–215.
Midgley G. Systemic intervention: philosophy, methodology and practice. New York, NY: Kluwer Academic/Plenum Publishers; 2000.
von Bertalanffy L: General systems theory. Harmondsworth, U.K: Penguin; 1968.
Forrester J. Industrial dynamics. Cambridge, U.K: MIT Press; 1961.
Checkland P. Systems thinking, systems practice. New York: J. Wiley; 1981.
Riley WJ, Moran JW, Corso LC, Beitsch LM, Bialek R, Cofsky A. Defining quality improvement in public health. J Public Health Man. 2010;16:5–7.
World Health Organization. Everybody’s business-strengthening health systems to improve health outcomes: WHO’s framework for action. Geneva, Switzerland: World Health Organization; 2007. Available: http://www.who.int/healthsystems/strategy/everybodys_business.pdf
Flood R, Jackson M. Creative problem solving: total system intervention. New York: John Wiley & Sons; 1991.
Foote JL, North NH, Houston DJ. Towards a systemic understanding of a hospital waiting list. J Health Organ Man. 2004;18:140–54.
Flood R. The relationship of ‘systems thinking’ to action research. Syst Pract Act Res. 2010;23:269–84.
Midgley G. System thinking: an introduction and overview. In: Midgley G, editor. Systems thinking, Volume 1. London, U.K: Sage; 2003. p xvii-liii.
Foote JL, Gregor JE, Hepil MC, Baker VE, Houston DJ, Midgley G. Systemic problem structuring applied to community involvement in water conservation. J Oper Res Soc. 2007;58:645–54.
Daellenbach H. Systems thinking. In: Daellenbach HG, Flood RL, editors. The informed student guide to management science. London: Thomson Learning; 2002. p. 273–4.
Ulrich W. Critical heuristics of social systems design. Euro J Oper Res. 1987;31:276–83.
Midgley G, Cavana RY, Brocklesby J, Foote JL, Wood DRR, Ahuriri-Driscoll A. Towards a new framework for evaluating systemic problem structuring methods. Euro J Oper Res. 2013;229(1):143–54.
Ministry of Business, Innovation and Employment. New Zealand Health Research Strategy 2017–2027. Wellington, New Zealand; 2017. Available: http://www.health.govt.nz/system/files/documents/publications/nz-health-research-strategy-jun17.pdf
Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell W, Robinson N. Lost in knowledge translation: time for a map? J Contin Educ Health. 2006;26:13–24.
Smylie J, Martin CM, Kaplan-Myrth N, Steele L, Tait C, Hogg W. Knowledge translation and indigenous knowledge. Int J Circumpol Heal. 2004;63(Suppl 2):139–43.
Estabrooks CA, Thompson DS, Lovely JJ, Hofmeyer A. A guide to knowledge translation theory. J Contin Educ Health. 2006; 26:25-36.
Grimshaw JM, Eccles MP, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7:50.
Strauss SE, Tetroe J, Graham I. Defining knowledge translation. Can Med Assoc J. 2009;181:165–8.
Reid J, Cormack D, Crowe M. The significance of socially-assigned ethnicity for self-identified Māori accessing and engaging with primary healthcare in New Zealand. Health. 2016;20:143–60.
Lavis JN. Research, public policymaking, and knowledge-translation processes: Canadian efforts to build bridges. J Contin Educ Health. 2006;26:37–45.
Pronovost P, Berenhaoltz S, Needham D. Translating evidence into practice: a model for large scale knowledge translation. Brit Med J. 2008;337:963–5.
Ministry for Primary Industries. Ministry for Primary Industries science strategy Rautaki Putaiao. Wellington: Ministry for Primary Industries; 2015. Available: http://www.mpi.govt.nz/
Rasmus SM, Charles B, Mohatt GV. Creating Qungasvik (a Yup’ik intervention “toolbox”): case examples from a community-developed and culturally-driven intervention. Am J Commun Psychol. 2014;54:140–52.
Mulrennan ME, Mark R, Scott CH. Revamping community-based conservation through participatory research. Can Geogr. 2012;56:243–59.
BeLue R, Carmack C, Myers KR, Weinreb-Welch L, Lengerich EJ. Systems thinking tools as applied to community-based participatory research: a case study. Health Educ Behav. 2012;39:745–51.
Gibson O, Lisy K, Davy C, Aromataris E, Kite E, Lockwood C, et al. Enablers and barriers to the implementation of primary health care interventions for indigenous people with chronic diseases: a systematic review. Implement Sci. 2015;10:71.
Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53.
Bailie RS, Si D, Robinson GW, Togni SJ, d’Abbs PHN. A multifaceted health-service intervention in remote aboriginal communities: 3-year follow-up of the impact on diabetes care. Med J Australia. 2004;181:195–200.
Bailie R, Si D, Dowden M, O'Donoghue L, Connors C, Robinson G, Cunningham J, Weeramanthri T. Improving organisational systems for diabetes care in Australian indigenous communities. BMC Health Serv Res. 2007;7:67.
Roubideaux Y, Noonan C, Goldberg JH, Valdez SL, Brown TL, Manson SM, Acton K. Relation between the level of American Indian and Alaska native diabetes education program services and quality-of-care indicators. Am J Public Health. 2008;98:2079–84.
Wilson C, Gilliland S, Cullen T, Moore K, Roubideaux Y, Valdez L, et al. Diabetes outcomes in the Indian health system during the era of the special diabetes program for Indians and the government performance and results act. Am J Public Health. 2005;95:1518–22.
Kenealy TW, Eggleton KS, Robinson EM, Sheridan NF. Systematic care to reduce ethnic disparities in diabetes care. Diabetes Res Clin Pr. 2010;89:256–61.
Smith R, Krebs J, Weatherall M, McBain L, Hullah M, Shapleski M. Analysis of a primary care led diabetes annual review programme in a multi ethnic cohort in wellington. New Zealand Diabetes Res Clin Pr. 2011;91:164–70.
Simmons D. Impact of an integrated approach to diabetes care at the Rumbalara aboriginal health service. Intern Med J. 2003;33(12):581.
Schraer CD, Weaver D, Naylor JL, Provost E, Mayer AM. Reduction of amputation rates among Alaska natives with diabetes following the development of a high-risk foot program. Int J Circumpol Heal. 2004;63 Suppl 2:114.
Ramesh M, Schraer C, Mayer AM, Asay E, Koller K. Effect of special diabetes program for Indians funding on system changes in diabetes care and outcomes among American Indian/Alaska native people 1994-2004. Int J Circumpol Heal. 2008;67:203–12.
Virani S, Strong D, Tennant M, Greve M, Young H, Shade S, et al. Rationale and implementation of the SLICK project. C J Public Health. 2006;97:241–7.
McDermott RA, Schmidt BA, Sinha A, Mills P. Improving diabetes care in the primary healthcare setting: a randomised cluster trial in remote indigenous communities. Med J Australia. 2001;174:497–502.
Tobe SW, Pylypchuk G, Wentworth J, Kiss A, Szalai JP, Perkins N, et al. Effect of nurse-directed hypertension treatment among first nations people with existing hypertension and diabetes mellitus: the diabetes risk evaluation and Microalbuminuria (DREAM 3) randomized controlled trial. Can Med Assoc J. 2006;174:1267–71.
Ralph-Campbell K, Pohar SL, Guirguis LM, Toth EL. Aboriginal participation in the DOVE study. C J Public Health. 2006;97:305–9.
This manuscript was supported by a grant from the Healthier Lives National Science Challenge (PI Maui Hudson, HL-T1CR-D 13058/1 SUB1320).
Availability of data and materials
Articles included in the analysis are cited in the reference list.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
- Kaupapa Māori
- Community-engaged research
- Systems thinking
- Integrated knowledge translation
- Implementation science