Skip to main content

Research on the move: exploring WhatsApp as a tool for understanding the intersections between migration, mobility, health and gender in South Africa

Abstract

Background

Reflecting global norms, South Africa is associated with high levels of cross-border and internal population mobility, yet migration-aware health system responses are lacking. Existing literature highlights three methodological challenges limiting the development of evidence-informed responses to migration and health: (1) lack of engagement with the process of migration; (2) exclusion of internal migrants; and (3) lack of methodologies that are able to capture ‘real-time’ data about health needs and healthcare seeking experiences over both time and place. In this paper, we reflect on a four-month pilot project which explored the use of WhatsApp Messenger - a popular mobile phone application used widely in sub-Saharan Africa – and assessed its feasibility as a research tool with migrant and mobile populations in order to inform a larger study that would address these challenges.

Method

A four-month pilot was undertaken with eleven participants between October 2019 and January 2020. Using Survey Node, an online platform that allows for the automatic administration of surveys through WhatsApp, monthly surveys were administered. The GPS coordinates of participants were also obtained. Recruited through civil society partners in Gauteng, participants were over the age of 18, comfortable engaging in English, and owned WhatsApp compatible cell phones. Enrolment involved an administered survey and training participants in the study protocol. Participants received reimbursement for their travel costs and monthly cell phone data.

Results

Out of a possible eighty eight survey and location responses, sixty one were received. In general, participants responded consistently to the monthly surveys and shared their location when prompted. Survey Node proved an efficient and effective way to administer surveys through WhatsApp. Location sharing via WhatsApp proved cumbersome and led to the development of a secure platform through which participants could share their location. Ethical concerns about data sharing over WhatsApp were addressed.

Conclusions

The success of the pilot indicates that WhatsApp can be used as a tool for data collection with migrant and mobile populations, and has informed the finalisation of the main study. Key lessons learnt included the importance of research design and processes for participant enrolment, and ensuring that the ethical concerns associated with WhatsApp are addressed.

Background

Recent years have seen increased attention being paid to the global governance of cross-border migration – the movement of people across international borders, including asylum seekers, refugees, migrant workers and undocumented migrants [1, 2]. Driven in many cases by high-income countries (HICs) who want to restrict the inward movement of people from low- and middle-income countries (LMICs), these discussions tend to focus on concerns around the role of the nation state and sovereignty, and push for the securitisation of cross-border migration through both border management and immigration legislation [3]. This focus on cross-border migration means that the more prevalent movements of people within their country of birth, internal migration, is often overlooked. While cross-border migrants, particularly those who are undocumented – are without the documents required to be in a country legally - face particular challenges in accessing healthcare, many of these difficulties are experienced by both cross-border and internal migrants [4, 5]. Despite attempts by global health actors to push the migration and health agenda for more than a decade in order to achieve health for all, challenges persist as cross-border and internal migrant populations continue to be left-behind in both research and policy development [6, 7]. This is particularly so for marginalised migrant groups, including those who sell sex, undocumented migrants, and people seeking asylum on the basis of their gender identity [6, 7]. Leaving migrants behind has serious implications for all, negatively affecting progress on the targets set out in the Sustainable Development Goals (SDGs) and other associated global health processes [6,7,8,9,10].

The South African context, associated with high levels of cross-border and internal migration, makes for an ideal case study in which to explore a mobile methodology – a methodological approach that facilitates the collection of data whilst participants migrate - for understanding the health-related experiences of migrants in ‘real-time’. South African health systems are not migration-aware nor mobility-competent, affecting access to healthcare for cross-border and internal migrants [5, 11,12,13]. Key populations, including sex workers and trans people, who are known to be particularly mobile, face additional barriers to access as a result of their gender and/or sexuality [14]. Furthermore, while more women are migrating into South Africa than before, they face particular challenges in the informal economy in which many work [15], accessing healthcare [16] and fulfilling care roles [17].

Improving responses to migration and health in South Africa

Drawing on existing research literature, we highlight three specific challenges that are limiting the development of improved responses to migration and health globally, although our focus here is on South Africa: (1) the focus on individual migrants rather than on the process of migration; (2) the prioritisation of cross-border migrants and the exclusion of internal migrants; and (3) the methodological limitations for obtaining ‘real-time’ data over time and place.

Firstly, the field of migration and health tends to focus on the movement of individual migrants – including those seeking asylum – rather than on the process of migration itself [6, 9]. This often results in efforts that, for example, aim to make health systems ‘migrant-sensitive’ – often through cultural competency training for healthcare workers – rather than ‘migration-aware’, whereby systems embed the movement of people within and between countries into their design and implementation [11, 13].

Secondly, whilst limited, efforts to address migration and health focus on the movement of cross-border migrants and overlook internal migrants – those who move within their countries of birth – and intra-regional migrants, both of which are prevalent in LMIC contexts. Whilst these movements account for a significant proportion of all global migration, they remain left-behind in global migration and health governance discussions that predominantly focus on the movement of people from LMICs to HICs [9, 18, 19].

Finally, within the field of migration and health research, we have not found examples of methodologies that are able to capture ‘real-time’ data about health needs, healthcare seeking experiences, and interactions with healthcare systems over both time and place. Longitudinal research on migration and health tends to make use of repeated quantitative measures collated in a single geographic location that rely on participant recall of experiences, time, and place, such as through Demographic Health Surveillance Surveys (DHSS) [20]. Qualitative approaches for exploring migration and health over time, on the other hand, largely rely on face-to-face interactions between the researcher(s) and participants at different moments. Sometimes mobile technology – like WhatsApp – is used by researchers to remain in contact with participants, conduct interviews or, increasingly, continue ongoing participatory research [21]. However, these approaches are rarely designed to capture experiences over time and place as they are happening – something particularly important when working with migrant groups. Nor do they tend to explore the capabilities of technology as a data collection tool itself.

WhatsApp as a research tool for exploring migration, mobility, health and gender in South Africa

In order to explore intersections between migration, mobility and the South African health system, and taking into consideration the three concerns raised above, the Migration, Gender and Health Systems (MiGHS) project - a collaboration between the Universities of the Witwatersrand (Wits) and Cape Town (UCT), the London School of Hygiene and Tropical Medicine (LSHTM) and the South African National Department of Health (NDoH) - aims to explore the use of mobile technology as a tool for researching the health-related experiences of cross-border and internal migrants in ‘real-time’. Funded by the UK MRC Wellcome Trust Health Systems Research Initiative, the project draws on previous research in the field of migration and health undertaken by the collaborators [5, 22, 23].

Following a review of the literature, we chose to explore the use of WhatsApp Messenger - a social media platform operated on smart phones – in this research. Four key reasons explain our decision to use WhatsApp: its prevalence as a means of communication in Southern Africa [24, 25]; the application’s affordability; its ease of use, including allowing the participant to respond to survey questions and share their location within WhatsApp; and – perhaps most importantly – the ability to retain contact with participants should they cross international borders [26,27,28,29,30,31].

To date, the use of WhatsApp as a tool for data collection in health research has been limited [32]. Our scoping review indicates that WhatsApp has either been used to disseminate survey tools, usually through sharing a link to an online SurveyMonkey or Google Form, or, through the creation of a WhatsApp Group as an intervention to facilitate communication between healthcare workers. We found that while some attention has been paid to the use of WhatsApp in mHealth and telemedicine, and amongst healthcare workers [33,34,35], there is little published that assesses the use of WhatsApp as a data collection tool in health research and communication interventions. Importantly, even within the literature that does exist, limited attention has been paid to the ethical implications of using WhatsApp or the ways in which existing social and economic inequities may affect its use.

A pilot study

In this paper we reflect on the results of a pilot study, conducted by MiGHS, that sought to investigate the potential use of WhatsApp for a larger study the project hopes to undertake. The larger study aims to retain contact with 400 mobile study participants to be recruited in four areas of South Africa for a twelve-month period, to document their experiences of health systems usage in real-time. To explore the feasibility of this study, a four-month pilot project, on which this paper reflects, was undertaken between October 2019 and January 2020 to explore the opportunities and challenges associated with the use of WhatsApp as a research tool. This paper reflects on the successes and challenges of the pilot and how it has informed the main study. This paper does not reflect on the data collected during the pilot as the pilot sample was small and the focus of the pilot was on the feasibility and practicalities of using WhatsApp as a research tool. Nor does the paper speak to the broader interest of the MiGHS project in terms of the intersection of gender with migration and access to health systems, as this was beyond the scope of the pilot study. However, through documenting our use of the application in this research and the ways the pilot has shaped our thinking as we move into the main project, we hope to contribute insights to existing gaps in the literature on migration and health, and to the development of an emerging best practice around the use of WhatsApp in health research.

Methods

In developing the pilot and thinking through the logistics of using WhatsApp, four key questions animated our discussions. The first was how to administer a survey through WhatsApp - being able to automate questions and responses, being able to send the survey out en masse, and ensuring that anonymity could be assured were all pivotal. The second question pertained to how we could and should ask participants to share their locations with us. The third question was how to ensure, through the recruitment process, that participants felt sufficiently comfortable with and invested in the project that they would respond to survey and location prompts across a four-month period. The final question was how to ensure that at each step of the process the privacy of participants and their information was protected.

Data collection and management

Data was collected in three ways in the pilot:

  1. 1.

    A survey to ascertain the socio-demographic profile, health seeking behaviour history and migratory history of the participant was administered at the point of recruitment;

  2. 2.

    A monthly survey administered through WhatsApp to explore its potential for collecting and tracking health seeking behaviour across the four months; and

  3. 3.

    A monthly prompt for the participant to share their location with us using the WhatsApp location sharing function to generate data that would indicate if and how mobility intersects with healthcare access.

A search of available software through which monthly surveys could be administered indicated that there are very few options. The platform chosen for this project was Survey Node.Footnote 1 Although Survey Node appears to have been primarily used in customer service evaluations, the software’s ability to interface with WhatsApp – through WhatsApp Business - and the dearth of alternatives were key factors in our choice. As such, after the successful enrolment of the participants, the WhatsApp monthly survey was sent out to each participant four times between October 2019 and January 2020. Table 1 outlines the schedule for the pilot – this was developed so that survey and location prompts were sent in a systematic manner that was clear to the whole research team. Given time constraints, surveys were administered slightly more frequently than once a month. However, they were spaced out as much as possible and in such a way so as to ensure that surveys were not sent on or too close to Christmas and New Year, but we could still gauge whether participants would respond to surveys administered at this time of year. In addition, participants were asked to share their location once a month using WhatsApp’s ‘send location’ function. Both the invitation to respond to the survey and the location sharing took place on a WhatsApp account that was run by the project team. The survey itself was administered by Survey Node using WhatsApp Business.

Table 1 Pilot schedule

Data collected through the surveys was exported from Survey Node (by a .csv file) into Excel, cleaned, and then imported into SPSS.

The enrolment process

Our sampling was respondent driven to ensure the adequate inclusion of migrant and mobile populations [37, 38]. In the main study, we plan to enrol participants across four provinces and at healthcare facilities, as well as through organisations that work with migrant and mobile populations in order to ensure that the sample is diverse in terms of gender and migration history. For the pilot, given that we only intended to recruit ten participants, and that the primary objective was to see if and how participants responded to WhatsApp as a research tool, we recruited exclusively in Gauteng – in the cities of Johannesburg and Tshwane – through non-governmental organisations (NGOs) with whom the researchers had worked before.

Recruitment took place at three NGOs, all of whom work with migrant and mobile populations. The organisations approached potential participants, made them aware of the project, and invited them to meet with the researchers. Organisations were asked to ensure that potential participants were over the age of eighteen, could communicate in English, and owned a cell phone that was WhatsApp compatible. While we hope to include additional languages in the main study, the pilot was exclusively conducted in English. Participants were asked what their home language was and how comfortable they felt proceeding in English during enrolment. All indicated that they were happy to participate in English.

At the meeting with the researchers, potential participants were given an overview of the project, potential risks associated with involvement – these were primarily in relation to sharing data over WhatsApp – and the time commitment that it would involve. If individuals were interested in taking part, they were then recruited and started the enrolment process.

Sixteen participants were recruited into two groups – Group 1 included those recruited at the first two organisations, while Group 2 included those recruited at the third as this happened 2 weeks after Group 1 was recruited. Surveys were sent to each group according to a different schedule due to the time difference between recruitment (Table 1). In addition to administering the enrolment survey at the point of enrolment, much time was spent familiarising participants with the particularities of responding to the survey and location prompts on WhatsApp, for which we developed several practice tools (see Table 2).

Table 2 Research instruments

During enrolment, each participant was allocated a unique identifier and their cell phone number and service provider was recorded. All efforts were made to ensure that the participant’s contact information was correctly recorded so that they would receive the monthly surveys and data, and care was taken to ensure that this information remained confidential during and after the project. The participant’s cell phone number was added to a project cell phone and the participant was asked to save the project cell phone number on their phone. The participant was then sent the link to the WhatsApp practice survey(s). Following initial recruitments, researchers decided to develop a second WhatsApp practice survey as the researchers felt that the first was done under heavy supervision by the researcher, and would thus not necessarily indicate comfort or ability to respond to the survey. Each of the practice surveys consisted of three neutral questions including, for example, asking the participant which mobile network they used as a multiple-choice question and how they recharged their phone with data as a free text question. These surveys were designed to ensure that participants became familiar and comfortable with responding to automated questions sent through WhatsApp.

Participants were also asked to practice sending their pin locations during enrolment. After the first round of recruitment, it became clear that researchers would need to practice this with participants at the point of recruitment and ensure, for example, that location settings were turned on in WhatsApp. It was made clear to participants prior to recruitment that no real-time monitoring of their location would be undertaken. Instead, patterns in mobility over the study period and across the group of participants as a whole were what was of interest to the researchers. In addition, assurances were made that no location data would be shared with any law or immigration enforcement of any kind, and data presented in publications or at conferences would be anonymised.

During the project itself, Group 1 was asked to share their location at the same time that they were asked to respond to the monthly survey, while Group 2 was asked to share theirs ten to fourteen days after they had been asked to respond to the survey. This was done to get a sense of whether one worked better than the other, but the pilot data has not suggested any tangible difference.

Three participants were not carrying their WhatsApp compatible phones with them at the time that they were recruited; this is not uncommon in South Africa as the risk of cell phone theft is high, particularly for those reliant on public transport. Although steps were taken by researchers to ensure that these participants could complete their enrolment once they got home, the enrolment of these participants was not successful.

The final part of the enrolment process involved giving the participants approximately 50 ZARFootnote 2 worth of data to reimburse them for the use of their phones during recruitment. In addition to reimbursing them for any travel expenses incurred as a result of their participation in the project. A week after their recruitment, a WhatsApp initiation survey was sent to each participant. Their completion of this survey marked their successful enrolment in the pilot.

Figure 1 outlines this process and the number of participants who successfully completed each step. Although ten participants completed the initiation survey, upon following up with the six participants who did not, an eleventh participant was found to be willing and able to be included in the groups receiving the monthly surveys moving forward.

Fig. 1
figure 1

Overview of participation

Ethical clearance

Research ethics clearance was obtained from Wits Research Ethics Committee (REC) (non-medical) (certificate H19/09/51) and the LSHTM REC (reference 17,889–1) for this study. At the point of enrolment, the project was explained to the group of potential participants as a whole. Individual participants were then approached by a single researcher and asked if they were willing to continue with the enrolment process. The details of the project – as contained in the information sheet – were then discussed, as was the informed consent form. If verbal informed consent was given this was recorded by the researcher and the enrolment process began.

Results

As the focus of this pilot project was on the logistics and methods, and only eleven participants participated across the four-month period, this section exclusively discusses the findings with regard to the feasibility of using WhatsApp as a tool for data collection moving forward. Our analysis of these findings has led us to (a) feel cautiously optimistic about the feasibility of the main study and WhatsApp as a tool for data collection, and (b) implement appropriate changes for the main study.

Overview of participation

As indicated above, potential participants were given an overview of the project and the opportunity to ask questions prior to choosing whether or not they would like to participate in the study. Following this information session at the first NGO, several participants left due to concerns about the amount of time it would take for them to enrol in the study as there were only three researchers present to undertake the enrolment process. No concerns were raised about the use of WhatsApp nor location sharing by participants. In addition, lacking a valid visa or permit did not appear to be a deterrent for participants, in fact many used the opportunity to express their frustrations with the documentation system in South Africa. This is in line with previous studies that have indicated that undocumented migrants are willing to report their status, so long as confidentiality and anonymity are guaranteed [5].

Of great importance to this study was establishing whether participants would continue to respond to surveys administered through WhatsApp over a period of several months. What the pilot was able to establish was that although not all 16 recruited participants responded to the survey and location tracking prompts, if participants responded to the WhatsApp initiation survey – a third practice survey sent out a week after the participants were recruited to complete their enrolment – there was a high chance that they would continue to engage with the project over the coming months. While they may not have responded to each prompt, the ten participants who responded to the WhatsApp initiation survey remained engaged over the full period of the pilot.

Figure 1 indicates the number of responses to each survey and location prompt. The low number of responses (three out of a possible eleven) to the prompt for location three are something of an anomaly, which we believe is a result of the timing of the prompt. Group 1 was asked to share their third location pin on the 16 December, a public holiday shortly before Christmas. The lack of responses from this group to this prompt account for the much smaller number of responses here and highlights the importance of taking national holidays into account when planning the main study.

Although small, the sample for the pilot included both internal and cross-border migrants; men and women; and individuals with a range of healthcare seeking histories and varied legal statuses, based on the documentation they reported holding at the time of enrolment. However, the pilot was not designed to ascertain whether there were any differences in either the engagement of participants with the research or their responses to the surveys that can be attributed to migration status, nationality or gender.

Participant recruitment

There were three key findings with regards to the recruitment process. The first was that the enrolment. I interview allowed us to build a socio-demographic profile of the participants. While analysis of this data means very little given the small numbers recruited into the pilot, the data collected indicates that participants were able to understand and respond to the surveys administered via WhatsApp. Small changes have been made to the protocols for the main study, the rephrasing of questions for example, as informed by the pilot. Changes include adding a question about contraception to ensure that access to contraception and access to chronic medication are not conflated, and asking participants twice – once at the beginning and once at the end of the survey – whether they are on chronic medication to ensure that ambiguities around defining chronic medication were addressed.

The second finding was that the recruitment process as a whole was fairly successful in positioning participants to be able to respond to the survey and location prompts. Participants were asked how they felt and whether they had any concerns during and following the practice surveys, as well as at the end of the enrolment process. Although six recruited participants did not complete the enrolment process, this was not surprising given that three of these six participants did not have WhatsApp compatible phones with them at the point of recruitment. Moving into the main study, only participants who have their WhatsApp compatible phone with them at the time of recruitment will be enrolled.

The third finding and decision with regards to the recruitment of participants was to move the recruitment process to REDCap.Footnote 3 The use of multiple documents during enrolment proved cumbersome as did the additional step of needing to manually enter the data into an Excel spreadsheet. REDCap is a secure web-based platform used by many in the School of Public Health at Wits (as well as across other institutions) to build, administer, and manage online databases and surveys. REDCap also has a mobile application that can be downloaded onto mobile devices. Mobile devices can then be used during the recruitment process. This will not only make the collection of data easier, but also improve the management of the database that will be created through the enrolment survey. Data collected through REDCap can be downloaded into various file formats, including .csv, which can then be imported into Excel and SPSS.

As such, the information sheet, informed consent form, checklist for practice surveys and location sharing, and enrolment survey will all be administered through REDCap. Hard copies of the information sheet will also be given to participants to ensure compliance with ethical clearance received.

Monthly surveys

One of the key questions the pilot sought to answer was how best to conduct the monthly surveys. As indicated, we choose Survey Node as the platform on which we would build our surveys. However, although the Survey Node website talked about being WhatsApp compatible, it took some time and contact with the platform’s customer service in order to ascertain exactly how Survey Node could be used in conjunction with WhatsApp. We had imagined being able to save participants’ cell phone numbers attached to a unique identifier in Survey Node, and then send participants the survey from Survey Node directly to WhatsApp. However, survey links can only be sent via text message from the platform. Once the participant clicks on the survey link, indicating consent, they are rerouted to a WhatsApp chat with a United Kingdom number associated with Survey Node.Footnote 4 This is in order to comply with Facebook’s consent policy. As such, the only way to send the survey to WhatsApp directly, given that we would already have informed consent from participants, is to copy and paste the survey link into a WhatsApp message, and broadcast that to participants from a project cell phone. This was the only way to circumvent a text message resembling spam as the starting point for each monthly survey. Additionally, even if numbers are saved to a unique identifier, survey responses are not linked to the unique identifier in the Survey Node database. They are exclusively linked to the number from which the responses originate. Once these limitations were clear, we were able to successfully work around them and use the platform throughout the pilot.

Over the course of the pilot, participants were each asked to respond to the monthly survey four times, and we received a total of thirty five responses to the survey (out of a possible forty four). Across these responses, nineteen instances of participants seeking healthcare were reported, of which eight were associated with some kind of challenge during this process. Challenges reported included being unable to access healthcare as the participant in question lacked the correct documentation, and complaints about waiting time at facilities. Given the small number of participants in the pilot, no conclusions can be draw from the responses themselves, but it does speak to the potential data that the main study will be able to collect.

Analysis of the data collected during the pilot did not indicate that participants were averse to answering particular questions nor that their answers were inconsistent. Analysis of the responses did point to some ambiguities and common misunderstandings with regards to the phrasing of the questions, which have subsequently been changed for the main study.

Some changes to the monthly survey have been made for the main study as informed by our analyses of the pilot. Importantly, where possible, questions and response options have been standardised across the enrolment survey and WhatsApp monthly survey by, for example, ensuring that multiple choice options are identical. Additional choices were also added to the multiple-choice questions, as informed by responses in the pilot when participants chose ‘other’ when responding to a multiple-choice question and were then given the option to explain in free text. For example, ‘physical pain’, ‘referral’, ‘contraception’ and ‘malaria’ were all added as options for the question ‘why did you seek care?’

Location tracking

The use of WhatsApp’s location sharing function to track the location of participants proved unsustainable. Management of this data involved having to enter the WhatsApp chat between the participant and the project team, open the shared location pin, copy the data and paste it into an Excel spreadsheet that could then be imported into GIS software. While this was manageable during the pilot study given the small number of participants, a different mechanism for logging locations has been created for the main study. A secure and user-friendly web-based platform has been developed through which participants can log their location. Locations are attached to the participant’s cell phone number and automatically added to a database that can then be managed, imported into GIS software and analysed. Importantly, this platform only captures the participant’s location at the moment that they enter their cell phone number into the platform. It does not continue to track their location. This platform was tested with Group 2 the fourth and final time that they were asked to log their location, and elicited as many responses as previous prompts to send their location via WhatsApp.

While all of the location data received was from within South Africa, location data was captured from those who moved internally over Christmas and data correlated to participants reported movements as captured by the survey.

Cell phone data

Finally, the biggest logistical concern – and something the pilot set out to explore - related to reimbursing participants for the use of their own cell phones and mobile data during the study. Three approaches were tested at the point of recruitment and during the pilot.

Initially, we had imagined that at the point of recruitment, data could be transferred from a project phone to the participant’s phone. However, we discovered that data can only be transferred between phones on the same service provider network, as such this was not a practical solution as there are four major networks in South Africa (MTN, Vodacom, Telkom, Cell C) and the researcher only has access to a project phone on a single network at the point of enrolment. To address this, on the first day of recruitment, participants were given 50 ZAR cash (sufficient to purchase, on average, 500 MB of mobile data [41]) to purchase data for a network of their choice. On the second day, participants were asked which network they used, and a member of the research team went and purchased vouchers for data that were then distributed to the participant. During the second round of recruitment, one of the researchers used her personal banking app to send data directly to each participant’s phone.

In addition, every month, prior to sending participants the survey, participants were sent 50 ZAR of data directly to their phones to enable them to respond to the survey. Understanding how we could send participants cell phone data every month has proven challenging. We had hoped to send data through Survey Node, but the pilot indicates that this is not possible. The only solution was the use of a personal bank account by one of the researchers to send data to each participant on the day that they will receive the survey. As such, a participant received 50 ZAR worth of data and then, a few minutes later, a broadcast message on WhatsApp with a link to the survey every month.

Discussion

Due to both the novelty of WhatsApp as a tool for data collection, in addition to the limited literature documenting its use in health research to date, each stage and element of the pilot project was subject to detailed discussion during the project’s development, its implementation and following its conclusion. Although the focus of this paper has not been on the data collected through the pilot, due to the size of our sample, an analysis of the data has indicated that participants were able to understand the questions and respond to both multiple choice and free text questions appropriately. While some questions in both the enrolment and monthly survey instruments have been rephrased for the main study as informed by the pilot, the data from the pilot has indicated that we will be able to analyse the responses in the main study in order to address the research objectives of the MiGHS project as a whole.

The concerns that dominated our discussions however related to whether or not the research was ethical and was being conducted in ways that protected participants, and whether there were additional ways to streamline the mechanisms underpinning the research.

There were three key ethical considerations in this project. The first pertained to its longitudinal nature and ensuring that consent was ongoing. It was felt that through ensuring a rigorous informed consent process at the point of recruitment and the need for participants to physically ‘opt in’ every month by responding to the survey questions or logging their location, participants were in a position to decline to remain involved in the project. By continuing to opt in through responding to prompts, participants can thus be understood to be giving continued consent.

This links to the second ethical concern - the use of mobile phone numbers and anonymity. While participants’ names were never recorded, their numbers were vital for the use of Survey Node and WhatsApp. However, within the South African context, cell phone numbers are not key identifiers of individuals. Several individuals may share one cell phone number, numbers may not be registered in the users’ name and are easily discarded and replaced, and reports indicate that often individuals have more than one cell phone or cell phone number to take advantage of various offers by network providers [42]. While this may have some ramifications for our research, it means that participants are not exposed to any undue risk by sharing their cell phone numbers with us. It does mean, however, that participants’ responses could be seen by other users of a phone that is shared or that surveys could be responded to by someone who is not the enrolled participant. While this is difficult to protect against, a discussion about this at the point of enrolment is necessary to ensure that potential participants, who are best placed to understand the dynamics of their own phone use, understand these risks and make an informed decision as to whether or not they participate in the study. Whilst it is not possible to remove these risks entirely, in future research participants could be encouraged to delete their survey responses once completed or enable WhatsApp’s ‘disappearing messages’ function for the chat with Survey Node.

The third ethical consideration pertained to the sharing of location data. Ultimately, the WhatsApp share location function generated data in a format that was too cumbersome for the project team to manage. In addition, privacy concerns associated with shared, lost or stolen phones remain. To address this, we developed and used our own secure platform for location sharing towards the end of the pilot, which we will continue to use in the main study.

Finally, the biggest logistical concern related to reimbursing participants for the use of their own cell phones and mobile data during the research. During the research we tried a number of strategies including using the personal banking app of one of the researchers to transfer data to the participants, as discussed in the results. Although we were able to make do for the pilot, none of these options are realistic when we consider recruiting over 400 participants for the main study. Moving forward, it is clear that at the time of enrolment, pre-purchasing a large quantity of vouchers for each of the service providers and equipping each researcher with several vouchers from each network is the best way to proceed.

With regards to the monthly data sent to participants the only real option – which was done in the pilot and we will continue to do in the main study – is to make use of one of the researcher’s personal banking accounts to send data directly to each participant on the day that they will receive the survey. While this remains a cumbersome part of the research method, streamlining and automating this part of the process has not been possible given the constraints of university financing systems and banking systems. Ideally, this process would utilise an institutional bank account that offers the same functionality as a personal bank account.

Limitations

While we believe our pilot study to have been sufficiently successful as to warrant optimism about the main study, several limitations with both WhatsApp as a data collection tool and our piloting of it remain.

A central limitation of this pilot is the small number of participants. While engagement by participants was fairly consistent and high, it is difficult to say with any degree of certainty whether a much larger sample will behave in a similar way. Our sample for the pilot were all recruited through NGOs and, as such, many have had a higher level of digital literacy and felt more entitled to reflect on and able to articulate their experiences accessing healthcare. In addition, due to the small size of our sample, it is unclear how existing inequities, including the way in which access to mobile devices is gendered, may affect participation in the main study. While WhatsApp is a fairly cheap way to communicate, for many in South Africa access to a WhatsApp compatible phone remains prohibitively expensive. As such, the necessity for participants to have access to a WhatsApp compatible cell phone will introduce potential biases in the sample and lead to oversampling of some demographics. However, the implications of inequities in access to WhatsApp will only become apparent in the main study.

An additional limitation as a consequence of the size of the sample is that we were not able to explore gender and the intersection of gender with migration and with access to healthcare in the pilot. However, the data does indicate that these are intersections that we will be able to explore with a larger sample in the main study.

In addition, the use of WhatsApp is itself a potential limitation: it is not a quick and easy research fix. In this case, a thorough enrolment process completed face-to-face; constant time and input from researchers to ensure that participants were receiving prompts, cell phone data and responding to questions; and access to mobile devices and consistent and reliable internet for researchers were all vital. This is in addition to the importance of finding ways to address the limitations of institutional financing systems, which requires research teams to have the ability to foot research costs upfront in order to conduct the research. While this is not meant to dissuade anyone from considering the potential of WhatsApp as a research tool, it is important to note that this approach to research is not to be undertaken lightly and without adequate preparation.

Finally, use of WhatsApp requires researchers to keep abreast of changes in the functionality and security of the application itself and developments in the regulations governing the collection and storage of private information across different contexts. In South Africa, for example, the Protection of Personal Information Act (POPIA) (2013) will come into effect in July 2021 [43]. The implications of this for research remain to be seen as Research Ethics Committees are still developing guidelines for research within this new legislative context.

Conclusion

The successful completion of this pilot points to the feasibility of and potential for the use of WhatsApp in health research, particularly with migrant and mobile populations. We have shown that WhatsApp can be used as a platform for undertaking repeat surveys over time and place, without needing to redirect the participant to another platform and survey tool that may not be compatible with their device and which may lead to increased costs for the participant. However, the mechanics of research that uses WhatsApp as a research tool need to be carefully thought out. This is particularly true during the enrolment process; this is the only point at which the researcher meets with the participant face-to-face. The use of WhatsApp provides the opportunity to gather real-time data from participants over a period of time. Data that, in this case, will hopefully go some way to improving our understandings of the ways in which migrant and mobile individuals move and their health experiences and interactions with the healthcare system in South Africa. However, the use of WhatsApp can – if not managed carefully - place participants at increased risk due to both the nature of the data that is collected and the method of capturing data through the application. As with any research approach, due consideration must be given to ensure that the data provided by participants is protected and that they are not exposed to any risk through the research process. The use of mobile technology heightens the importance of the principle of do no harm.

In paying careful consideration to the use of WhatsApp, we have developed mechanisms to rigorously document our experiences of the use of WhatsApp and to detail our approach to addressing the associated ethical challenges – key gaps in the current literature as identified by our scoping review [32]. It is difficult to determine if we have adequately understood and taken into account the ways that existing inequities are reflected in the research methodology due to the limited number of participants in the pilot study [42, 44]. However, the pilot suggests that ownership of WhatsApp-compatible cell phones is sufficiently widespread to allow for this kind of a study. In addition, ensuring that participants are provided with data to enable their participation ensures that participants are not excluded due to the cost of participation.

Finally, the pilot demonstrates that the use of WhatsApp allows for research that addresses the three concerns we raised with the state of research on migration and health. Firstly, through continuous engagement with participants over both time and place a shift in focus from the experiences of individual migrants to a better understanding of how the migration process intersects with access to healthcare will be facilitated. Secondly, through respondent driven sampling, internal migrants – and, therefore, internal migration – are not left-behind. Finally, the use of WhatsApp allows for the collection of ‘real-time’ data over time and place. It suggests, through the ability to focus on the process of migration, including internal migration, and opportunities it provides to elucidate the ways in which this process intersects with access to healthcare and gender, that this kind of research method has real potential.

The findings from this pilot study inform were used to inform the finalisation of the methodology for our main study, which has been postponed indefinitely due to the Covid19 pandemic.

Availability of data and materials

All data generated or analysed for this paper are included in this published article [and its supplementary information files].

Notes

  1. Survey Node is a trading name of ESJ Software Ltd., a UK software development company that specialises in developing and supporting innovative cloud and enterprise solutions for telecom networks, value added service providers and customer service focused organisations [36].

  2. 2,8 USD at the time of writing (August 2020). We say approximately as some networks do not have a data or airtime voucher that is worth exactly 50 ZAR.

  3. ‘REDCap is a secure web platform for building and managing online databases and surveys. REDCap’s streamlined process for rapidly creating and designing projects offers a vast array of tools that can be tailored to virtually any data collection strategy.’ [39, 40]

  4. ‘To initiate a message to a number via WhatsApp there must be an explicit confirmed opt-in obtained prior to message initiation.’ (personal communication with Survey Node, 9 October 2019)

Abbreviations

ACMS:

The African Centre for Migration & Society, University of the Witwatersrand

GCM:

Global Compact for Safe, Orderly and Regular Migration

GCR:

Global Compact for Refugees

HIC:

High-income country

LMIC:

Low- and middle-income country

LSHTM:

London School of Hygiene and Tropical Medicine

MiGHS:

The Migration, Gender and Health Systems project

NDoH:

National Department of Health

NGO:

Non-governmental organisation

REC:

Research Ethics Committee

SDG:

Sustainable Development Goals

UCT:

University of Cape Town

UHC:

Universal Health Coverage

Wits:

University of the Witwatersrand

References

  1. Guild E, Grant S. Migration governance in the UN: What is the Global Compact and what does it mean?. London: Queen Mary University of London; 2017. Report No.: 252/2017. Available from: https://repository.ubn.ru.nl/bitstream/handle/2066/182071/182071.pdf?sequence=1 [cited 2019 Jul 2]

  2. Nanopoulos E, and Guild E, Weatherhead K. Securitisation of Borders and the UN's Global Compact on Safe, Orderly and Regular Migration. Queen Mary School of Law Legal Studies Research Paper No. 270/2018. 2018. https://ssrn.com/abstract=3099996.

  3. Nanopoulos E, Guild E, Weatherhead K. Securitisation of Borders and the UN’s Global Compact on Safe, Orderly and Regular Migration. Queen Mary Univ Lond Sch Law Leg Stud Res Pap No 2702018 Secur. 2018;

  4. Myroniuk TW, Vearey J. Social capital and livelihoods in Johannesburg: differential advantages and unexpected outcomes among foreign-born migrants, internal migrants, and long-term south African residents. Int Migr Rev. 2014;48(1):243–73. https://doi.org/10.1111/imre.12076.

    Article  Google Scholar 

  5. Vearey J, de Gruchy T, Kamndaya M, Walls HL, Chetty-Makkan CM, Hanefeld J. Exploring The Migration Profiles of Primary Healthcare Users in South Africa. J Immigr Minor Health. 2016; Available from: http://www.readcube.com/articles/10.1007/s10903-016-0535-7 [cited 2016 Dec 2].

  6. Vearey J, Hui C, Wickramage K. Migration and Health. In: World Migration Report. Geneva: IOM; 2020. Forthcoming.

    Google Scholar 

  7. Mosca DT, Vearey J, Orcutt M, Zwi AB. Universal Health Coverage: ensuring migrants and migration are included. Glob Soc Policy. 2020;20(2):247–53 Available from: https://0-journals-sagepub-com.innopac.wits.ac.za/doi/full/10.1177/1468018120922228 [cited 2020 Jun 25].

    Article  Google Scholar 

  8. Abubakar I, Aldridge RW, Devakumar D, Orcutt M, Burns R, Barreto ML, et al. The UCL–Lancet Commission on migration and health: the health of a world on the move. Lancet. 2018;392(10164):2606–54. https://doi.org/10.1016/S0140-6736(18)32114-7.

    Article  PubMed  Google Scholar 

  9. Wickramage K, Vearey J, Zwi A B, Robinson C, Knipper M. Migration and health: A global public health research priority. BMC Public Health. 2018;18(1), 987. https://doi.org/10.1186/s12889-018-5932-5.

  10. IOM. Health of Migrants: Resetting the Agenda. Report of the 2nd Global Consultation. Colombo, Sri Lanka, 21–23 February 2017. Geneva: IOM; 2017. Available from: https://www.iom.int/sites/default/files/our_work/DMM/Migration-Health/GC2_SriLanka_Report_2017_FINAL_22.09.2017_Internet.pdf

    Google Scholar 

  11. de Gruchy T, Vearey J. “Left behind”: why implementing migration-aware responses to HIV for migrant farm workers is a priority for South Africa. Afr J AIDS Res. 2020;10:1–12.

    Google Scholar 

  12. Vearey J. Moving forward: why responding to migration, mobility and HIV in south (ern) Africa is a public health priority. J Int AIDS Soc. 2018;21:e25137. https://doi.org/10.1002/jia2.25137.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Vearey J, Modisenyane M, Hunter-Adams J. Towards a migration-aware health system in South Africa: a strategic opportunity to address health inequity. In: Padarath A, Barron P, editors. South African health review 2017. Durban: Health Systems Trust; 2017. p. 89–98. Available from: http://www.hst.org.za/publications/south-african-health-review-2017.

    Google Scholar 

  14. Walker R, Vearey J. Gender, migration, & health in SADC: A focus on women and girls: The African Centre for Migration and Society; Sonke Gender Justice. Cape Town: UKAID; 2019.

  15. Statistics South Africa. Migration dynamics of women, children and the elderly in South Africa. Pretoria: Statistics South Africa; 2020. Report No.: 03–51–04. Available from: http://www.statssa.gov.za/publications/Report-03-51-04/Report-03-51-042020.pdf

    Google Scholar 

  16. Makandwa T, Vearey J. Giving birth in a foreign land: exploring the maternal healthcare experiences of Zimbabwean migrant women living in Johannesburg. South Africa Urban Forum. 2017;28(1):75–90. https://doi.org/10.1007/s12132-017-9304-5.

    Article  Google Scholar 

  17. Walker R. Selling sex, mothering and ‘keeping well’ in the City: reflecting on the everyday experiences of cross-border migrant women who sell sex in Johannesburg. Urban Forum. 2017;28(1):59–73. https://doi.org/10.1007/s12132-016-9284-x.

    Article  Google Scholar 

  18. UNDESA. International Migration 2019. New York: United Nations Department of Economic and Social Affairs; 2019. Available from: https://www.un.org/en/development/desa/population/migration/publications/wallchart/docs/MigrationStock2019_Wallchart.pdf [cited 20 Jul 2020]

    Google Scholar 

  19. Vidal EM, Tjaden JD, Global Migration Data Analysis Centre. Global migration indicators 2018: insights from the Global Migration Data Portal: www.migrationdataportal.org. 2018. Available from: https://publications.iom.int/system/files/pdf/global_migration_indicators_2018.pdf [cited 20 Jul 2020]

  20. Gerritsen A, Bocquier P, White M, Mbacké C, Alam N, Beguy D, et al. Health and demographic surveillance systems: contributing to an understanding of the dynamics in migration and health. Glob Health Action. 2013;6(0) Available from: http://www.globalhealthaction.net/index.php/gha/article/view/21496 [cited 16 Jul 2015].

  21. Migration and Health. A Research Methods Handbook. 1st ed: University of California Press; 2014. Available from: https://www.jstor.org/stable/10.1525/j.ctt7zw2z4 [cited 20 Jul 2020]

    Google Scholar 

  22. Walls HL, Vearey J, Modisenyane M, Chetty-Makkan CM, Charalambous S, Smith RD, et al. Understanding healthcare and population mobility in southern Africa: the case of South Africa. S Afr Med J. 2015;106(1):14–5. https://doi.org/10.7196/SAMJ.2016.v106i1.10210.

    Article  PubMed  Google Scholar 

  23. Hanefeld J, Vearey J, Lunt N, Bell S, Blanchet K, Duclos D, et al. A global research agenda on migration, mobility, and health. Lancet. 2017;389(10087):2358–9. https://doi.org/10.1016/S0140-6736(17)31588-X.

    Article  PubMed  Google Scholar 

  24. Dahir AL. WhatsApp is the most popular messaging app in Africa: Quartz Africa. Available from: https://qz.com/africa/1206935/whatsapp-is-the-most-popular-messaging-app-in-africa/. [cited 22 Jul 2020]

  25. Most popular messaging apps. Statista. Available from: https://www.statista.com/statistics/258749/most-popular-global-mobile-messenger-apps/. [cited 22 Jul 2020]

  26. WhatsApp. WhatsApp.com. Available from: https://www.whatsapp.com/. [cited 22 Jul 2020]

  27. Lambton-Howard D, Anderson R, Montague K, Garbett A, Hazeldine S, Alvarez C, et al. WhatFutures: Designing Large-Scale Engagements on WhatsApp. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ‘19. Glasgow, Scotland: ACM Press; 2019. p. 1–14. Available from: http://dl.acm.org/citation.cfm?doid=3290605.3300389 [cited 22 Jul 2020].

    Google Scholar 

  28. Lima ICV de, Galvão MTG, Pedrosa SC, Cunha GH da, Costa AKB, Lima ICV de, et al. Use of the Whatsapp application in health follow-up of people with HIV: a thematic analysis. Esc Anna Nery. 2018;22(3). Available from: http://www.scielo.br/scielo.php?script=sci_abstract&pid=S1414-81452018000300202&lng=en&nrm=iso&tlng=en [cited 2018 May 8]

  29. Sylverken AA, Owusu-Dabo E, Kwarteng A, Twumasi-Ankrah S, Owusu M, Adu-Amoah L, et al. Use of social media in a national tuberculosis drug resistance survey: lessons from the first anti-tuberculosis drug resistance survey in Ghana. AAS Open Res. 2019;2:4. https://doi.org/10.12688/aasopenres.12920.2.

    Article  Google Scholar 

  30. Kamel Boulos MN, Giustini DM, Wheeler S. Instagram and WhatsApp in health and healthcare: an overview. Future Internet. 2016;8(3):37. https://doi.org/10.3390/fi8030037.

    Article  Google Scholar 

  31. Montag C, Błaszkiewicz K, Sariyska R, Lachmann B, Andone I, Trendafilov B, et al. Smartphone usage in the 21st century: who is active on WhatsApp? BMC Res Notes. 2015;8 Available from: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4522968 [cited 22 Jul 2020]/.

  32. Manji K, Hanefeld J, Vearey J, Walls H, de Gruchy T. Using WhatsApp messenger for health systems research: a scoping review of available literature. Health Policy Plan. 2021;36(5):czab024. 

  33. Mars M, Morris C, Scott RE. WhatsApp guidelines – what guidelines? A literature review. J Telemed Telecare. 2019;25(9):524–9. https://doi.org/10.1177/1357633X19873233.

    Article  PubMed  Google Scholar 

  34. Scott RE, Morris C, Mars M. Development of a “cellphone stewardship framework”: legal, regulatory, and ethical issues. Telemed E-Health. 2021;27(3):316–22. https://doi.org/10.1089/tmj.2020.0048.

    Article  Google Scholar 

  35. Meyer GD, Meyer N, Du Toit JD, Mans PA, Moffett BD. WhatsApp-propriate? A retrospective content analysis of WhatsApp use and potential breaches in confidentiality among a team of doctors at a district hospital. South Africa S Afr Med J. 2021;111(2):171–5. https://doi.org/10.7196/SAMJ.2021.v111i2.14453.

    Article  CAS  PubMed  Google Scholar 

  36. Survey Node. Survey Node | Conduct WhatsAPP, SMS & IVR Surveys – Global Platform For WhatsAPP, SMS & IVR Surveys. 2019. Available from: https://www.surveynode.com/ [cited 18 Mar 2020]

  37. Coetzee J, Gray GE, Jewkes R. Prevalence and patterns of victimization and polyvictimization among female sex workers in Soweto, a south African township: a cross-sectional, respondent-driven sampling study. Glob Health Action. 2017;10(1):1403815. https://doi.org/10.1080/16549716.2017.1403815.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  38. Johnston LG, Sabin K. Sampling hard-to-reach populations with respondent driven sampling. Methodol Innov Online. 2010;5(2):38.1–48. https://doi.org/10.4256/mio.2010.0017.

    Article  Google Scholar 

  39. Patridge EF, Bardyn TP. Research electronic data capture (REDCap). J Med Libr Assoc JMLA. 2018;106(1):142–4.

    Google Scholar 

  40. REDCap. REDCap. Available from: https://redcap.core.wits.ac.za/redcap/. [cited 18 Mar 2020]

  41. Kesler R. Comparing Data Prices in South Africa. 22seven; 2019. Available from: https://blog.22seven.com/2019/07/comparing-data-prices-in-south-africa/ [cited 6 Feb 2021

  42. Silver L, Johnson C. Internet connectivity seen as having positive impact on life in Sub-Saharan Africa. Pew Research Center; 2018 Available from: https://www.pewresearch.org/global/2018/10/09/internet-connectivity-seen-as-having-positive-impact-on-life-in-sub-saharan-africa/.

  43. Adams R, Adeleke F, Anderson D, Bawa A, Branson N, Christoffels A, et al. POPIA Code of Conduct for Research (with corrigendum). South Afr J Sci. 2021;117(5/6). Available from: https://sajs.co.za/article/view/10933 [cited 3 Jun 2021]

  44. Gillwald A, Mothobi O, Rademan B. The state of ICT in South Africa. Cape Town: Research ICT Africa; 2018. p. 123. Report No.: 5

    Google Scholar 

Download references

Acknowledgements

We would like to acknowledge and thank the members of the MiGHS project who were not directly involved in the pilot project, but who provided insights and guidance during its conception and the writing of this paper - Lucy Gilson, Moeketsi Modisenyane, Jill Olivier, Shehani Perera and Helen Walls. We would like to thank Lenore Longwe and Kwandakwethu Ndaba of the ACMS for administrative support throughout the project. Thanks to Janine White from the Wits School of Public Health for her assistance with REDCap. Abigail Dawson from the Consortium for Refugees and Migrants in South Africa (CoRMSA), Liesbeth Stockaert and Kate van den Berg from Médecins sans Frontières (MSF), and Ngqabutho Mpofu from the Treatment Action Campaign (TAC) are thanked for their assistance in facilitating our fieldwork for the pilot. Finally, we would like to thank Paul Ajayi for consulting with us on the functionality of the location data shared via WhatsApp.

Funding

This research is funded through the Health Systems Research Initiative (HSRI) in the UK, a collaboration between the UK MRC, ERSC, DFID, and the Wellcome Trust. Grant number: MR/S013601/1.

Author information

Authors and Affiliations

Authors

Contributions

TdG was involved in the development of the pilot project, led the recruitment of participants, and managed the logistics of the pilot, including data collection, management and analysis. TdG wrote the first draft and has been responsible for incorporating the feedback from the other authors and reviewers. JV was involved in conceptualisation and proposal writing; development of the pilot project; made substantive contributions to the first draft of this paper; finalised the manuscript with TdG; and reviewed, commented on, and approved revisions. CO consulted on the use of WhatsApp for gathering location data, and designed and built the secure web-based platform which will be used by participants in the main study. CO reviewed this paper to ensure that it accurately reflected his work. LM was involved in the development of the pilot project, the recruitment of and following up with participants. She contributed to discussions about the pilot and the development of this paper, including reviewing, commenting on, and approving revisions. KM was involved in the development of the pilot project and the recruitment of participants. She contributed to discussions about the pilot and the development of this paper. JH was involved in conceptualisation and proposal writing, as well as development of the pilot project. She reviewed, commented on, and approved the final manuscript. The authors read and approved the final manuscript.

Corresponding author

Correspondence to Thea de Gruchy.

Ethics declarations

Ethics approval and consent to participate

Research ethics clearance was obtained from Wits Research Ethics Committee (REC) (non-medical) (certificate H19/09/51) and the LSHTM REC (reference 17889–1) for this study.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

de Gruchy, T., Vearey, J., Opiti, C. et al. Research on the move: exploring WhatsApp as a tool for understanding the intersections between migration, mobility, health and gender in South Africa. Global Health 17, 71 (2021). https://doi.org/10.1186/s12992-021-00727-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12992-021-00727-y

Keywords