Factors influencing job preferences of health workers providing obstetric care: results from discrete choice experiments in Malawi, Mozambique and Tanzania
© The Author(s). 2016
Received: 29 January 2016
Accepted: 23 November 2016
Published: 20 December 2016
Task shifting from established health professionals to mid-level providers (MLPs) (professionals who undergo shorter training in specific procedures) is one key strategy for reducing maternal and neonatal deaths. This has resulted in a growth in cadre types providing obstetric care in low and middle-income countries. Little is known about the relative importance of the different factors in determining motivation and retention amongst these cadres.
This paper presents findings from large sample (1972 respondents) discrete choice experiments to examine the employment preferences of obstetric care workers across three east African countries.
The strongest predictors of job choice were access to continuing professional development and the presence of functioning human resources management (transparent, accountable and consistent systems for staff support, supervision and appraisal). Consistent with similar works we find pay and allowances significantly positively related to utility, but financial rewards are not as fundamental a factor underlying employment preferences as many may have previously believed. Location (urban vs rural) had the smallest average effect on utility for job choice in all three countries.
These findings are important in the context where efforts to address the human resources crisis have focused primarily on increasing salaries and incentives, as well as providing allowances to work in rural areas.
KeywordsHuman resources Obstetric care providers Non-physician clinicians Job preferences Malawi Tanzania Mozambique Retention Discrete choice experiments
The role of the health workforce as a critical pillar of a health system’s ability to meet population healthcare needs has become a major focus of attention, particularly in low and middle-income countries. Until relatively recently human resources for health (HRH) represented a neglected area for research and investment in health systems development . It is only really since the World Health Report 2006 , which was devoted almost exclusively to assessing a stated crisis in the global health workforce and the examination of measures to tackle it, that HRH has received greater attention. Such efforts have been motivated by increasingly clear evidence of the relationship between the number and quality of human resources for health and improved health outcomes [2, 42].
The World Health Organization (WHO) identified 57 countries, 36 of which are in sub-Saharan Africa, that fall below the threshold in workforce density required for significant coverage of essential interventions, including those necessary to meet the health-related Millennium Development Goals (MDGs). In most of Africa, there are fewer than five doctors for every 100,000 people, and each year 20,000 health professionals leave their posts to pursue jobs in urban areas, outside of the public health system or outside of their own countries. Africa requires an estimated 140% increase in the total number of doctors, nurses and midwives to ensure adequate coverage of essential health interventions – a shortage of almost one million health workers.
Density of human resources in the health sector, particularly doctors, nurses and midwives, own has been shown to correlate with variation in infant, under-five and maternal mortality rates across countries. Given the current inadequate and uneven distribution of the global health workforce, meeting the MDGs for health, particularly MDG 5 (to improve maternal health) and MDG 4 (to reduce child mortality, will be impossible without substantial increases in human resources. While doctors have the skills necessary to provide emergency obstetric care (EmOC), they are in such limited supply and high demand it is neither practical nor economic that they provide all the care required. As such, the use of mid-level providers (MLPs) including non-physician clinicians (NPCs), all clinical health professionals who are not doctors, is one key strategy to providing quality EmOC, thereby reducing maternal and neonatal deaths.
NPCs have been trained and deployed in 25 of 47 sub-Saharan African countries. Initial research is reporting that NPCs expand cost-effective quality services to under-serviced areas and play a critical role as part of a team of health workers providing care [8, 32, 33]. However, these cadres – a valuable resource - are placed in a vulnerable position because so little attention has been paid to their on-going training and career development. In many low-income countries, NPCs provide much of the EmOC , but an enabling environment is needed to continue, expand and improve upon that care.
Recent research has contributed to a greater understanding of the factors affecting the motivation, retention and performance of these cadres . In contrast to a commonly held belief, it appears that financial incentives alone are insufficient as a motivator for health workers ([7, 29]). Instead a range of financial, career development and managerial factors seem to be necessary .
McAuliffe et al.  show that organizational justice – perceived fairness in decisions, procedures and outcomes – correlated particularly strongly with job satisfaction amongst NPCs.
The range of factors likely to lead to the motivation and retention of NPCs and other health workers now appears to be relatively well understood. What is less well known however is the relative importance of the different factors in determining motivation and retention; how these interact, and how they differ across different cadres of health worker and different settings. In this study we aim to explore such factors for health workers providing obstetric care.
The DCE literature on employment preferences in sub-Saharan Africa
Attributes and attributes levels for HRH DCE applications
Country and Sample
Mangham and Hanson 
Malawi; 107 registered nurses
Place of work
City, District town
Net monthly payment
K30.000, K40.000, K50.000
Availability of material resources
Usually inadequate supply, Usually inadequate supply
Typical daily workload
Light, Medium, Heavy
Provision of government housing
No gov. housing provided, Basic gov. housing provided, Superior gov. housing provided
Opportunity to upgrade qualifications
After 3 years, After 5 years
Hanson and Jack 
Ethiopia; 219 doctors and 642 nurses
Geographical location (place of work)
For doctors: Addis Ababa, Zonal capital.
For nurses: City, Rural area
Net monthly pay
Base is salary at average civil service grade, Others multiples of this.
Government provided housing
None, Basic, Superior
Availability of equipment and drugs
Time commitment following training
1 year, 2 years
Permission to hold a second job in the private sector (doctors only)
Permitted, Not permitted
Level of supervision (nurses only)
Blaauw et al. 
Labelled design; presented alternatives described as ‘urban job’ and ‘rural job’
Kenya, S Africa, Thailand; 300 graduating nurses per country
Urban – entry salary; Rural – entry salary +10, +20 and +30%
(years of service before study leave)
Varied by country.
(e.g. Kenya: No study leave; 1 years study leave after 4 years service)
Urban – none, basic; Rural – basic, superior
(years of service before promotion)
Varied by country
Kenya: 2 years; 4 years
S Africa and Thailand: 1 year; 2 years
Varied by country.
Kenya: Short-term; Permanent contract
S Africa: None; Car allowance
Thailand: Basic, expanded insurance cover
Kruk et al. 
Ghana; 302 fourth year medical students
Basic; +30; +50%; Twice basic
No allowance; Allowance
Infrastructure, equipment, supplies
Years of work before study leave
Study leave after 5 years of service; After 2 years
None; Basic; Superior
Utility car not provided; Provided
Tanzania; 320 clinical officer final year students
Salary and allowances
None; Education opportunity offered after 2; 4; and 6 years
Dar-es-Salaam; Regional HQ; District HQ; .3 h drive from district HQ
Availability of equipment and drugs
None; Decent house provided
No utilities; Utilities and mobile coverage
Ageyi-Baffour et al. 
Ghana: 298 third-year midwifery students
Base, base plus 30%
No allowance, allowance
Infrastructure, equipment & supplies
Not supportive, supportive
Minimum years of work before study leave
2, 5 years
Free basic, free superior
No car loan, car loan
Rockers et al., 
Uganda: 246 medical students,
132 nursing students,
50 pharmacy students
57 laboratory students
4 levels customised for each cadre
No housing, free basic housing, housing allowance
Length of commitment
2, 5 years
Support from manager
Not supportive, supportive
No provision, full tuition fees
Bocoum et al., 
Burkina Faso: 315 regional health workers
Regionalised Recruitment strategy
Continue, cancel, commit 5, 10 years
3 levels from €33.6-€64.1
75% reduction for lab exams. 80% reduction lab and medicines; free medciation and lab exams
Sufficient quality equipment, insufficient, sufficient quantity but poor quality
Free housing, no housing, 25% increase in housing allowance
Robyn et al. 2015 
Cameroon: 351 medical students, nursing students and health workers
Accessability/connectivity to the city
Health Facility infrastructure
Lack of; adequate
None; good quality housing
No prefential access to ongoing training; preferential access
Base; base + 255; base +50%; Base + 75%
Job assignment in an urban area
Uncertain; automatic after 3 years
Honda & Vio 
Mozambique: 334 non-physician clinicians, 123 students
Place of work
Rural, Capital city; provincial city
Base salary, base plus 50%; base plus 100%
None; Government housing
Loan for housing or land
Not available; available
None offered; offered after 5 years only
No in-service training; regular in-service training
Availability of equipment & Medicine
Part-time allowed; allowed outside hours
Takemura et al. 
Kenya: 57 clinical officers
Quality of the Facility
1 year study leave after 2 years; after 5 years
Insufficent to afford basic; sufficient for superior
Monthly basic salary
10% additional; 30% additional
In 2 years; in 3 years
Table 1 summarizes the major works in this area. One of the earliest uses of DCEs to investigate the job preferences of health workers in Africa was Mangham and Hanson . This work was undertaken in the context of a major Government drive to increase the salaries of health workers. The results of the discrete choice experiment found that there were relatively few nurses whose preferences were dominated by a single attribute, and all six attributes had a statistically significant influence on the nurses’ preferences. The nurses were willing to trade between job attributes, and therefore willing to forego pay increases to obtain improvements in their non-monetary benefits or working conditions. The opportunity to upgrade qualifications, provision of basic government housing (compared with none) and increases in net monthly pay had the greatest impact on the utility associated with a particular job.
A similar DCE was conducted in Ethiopia , which was particularly focused on identifying factors affecting labour supply of doctors and nurses in rural areas. For doctors, they found that higher wages and quality housing incentives had the biggest impact on their willingness to work in rural areas. For nurses, availability of medical equipment and supplies were more likely to attract them to rural areas. Interestingly, they also found that married doctors valued a job in Addis Ababa three times as highly as their single counterparts, whereas younger doctors placed a higher value on reduced time spent working in remote rural areas to meet training payback commitments than their older colleagues.
A multicountry DCE study in Kenya, South Africa and Thailand also examines the effectiveness of different job attributes in attracting graduating nurses to work in rural areas . A labelled design was used, with the two job alternatives presented being described as a ‘rural job’ and an ‘urban job’, so attributes differed across presented alternatives. In Kenya and South Africa training opportunities and rural allowances were shown to be particularly important, whereas in Thailand health insurance coverage was estimated to have the greatest impact. Only a minor preference for relational over hierarchical work cultures was reported (odds ratio of 1.2 for choosing the job in Kenya and South Africa, and 2.0 in Thailand). Given the variations in preferences according to age and marital status found in Hanson & Jack’s study, caution should be employed in generalising findings from studies with newly graduating health professionals to the health workforce already employed in the service. An attribute proving attractive to a newly graduated health professional may not have the same potential to retain an experienced, possibly demotivated health worker in the system.
DCEs have also been employed to estimate job preferences, albeit amongst students, in West Africa. Kruk and her colleagues examine the factors that affect preferences of medical students for rural postings in Ghana . The strongest predictors of job choice were improved infrastructure, equipment and supplies; supportive management; and the provision of housing. The choices of women were shown to be particularly influenced by supportive management style whereas for men superior housing was considered more important. Kruk et al. interpret the student’s valuing of non-monetary attributes over high remuneration as a social desirability effect of the study. The paper also suggests that the students’ interpretation of ‘management style’ is not clear and may indicate concerns about being ‘forgotten’ in rural areas when it comes to promotion and training opportunities. Rockers et al.  study of students in Uganda found choice of job posting was strongly influenced by salary, facility quality and manager support, relative to other attributes and they conclude that salary is not the only important factor health workers consider when deciding where to work. However, Robyn et al.  found that among medical and nursing students a rural retention bonus of 75% of base salary and improved health facility infrastructure respectively were the attributes with the largest effect sizes. Among medical doctors and nurse aides, a rural retention bonus of 75% of base salary was the attribute with the largest effect size. On the other hand, improved health facility infrastructure, was the attribute with the largest effect size among the state registered nurses surveyed. Ageyi-Baffour et al.  in a study of midwifery students identified: 1) study leave after 2 years of rural service; 2) an advanced work environment with reliable electricity, appropriate technology and a constant drug supply; and 3) superior housing (2 bedroom, 1 bathroom, kitchen, living room, not shared) as the top three motivating factors to accept a rural posting in Ghana.
All the initial uses of DCEs to examine employment preferences in the African context focused on traditional cadres of health worker (doctors and nurses) or students. The work of Kolstad  examines preferences of NPCS (clinical officers) in Tanzania. As with several of the aforementioned studies, the particular policy interest was attracting health workers to rural areas. HR management was not included as a job attribute, but the study found wages (including hardship allowances) and opportunities for continued education to be particularly strong predictors of choice. Similarly a study with clinical officers in Kenya  found that educational opportunities i.e. a 1-year guaranteed study leave after 3 years of service would have the greatest impact on retention, followed by good quality health facility infrastructure and equipment and a 30% salary increase. A larger study in Mozambique  included 334 non-physician clinicians (trained for 3 or 5 years) and 123 student cohorts of the same cadres. The study drew from the design of the study reported in this paper and therefore included a broader range of attributes than previous studies (see Table 1). Their results indicated that the provision of basic government housing had the greatest impact on the probability of choosing a job at a public health facility, followed by the provision of formal education opportunities and the availability of equipment and medicine.in the facility. Housing also featured strongly in a study of 315 regional health workers in a Burkina Faso study .
Although the existing literature is based on experiments across countries and on different health worker cadres, some common findings are emerging. Opportunities for education and professional upgrading appear to be a leading determinant of choice; location is often crucial; and pay is also important but is not as strong a predicator as many may have previously believed. Human resource management (HRM) does not feature prominently within experiments to date; and although some papers have found management style is a strong predictor of choice , others have found less of an effect [5, 13].
Mandeville et al.  in a recent systematic review of the use of DCEs to inform health workforce policy called for more studies that focus on a wider range of health workers. In many countries e.g. Tanzania, Malawi, Ethiopia, Mozambique non-physician clinicians (e.g. clinical officers, surgical technicians) and mid-level cadres comprise the majority of the workforce. Our study includes all cadres engaged in the provision of EMOC in public facilities across 3 countries and therefore adds to our understanding of what motivates these different cadres of health workers.
This paper presents findings from large sample discrete choice experiments to examine the employment preferences of all cadres providing obstetric care in the public health systems in Malawi, Mozambique and Tanzania. The study is one component of the Health System Strengthening for Equity Study (HSSE). HSSE used a systems approach to explore how NPCs function within the delivery system for EmOC. Drawing on the WHO framework for monitoring health systems, HSSE focused on addressing the six building blocks necessary for a functioning health system – generating the evidence that explored the gaps and constraints in the system and using this information to advocate for evidence based policy changes at global, regional and national levels. The DCE component of the study was aimed at identifying the importance of different factors in the work environment that are considered influential in the motivation and retention of staff.
This study addresses the gaps in the extant literature by focusing on cadres that are currently providing the majority of healthcare and by including potentially important motivators such as human resources management and professional development. In addition the study comprises a large sample across three countries, where the majority of previous studies (apart from Blaauw et al.’s  study across three countries that focused only on graduating nurses) are single country studies.
The study was approved by the Institutional Review Board of Columbia University, New York; Global Health Ethics Committee Trinity College, Dublin; and the Institutional review boards of College of Medicine, Malawi, Eduardo Mondlane University, Mozambique and Ifakara Health Institute, Tanzania.
Discrete choice experiments
This paper explores health workers’ preferences for job attributes using a discrete choice experiment (DCE). The DCE method has its foundations in probabilistic choice and random utility theory . It enables observation of individuals’ preferences in situations where either the market does not exist (e.g. for new goods and services), is imperfect (e.g. public goods, such as parks); or when there is insufficient variation between attributes to permit accurate estimation of demand functions (as is the case for employment preferences). It is assumed that when faced with alternatives an individual will choose that which yields the greatest utility. The true utility an individual derives from an alternative is not directly observable, but is assumed to be composed of utility associated with constituent attributes that can be observed . The individual is assumed to be rational and consistent in his/her choices.
In human resources applications, DCEs are used to describe hypothetical job alternatives (or choice scenarios) presented to respondents who are requested to choose one. Each respondent evaluates a series of choice scenarios carefully designed in order to have some desirable statistical properties . The multiple choices made by each respondent permit measurement of the relative importance of the job attributes upon which health workers make their choices. DCEs, therefore, provide valuable evidence to inform policies to attract and retain human resources for health since they enable observation of what influences health workers’ employment decisions.
DCE experimental design
The design of DCEs involves different stages, from the selection of attributes and attribute levels to the construction of choice scenarios . The aim is to construct hypothetical scenarios that are meaningful and important to the respondents, without resulting in heavy cognitive burden, whilst at the same time being statistically efficient [4, 25].
The first step in the process is the selection of a valid and comprehensive set of attributes and attribute levels related to the choices being analysed. All possible combinations of attribute and levels are enabled through a factorial design, and a fraction of possible combinations are selected to be included in the choice surveys (this is known as a fractional factorial design). The literature on experimental design for DCE is large and continuously evolving; with contributions coming from diverse fields such as environmental economics, marketing, and transportation economics [24, 47].
Attributes and attribute levels for job alternatives – three countries
Variables for analysis
0 = rural
1 = urban
Net monthly pay
1.5 × base
2 × base
0 = base salary
1 = 1.5 × base salary or 2 × base salary
0 = base salary or 1.5 v base salary
1 = 2 × base salary
0 = no housing
1 = basic or superior housing
0 = no housing or basic housing
1 = superior housing
Equipment and Drugs
0 = Inadequate
1 = Improved
Continuing Professional Development
0 = Limited
1 = Improved
Human Resources Management
0 = Poor
1 = Functioning
All possible combinations of attributes and attribute levels (i.e. a full factorial design) would result in 144 possible scenarios or job descriptions (24 × 32, i.e. four attributes with two levels and two attributes with three levels). In order to have a manageable number of scenarios, a fractional rather than full factorial design was used. A set of choices was selected to allow the main effects (the effect of each independent variable on the dependant variable) to be explored. A constant comparator method was used i.e. holding one job specification constant while changing the levels of the attributes in the second job specification. In total 15 choice sets were presented. In DCE applications in the health research arena there has been a move towards the use of optimal designs and the use of SPEED software to generate orthogonal designs. A recent review of DCE designs  identified fractional factorial designs as the most commonly used for DCE applications. In addition they found the mean number of attributes to be 5 and the mean number of choice sets to be 14. We did not include an opt-out option in the design. The rationale for employing a forced choice is that although an opt-out option can reduce biases in parameter estimates, it cannot provide sufficient information on respondents’ preferences for the attributes if too many respondents choose the opt-out option .
Field staff received a one-week training on all steps in the data collection process. This included a trip to the field to pilot test the instrument on a small sample of health workers. Although the survey was designed to be self-administrated, field staff were required to remain in the facility during the data collection period to explain the contents of the survey and answer any questions that staff might have. Ensuring a common understanding of the attributes and levels and the provision of standard explanations across all sites was emphasised to fieldworkers during training. The descriptions of attributes and attribute levels are contained in Appendix 1. This was included in the survey instrument and respondents were instructed to read and make sure they understood these before completing the questionnaire.
The primary target for the DCE was health care workers who had performed at least one of the EmOC signal functions in the previous three months; thus the focus was on maternity staff, as well as health care workers who provide surgical services, such as caesarean section. Since it was not possible to randomly sample healthcare workers themselves, guided by existing staffing levels, the project randomly sampled hospitals and health centres to be visited to approach the minimum target of 500 health care workers per country for the provider survey. Hospitals were intentionally oversampled because the majority of EmOC is provided in hospitals rather than health centres. In Malawi, a near-national sample of facilities (N = 84) intended to provide EmOC services was identified and included central, district, rural and CHAM (faith-based organisations) -operated hospitals and a randomly sampled urban and recently upgraded health centre designated to provide EmOC. A few districts/facilities were excluded in Malawi due to their recent participation in another human resources study in which similar data had been collected from health workers. In Tanzania, due to the size of the country, cluster sampling was employed. One region was randomly selected in each of the eight geographic zones and all districts within those eight regions were then included in the sampling frame. The primary hospital serving the district was identified for inclusion; either the government-run district hospital or voluntary agency-run (VA) designated district hospital (DDH). In some districts that also contain the regional headquarters, the regional hospital was included in the sample when there was no district hospital serving the community. One health centre (HC) was randomly selected in each district, thus there were two facilities from each district in the study (N = 90). In Mozambique, a near national sample of general, district and rural hospitals was included to maximise the potential participation of the NPC cadre tecnico de cirurgia. In addition, two to three health centres (type 1 and type 2) providing maternity care, and therefore at least some basic EmOC functions, were randomly selected in each district for inclusion in the study (N = 138).
Data collection was conducted in the three countries during 2008–09. In each of the selected facilities staff were deemed eligible to participate if they were present during the study visit and reported having provided at least 1 of the 9 EmOC signal functions within the previous 3 months, and had granted informed consent. There are 7 signal functions for basic EmOC (parenteral antibiotics, parenteral utertonics, parenteral anti-hypertensives, removal of retained products, manual removal of placenta, assisted vaginal delivery, neonatal resuscitation), and 9 signal functions for comprehensive EmOC (the basic 7, plus caesarean delivery and blood transfusion).
The mixed logit model
Discrete choice models are Random Utility Models (RUMs) that are widely used for the analysis of discrete choice experiments. Three underlying assumptions of discrete choice models are that (i) choice is discrete (individuals either choose a particular alternative or not), (ii) the utility for an alternative is a random variable that varies over individuals and (iii) in a choice situation, individuals choose the alternative for which their utility is maximized.
The aim of discrete choice models is to estimate the probability of an individual choosing one alternative over the other alternatives presented in the choice scenario [15, 25]. Individuals choose goods and services that yield the highest utility (or satisfaction). Therefore, the choice between alternatives in a choice experiment is based on the combination of attributes and attribute levels that results in an increase in utility for the respondents ([27, 38]). The task is then to estimate parameters that determine the relative importance of different attributes affecting the choice process.
Conditional (or multinomial) logit models are discrete choice models that have been utilized in many fields of research, from marketing to medicine. In recent times however, these models have been superseded somewhat by the more flexible mixed logit model. The mixed logit model has become popular following the development of simulation methods that enable it to be estimated more readily, and following the integration of these methods into popular software tools . The mixed logit is a highly flexible discrete choice model that can approximate any random utility model . Hensher and Greene  and Train  describe this model in detail. A more detailed description of the model and its parameter estimation is contained in Appendix 3.
Mixed logit models were fitted to the discrete choice data from each country to estimate job preferences. All choice scenarios presented to individuals contained two unlabelled alternatives (two job descriptions). Each job was described by six attributes, four of which had two levels (location, equipment, professional development and HRM) and two of which had three levels (pay and housing).
All job attributes were represented as categorical measures (Table 2) and therefore were coded as dummy variables for statistical analysis. Attributes were coded for analysis as binary (dummy) variables. Each two-level attribute was represented by a single binary variable, while each three-level attribute (pay and housing) was represented by two binary variables. Table 2 shows the attribute coding system used in the analysis. Pay was included as a categorical, rather than a continuous predictor, to allow for the possibility of a non-linear effect of pay on utility. It was considered likely that the added utility of 1.5 × base over base pay, was not the same as the added utility of 2 × base over 1.5 × base.
Binary mixed logit models were fitted to estimate the probability of an individual choosing a given alternative (job 2) over the other (job 1). Normally distributed random coefficients were specified for each of the eight attribute variables.
Sample demographics for each country
Malawi (N = 602)
Mozambique (n = 569)
Tanzania (N = 801)
Frequency (and percentage)
Note that the first four individual-specific characteristics in Table 3 are categorical, while the fifth is a numeric variable. The baseline category for each categorical variable is marked in the table (*) and the variable is therefore represented by the inclusion of dummy variables for the other categories.
Grouping of cadres for statistical analysis
Registered nurse midwife
Registered public health nurse
Assistant Medical Officer
Registered nurse midwife
Nurse (higher degree)
Enrolled Nurse Midwife
Enrolled public health nurse
Enrolled Nurse Midwife
Nurse Midwife Technician
Mid-level MCH nurse
Basic level nurse
Basic level MCH nurse
Elementary level nurse
Define the set of candidate variables as the interaction of each alternative specific attribute with each relevant individual-specific characteristic.
Define the initial model to be the conditional logit model fitted including all alternative-specific attributes and excluding all candidate variables (interactions).
Calculate the change in BIC that would occur by adding each candidate variable to the initial model. Add the candidate variable to the model that gives the largest increase in BIC.
Repeat step 3. At this stage there should be two candidates in the current model.
Propose to remove a candidate variable from the model. If removing any of the candidate variables from the model increases the BIC, then remove the candidate variable that gives the largest increase in BIC. Otherwise, don’t remove a candidate.
Propose to add a candidate variable to the model. If adding any of the candidate variables to the model increases the BIC, then add the candidate variable that gives the largest increase in BIC. Otherwise, don’t add a candidate.
Repeat steps 5 and 6 until no further changes are made to the model. The candidates included in the model at this stage are selected for inclusion.
A similar variable selection strategy to the above was used in Raftery and Dean  and in Galligan et al.  to select variables for inclusion in clustering and classification models respectively. Results across the 200 bootstrap samples were compiled. Fixed effect interaction terms that were chosen in 50% or more of the bootstrap samples were considered to be important, and hence were selected for inclusion in the mixed logit model for that country.
Mixed logit models were fitted with varying numbers of Halton draws , starting at 500 draws and increasing the number of draws by 500 until convergence of the parameter estimates was reached. A large number of draws was required for each dataset, attributable to the eight random coefficients for which distributional parameters must be estimated.
Likelihood ratio tests comparing models fitted with uncorrelated, and correlated, random coefficients
Log likelihood (uncorrelated random coefficients)
Log likelihood (correlated random coefficients)
Likelihood ratio test
X 2 = 170.4, df = 28, p < 0.001
X 2 = 140.51, df = 28, p < 0.001
X 2 = 268.45, df = 28, p < 0.001
Conditional logit models were fitted in the mlogit package in R (R: A language and environment for statistical computing). Mixed logit models were fitted here using the mixlogit command  in Stata Version 12.1.
A total of 602 health workers (response rate 87%) in Malawi completed the discrete choice experiment. Thirty-four health workers were missing information on the individual-specific variables included in the selected mixed logit model, so this model was fitted using data on 568 individuals. Most of these individuals responded to all 15 choice situations, but 13 individuals (2.3%) were missing one or more responses.
The fixed effect interaction terms selected most frequently from 200 bootstrap samples were: the interaction between gender and HRM, the interaction between age and PD, and the interaction between the individual’s current job location (rural vs urban) and the location of the jobs they were choosing between. These interaction effects were selected in 82, 68.5 and 55% of bootstrap samples respectively. Other interaction effects were selected in less than 50% of samples and thus were omitted from the mixed logit model.
Mixed logit model results for DCE in Malawi
Estimate (95% confidence interval)
0.537 (0.059, 1.015)
−0.03 (−0.05, −0.01)
0.506 (0.184, 0.829)
−0.653 (−0.927, −0.378)
2.39 (2.056, 2.723)
1.78 (1.318, 2.242)
2.507 (2.108, 2.906)
0.67 (0.336, 1.004)
2.184 (1.844, 2.524)
3.851 (3.058, 4.645)
3.26 (2.662, 3.857)
Random (Standard deviation)
0.592 (0.242, 0.943)
1.288 (0.955, 1.62)
2.276 (1.825, 2.726)
1.456 (1.05, 1.862)
1.767 (1.396, 2.139)
1.74 (1.441, 2.038)
2.079 (1.706, 2.453)
2.09 (1.687, 2.493)
As one might expect, health workers showed strong preferences for jobs with a better than basic salary. The estimated effect on utility of a job with a salary of twice the base level compared with a job paying the base salary is 4.1 (the sum of the coefficients for pay1 and pay2), making this job attribute the one which health workers found most attractive overall. The estimated standard deviation for pay1 and pay2 are 1.3 and 2.3 respectively, indicating that there was a much larger variability in health worker preferences when it came to jobs with a salary of twice the basic level than there was in preferences towards jobs with a salary of 1.5 times the base level. Based on the Normal distributions fitted to random coefficients (means and standard deviations shown in Table 6), an estimated 97% of health workers prefer jobs with a salary of 1.5 times the base salary, while a lower percentage of 78% are estimated to prefer a job with a salary of twice the base level (over a salary of 1.5 times the base level). Although salary was valued most highly by health workers, other job attributes appear to be almost equally important to workers.
The mean coefficient for HRM is 3.3 (estimated for males), highlighting the strong preference of health workers on average for jobs where there is a functioning system of human resource management. Females prioritize HRM even more strongly than males, with an estimated mean coefficient of 3.8 (sum of coefficients for HRM and gender*HRM). However, there is also a large variability in the preferences of health workers for this attribute (estimated standard deviation = 2.09).
Strong preferences for HRM were closely followed by preferences for the availability of continuing professional development (PD), which varied with age. For the youngest person in the sample (aged 21), the estimated mean coefficient for professional development is 3.2, while the estimated mean coefficient for the oldest person in the sample (aged 73) is just 1.7. This indicates that while improved (as opposed to limited) availability of continuing professional development was one of the most valued job attributes for health workers in Malawi, this was significantly more important for younger health workers than for older workers.
The coefficient mean for house1 is the next largest, indicating that housing had a strong influence on health workers’ job choices, on average. An estimated 96% of health workers preferred jobs with some form of housing provided. The large positive coefficient for house1 (2.507) and the much smaller coefficient for house2 (0.67) indicate that, although health workers had strong preferences for jobs that provided housing (either basic or superior) compared with jobs that provided no housing, the standard of housing provided (basic vs. superior) were not so important to health workers on average.
Health worker preferences were divided when it came to job location (rural vs. urban), and preferences differed for health workers currently based in rural and urban health facilities. Based on the negative coefficient mean (−0.653) for location and coefficient standard deviation (0.592), it’s estimated that approximately 86% of health workers located in rural health facilities also preferred jobs in rural facilities. For health workers in urban facilities, it’s estimated that 60% preferred jobs in a rural location. Despite these differences however, the estimated coefficient means and standard deviation are relatively small, indicating that location was the least important job attribute to health workers.
A total of 569 health workers (response rate 97%) in Mozambique participated in the discrete choice experiment. Only one individual-specific variable (basic) was selected for inclusion in the final model, for which ten of the 569 health workers had missing values. Therefore, the selected mixed logit model was fitted using choice data on 559 health workers. Most of these individuals responded to all 15 choice situations, but 26 individuals (4.7%) were missing one or more responses.
Fixed effect interactions were included in the final model between basic (basic level cadre) and equip, and between basic and PD. Interactions with the indicator for high level cadres was not selected for inclusion in the final model. Therefore, the basic*equip and basic*PD interaction terms contrast the preferences of basic level cadres with those of mid and higher level cadres for jobs with improved availability of equipment and drugs, and with improved availability of continuing professional development.
Mixed logit model results for DCE in Mozambique
Estimate (95% confidence interval)
−0.703 (−1.097, −0.309)
−0.607 (−1.019, −0.194)
0.056 (−0.148, 0.261)
1.097 (0.887, 1.306)
0.582 (0.191, 0.973)
1.505 (1.199, 1.81)
0.069 (−0.188, 0.326)
1.9 (1.616, 2.184)
2.305 (2.015, 2.595)
1.979 (1.598, 2.36)
Random (standard deviation)
0.485 (0.149, 0.822)
1.055 (0.798, 1.312)
1.829 (1.444, 2.214)
1.55 (1.197, 1.903)
1.14 (0.81, 1.471)
1.434 (1.18, 1.688)
1.433 (1.139, 1.728)
1.615 (1.269, 1.961)
Improved (as opposed to limited) opportunities for continuing professional development is estimated to be the most important job attribute on average for mid and high level cadres in Mozambique, with an estimated mean coefficient of 2.3 for PD. For basic level cadres, this job attribute was still important on average but less so, with a mean coefficient estimate of 1.7 (=2.3–0.6).
As well as opportunities for professional development, health workers (basic, mid and high level cadres) showed strong preferences on average for jobs described as having a functioning system of human resource management, with an estimated coefficient mean of approx. 2.0 for this job attribute. Mid and high level health workers showed similarly large preferences for jobs that were described as having improved availability of equipment and drugs (coefficient mean = 2). In contrast, basic level cadres valued this job attribute less (coefficient mean = 1.2) than they did other attributes such as provision of housing.
A job with housing provided was more attractive to health workers on average than a job with a salary that was 1.5 times the basic level, indicated by the coefficient mean of 1.5 for house1 and 1.1 for pay1. Superior (compared with basic) quality housing was not valued highly by health workers on average, with an estimated coefficient mean of just 0.1 for this job attribute.
The coefficient mean of 0.6 estimated for pay2 suggests that a job with a salary that was twice the basic level was valued more highly on average than a job with a salary that was 1.5 times the basic level, as one might expect. However, the largest variability in preferences overall was seen for this variable (pay2) with an estimated coefficient standard deviation of 1.8. This large variability suggests that while health workers on average showed a moderate preference for this attribute, there are some who valued it it lot more or a lot less than others.
With regard to job location (urban vs. rural), the coefficient distribution is estimated to be centred close to zero with a mean of 0.06, with a standard deviation of 0.5. This appears to be the least influential job attribute of those considered. Based on the fitted random coefficient distribution with mean 0.06 and standard deviation 0.5, an estimated 55% of health workers were estimated to prefer jobs located in an urban setting, while an estimated 45% prefer jobs in a rural location.
A total of 801 health workers (response rate 93%) in Tanzania participated in the discrete choice experiment. Only two individual-specific variables (high and fc) were included in the final model, on which two individuals were missing values. Therefore, the selected mixed logit model was fitted using choice data on 799 individuals. Most (95%) of these individuals responded to all 15 choice situations, with just 36 individuals missing one or more responses.
Fixed effect interactions were included in the final model between fc (type of facility in which health worker is based – health center vs hospital) and job location, and between pay1 and high (indicator for high level cadre). Since the interaction with basic was not selected for inclusion in this final model, the high*pay1 interaction term contrasts the preferences of high level cadres with those of basic and mid level cadres for jobs with a salary that is at least (1.5 × base) as opposed to a basic salary.
Mixed logit model results for DCE in Tanzania
Estimate (with 95% confidence interval)
0.457 (0.196, 0.718)
0.388 (0.122, 0.654)
−0.122 (−0.349, 0.105)
0.944 (0.4570.731, 1.158)
0.451 (0.135, 0.766)
1.308 (1.087, 1.529)
−0.308 (−0.504, −0.112)
1.478 (1.262, 1.694)
1.453 (1.253, 1.652)
2.053 (1.736, 2.371)
Random (Standard deviation)
0.8 (0.579, 1.02)
0.964 (0.692, 1.236)
1.166 (0.898, 1.435)
1.363 (1.139, 1.587)
1.495 (1.165, 1.825)
1.408 (1.179, 1.637)
1.442 (1.237, 1.648)
1.913 (1.63, 2.196)
The job attribute most highly valued by health workers on average was a functioning system of human resource management, which had an estimated coefficient mean of 2.1 and standard deviation of 1.9. Therefore, based on the Normal distribution fitted to this random coefficient, it’s estimated that 86% of the health worker population value this job attribute, with some health workers placing a very high value on this attribute.
The average health worker is estimated to place less value on a job with a high salary than a job with improved availability of equipment and drugs and improved opportunities for continuing professional development. For basic and mid level cadres, the effect of a job with a salary of twice the basic level on utility (compared with a job of basic salary) is 1.4, lower than the estimated average effects for PD and equip, each with a coefficient mean of 1.5. High level cadres, in contrast, are estimated to place a higher value on a job with a better than basic salary, and have a coefficient mean of 1.8 for the effect on utility of a job with twice the basic salary.
With regard to job location, the preferences of health workers in different types of facilities are estimated to differ. Hospital workers appear to have stronger preferences on average for jobs in an urban location than health center workers. Approximately 56% of health facility workers are estimated to have preferences for jobs in a rural location, compared with an estimated 34% of hospital workers. The relatively small coefficient mean and standard deviation for location indicates that location was the least important job attribute to health workers.
Health workers placed a relatively high value on jobs with provided housing. An estimated 87% of health workers prefer jobs with housing provided over jobs without provided housing, based on the coefficient distribution fitted for house1 with mean 1.3 and standard deviation 1.36 (Table 8). However, it seems that having a superior quality of housing compared with a basic level of housing is not an important job attribute to the average health worker, with an estimated coefficient mean of −0.3 for house2.
These DCEs represent the largest DCEs on employment preferences of health workers in post ever undertaken on the African continent. The previous largest experiment of 861 doctors and nurses was by Hanson and Jack  undertaken in one country - Ethiopia. The only other cross country study by Blaauw et al.  sampled graduating nurses in three countries. Our study contributes to the existing knowledge by focusing on a large cohort of health workers who are engaged in the delivery of emergency obstetric care services. The study was based on a sample of 602 respondents in Malawi, 801 in Tanzania, and 569 in Mozambique, providing a total sample size of 1972. The results are remarkable because of their consistency across the countries. By far the strongest predictors of job choice were shown to be access to continuing professional development and human resources management. The impact of opportunities for career development has been shown continually throughout previous studies, and is usually one of the most important factors underlying job choice. For instance, Mangham and Hanson , Blaauw et al. , Kolstad , Honda & Vio  and Takemura et al.  all found opportunities for upgrading qualifications and further education to be strong predictors of choice. Human resource management has seldom been captured in previous work. When it has been, studies have shown it to hold predictive power, although somewhat partial definitions have been adopted. Hanson and Jack  show the ‘level of supervision’ is one of the most important factors for nurses in Ethiopia, Blaauw et al.  report some preference for ‘relational’ over ‘hierarchical’ management style, and Kruk et al.  show ‘supportive management style’ to be a key factor for medical students in Ghana. This study uses a more comprehensive definition than previous work –with HRM being described as the overall quality of management, including mechanisms for ‘staff support’, ‘supervision’ and fair and transparent systems of ‘appraisal’. According to our results, the attributes HRM and access to continuing professional development (which is also a component of HRM) hold much more explanatory power than any of the other attributes in our experiments in Tanzania and Mozambique. They also show a high utility in Malawi, though a salary double the base pay level shows higher utility in this sample.
Consistent with similar works we find pay and allowances to be important and significantly positively related to utility, but financial rewards are not as fundamental a factor underlying employment preferences as many may have previously believed. Good human resources management, opportunities for professional development and basic housing are consistently of higher utility than a job that pays one and a half times current base salary. There is evidence to indicate diminishing marginal utility in relation to pay in all three countries. There is emerging observational evidence that pay increases coupled with other initiatives have led to significant improvements in recruitment and retention in Malawi, particularly when this pushes pay above a subsistence level that health workers feel is the minimal acceptable. It may be that once remuneration rates reach a level that allows health workers to meet their basic needs, other considerations become more important than pay. The diminishing marginal utility of pay evident in the results may be an indication that this optimum level is possibly at 1.5 times current basic salaries, as the utility increase is smaller when salary moves from 1.5 to double.
An unexpected finding from this study is the low utility location has in job preference. This is contrary to anecdotal evidence that is strongly suggestive of a preference for work in urban rather than rural locations and several studies that have focused on identifying factors that might attract health workers to rural locations (e.g. [5, 22]). There is some evidence in the recent literature that urban locations may not be high priority for all health workers, for example Blaauw et al.’s  study found that even in the absence of any human resource policy intervention, 84.2% of recent Thai nursing graduates would choose a rural job, as would 43.4% of the nurse graduates in Kenya. However there continues to be a strong emphasis on incentivising rural postings for health workers.
A limitation of this work as with all DCE results is that it is based on ‘stated preferences’, based on what individuals state they believe, think and will do when presented with hypothetical situations; rather than on ‘revealed preferences’, in terms of choices and behaviour in response to real-life situations. Some might consider the use of an orthogonal fractional factorial, and not an optimal, trial design a limitation of the study but this design was commonly used at the time, although it has since been replaced by more statistically efficient designs. A further limitation of this study is the use of a common comparator. While previously common, this is no longer best practice as it discards much information and can lead to identification problems.
Despite these caveats, DCEs such as this do provide rich and valuable information to guide future policy development, particularly in the context of scarce resources where trade-offs are inevitable and policy priorities need to be more informed by evidence of what is likely to deliver the greatest impact.
The results are remarkable because of their consistency across the countries. By far the strongest predictors of job choice were shown to be access to continuing professional development and the presence of functioning human resources managemant. Consistent with similar works we find pay and allowances to be important and significantly positively related to utility, but financial rewards are not as fundamental a factor underlying employment preferences as many may have previously believed. There is evidence to indicate diminishing marginal utility in relation to pay in the three countries. Location (urban vs rural) had the smallest effect on utility for job choice in all three countries. These findings are important in the context where efforts to address the human resources crisis have focused primarily on increasing salaries and incentives, as well as providing additional allowances to work in rural areas. Our conclusion is that improving human resources management, and in particular access to continuing professional development, may prove a more effective motivation and retention strategy.
We wish to acknowledge all of the health workers who generously gave of their time to enable us to complete this study and the health officials who facilitated access to them. We thank all of our colleagues on the Health Systems Strengthening for Equity project team. We wish to acknowledge Irish Aid for their generous funding for this project.
This study was funded by Irish Aid.
Availability of data and materials
Data is no longer available as the preiod for data retention in the participating instituions has elapsed.
EM contributed to the design of the study and data analysis and drafted this paper. MG conducted the mixed logit analysis and drafted the results section of the paper. PR contributed to earlier discussions on the analysis and reviewed the paper. FW, HM and MS provided oversight for the study in each of their respective countries, and contributed to the drafting and review of this paper. HDP contributed to the study design, project managed the study and contributed to and reviewed this paper, EA conducted preliminary analysis on the data for an earlier draft of this paper. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Not applicable, as consent was obtained from participants in the consent to participate process.
Ethics approval and consent to participate
The study was approved by the Institutional Review Boards of Trinity College, University of Dublin, Columbia University, New York, Ifakara Health Institute, University of Malawi and Eduardo Mondlane University.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Ageyi-Baffour P, Rominski S, Nakua E, Gyakobo M, Lori JR. Factors that influence midwifery students in Ghana when deciding where to practice: a discrete choice experiment. BMC Medical Education. 2013;13:64.View ArticlePubMedPubMed CentralGoogle Scholar
- Anand S, Barnighausen T. Human resources and health outcomes: cross country econometric study. Lancet. 2004;364(9445):1603–9.View ArticlePubMedGoogle Scholar
- Bekker-Grob E, Ryan M, Gerard K. Discrete choice experiments in health economics: a review of the literature. Health Econ. 2012;21:145–72.View ArticlePubMedGoogle Scholar
- Bennet J, Blamey R. The choice modelling approach to environmental valuation. Cheltenham: Edward Elgar Publishing Limited; 2001.Google Scholar
- Blaauw D, Erasmus E, Pagaiya N, Tangcharoensathein V, Mullei K, Mudhune S, Goodman C, English M, Lagarde M. Policy interventions that attract nurses to rural areas: a multicountry discrete choice experiment. Bull World Health Organ. 2010;88:350–6.View ArticlePubMedPubMed CentralGoogle Scholar
- Bocoum FY, Kone E, Kouanda S, Yameogo ME, Bado AR. Which incentive package will retain regionalized health personnel in Burkina Faso: a discretechoice experiment. Hum Resour Health. 2014;12 Suppl 1:S7. http://www.human-resources-health.com/content/12/S1/S7.View ArticleGoogle Scholar
- Bradley S, McAuliffe E. Mid-level providers in emergency obstetric and newborn health care: factors affecting their performance and retention within the Malawian health system. BMC Human Resources for Health. 2009;7(14).Google Scholar
- Chilopora G, Pereira C, Kamwendo F, Chimbiri A, Malungu E, Bergstrom S. Postoperative outcome of caesarean sections and other major emergency obstetric surgery by clinical officers and medical officers in Malawi. Hum Resour Health. 2007;5:17.View ArticlePubMedPubMed CentralGoogle Scholar
- de Bekker-Grob EW, Ryan M, Gerard K. Discrete choice experiments in health economics: a review of the literature. Health Econ. 2012;21(2):145–72.Google Scholar
- Galligan MC, Saldova R, Campbell MP, Rudd PM, Murphy TB. Greedy feature selection for glycan chromatography data with the generalized Dirichlet distribution. BMC Bioinformatics. 2013;14:155. doi:https://doi.org/10.1186/1471-2105-14-155.View ArticlePubMedPubMed CentralGoogle Scholar
- Guttman R, Castle R, Fiebig DG. Use of discrete choice experiments in health economics: an update of the literature. 2009. CHERE Working Paper, University of Technology, Sydney.Google Scholar
- Hall J, Viney R, Hass M, Louviere JJ. Using stated preference discrete choice modelling to evaluate health care programs. J Bus Res. 2004;57(9):1026–32.View ArticleGoogle Scholar
- Hanson K, Jack W. Health workers preferences for Job attributes in Ethiopia: results from a discrete choice experiment. 2008. Working Paper, Georgetown University.Google Scholar
- Hensher DA, Greene WH. The mixed logit model: the state of practice. Transportation. 2002;30(2):133–76.View ArticleGoogle Scholar
- Hensher DA, Rose JM, Greene WH. Applied choice analysis: a primer. New York: Cambridge University Press; 2005.View ArticleGoogle Scholar
- Hole AR. Fitting mixed logit models by using maximum simulated likelihood. Stata J. 2007;7(3):388–401.Google Scholar
- Honda A, Vio F. Incentives for non-physician health professionals to work in the rural and remote areas of Mozambique—a discrete choice experiment foreliciting job preferences. Hum Resour Health. 2015;13:23. doi:https://doi.org/10.1186/s12960-015-0015-5.View ArticlePubMedPubMed CentralGoogle Scholar
- Hongoro C, McPake B. How to bridge the gap in human resources for health. Lancet. 2004;364(9443):1451–6.View ArticlePubMedGoogle Scholar
- Kolstad JR. How to make rural jobs more attractive to health workers. Health Econ. 2011;20:2.View ArticleGoogle Scholar
- Kruk ME, Johnson JC, Gyakobo M, Agyei-Baffour P, Asabir K, Kotha R, Kwansah J, Nakua E, Snow R, Dzodzomenyo M. Rural practice preferences among medical students in Ghana: a discrete choice experiment. Bull World Health Organ. 2010;88:333–41.View ArticlePubMedPubMed CentralGoogle Scholar
- Lancaster KJ. A New approach to consumer theory. J Polit Econ. 1966;74:132–57.View ArticleGoogle Scholar
- Lehmann U, Dieleman M, Martineau T. Staffing remote rural areas in middle and low-income countries: a literature review of attraction and retention. BMC Health Serv Res. 2008;8:19. doi:https://doi.org/10.1186/1472-6963-8-19.View ArticlePubMedPubMed CentralGoogle Scholar
- Lobis S, Mbaruku G, Kamwendo F, McAuliffe E, Austin J, de Pinho H. Expected to deliver: alignment of regulation, training and actual performance of emergency obstetric care providers in Malawi and Tanzania. Int J Gynecol Obstet. 2011;115(3):322–7. December 2011.View ArticleGoogle Scholar
- Louviere J. What you don’t know might hurt you: some unresolved issues in the design and analysis of discrete choice experiments. Environ Resour Econ. 2006;34:173–88.View ArticleGoogle Scholar
- Louviere J, Hensher DA, Swait JD. Stated choice methods: analysis and applications. 2000. Cambridge University Press.View ArticleGoogle Scholar
- Mandeville K, Lagarde M, Hanson K. The use of discrete choice experiments to inform health workforce policy: a systematic review. BMC Health Serv Res. 2014;14:367. doi:https://doi.org/10.1186/1472-6963-14-367.View ArticlePubMedPubMed CentralGoogle Scholar
- Mangham LJ, Hanson K. Employment preferences of public sector workers in Malawi: results from a discrete choice experiment. Trop Med Int Health. 2008;13(12):1433–41.View ArticlePubMedGoogle Scholar
- Mangham L, Hanson K, McPake B. How to do (or not to do)…designing a discrete choice experiment for application in a low income country. Health Policy Plan. 2008;24(1):151–8.PubMedGoogle Scholar
- McAuliffe E, Bowie C, Manafa O, Maseko F, Maclachlan M, Hevey D, Normand C, Chirwa M. Measuring and managing the work environment of the mid-level provider - the neglected human resource. Hum Resour Health. 2009;7:13.View ArticlePubMedPubMed CentralGoogle Scholar
- McAuliffe E, Manafa O, Maseko F, Bowie C, White F. Understanding job satisfaction amongst mid-level cadres in Malawi: the contribution of organizational justice. Reprod Health Matters. 2009;17(33):80–90.View ArticlePubMedGoogle Scholar
- McFadden D, Train K. Mixed MXL models for discrete response. J Appl Econ. 2000;15:447–70.View ArticleGoogle Scholar
- Mullen F, Frehywot S. Non-physician clinicians in 47 sub-Saharan African countries. Lancet. 2007;370:2158–63.View ArticleGoogle Scholar
- Pereira C, Cumbi A, Malalane R, Vaz F, McCord C, Bacci A, Bergstrom S. Meeting the need for emergency obstetric care in Mozambique: work performance of medical doctors and assistant medical officers trained for surgery. BJOG. 2007;114(12):1530–3. Epub 2007 Sep 17.Google Scholar
- Raftery AE, Dean N. Variable selection for model-based clustering. J Am Stat Assoc. 2006;101:168–78.View ArticleGoogle Scholar
- Revelt D, Train K. Mixed logit with repeated choices: households’ choices of appliance efficiency level. Rev Econ Stat. 1998;80(4):647–57.View ArticleGoogle Scholar
- Robyn PJ, Shroff Z, Zang OM, Kingue S, Djienouassi S, Kouontchou C, Sorgho G. Addressing Health Workforce Distribution Concerns: A Discrete Choice Experiment to Develop Rural Retention Strategies in Cameroon (March 8, 2015). Int J Health Policy Manag. 2015;4:169–180. doi:https://doi.org/10.15171/ijhpm.2015.27. Available at SSRN: https://ssrn.com/abstract=2575313.
- Rockers P, Jaskiewicz W, Wurts L, Kruk ME, Mgomella G, Ntalazi F, Tulenko K. Preferences for working in rural clinics among trainee health professionals in Uganda: a discrete choice experiment. BMC Health Serv Res. 2012;12:212. doi:https://doi.org/10.1186/1472-6963-12-212.View ArticlePubMedPubMed CentralGoogle Scholar
- Ryan M, Gerard K. Using discrete choice experiments to value health care programmes: current practice and future research reflections. Appl Health Econ Health Policy. 2003;2(1):55–64.Google Scholar
- Ryan M, Bate A, Eastmond CJ, Ludbrook A. Use of discrete choice experiments to elicit preferences. BMJ Qual Saf. 2001;10:50–60.View ArticleGoogle Scholar
- Ryan M, Kolstad J, Rockers PC, Dolea C. How to conduct a discrete choice experiment for health workforce recruitment and retention in remote and rural areas: a user’s guide for policy makers and researchers. Geneva: World Health Organization, World Bank, and CapacityPlus; 2012.Google Scholar
- Schwarz GE. Estimating the dimension of a model. Ann Stat. 1978;6(2):461–4.View ArticleGoogle Scholar
- Speybroek N, Kinfu Y, Dal Poz MR, Evans DB. Reassessing the relationship between human resources for health, intervention coverage, and health outcomes. 2006. WHO.Google Scholar
- Street DJ, Burgess L, Viney R, Louviere J. Designing discrete choice experiments for health care. In: Ryan M, Gerard K, Amaya-Amaya M, editors. Using discrete choice experiments to value health and health care. 2008. p. 47–72. Springer.View ArticleGoogle Scholar
- Takemura T, Kielmann K, Blaauw D. Job preferences among clinical officers in public sector facilities in rural Kenya: a discrete choice experiment. Hum Resour Health. 2016;14:1. doi:https://doi.org/10.1186/s12960-015-0097-0.View ArticlePubMedPubMed CentralGoogle Scholar
- Train K. Halton sequences for mixed logit. UC Berkeley: Department of Economics, UCB; 2000. Retrieved from: http://escholarship.org/uc/item/6zs694tp.Google Scholar
- Train K. Discrete choice methods with simulation. New York: Cambridge University Press; 2003.View ArticleGoogle Scholar
- Viney R, Savage E, Louviere J. Empirical investigation of experimental design properties of discrete choice experiments in health care. Health Econ. 2005;14:349–62.View ArticlePubMedGoogle Scholar
- WHO. World health report: working together for health. 2006.Google Scholar
- Willis-Shattuck M, Bidwell P, Thomas S, Wyness L, Blauuw D, Ditlopo P. Motivation and retention of health workers in developing countries: a systematic review. BMC Health Serv Res. 2008;8:247.View ArticlePubMedPubMed CentralGoogle Scholar