- Research
- Open access
- Published:
Efficiency of primary care in rural Burkina Faso. A two-stage DEA analysis
Health Economics Review volume 1, Article number: 5 (2011)
Abstract
Background
Providing health care services in Africa is hampered by severe scarcity of personnel, medical supplies and financial funds. Consequently, managers of health care institutions are called to measure and improve the efficiency of their facilities in order to provide the best possible services with their resources. However, very little is known about the efficiency of health care facilities in Africa and instruments of performance measurement are hardly applied in this context.
Objective
This study determines the relative efficiency of primary care facilities in Nouna, a rural health district in Burkina Faso. Furthermore, it analyses the factors influencing the efficiency of these institutions.
Methodology
We apply a two-stage Data Envelopment Analysis (DEA) based on data from a comprehensive provider and household information system. In the first stage, the relative efficiency of each institution is calculated by a traditional DEA model. In the second stage, we identify the reasons for being inefficient by regression technique.
Results
The DEA projections suggest that inefficiency is mainly a result of poor utilization of health care facilities as they were either too big or the demand was too low. Regression results showed that distance is an important factor influencing the efficiency of a health care institution
Conclusions
Compared to the findings of existing one-stage DEA analyses of health facilities in Africa, the share of relatively efficient units is slightly higher. The difference might be explained by a rather homogenous structure of the primary care facilities in the Burkina Faso sample. The study also indicates that improving the accessibility of primary care facilities will have a major impact on the efficiency of these institutions. Thus, health decision-makers are called to overcome the demand-side barriers in accessing health care.
Background
Improving the health status of people in low-income countries is a very important human goal which has been on the global agenda for a long time [1]. However, for many years the transfer of financial funds was regarded as a sufficient strategy to safeguard that health services provide effective health care [2, 3]. The efficient utilization of these funds was strongly neglected by international and local decision-makers as well as by scientists [4, 5], but meanwhile there is agreement that low-income countries can only achieve the health-related Millennium Development Goals (MDGs) if research and health-policy focus on efficiency [6, 7].
In industrialised countries, measuring efficiency, benchmarking and consequent improvement of performance have become a standard and a wide variety of instruments was developed, ranging from simple ratios and unit costing to more complex methodologies, such as Data Envelopment Analysis (DEA) and Stochastic Frontier Analysis [8]. In particular, DEA has proven to be of great practical value for the calculation of the relative efficiency, the benchmarking process [9] and the performance enhancement of different organisations [10], such as energy enterprises [11], universities [12], and health care facilities [13]. In the industrialised world, DEA is frequently utilized as a benchmarking tool for health care institutions [14] and helps to determine the strengths and weaknesses of facilities in order to improve the ratio of inputs and outputs.
In spite of the basic necessity to avoid waste of scarce resources in health care institutions, health economic research in Africa is focussed on specific interventions programmes or the entire health care system [15, 16]. Benchmarking of service providers and in particular Data Envelopment Analysis are very rarely performed in Africa. Most of the published studies concentrate on hospitals of the same level, for instance in Angola [17], Botswana [18], Ghana [19], and Namibia [20], or large health centres operating almost at the hospital level, such as in Ghana [21], Sierra Leone [22], and Kenya [23]. Very little is known about the efficiency of small primary care facilities in African countries, although these institutions treat the majority of patients.
In this paper we present a DEA analysis of small primary care facilities in the health district of Nouna, Burkina Faso. These institutions are the prime source of medical services for the population of this health district, and every contribution to measure and increase the efficiency of these facilities will have a direct impact on human life. The study is based on previous research on the efficiency of primary care facilities in Nouna health district [24]. We expand the efficiency measurement by a comprehensive second stage, in which the efficiency scores estimated at the first stage are explained in a regression with environmental variables as independent variables. We are motivated to perform this analysis as we expect to determine the reasons for poor efficiency of some primary care facilities and to find parameters to improve the performance of these institutions. Another intention of this paper is the proof that advanced efficiency analysis is a feasible and meaningful tool of health systems research in the African context.
The structure of this paper is as follows. In the next section, the methodological issues are presented. We provide some background information on the study area and outline the adopted two-stage DEA analysis. This is followed by the presentation of our results. Subsequently, we hold a discussion on the corresponding implications. The final section contains our concluding remarks.
Methods
Study Site
The study was carried out in the Nouna Health District, which is identical to the administrative province of Kossi in Northwestern Burkina Faso, a land-locked country in Western Africa with an estimated population of about 14.7 million, 74% of them live in rural areas. Kossi covers an area of 7,464 square kilometres [25]. This predominantly rural, semi-arid area at the edge of the Sahel zone has a population of almost 279,000 inhabitants. Most of the people there are illiterate, extremely poor and work as subsistent farmers, producing crops like millet and sorghum. The most important ethnic groups are Dafing/Marka, Bwaba, Mossi and Peulh [26]. The people in this region are predominantly Muslim (65%), with some percentage of the population being Christian (29%), and 6% adherer to traditional beliefs respectively.
Formal health services are provided by 24 primary care facilities (Centre de Santé et de Promotion Sociale, CSPS), one dispensary and a small hospital (Centre Medical avec Antenne Chirurgicale, CMA) in Nouna town. The primary care facilities (CSPS) provide first-line services at the village level and are primarily located in rural, peripheral areas of Burkina Faso [27]. They are usually staffed with a team of two to four health workers and one to three unqualified volunteers. They are responsible for a catchment area of 5 to 23 villages. Each CSPS provides basic outpatient services (incl. a maternity unit) and is linked to a public pharmacy. There are also vaccination programmes which are operated locally in the villages. The CMA, which is equipped with nearly 100 beds with surgical facilities, is the first referral level for the primary care facilities [6].
Basic DEA Model
Data Envelopment Analysis is rooted in the concept of efficiency. In general, this term reflects the degree of success with which an organisation uses its inputs/resources x to produce outputs y of a given quality. This can be assessed in different categories of efficiency. Technical efficiency is determined by comparing the difference between the observed ratio of combined quantities of an organization's output to input and the ratio achieved by best practice. Producing the maximum output or consuming the minimum inputs, as compared to what is technically feasible, is an essential step for service providers to be able to meet their objectives best. According to this concept an organisation or facility (decision-making unit, DMU) is efficient, if it operates on its corresponding production possibilities frontier. Inefficient producers operate below it. Generally, the best practice frontier can be determined either by using parametric approaches, which are based on regression analysis, or by applying nonparametric techniques. Data Envelopment Analysis, which was proposed by Charnes et al. [28] in its present form, is linked with the concept of relative efficiency of similar entities. According to Banker and Maindiretta [29] it offers certain important advantages over parametric methods: First, DEA does not impose the assumption of any functional form on the relationship between inputs and outputs. This attribute is especially useful for cases in which the correspondence is not known or specified by theory. DEA uses linear programming to construct a piecewise efficiency frontier and must only be based on the minimum assumptions of monotonicity and convexity of the efficiency frontier. Second, DEA can be used not only to identify inefficient units, but also to estimate the degree of inefficiency. Third, it is possible to include multiple inputs and outputs in DEA, which is especially important for the analysis of health care services, whereas the weights are calculated within the DEA procedure. The DEA method allows variable and fixed inputs, whereas the variable inputs might change in the short run while the values of the fixed inputs are only allowed to be changed in the long run. The DEA approach allows each DMU to choose the optimum weightings for the outputs and inputs. Each DMU is considered in turn and its most favourable weights are selected. Special features provide the analysis' adjustment to the concrete problem setting.
However, the strengths of DEA lay the foundation of its weaknesses as well. As DEA is an empirically based estimation technique, it is sensible to outliers, error measurements and random influences in the data. DEA deems any deviation from the efficiency frontier to be the result of inefficiency. From the endogenous weighting system follows a second shortcoming. If the number of factors considered in the efficiency analysis is relatively high, the DEA approach may lead to substantial overestimates of the efficiency of DMUs. Nevertheless, DEA is probably because of its advantages the most appropriate technique currently available for measuring relative efficiency in health services [30]. The number of studies has increased dramatically over the past few years [31].
According to DEA the efficiency of a multiple-output, multiple-input DMU k, with k = 1, ..., n, can be presented as follows:
whereas u measures the weight of each output y j (j = 1, ..., s), and v indicates the weight of each input x i (i = 1, ..., m) The efficient frontier of the group (θ = 1) is constituted by the most efficient DMUs to which the efficiencies of the remaining DMUs are related to. Best performers do not waste any input and can therefore be regarded as "peers" for entities with a weak evaluation and a less efficiency. This implies that the efficiency score θ falls between 0 and 1.
To estimate the efficiency frontier, different important options have to be fixed. The orientation of the models reflects the appropriate direction of optimisation. This reflects which kind of quantities managers have better under control. In some branches, the organisations may be given a fixed quantity of resources and asked to produce as much output as possible. In this case the output-oriented approach might be appropriate. By contrast, an input-oriented approach should be used, if a fixed level of output has to be reached by using a minimal quantity of inputs. Because DMUs might differ according to their size and the quantities of inputs used and outputs produced respectively, assumptions concerning the returns to scale have to be formulated. The Charnes, Cooper, Rhodes (CCR) model incorporates constant returns to scale in production. The efficiency measure (1) and the usual side conditions can be adjusted accordingly. To obtain a linear programming problem, the Charnes-Cooper transformation [32] can be used. The output-oriented linear programming envelopment for the DMU under evaluation k is:
whereas η is defined based on the efficiency score of DMU k:
and the vector φ represents intensity variables which indicate the necessary combination of efficient entities (reference unit or peer) for every inefficient DMU in order to form a "virtual unit" or benchmark that is on the frontier.
Based on the CCR approach several other models were developed which build a profound basis for efficiency analysis with different returns to scale, different envelopment surfaces and different ways to project inefficient entities to the efficient frontier. Banker et al. [33] formulated the Banker, Charnes, Cooper (BCC) model which evaluates solutions for non-increasing returns to scale, non-decreasing returns to scale or variable returns to scale. Whereas the CCR model only measures overall technical efficiency , the BCC model exclusively evaluates pure technical efficiency , because scale effects are taken into account. The comparison of CCR and BCC results enables to identify inefficiency which can be mitigated by increasing or decreasing the production volume resulting in a removal of scale inefficiencies. Thus, the ratio of the CCR and BCC efficiency measures will yield an estimate of the pure scale efficiency (SE) of DMU k [33], i.e.,
indicating whether e.g. the different primary care facilities were operating on an efficient scale in producing their services. The optimal size of a DMU is reached when a marginal increase of all inputs (scale) leads to the same relative increase of outputs. The bigger the difference between the scale efficiency score of a DMU and full scale efficiency (SE k = 1), the more unfavourable are the consequences of scale. It tells us how much output of a DMU can be expanded until it is as efficient as the reference unit.
Two-Stage DEA Analysis
There are many important DEA extensions [34]. Amongst others, one-stage DEA, which only involve standard DEA analysis, has been broadened by a second stage, in which regression technique is used to explain the efficiency scores, which were measured at the first stage. The classical linear regression model takes the form
where Y, a dependent variable, is explained by a vector of independent variables X i . The β i are unknown regression coefficients, β 0 represents a constant and ε is the error term reflected in the residuals. Regression equation (5) can be estimated by Ordinary Least Squares (OLS), which minimises the sum of squared distances between the observed responses in a set of data, and the fitted responses from the regression model. OLS yields best linear unbiased estimates (BLUE) on the assumption of independent identically distributed (iid) observations with constant mean and variance, if several important assumptions about the way in which the observations are generated are not violated [35]. If e.g. the relationship between dependent and independent variables is not linear or the dependent variable is limited in some way, OLS estimates are biased, even asymptotically. Based on diagnostic analyses or misspecification tests hints for a more adequate formulations can be detected.
Two-stage DEA aims at explaining the efficiency score θ by a set of environmental influences and other non-discretionary (sometimes causal) factors which are beyond the control of the facility managers. In order to get unbiased results it is of great importance to choose the most appropriate estimation technique. Especially the characteristics of the dependent variable θ have to be carefully studied.
Several authors have interpreted it θ as censored, limited to the interval ]0;1], thus using the (censored) Tobit model to analyse the relationship with explanatory variables [36]. Equation (5) has to be adjusted accordingly.
The Tobit model can thus be defined for DMU k:
where is an unobserved latent variable and θ k is the DEA score. X k is a (row) vector of observation-specific variables for DMU k that affect its efficiency score through the vector of parameters β to be estimated.
There is an ongoing discussion whether the Tobit model is really the appropriate functional form for performing the second stage analysis. Wheras Hoff [36] states that in most cases the Tobit approach will be sufficient in representing the second stage DEA models, McDonald [37] argues, that this approach might be inappropriate because the efficiency scores are not generated by a censoring process but are fractional data. Based on the results of post-estimation regression analyses it has to be decided which approach is more appropriate. In a recent paper Simar and Wilson [38] emphasised that these conventional approaches have severe shortcomings because the efficiency scores generated at the first stage are strongly dependent on each other in the statistical sense, and using them in a second stage regression might violate the basic model assumption required by regression. Because measurement errors which affect observations on the efficiency frontier can create complicated patterns of serial correlation for observations that lie within that portion of the frontier, they proposed a truncated regression approach with a bootstrap procedure instead. The latter is a computer-based method that is based on the idea of re-sampling from an original data to assign statistical properties for the efficiency scores [39]. We follow the estimation algorithm of Simar and Wilson [38] as there is currently no methodical alternative [40].
Data
We used data collected by a comprehensive long-term cost information system which covers both supply and demand side, and which contains information about direct and indirect costs. The provider information system was established in 2003 and gathers costing data from every health facility within the district [41]. Since the year 2000, a household survey is operative in that area under demographic surveillance by the Centre de Recherche en Santé de Nouna (CRSN). The survey, known as Nouna Health District Household Survey (NHDHS), records information on a statistically representative sample of the population within the study area of the CRSN, which covers a considerably part of the Nouna health district, at regular intervals of time [42]. Both complementary information modules provide data that permit the calculating of the total tangible costs of illness in the complete health district.
At the first stage of the analysis we used data from all 25 CSPS which were operative in 2005 in the Nouna Health District. Three of them started their activity in the middle of that year. With the exception of immunisation, all other services which are regularly provided at the level of primary care facilities were offered. The activity data were adjusted accordingly. We excluded data from the pharmacies because Burkina Faso joined the Bamako Initiative in 1992 and they operate independently from the primary care facilities they are linked to.
In order to measure the CSPS efficiencies we restricted our analysis to four inputs and four outputs. As inputs we chose 1) Personnel costs in 2005 [US$], 2) CSPS building area [m2], 3) Depreciation of CSPS equipment in 2005 [US$] and 4) Vaccination costs in 2005 [US$]. Personnel costs were used as a proxy for the production factor labour. The structure of the health care personnel across the primary care facilities is quite similar concerning their qualification. In employment contracts for the public sector in Burkina Faso occupational skill and not working time determines individual earnings. Thus, personnel costs incorporate the qualification level. Most studies which assess efficiency in hospitals or bigger health facilities in developing countries use "number of beds" as an indicator for capital inputs. As hospitalisation in the CSPS occurs only in cases of emergency and for a very small length of stay (Ø < 1 day), beds are no appropriate indicator. Therefore the building area of the CSPS buildings and the annual depreciation costs for equipment in the primary care facilities were used. The lifetime of equipment was estimated using information from the ministry of health. Equipment with a value below 10,000 FCFA (18.60 US$) was depreciated at once. Vaccinating represents one of the most expensive activities which were performed at the level of primary health care.
We used four output measures which reflect the main activities performed in the primary care facilities: 1) general consultation and nursing care, 2) deliveries, 3) immunisation, and 4) special services, e.g. family planning, prenatal and postnatal consultations. All of these indicators are based on the number of cases thus they only reflect intermediate outputs.
Because DEA is very sensitive with regard to missing data and outliers, we pursued two strategies to adjust for the missing vaccination services at three CSPS: (1) Vaccination input and output data were balanced according to the catchment area. (2) Efficiency measurement was limited to three inputs and three outputs, excluding vaccination. Therefore, the combination of the measured indicators ensures in both cases adherence to the DEA convention that the minimum number of DMU observations should be greater than three times the number of inputs plus outputs [43].
Since the choice of a particular DEA model has effects on the study, the special situation in Nouna Health District has to be taken into account. There are good reasons for choosing "input-orientation" in industrialised countries because low demand for health services is not regarded as problem per se [44]. However, an "output-oriented" approach is appropriate for Nouna health district. Local committees (Comité de Gestion, COGES) which are responsible for the administration of the primary care facilities in Nouna Health District have only limited control over the volume of inputs. Decision-makers at the level of the health district and at the ministry of health take the relevant input decisions. They decide about the installation of a further CSPS, provide primal endowment and pay the staffs' salaries. In theory, COGES can use local revenue from user fees to finance additional staff or new equipment, but in reality these resources are insufficient.
To estimate the impact of non-discretionary factors on the efficiency of the primary care institutions we used 2005 data from the Nouna Health District Household Survey. Information about 7,345 individuals, who lived in the catchment area of eight CSPS, was available. The information about the name of the nearest CSPS was replaced by the corresponding DEA score. The exogenous variable selection was based on our hypothesis that problems on the demand side might influence the performance of the CSPS. According to a standard approach in health economics individuals produce their own health [45]. Their own preferences, which might be influenced by their social and cultural environment and a set of financial and other constraints, are responsible for their own health care seeking. On an aggregated level these behavioural patterns are accountable for the actual demand at the level of health facilities, which in turn might have consequences for the efficiency of the CSPS. These factors can be interpreted as barriers to health-care seeking. Therefore, we included variables which can be linked to that approach. Based on information about individual ownership of animals and local prices we created a livestock variable. Domestic animals represent accumulated savings. Additionally we collected information on durable goods (bicycles, radios, TV sets etc.) and combined them with local price information.
In addition, cultural background and religious beliefs might also influence individual health seeking behaviour. For instance, Marschall and Fleßa [24] reported that a specific conservative religious group (Islamic Wahabi movement) obviated some parts of modern health care. Particular Muslim factions shaped some communities' relation to immunisation questions. In their study about specific factors associated with the vaccination status in Nouna Health District, Sanou et al. [46] found out that children of Muslim families (controlling for economic status) have significantly lower rates of complete immunisation coverage in rural areas. Non-Muslims had almost twice the probability of being in the completely vaccinated group.
Finally, it can be assumed that ethnic affiliation can be important for not seeking modern healthcare. This information is also given in the Nouna Health District Household Survey.
Results
Descriptive results
Table 1 shows the results of the cost-of-illness information system of Nouna health district. It is obvious that the statistics have a wide range. According to the official standards of Burkina Faso a CSPS has to provide services for about 10,000 people within a radius of the catchment area of 10 kilometres [47–49], and it is in principal built and staffed according to a national standard for primary care facilities. However, in reality most of the peripheral entities are understaffed and have low annual personnel costs. In contrast, the CSPS in Djibasso and the dispensary in Nouna town have costs above 19,000 US$. The Djibasso CSPS is a previous Centre medical (CM), which was downgraded in its status to a primary care facilitiy, so that it has still the overheads of a CM although functionally working as a CSPS.
Also the floor area shows a wide range between 52 (Lekuy) and 363 (Nouna town) square metres. Differences in equipment costs (858 US$ - 2,509 US$) are mainly the consequence of the corresponding age of the institution, as expensive inventory is normally transferred at the date of opening the facility. Replacement of written-off equipment is the exception rather than the rule.
Most of the primary care facilities reported vaccine costs between 10,000 US$ and 20,000 US$. However the vaccination costs of CSPS Djibasso were nearly seven times higher than those in the catchment area of CSPS Kononkoira.
The outputs differ also strongly between these health care institutions. In the CSPS Yevedougou only 40 children were born within seven months, whereas women gave birth to 897 babies in Barani CSPS. Most outpatient visits (4,654) were reported in Djibasso, only 976 in Bagala. Among the output variables the number of vaccinations shows the widest variability. Excluding the new facilities there were 41,231 cases in Barani and 2,028 in Kononkoira.
The analysis of the Nouna Health District Household Survey showed that 4,495 people (61.2%) are Muslims, 1,997 (27.2%) were Catholics, 337 (4.9%) Protestants and 480 (6.5%) were Animists. The most important ethnic group are the Dafing with 2,867 (39%) members. Other included ethnics were the Bwaba (1,740 people, 23.7%), the Mossi (1,227 people, 16.7%). the Samo (742 people, 10.1%) and the Peulh (680 people, 9.2%).
Based on the data on inputs and outputs we could calculate the first stage of the DEA model, the results of which are presented in the next sub-section.
First stage DEA
Results obtained by the application of the output-orientated DEA approach according to constant returns to scale (CCR) are presented by table 2.
The primary care facilities are arranged alphabetically. Results both from including 4 inputs and 4 outputs (right part of the table) and excluding vaccination (left) are shown. In general, the scores, which are recorded in columns two and six, are quite similar. DMUs which are efficient in the reduced model are also best practice in the comprehensive one. However, in the latter model the facilities of Nian and Nouna are additionally relative efficient. Eleven of the twenty-five DMUs (44%) are best practice (score = 1) in the extended approach, and nine (36%) in the reduced one, respectively. It can be seen that Gassingo is the worst performer excluding vaccination (0.3693), whereas Bagala shows the largest inefficiencies in the comprehensive one with a score value of 0.5207. The columns "reference set" and "λ" include the corresponding reference units for the inefficient DMUs and the λ values, which are the raw weights assigned to peer units when solving the DEA approach. The higher the contribution, the closer in performance is the peer to the unit under consideration. As shown in the table, e.g. Bagala can virtually become efficient by combining the CSPS in Dara, Bomborokuy, Nian, Dembo and Berma as peers with raw weights of λ = 0.1089, λ = 0.0001, λ = 0.0001, λ = 0.0001 and λ = 0.1989.
In the follow-up analyses we concentrated on the extended model, because neglecting immunisation would be mean omitting the most expensive input of CSPS services. Based on the assumption of variable returns to scale (BCC), 17 of 25 primary care facilities (68%) are relatively efficient. This reflects that the envelopments' surface differs depending on the scale assumptions that underpin the model. Table 3 presents the efficiency results for the remaining eight inefficient CSPS under this most flexible returns to scale assumption.
Therefore, the resulting efficiency scores which are reported in the second column are much higher than the corresponding values in table 2. The third column lists the included input and output variables, with the original data aside. The projection column presents the results of the DEA calculations. A DMU is BCC efficient if it has no input excesses and no output shortfalls. If so, the difference between original data and projection is 0.00%. The inefficient CSPS should improve their productivity and make better use of their resources. The improvements needed to reach it are listed in the last column.
The DEA projections suggest that the inefficient units were too large for being efficient. The results indicate that e.g. the personnel costs (area) in Dokuy CSPS are 13.10% (16.28%) too high for being efficient. Similarly, efficiency can theoretically be attained if the output values of outpatient visits and deliveries are increased by 38.46% and 68.15%, respectively. Because the DEA calculations based on the BCC model incorporate the effects of DMU size on efficiency, a primary care facility only needs to be purely technically efficient to be considered as efficient. Thus, if the ratio efficiency-CCR/efficiency-BCC is calculated the scale efficiency can be determined. The corresponding scores are presented in Table 4.
The corresponding implication for e.g. the health facility in Bagala is that it operates locally efficient (BCC efficient, pure technical efficiency = 1), whereas its overall technical inefficiency is caused by its failure to achieve scale efficiency, represented by SE = 0.5207. In particular, 10 of the 13 scale inefficient CSPS had their technical efficiency scores higher than the scale efficiency scores. This implies that the overall inefficiency is primarily due to the scale inefficiency, i.e., they are either too big or the demand for services is too low. The latter calls for a thorough analysis of demand-side factors influencing the efficiency of the primary care units. The results will be presented in the next sub-section.
Second stage DEA
Table 5 presents an overview of the environmental variables which were used in the second stage. To control for the influence of religion and ethnic groups, respectively, the corresponding categories were implemented as dummy variables. In table 6 descriptive statistics of the environmental variables are provided.
The financial variables are expressed in F CFA, the regional currency. According to our data the livestock value of the richest individual was 23,136,300 F CFA (43,334 US$), on average at the household level per capita was 47,574 F CFA (88 US$). The highest value of individual owned durable household goods was 64,485,000 F CFA (119,942 US$). Taking into account that households in the sample have a size up to 57 members, with mean of about 12 members, the average value of household goods per capita at that level was 92,530 F CFA (177 US$). Keeping in mind that the used market price data do not account for depreciation and illness, the data can be interpreted as reflection of the extreme poverty in that district.
Correlation coefficients between all variables included in the analysis were calculated. Generally speaking, there is no or only weak pair wise correlation between the environmental variables. Additionally, multicollinearity of the used independent variables was checked by calculating the variance inflation factor for each variable. Excluding one category of religious belief and ethnic group helps to avoid this problem and results in tolerance levels above 0.2.
In Table 7 and 8 we report the findings of three different estimates of the 2nd stage analysis. We chose the normal censored Tobit and the truncated regression model as starting point.
The Tobit regression model predicting DEA scores by the spatial and socio-economic variables is statistically significant (χ2 = 1630.93, df = 14). Many of the independent variables in the model are also statistically significant at the 0.01 level. Since the efficiency measure ranges between 0 and 1, we inverted the dependent variable and subtracted one. Thus the sign of the coefficients are reversed - a positive coefficient implies an inefficiency increase whereas a negative coefficient means an association with inefficiency decline, thus increased efficiency. Longer distances to rural primary care facilities seems to have a clear negative impact on the efficiency, which is reflected in the positive sign of the corresponding coefficient.
Also the affiliation with a special religious belief can be linked with the performance of health facilities, because of the corresponding actual demand of modern health care or not. However, caution is required concerning the interpretation of the coefficients' signs: In the section "religion" the presented values have to be interpreted with reference to Protestants, in the category "ethnic group" the corresponding benchmark are the Mossi. Keeping that in mind, the criterion "Animist" is linked with an inefficiency increase compared to the Protestants. Most of the ethnic groups (Bwaba, Dafing and Peulh) in Nouna Health District seem to contribute to an efficiency increase in comparison to the Mossi, whereas the result for the Bwaba is not significant at all.
The findings concerning the livestock and the household goods variables are less clear. Neither personal ownership of animals nor of durable goods as a proxy of income and wealth (ability to pay) seem to have an influence on the efficiency of a CSPS. Unlike that, the household level is much more important. However, the result for the wealth of a household per se without considering the number of family members is significant on a higher level. The squared correlation between the observed and predicted efficiency score (McKelvey & Zavainona 's pseudo R2 ) is 0.219, indicating that the included predictors account for nearly 22% of the variability in the outcome variable; which is rather weak. The value of the ancillary statistic "sigma" (0.296) can be compared with the standard deviation of the independent variable which is 0.254. This reflects an increase.
The results from a truncated regression model based on the same specification are presented in the right part of the table. In principle, most of the findings are similar. The signs are the same but the significance of the estimated coefficients has risen. Regarding to the significance of livestock and the ownership of durable goods variables it can be seen that under this estimation technique the importance of per capita specifications has gained more importance. For example, a unit change in the value of household livestock per capita leads to a 1.3% increase in the predicted score level. The sigma value, which can be used for assessing the fit, suggests a very modest reduction in comparison to the Tobit model.
Table 8 reports the estimation results from the bootstrap procedures linked with a truncated regression as described in the method's section.
We used three different model specifications. The variables which are used as independent variables in model I are identical to the non-bootstrapped regressions. By contrast, the reference value of the ethnic groups and religious confession is changed in model II. Estimation model III differs from model I in terms of cancelling the aggregated household variables. It is obvious, that the estimated coefficients are very similar irrespective of the applied specification. Moreover, they are close to the estimates derived from the more usual Tobit procedure, and, very importantly, they are highly significant. Analogously, the fit of all of them is nearly the same, whereas model I provides the best fit, as can be seen by the lowest value of sigma.
Discussion
The efficient use of scarce resources is especially important in poor countries. Data Envelopment Analysis is an appropriate tool to compare the performance of similar units, e.g. health facilities at the same level of care.
The first-stage findings identify clearly some inefficient primary care facilities and their corresponding peers. Generally speaking, the results are in line with the existing studies on the performance of health facilities. Most of the published DEA studies report a quite high mean efficiency score. For example Hollingsworth [31] reported in a recent review on the results of efficiency measurement worldwide across different types of hospitals a mean efficiency score of 0.835 and the corresponding median of 0.85. The average score of the primary care facilities in Nouna Health District based on constant returns to scale is 0.862. However, this result is higher than the corresponding findings from similar facilities in Zambia (0.619) reported by Masiye et at. [50], and in Sierra Leone (0.78) studied by Renner et al. [51] respectively.
It is often supposed, that facilities in Africa are not very efficient. There is no contradiction between this statement and our findings, as the first one is based on the concept of absolute efficiency, but DEA is linked with relative efficiency. Thus a high DEA score does not mean that these facilities are 'well managed' and that there would be little scope for improvement. Most of the DEA studies conducted in sub-Saharan Africa report a very high share of inefficient facilities. For example Akzahli et al. [21] found out that 78% of the analysed primary care facilities in Ghana were technically inefficient and Kirigia et al. 2001 [52] report that 70% of the studied primary health care clinics in South Africa were inefficient. If the studied facilities are quite homogenous their performance might be similar. This is the case in our study: there is obviously some deviation, but in general the primary care facilities are quite similar - especially in terms of underutilization and excess capacities [53]. Thus only 56% are below the best-practice frontier, which is identical to the result of Kririgia et al. [23].
Our findings of the average scale efficiency score (0.8898), which is nearly the same as in the case of 89 randomly sampled primary care facilities in Ghana (86%) analysed by Akzali et al. [54], allows for an interesting remark: The average size of the CSPS in Nouna Health District is not far from relative efficiency, although an additional 11% productivity gain would be feasible - assuming no other constraining factors - provided they adjusted their services to an optimal scale.
Second stage DEA is the logical extension of traditional performance measurement by considering non-discretionary environmental parameters which might influence the facilities' performance. So far, only one study tried to take these factors into account in the case of sub-Saharan Africa. Akzali et al. [21] estimated the impact of several economic and structural factors on the DEA efficiency measure of 88 randomly selected health facilities. Based on a logistic regression they showed that variables like "access to safe drinking water" or "staff incentives" matter. However, these factors are rather general and do not explicitly focus at barriers for health care seeking. They are consistent with the applied input-oriented approach. In the case of Nouna Health District we combined the output-oriented approach at the first stage with factors influencing the demand side at the second stage.
The high significance of the included spatial, economic and cultural variables induces some clear messages, which can be directly linked with the existing literature. From an ethical point of view it is not appropriate to try to reduce waste of resources by downsizing or closing of some of the CSPS with a worse performance [55], which is suggested by some other DEA-papers which focus at sub-Saharan Africa health facilities e.g. [21, 19], but to take better advantage of the existing capacities. Apparently it will not be possible that most of the Millennium Development Goals will be met by 2015 in Africa. From a medical point of view it is well-known that there is a large latent demand for health care services in Africa; but the actual demand for modern health care is low. The corresponding question is how to increase utilisation rates. Flessa [6] showed that three steps have to be accomplished depending each on various factors. First, a need has to be perceived in the population. In the case of an illness, the condition has to be regarded as abnormal and modifiable. This depends, among others, on the health status of the patient's surrounding. A need will become a want, if means are defined, which are considered capable to satisfy the need. This depends, however, on the concept the patient has about the disease and their understanding of an appropriate treatment by western or traditional health care. Finally, the turning of a want into a demand depends on the affordability, the accessibility, the quality and on the personal priority setting. Our findings confirm this concept. Geographical accessibility, which is approximated by the distance variable, is of great importance for the decision to visit a CSPS and thus for the number of patients. Thus it is the health policy's task to improve the spatial allocation of primary care facilities in order to induce additional demand. This has been done in Nouna Health District during the last years, but there are still some improvements possible [56].
The results of this study are also in line with analyses which focus at the importance of wealth, to the corresponding ability to pay and the consequences for health-care seeking, e.g. [57]. According to our estimates the importance of total household resources is more significant than total household assets per capita, a result which could be questioned.
Our estimations also show that cultural attributes and the religious confession of the population within the catchment area of a CSPS matter. Marschall and Flessa [24] pointed out that in 2004 the primary care facility Ira performed badly because the treatment was not in line with their conservative Islamic belief. After some changes in the facilities' staff, the CSPS was re-accepted by this part of the population. Our results show, that the variable "Moslem" can be associated with a negative influence on efficiency. Unfortunately it is not possible on the basis of our database to distinguish between different subgroups. The same argument seems to be valid for some ethnic groups. Their traditional concepts have to be linked with the provision of modern health care.
Most of the costs at the level of primary care in the Nouna Health District are fixed and there is much idle capacity. Thus increased utilization of these services is possible without much additional costs [58]. Consequently, both in this district and in health facilities with a similar background, global targets like the MDGs might be attainted with little additional money [59].
There are several methodological suggestions for conducting 2nd stage analysis [43]. To meet elementary statistical concerns, bootstrapping has become more important. Whereas in the aftermath of the work by Simar and Wilson [38] bootstrapping is increasingly used both at the first and at the second stage, e.g. [60] and [61], we only used it on the second one, because our database at the first level included information from all facilities and not just a small sample population. Our corresponding results relating to econometric methods suggest that either of the applied (non) bootstrapped applications can be justified as the appropriate method for evaluating the impact on efficiency. The estimated Tobit and truncated coefficients are within or near the bootstrapped confidence intervals. Furthermore, the results are quite robust across different specifications. This kind of observation is not unique. According to Alfonso and St. Aubyn [60] this can be interpreted as additional support for the obtained results.
Conclusions
This paper investigates the performance of all primary care facilities in a rural health district in Burkina Faso and the linkages with spatial and socio-economic variables on the demand side by using DEA and regression analyses. In the African culture it would be almost impossible to close down health care institutions, and in Nouna health district this would result in inacceptable travel distances for patients. Consequently, the health policy decision-makers should aim at increasing the efficiency of these facilities by providing incentives for the people in the catchment area for increasing modern healthcare seeking. One important first step is to overcome barriers that prevent people from turning wants into actual demand. It is not enough that within the framework of the MDG campaign new primary care facilities are built, the people should also be attracted by a convincing strategy. In this regard we demonstrated that the discussion about overcoming demand side barriers and improving efficiency are just the two sides of the same coin.
This study has some limitations: First, the study area of the 1st stage and the 2nd stage analysis differ. Because the Nouna Health District Household Survey does not cover Kossi totally, it was only possible to explain the calculated DEA efficiency scores of eight primary care facilities by corresponding demand-side data. Second, there are further demand-side factors which might have a significant impact for health-care seeking [62], e.g. priority or urgency of need. Unfortunately it was not possible to link the disposable data with specific CSPS. We also did not consider quality aspects of health care provision. Previous investigation in the study area showed that people did not accept some health care services because of the perceived low quality of care [63] and resort to traditional medicine or self-treatment [64]. This was also pointed out by [65]. It was also not possible to fit the quality-related variables which are included in the household survey in our study. Furthermore education matters for the acceptance of modern health care. We did not include corresponding variables into our regression analysis because the formal education in Nouna Health District is on a very low level and according our estimation strategy it was not useful to inflate the estimation with an additional bundle of dummy variables. In addition, there is a high correlation with the livestock and the household goods variables.
The obvious next step should be a thorough analysis of the DEA score dynamics in Nouna Health District. By using more comprehensive provider and household data based on a longer period of time it is possible to investigate the impact of health policy changes on the CSPS efficiency.
References
WHO: Alma-Ata 1978: Primary Health Care - Report of the International Conference on Primary Health Care, Alma-Ata, USSR, 6–12 September 1978. Geneva: World Health Organization; 1978.
Segall M: Planning and politics of resource allocation for primary care: promotion of meaningful national policy. Social Science and Medicine 1983, 17: 1947–1960. 10.1016/0277-9536(83)90135-1
Amoako KY: Additonal resources will mean better health. Bulletin of the World Health Orgnization 2002, 80: 164–165.
Sachs J: An economist's view of health. Bull World Health Organ 2002, 80: 168–169.
Flessa S: Gesundheitsreformen in Entwicklungsländern. Frankfurt am Main: Lembeck; 2002.
Flessa S: Costing of health care services in developing countries. A prerequisite for affordability, sustainability and efficiency. Frankfurt am Main et al.: Lang; 2009.
Möller J, Schmidt C, Laaser U, B. G: Gesundheit der Ökonomie und Ökonomie der Gesundheit. Journal of Public Health 2004, 12: 3–9. 10.1007/s10389-003-0003-4
Kumbhakar SC, A KLC: Stochastic Frontier Analysis. Cambridge: Cambridge University Press; 2003.
Cook WD, Seiford L: Data envelopment analysis (DEA) - Thirty years on. Eur J Oper Res 2009, 192: 1–17. 10.1016/j.ejor.2008.01.032
Gattoufi S, Oral M, Reisman A: Data envelopment analysis literature: a bibliography update (1951–2001). Socioecono Plann Sci 2004, 38: 159–229.
Zhou P, Anga BW, Poha KL: A survey of data envelopment analysis in energy and environmental studies. Eur J Oper Res 2008, 189: 1–18. 10.1016/j.ejor.2007.04.042
Abbott M, Doucouliagosa C: The efficiency of Australian universities: a data envelopment analysis. Econ Educ Rev 2003, 22: 89–97. 10.1016/S0272-7757(01)00068-1
Ozcan YA: Health Care Benchmarking and Performance Evaluation: An Assessment using Data Envelopment Analysis (DEA). Berlin: Springer; 2008.
Flessa S: Grundzüge der Krankenhaussteuerung. München: Oldenbourg; 2008.
Murray CJL, Salomon JA, Mathers CD, Lope AD: Summary measures of population health. Geneva: World Health Organisation; 2002.
Murray CJL, Evans DB: Health systems performance assessment. Geneva: World Health Organisation; 2003.
Kirigia J, Emrouznejad A, Cassoma B, Asbu E, Barry S: A Performance Assessment Method for Hospitals: The Case of Municipal Hospitals in Angola. J Med Syst 2008, 32: 509–519. 10.1007/s10916-008-9157-5
Ramanathan TV, Chandra KS, Thupeng WM: A comparison of the technical efficiencies of health districts and hospitals in Botswana. Dev South Afr 2003, 20: 307–320. 10.1080/03768350302955
Osei D, d'Almeida S, O'George M, Kirigia M, Mensah M, Kainyu L: Technical efficiency of public district hospitals and health centres in Ghana: a pilot study. Cost Eff Resour Alloc 2005., 3:
Zere E, Mbeeli T, Shangula K, Mandlhate C, Mutirua K, Tjivambi B, Kapenambili W: Technical efficiency of district hospitals: Evidence from Namibia using Data Envelopment Analysis. Cost Eff Resour Alloc 2006., 4:
Akazili J, Adjuik M, Chatio S, Kanyomse D, Hodgson A, Aikins M, Gyapong J: What are the technical and allocative efficiencies of public health centres in Ghana? Ghana Med J 2008, 42: 149–155.
Renner A, Kiriga J: Technical efficiency of health centres in Sierra Leone. African Health Monitor January-June 2005 2005, 39–42.
Kirigia JM, Emrouznejad A, Sambo LG, Munguti N, Liambila W: Using data envelopment analysis to measure the technical efficiency of public health centers in Kenya. J Med Syst 2004, 28: 155–166.
Marschall P, Flessa S: Assessing the efficiency of rural health centres in Burkina Faso: an application of Data Envelopment Analysis. Journal of Public Health 2009, 17: 87–95. 10.1007/s10389-008-0225-6
Institut national de la statistique et de la démographique Burkina Faso: Annuaires statistique Edition 2008. Ouagadougou. 2009.
Beiersmann C, Sanou A, Wladarsch E, De Allegri M, Kouyaté B, Müller O: Malaria in rural Burkina Faso: local illness concepts, patterns of traditional treatment and influence on health-seeking behaviour. Malar J 2007, 207: 106.
Ministère de la Santé Burkina Faso: Annuaire statistique/santé 2008. Ouagadougou. 2009.
Charnes A, Cooper WW, Rhodes E: Measuring the efficiency of decision making units. Eur J Oper Res 1978, 3: 429–444.
Banker RD, Maindiratta A: Piecewise loglinear estimation of efficient production surfaces. Manage Sci 1986, 32: 126–136. 10.1287/mnsc.32.1.126
Hollingsworth B, Dawson PJ, Maniadakis N: Efficiency measurement of health care: a review of nonparametric methods and applications. Health Care Manag Sci 1999, 2: 162–172.
Hollingsworth B: The Measurement of Efficiency and Productivity of Health Care Delivery. Health Econ 2008, 17: 1107–1128. 10.1002/hec.1391
Charnes A, Cooper WW: Programming with Linear Fractional Functionals. Naval Research Logistics Quarterly 1962, 9: 181–185. 10.1002/nav.3800090303
Banker RD, Charnes A, Cooper WW: Some models for estimating technical and scale inefficiency in data envelopment analysis. Manage Sci 1984, 30: 1078–1092. 10.1287/mnsc.30.9.1078
Coelli TJ, Rao DSP, O'Donnell CJ, Battese GE: An Introduction to Efficiency and Productivity Analysis. 2nd edition. Berlin: Springer; 2005.
Greene WH: Econometric Analysis. 6th edition. Upper Saddle River: Prentice Hall; 2008.
Hoff A: Second stage DEA: Comparison of approaches for modelling the DEA score. Eur J Oper Res 2007, 181: 425–435. 10.1016/j.ejor.2006.05.019
McDonald J: Using Least Squares and Tobit in Second Stage DEA Efficiciency Analyses. Eur J Oper Res 2009, 197: 792–798. 10.1016/j.ejor.2008.07.039
Simar L, Wilson PW: Estimation and inference in two-stage, semi-parametric models of production processes. J Econom 2007, 136: 31–64. 10.1016/j.jeconom.2005.07.009
Efron B, Tibshirani RJ: An Introduction to the Bootstrap. Boca Raton: Chapman & Hall; 1998.
Hammerschmidt M, Wilken R, Staat M: Methoden zur Lösung grundlegender Probleme der Datenqualität in DEA-basierten Effizienzanalysen. Die Betriebswirtschaft 2009, 69: 289–309.
Flessa S, Kouyaté B: Implementing a comprehensive cost information system in rural health facilities: the case of Nouna health district, Burkina Faso. Trop Med Int Health 2006, 11: 1452–1465. 10.1111/j.1365-3156.2006.01691.x
Würthwein R, Gbangou A, Kouyaté B, Mugisha F, Yé Y, Becher H, Schmidt C, Sauerborn R: The Nouna Health District Household Survey - Design and Implementation. SFB 544 Discussion Paper 3/2001. Heidelberg
Cooper WW, Seiford LW, Tone K: Data Envelopment Analysis, A Comprehensive Text with Models, Applications, References and DEA-Solver Software New York. 2nd edition. 2009.
O'Neill L, Rauner M, Heidenberger K, Kraus M: A cross-national comparison and taxonomy of DEA-based hospital efficieny studies. Socio-Economic Planning Sciences 2008, 42: 158–190. 10.1016/j.seps.2007.03.001
Grossman M: The Demand for Health: A Theoretical and Empirical Investigation. In Book The Demand for Health: A Theoretical and Empirical Investigation. MA: National Bureau of Economic Research; 1972.
Sanou A, Simboro S, Kouyaté B, Dugas M, Graham S, Bibeau G: Assessment of factors associated with complete immunization coverage in children aged 12–23 months: a cross-sectional study in Nouna district, Burkina Faso. BMC Int Health Hum Rights 2009,9(Suppl 1):S10. 10.1186/1472-698X-9-S1-S10
Ministère de la Santé Burkina Faso: Plan nationale de developpement sanitaire. Ouagadougou. 2001.
Ministère de la Santé Burkina Faso: Programme national d'assurance qualité en santé. Ouagadougou. 2003.
Ministère de la Santé Burkina Faso: Tableau de bord santé 2008. Ouagadougou. 2009.
Masiye F, Kirigia JM, Emrouznejad A, Sambo LG, Mounkaila A, Chimfwembe D, Okello D: Efficient Management of Health Centres Human Resources in Zambia. J Med Syst 2006, 30: 473–481. 10.1007/s10916-006-9032-1
Renner A, Kirigia JM, Zere EA, Barry SP, Kirigia DG, Kamara C, Muthuri LHK: Technical efficiency of peripheral health units in Pujehun district of Sierra Leone: a DEA application. BMC Health Serv Res 2005, 5: 77. 10.1186/1472-6963-5-77
Kirigia JM, Sambo L, Scheel H: Technical efficiency of public clinics in Kwazulu-Natal province of South Africa. East Afr Med J 2001, 78: 1–3.
Marschall P, Flessa S: Expanding access to primary care without additional budgets? A case study from Burkina Faso. The European Journal of Health Economics 2008, 9: 393–403. 10.1007/s10198-007-0095-9
Akazili J, Adjuik M, Jehu-Appiah C, Zere E: Using data envelopment analysis to measure the extent of technical efficiency of public health centres in Ghana. BMC Int Health Hum Rights 2008, 8: 11. 10.1186/1472-698X-8-11
Alexander C, Busch G, Stringer K: Implementing and interpreting a data envelopment analysis model to assess the efficiency of health systems in developing countries. IMA J Management Math 2003, 14: 49–63. 10.1093/imaman/14.1.49
Cocking C, Flessa S, Reinelt G: Locating Health Facilities in Nouna District, Burkina Faso. In Operations Research Proceedings 2005, Selected Papers at the Annual International Conference of the German Operations Research Society (GOR), Bremen, September 7–9, 2005. Edited by: Haasis H, Kopfer H, Schönberger J. Berlin, Heidelberg, New York: Springer; 2005:431–436.
Su TT, Kouyaté B, Flessa S: Catastrophic household expenditure for health care in a low-income society: a study from Nouna District, Burkina Faso. Bulletin of the World Health Organization 2006, 84: 21–27.
Flessa S, Marschall P: Costing of Primary Care in Developing Countries: How much Health Can We Buy for a few Dollars? In Health Care Costs: Causes, Effects and Control. Edited by: Hofman B. New York: Nova Science; 2009:81–99.
Adam T, Ebener S, Johns B, Evans D: Capacity utilization and the cost of primary care visits: Implications for the costs of scaling up health interventions. Book Capacity utilization and the cost of primary care visits: Implications for the costs of scaling up health interventions (Editor ed.^eds.), City 2008, 6: 22.
Alfonso A, St Aubyn M: Cross-country efficiency of secondary education provision: A semi-parametric analysis with non-discretionary inputs. Econ Model 2006, 23: 476–491. 10.1016/j.econmod.2006.02.003
Barros CP, Assaf A: Bootstrapped efficiency measures of oil blocks in Angola. Energ Policy 2009, 37: 4098–4103. 10.1016/j.enpol.2009.05.007
Ensor T, Cooper S: Overcoming Barriers to Health Service Access and Influencing the Demand Side though Purchasing. In Book Overcoming Barriers to Health Service Access and Influencing the Demand Side though Purchasing. The International Bank for Reconstruction and Development/The World Bank: Washingto D.C.; 2004.
Baltussen RMPM, Yé Y, Haddad S, Sauerborn RS: Perceived quality of care of primary health care services in Burkina Faso. Health Policy Plan 2002, 17: 42–48. 10.1093/heapol/17.1.42
Mugisha F, Kouyate B, Gbangou A, Sauerborn R: Examining out-of-pocket expenditure on health care in Nouna, Burkina Faso: implications for health policy. Trop Med Int Health 2002, 7: 187–196. 10.1046/j.1365-3156.2002.00835.x
De Allegri M, Sanon M, Bridges J, Sauerborn R: Understanding consumers' preferences and decision to enrol in community-based health insurance in rural West Africa. Health policy 2006, 76: 58–71. 10.1016/j.healthpol.2005.04.010
Acknowledgements
The authors would like to thank Ali Sié, Athanase Pacéré, Bocar Kouyate, Germain Savadogo and Maurice Yé, for their support during the data collection and Rainer Sauerborn and Aurélia Souares from SFB 544 for providing the data from Nouna Health District Household Survey.
We are especially grateful for the comments and remarks by the participants of the Annual Conference (March 2010) and of the Working Group Meeting of Development Cooperation (October 2010) of the Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ).
Funding: This study was supported by a research grant of the German Research Foundation (Deutsche Forschungsgemeinschaft).
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors' contributions
The authors did the research jointly.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Marschall, P., Flessa, S. Efficiency of primary care in rural Burkina Faso. A two-stage DEA analysis. Health Econ Rev 1, 5 (2011). https://doi.org/10.1186/2191-1991-1-5
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/2191-1991-1-5