Skip to main content

Health economic evaluation of a web-based intervention for depression: the EVIDENT-trial, a randomized controlled study



Depression often remains undiagnosed or treated inadequately. Web-based interventions for depression may improve accessibility of treatment and reduce disease-related costs. This study aimed to examine the potential of the web-based cognitive behavioral intervention “deprexis” in reducing disease-related costs.


Participants with mild to moderate depressive symptoms were recruited and randomized to either a 12-week web-based intervention (deprexis) in addition to care as usual (intervention group) or care as usual (control group). Outcome measures were health-related resource use, use of medication and incapacity to work as well as relating direct health care costs. Outcomes were assessed on patients’ self-report at baseline, three months and six months.


A total of 1013 participants were randomized. In both groups total direct health care costs decreased during the study period, but changes from baseline did not significantly differ between study groups. Numeric differences between study groups existed in outpatient treatment costs. They could be attributed to differences in changes of costs for psychotherapeutic treatment from baseline. Whereas costs for psychotherapeutic treatment decreased in the intervention group, costs increased in the control group (− 16.8% (€80) vs. + 14.7% (€60)) (tdf = 685 = 2.57; p = 0.008).


The study indicates the health economic potential of innovative e-mental-health programs. There is evidence to suggest that the use of deprexis over a period of 12 weeks leads to a decrease in outpatient treatment cost, especially in those related to different types of psychotherapeutic treatment.


Major depression is a worldwide health problem, which lowers quality of life for the individual and generates huge costs for society. The lifetime prevalence of a diagnosed depression is estimated at 11.6% to 13.0% in German adults, with women having a nearly twice as high risk of disease as compared to men [1,2,3,4,5]. From a societal perspective, depressive disorders are associated with a substantial loss of resources. The diagnosis of depression has become the second most important reason for an incapacity for work [6,7,8]. In comparison to people without depression, patients with depressive disorder report twice as many days of incapacity for work [9]. Therefore, employees had an average absence of 51.8 days due to depressive episodes in 2014 [10]. In addition to indirect costs due to disease related productivity losses, depressive disorders are associated with high health care costs. Thus, the estimated annual direct treatment costs for Germany range between €686 and €3849 per patient within different studies. The total direct costs of depression in Germany were estimated at 5,2 billion Euro for the whole population [5, 11].

A depressive episode needs to be treated if symptoms exceed a certain period, persistence and strength [12]. But despite differentiated guidelines and a well-developed health care system, depressive episodes are rarely identified in time and treated adequately. Thus, many individuals with depression remain untreated, even in countries with well-developed health care systems [13]. This globally documented treatment gap in the management of mental illnesses may be counteracted by internet based self-help interventions. This form of intervention is particularly relevant as a treatment of mild to moderate depression [14, 15]. Employed in a stepped-care model, low intensity online-based interventions may bridge the treatment gap as an appropriate first option for patients with mild to moderate depressive symptoms. Advantages are low threshold, local and temporal independence, reductions in waiting time for face-to-face treatment, empowerment and anonymity [15, 16].

During the recent years different studies along randomized controlled trials as well as some meta-analyses provided evidence for the clinical effectiveness of e-mental health interventions (especially in the treatment of mild to moderate depressive symptoms). For example, a meta-analysis by Cujipers and colleagues stated that that self-guided psychological treatment has a small but statistically significant effect on participants with elevated levels of depressive symptomatology [14]. Moreover, another meta-analysis that was conducted in this textual context underlined the effectiveness of web-based interventions in the treatment of depression.

The meta-analysis by Karyotaki et al. demonstrated self-guided internet-based behavioral therapy to be significantly more effective on depressive symptoms severity and treatment response in comparison to control conditions [17].

While there is strong evidence for the effectiveness of web-based treatments for depression, effects on overall health care costs have been less well researched. In this context, only a few health economic evaluations exist up to now, most of them evaluating guided, less commonly unguided or minimally-guided internet interventions. Whereas most studies indicated that guided web-based interventions have the potential to be cost-effective [18], health economic evaluations of self-guided treatment programs tend to classify those interventions as not cost-effective according to direct costs of health services or productivity losses [19,20,21].

Against this background, the present study was designed to examine, whether the use of the minimally-guided cognitive behavioral self-help program deprexis over a period of 12 weeks in addition to care as usual leads to a significant reduction in direct health care costs within six months of observation. The main results of this study, the EVIDENT-trial, has been published elsewhere [22].


Study design

The EVIDENT-Trial is as a prospective, parallel-group, multicenter, randomized, controlled and assessor-blinded study which was conducted between August 2013 and December 2014. The study was approved by the Ethics Committee of the German Psychological Association (reference-number SM 04_2012) and registered at (identifier: NCT01636752). A study protocol with a detailed description of the trial design has been published [23].

Using an a-priori generated allocation schedule with random numbers, all participants were randomized into either an intervention group or a control group. Participants of the intervention group gained access to the online based self-help program “deprexis” for a period of 12 weeks in addition to care as usual. The program aims to promote self-management skills as well as to empower people with depressive symptoms to learn new and healthier behaviors. It consists of ten different modules, covering a broad range of elements of cognitive behavioral therapy such as behavioral activation and cognitive modification, psychoeducation, mindfulness and acceptance or interpersonal skills. For a detailed description of the program and all of its modules see Meyer et al. [24].

The control group received care as usual and was permitted to use any kind of therapy or treatment offered in standard care under the statutory health insurance scheme (e.g. outpatient medical care, inpatient hospital care or pharmaceutical care as well as psychiatric or psychotherapeutic treatment). After taking part in the last follow-up assessment, the participants of the control group were also invited to use the internet based program for a 12-week period.


Participants were recruited from various settings, including inpatient and outpatient medical and psychological clinics, health insurance companies, online forums for depression as well as different media (e. g. newspaper and radio) between August 2012 and December 2013.

Inclusion criteria were the presence of mild to moderate depressive symptoms, defined by scores between 5 and 14 on the Patient Health Questionnaire-9 (PHQ-9), age between 18 and 65 years, an adequate command of the German language, the availability of internet access and electronically written informed consent, which was obtained online prior to baseline assessment.

People with moderately severe to severe depressive symptoms (PHQ-9 score > 14), an acute suicidal tendency (> 0, PHQ-9 Item 9), a diagnosis of bipolar disorder or lifetime schizophrenia (both determined by a diagnostic telephone interview) or other serious mental or physical illnesses that required acute treatment were excluded from the study.

Resource use and costing

The health economic evaluation of the EVIDENT-trial focused on healthcare utilization, medication use and incapacity for work due to illness, as well as on resulting direct costs. Estimates of direct costs were derived from the payer-perspective. Therefore, patients’ time costs, traveling costs as well as indirect costs due to absenteeism or presentism were not included in the analysis. Fees for the use of the web based program were excluded from this analysis, as these are negotiated individually with clients such as health insurance companies and vary depending on usage circumstances [25]. Information on the amount of the fee for the online intervention is kept secret for competitive reasons and therefore not available for the German health care market.

All assessed data were based on participants’ retrospective self-reports, collected via an online survey platform at baseline, after three months (post-assessment) and after six months (follow-up assessment). The recall periods ranged from six months at baseline to three months during the post- and the follow-up assessment.

For data collection on healthcare utilization, we used a modified version of the FIMA [26], a standardized questionnaire which originally was designed for the assessment of health-related resource use within the older population groups in cross sectional and longitudinal surveys. For the purpose of this study, we adapted the recall-periods of FIMA and extended the list of assessed medical services by specific psychiatric and psychotherapeutic treatments. The complete list of assessed medical services is presented in Table 1.

Table 1 Assessed medical services by health care sector and corresponding valuation rates adapted from Bock et al. [28], indexed for 2014a

In order to monetarily value the assessed resource use, the quantitative data on utilization of services were priced, using standardized unit costs from Bock et al. [27]. Costs were calculated by multiplying the units of resource utilization with corresponding unit cost prices and are expressed in euro. For further analyses the single health care costs were summarized to sector related health care costs as presented in Table 1.

Following international standards of health economic evaluation [28], the unit costs from Bock et al. (calculated for the year 2011) were adjusted for inflation. Therefore, all cost-rates were adjusted to inflation for the reference year 2014, based on the German consumer price sub-index for health care [29].

To calculate the medication costs, we used a large database (“StammdateiPlus”) with information on all pharmaceuticals listed in Germany, corresponding active ingredient groups, defined daily doses, pharmacies’ retail prices and more. Since the primary data on medication use were collected between 2012 and 2014, we used the database version 46 with the latest update in December 2014 [30] for our analyses.

On basis of the StammdateiPlus, we calculated drug-specific unit costs per pill, injection, suppository etc. first. Therefore, the pharmacy retail price was used. In a second step, the number of drug units per recall period was calculated for each participant, using the assessed self-reports on dose rate and period of application. Finally, the calculated units of drug use per recall period were combined with the drug-specific unit costs to estimate medication costs.

Statistical analysis

Before starting with the data analysis, the whole dataset was checked for validity. Whenever reported numbers of resource use (e.g. number of contacts, number of therapy sessions, number of nights spent in hospital) exceeded the maximum number of days of the corresponding recall period, these single implausible data were deleted from the dataset and coded as missing.

The basic data analysis focused on descriptive parameters. We used measures of central tendency and measures of variability to describe differences concerning the sociodemographic variables or healthcare utilization between study groups. To determine the precision of mean values, 95%-confidence intervals were calculated. Additionally, chi-square tests were utilized for further examination of observed group differences.

To describe the assessed outcomes in variation of time and to check the observed values for regularities, time series analyses were conducted. In cases of normally distributed data, a paired t-test was carried out. If this condition was not fulfilled, a Wilcoxon signed-rank test was used. Comparative subgroup-analysis (especially between IG and CAU) were applied using t-test for independent samples. In order to check whether the intervention also has an influence on the costs independently from baseline costs, we conducted a difference in differences analysis. Therefore, the difference in costs between baseline and the study period was calculated. The changes in mean costs were then examined for differences between study groups, using paired t-tests for independent samples. The corresponding h0-hypothesis to be tested was: there are no significant differences in changes of mean costs between interventions and controls. Our statistical analyses are based on all available data (pairwise deletion), as this method has the advantage of using all observed data of each subject and leads to unbiased estimations. We did therefore not impute missing values as the used statistical methods are robust and valid for missing at random data. Besides, complete case analysis is the most common way of handling missing data in the analysis of clinical RCTs [31].

To enable a direct comparison of health care expenditures and sickness benefits in variation of time, all costs were calculated for a six-month period. Therefore, the health-care expenditures during the post-assessment period were summed up with those at follow-up assessment. Thus, the presented cost-analyses refer to the time-periods “six months pre enrollment” (baseline) versus “six months post enrolment” (post-assessment and follow-up assessment).

All statistical analyses were performed using IBM SPSS Statistics for windows version 22.0 and R version 3.3.2. The calculation of medication costs was conducted with Microsoft Excel 2016. The final cost variables were reimported to IBM SPSS-statistics for further analyses.


Participant flow

Participants were enrolled in the study between August 2012 and December 2013. Of the 2020 screened subjects, 1007 (49.9%) did not meet the inclusion criteria. Most of them were excluded because they reached a score on PHQ-9 of 14 points or more (n = 748; 74.3%). Finally, 1013 participants were randomized into the study groups: 509 to intervention and 504 to care as usual group. The post-assessment-questionnaire was completed by 781 participants (77.1%), 692 (68.3%) completed the 3-months follow-up questionnaire. There were no significant differences in rates of attrition at post treatment or 3-months follow-up between groups. Further, a logistic regression analysis concluded, that neither randomization group nor age, sex, family status, educational status, baseline PHQ-score, baseline diagnosis of depression or panic disorder were significantly associated with dropout status [22]. To obtain full information on participant flow, see the CONSORT flow chart (Fig. 1).

Fig. 1
figure 1

CONSORT participant flow chart

Participant characteristics

Detailed descriptive statistics for socio-demographic characteristics are presented in Table 2.

Table 2 Sociodemographic characteristics at baseline

About two-thirds (68.6%) of the 1013 participants who completed baseline questionnaire were female. The mean age of the sample was 44 years at baseline, ranging from 18 to 65 years.

Nearly 60% reported to be married or to have a steady relationship. Approximately the same number of participants stated to work on a regular contract (44.0% full-time, 23.4% part-time). No differences between study groups were found for any of the sociodemographic variables (gender: χ2 = 0.011, p = 0.915; age: tdf = 1011 = 0.15, p = 0.883; material status: χ2 = 6.753; p = 0.240; highest academic qualification: χ2 = 5.647, p = 0.447, employment status: χ2 = 2.793, p = 0.940). This indicates that randomization had been successful.

Health-related resource use

At baseline-assessment, there was no significant difference in health-related resource use between participants of the intervention group and those receiving care as usual, indicating that randomization was well balanced for resource use as well. Listed medical services or treatments. Briefly, about 80% of the participants in both groups reported that they took at least one medication during the past six months, 85% consulted a general practitioner, about 35% received psychotherapy and nearly 6% had an inpatient hospital stay.

Table 3 presents the percentage of subjects who reported to have used the listed medical services or treatments. Briefly, about 80% of the participants in both groups reported that they took at least one medication during the past six months, 85% consulted a general practitioner, about 35% received psychotherapy and nearly 6% had an inpatient hospital stay.

Table 3 Resource use by health care sector and study condition, six months pre-enrollment versus six months post-enrolment

Compared to baseline, the mean percentage of participants reporting to have received the assessed medical services six months post enrollment did not differ significantly, neither in variation of time nor between study groups. An exception is treatment by a surgeon or an orthopedist. Whereas the percentage of participants who consulted a surgeon or an orthopedist increased by 4.4%age points from 18.9% at baseline to 23.3% six months post enrollment in the intervention group, it decreased by 4.0 percentage points within the care as usual group (20.6% to 16.6%; between-group difference post-enrollment: χ2 = 0.011, p = 0.915).

Incapacity for work

In both study groups, the duration of incapacity for work decreased significantly during the period of six months post enrollment compared to six months pre enrollment (see Fig. 2). The average number of days of incapacity to work decreased by 4 days in both groups, whereas participants of the control-group reported a significant higher mean duration of incapacity for work during the six weeks pre enrollment to the study as well as during the six months post enrollment (IGpre-post: 19.1 to 15.1 days, − 20.9%, p = 0.001; CAUpre-post: 24.0 to 20.3 days, − 15.4%; p = 0.026). The changes in duration of incapacity for work did not differ significantly between groups (tdf = 640 = 0.74; p = 0.462).

Fig. 2
figure 2

Duration of incapacity for work six months pre enrollment compared to six months post enrollment


There were no significant differences in total direct health care costs between the study conditions at baseline (see Table 4). Six months pre enrolment mean total direct costs per participant were €2346 in the intervention group and €2475 in the care as usual group, showing only a small difference of €129 (tdf = 980 = 0.35; p = 0.730). During the six months after enrollment in the trial, mean total costs decreased significantly in both study groups. In the intervention group, total costs decreased by €631 (tdf = 412 = 1.70; p = 0.002), in the care as usual group average costs decreased by €625 (tdf = 420 = 4.004; p = 0.000) (see Fig. 3). The average reduction in total costs did not significantly differ between study conditions (tdf = 579 = − 1.77; p = 0.139).

Table 4 Health care expenditures (in €) by sector and study condition, six months pre-enrollment versus six months post-enrollment
Fig. 3
figure 3

Total health care expenditure six months pre versus six months post enrollment

Besides, on closer examination of sector-specific health care costs we found some important differences between the study groups: Whereas the mean direct costs of outpatient treatment slightly decreased in the intervention group, the average per participant costs increased in the care as usual group (see Table 4). Thus, average outpatient health care costs decreased by 4.4% (€33) from €750 to €717 in the intervention group (tdf = 344 = 1.47; p = 0.144), while costs increased about 11.5% (€78) in the control group from €684 during the period of six months before enrollment to €762 six months after enrollment to the trial (tdf = 340 = − 1.65; p = 0.099). These changes in average outpatient costs did significantly differ between groups (tdf = 684 = 2.16; p = 0.036). The increase in outpatient health care costs in the control group could mainly be traced back to a rise in costs of psychotherapeutic treatment: the six months pre enrollment costs for utilization of psychotherapy increased by €60 on average during the six months post enrollment. By contrast, mean costs for psychotherapeutic treatment decreased by €80 in the intervention group. The described contrary trend in costs for utilization of psychotherapeutic treatment lead to a significant difference in the development of mean changes between intervention group and care as usual (tdf = 685 = 2.57; p = 0.008).

In comparison to the described development of outpatient health care cost, an opposing trend could be identified when analyzing changes in cost for outpatient paramedical services. Whereas the mean direct costs for outpatient paramedical services slightly decreased in the care as usual group by 6.6% (€6) on average, costs for utilization of outpatient paramedical services increased in the intervention group by 31.0% (€24). Even if the change in costs between baseline and post enrollment was significant only for the intervention group (see Table 4), the difference in development of costs between the study groups was statistically significant (tdf = 684 = 2.16; p = 0.031). The significant increase in costs for outpatient paramedical services in the intervention group was mainly caused by an increase in utilization of physiotherapeutic treatment. The average cost per participant decreased about 43.5% (€27), from €60 six months pre enrollment to €87 at six months post enrollment.

Costs for inpatient hospital treatment as well as rehabilitation costs decreased between baseline and six months post enrollment in both study groups. There were no significant differences between study conditions, neither at baseline or post-enrollment nor in mean changes of costs.

Medication costs also decreased in both groups, but the reduction in average costs did not significantly differ between interventions and controls (tdf = 789 = 1.74; p = 0.998).


Principal findings

In this study we have not found that the internet intervention has a significant effect on the percentage of people reporting to have received single healthcare services, on incapacity for work due to illness and resulting total direct costs from payer perspective.

Therefore, the partially perceived changes in sector-specific health care costs can be traced back to changes in rates of utilization: decreasing costs as observed in the field of inpatient treatment, rehabilitation or drug expenses, result from shortened durations of stay, reductions in the number of perceived drugs, variations in dosage or shortened periods of medication use.

Numeric differences in health care expenditures between study groups existed in outpatient treatment costs. Whereas the mean direct costs of outpatient treatment slightly decreased in the intervention group (4.4%; €33), the average per participant costs increased in the care as usual group (11.5%; €78). The significant difference in change of outpatient treatment costs could be attributed to differences in changes of costs for psychotherapeutic treatment from baseline. Whereas costs for psychotherapeutic treatment decreased in the intervention group by 16.8% (€80) during the period of six months post enrollment to the study, costs increased in the control group by 14.7% (€60) (see Table 4).

The higher average duration of incapacity for work which was observed in the intervention group pre and post enrollment to study cannot be explained by baseline differences in sociodemographic characteristics, in severity of depressive symptoms or in the health-related resource use. As part of the RCT-design, participants were randomly assigned to the two study groups. It should therefore be presumed that the observed higher level of incapacity for work in the intervention group has a random origin. The simultaneous reduction in duration of incapacity for work in both study groups does not allow any indication that the use of internet intervention has led to a significant reduction in absenteeism.

Previous studies

Our estimated total direct health care costs are higher than average direct health care costs of other previously performed economic evaluations. To the best of our knowledge, for the German context only two studies exist, which give a detailed description for total direct per patient costs of depression. Whereas the estimated annual direct treatment costs in these studies differ between €686 [[32] and €3849 [33] per patient, the estimated total cost for a period of only six months differs between about €2350 to €2500 at baseline and €1700Footnote 1 to €1850 six months post assessment within our study (see Table 1). It has to be noted, that the methodology of cost assessment and cost calculation in both studies differed from our approach. The first study focused on average direct health care costs of non-institutionalized adults with depression. In contrast to our study, rehabilitation costs, outpatient paramedical services and sickness benefit were not taken into account, which could be an explanation for the significantly lower estimated average costs. Furthermore, because of the restriction to the non-institutionalized population costs might be underestimated [32]. The second study assessed service utilization (including inpatient, outpatient and rehabilitative services) and total direct costs of care in patients with depressive disorder. Again, outpatient paramedical services and sickness benefit were not included in the cost calculation. Additionally, the assessment of medication costs was limited to the depression-specific treatment, prescriptions due to somatic illness were not taken into account [33].

A further difference between our study and previously published studies regards to the instruments used to assess the health-related resource utilization. A recently published meta-analysis on cost-effectiveness of internet-based interventions for the treatment of depression [18] provides an overview of the cost assessment instruments that were used within twelve trials focusing on the cost-effectiveness of e-mental-health interventions. Half of the studies used the “Trimbos and Institute of Medical Technology Assessment Cost Questionnaire for Psychiatry” (TiC-P) to assess direct medical and non-medical costs [18]. The TiC-P allows for the measurement of medical costs as well as productivity losses in patients with a mental disorder. In contrast to the FIMA the TiC-P only focusses on the assessment of contacts within the mental healthcare sector and the use of medication [34]. The FIMA-questionnaire, on the other hand, covers total costs of care.

Several studies have documented that (acute) psychiatric disorders are associated with an increased use of primary care resources but also with a more frequent use of outpatient specialist care [9, 35]. Against this background, the FIMA-questionnaire provides more comprehensive information on healthcare utilization. This could be another reason for the higher estimated costs values within our study.

In conjunction with further differences in cost categorization approaches or differences within the study sample the illustrated differences in survey methods and used instruments limit the comparability of this trial with previously published studies.

A strength of our study is the large sample size. In comparison to other published studies in this research area our study benefits from the huge number of participants enrolled in the trial. To the best of our knowledge the present health economic evaluation is the first published one, which was conducted alongside a prospective randomized controlled trial with a sample size of more than 1000 participants [18]. Another advantage is the wide range of recruitment settings, varying from outpatient to inpatient settings as well as from specialized web-based communication platforms for people with depressive disorders to media used by the general population. The wide range of recruitments settings contributes the extern validity of the present research and supports the hypothesis, that the intervention is effective across different recruitment sources including clinical settings, which could be demonstrated by Klein et al. in another analysis in the context of the EVIDENT-trial [36].

One aspect less focused within this manuscript is the clinical efficacy of deprexis. However, since the medical benefits are of great importance in the context of health economic evaluations, it should be noted that different studies along randomized controlled trials as well as a meta-analysis provided evidence for the clinical effectiveness of deprexis. Thus, a comparison from eight studies demonstrated the effectiveness of deprexis for depressive symptoms at post-intervention, with a medium effect size of g = 0.54 (95% CI: 0.39–0.69) [25]. The results of the EVIDENT-trial also confirm the clinical effectiveness of the program. The study was able to demonstrate that internet intervention was superior to CAU alone in reducing mild to moderate depressive symptoms [22].


Some limitations should be considered when interpreting the results of our study. First, our health economic evaluation was conducted alongside a large multicenter study which was primarily designed to test clinical effectiveness of the internet intervention deprexis. Therefore, the EVIDENT-trial was powered to detect a post-treatment group difference in depression on the main outcome variable PHQ-9 [23]. Possible savings due the use of deprexis were not taken in account when calculating the sample-size. This could be a potential reason for the rather small and mostly not significant differences in direct costs between study groups. Furthermore, the relatively short follow-up period of six months could be another reason for only little differences in health care utilization, medication use, absenteeism due to sickness and resulting costs. Thus, further research is needed to assess the long-term health economic effects (at least two or three years of follow up) of e-mental-health interventions like deprexis.

All collected data were based on patients’ self-reports. Even though we used a standardized instrument for the evaluation of participants’ resource utilization, the assessed health related resource use may suffer from under-reporting due to memory failure or over-reporting due to recall bias. For the purpose of this study, the recall time frames of the FIMA (seven days for medication use, three months for outpatient medical care and outpatient paramedical services and 12 months for inpatient hospital treatment and rehabilitation) had to be standardized and adjusted to the general follow-up dates of the multicentre trial (six months at baseline and three months at post-treatment and follow-up). The relatively long recall periods, especially the period of six months at baseline, may strengthen these effects. As recent studies revealed, the reliability of collected data is clearly restricted by the degree to which patients accurately recall quantities of resources used [34, 37, 38]. Hence, different methods have been suggested to prevent reporting-bias or to correct assessed primary data for recall bias. The most common ways suggested for solving these problems are using patient controls as well as blinding the participants for the study hypothesis being tested [39], which both was realised in the present study.

Another limitation exists with regard to the transferability of the study results. Firstly, study enrollment was limited to people aged between 18 and 65 years as well as to those with mild to moderate depressive symptoms. Therefore, the results cannot be generalized to older people or patients with severe depression. In comparison to the corresponding German general population, participants in the EVIDENT-trial had a higher educational level and women were overrepresented in the study (68.6% females vs. 31.4 percent males) [40,41,42]. As Späth et al. demonstrated, these findings are in line with previous studies [42]. Thus, the higher proportion of women can be explained by a twice as high prevalence of moderate depression among women compared to men. Furthermore, women seem to be more likely to seek help then men, as a cross-sectional study on patterns of lay and professional help-seeking in men and women showed [42, 43]. The higher educational level within this trial could be explained by a higher demand for internet interventions in people with a higher educational level, which was shown for users of a web-based computer-tailored intervention promoting heart-healthy behaviours [44].

One further limitation is that the interventions costs could not be included to the analysis, as this economic evaluation was derived from payer perspective and negotiated license-fees for health insurance companies are not published. The only publicly available price-information relates to a single license for private persons (use of deprexis over a period of 90 days) which amounts to €297.50 including value-added tax [45]. Providing framework contracts with health insurance companies, the program-fees from payer perspective can be assumed to be significantly lower than those for individuals. As shown in Table 4, there is a statistically not significant difference of €135 in mean total costs at six months post-enrollment. It is possible that this difference in total costs could be offset if the program costs are taken into account.

A last limitation that should be noticed is that the conducted costing methodology is only able to generate approximatively information on direct health care costs. The utilization of unit costs for the monetarily valuation of health-related resource use cannot express actual per participant costs. To give an example: costs for inpatient hospital treatment were calculated by multiplying the number of days spent at hospital with a unit cost rate per day, whereas reimbursement within the German inpatient hospital sector is based on fees per case. Furthermore, the reimbursement-system in the outpatient sector combines elements of capitation payment with those of fee for service payments. However, costing by unit costs is a common and approved methodological approach for calculating health care costs within health economic evaluation studies [37, 46].


The present study indicates the health economic potential of innovative e-mental-health programs. Our results suggest that the simultaneous use of web-based self-help programs for depression in combination with care as usual leads to a significant decrease in outpatient treatment costs, especially in those related to different types of psychotherapeutic treatment. With regard to the strong evidence for the clinical effectiveness of deprexis [22], we would recommend the use of this program when weighing up cost and benefits. Although no significant savings in total health care costs could be demonstrated, from a health economic perspective the gained clinical benefits are a strong argument for the use of the cognitive behavioral self-help program.

Considering the above-mentioned limitations of our study, further research on health economic effects of innovative internet programs in the treatment of depressive disorders seems necessary to verify our findings by addressing remaining methodical limitations as well as to widen evidence for (positive) health economic effects such as savings in direct and indirect health care cost.

Availability of data and materials

The data that support the findings are not publicly available, as the publication of the collected primary data is not covered by the informed consent.


  1. Total amount of direct health care costs in the intervention group without costs of the intervention (value therefore differs from that shown in Table 1).



EffectiVeness of Internet-based DEpressioN Treatment


Questionnaire for Health-Related Resource Use in an Elderly Population


Patient Health Questionnaire


randomized controlled trial


Trimbos and Institute of Medical Technology Assessment Cost Questionnaire for Psychiatry


  1. Busch MA, Maske UE, Ryl L, Schlack R, Hapke U. Prävalenz von depressiver Symptomatik und diagnostizierter Depression bei Erwachsenen in Deutschland: Ergebnisse der Studie zur Gesundheit Erwachsener in Deutschland (DEGS1). Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2013;56:733–9.

    Article  CAS  PubMed  Google Scholar 

  2. Klesse C, Bermejo I, Härter M. Neue Versorgungsmodelle in der Depressionsbehandlung. Nervenarzt. 2007;78(Suppl 3):585–94; quiz 595.

    Article  PubMed  Google Scholar 

  3. Pietsch B, Härter M, Nolting A, Nocon M, Kulig M, Gruber S, et al. Verbesserte Versorgungsorientierung am Beispiel Depression - Ergebnisse aus dem Pilotprojekt des Gemeinsamen Bundesausschusses (G-BA). In: Gerste B, Robra B-P, Günster C, Klauber J, Schmacke N, editors. Versorgungs-Report 2013/2014: Schwerpunkt: Depression - Mit Online-Zugang zum Internet-Portal: Stuttgart: Schattauer GmbH; 2014. p. 55–75.

  4. Müters S, Hoebel J, Lange C. Diagnose Depression: Unterschiede bei Frauen und Männern. GBE kompakt. 2013;4:1–10.

    Google Scholar 

  5. Wittchen H-U, editor. Depressive Erkrankungen. Berlin: Robert-Koch-Inst; 2010.

    Google Scholar 

  6. Lademann J, Mertesacker H, Gebhardt B. Psychische Erkrankungen im Fokus der. Gesundheitsreporte der Krankenkassen Psychotherapeutenjournal. 2006:123–9.

  7. Bungard S, Hertle D, Kliner K, Lüken F, Tewes C. Der BKK Gesundheitsreport 2013: Gesundheit in Bewegung, Schwerpunkt Muskel- und Skeletterkrankungen. Berlin: BKK Dachverband e. V; 2013.

    Google Scholar 

  8. Gerste B, Robra B-P, Günster C, Klauber J, Schmacke N, editors. Versorgungs-Report 2013/2014: Schwerpunkt: Depression - Mit Online-Zugang zum Internet-Portal: Stuttgart: Schattauer GmbH; 2014.

  9. Jacobi F, Klose M, Wittchen H-U. Psychische Störungen in der deutschen Allgemeinbevölkerung: Inanspruchnahme von Gesundheitsleistungen und Ausfalltage. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2004;47:736–44.

    Article  CAS  PubMed  Google Scholar 

  10. Knieps F, Pfaff H, editors. Gesundheit und Arbeit: Zahlen, Daten, Fakten ; mit Gastbeiträgen aus Wissenschaft, Politik und Praxis. Berlin: MWV Medizinisch Wissenschaftliche Verlagsgesellschaft; 2016.

    Google Scholar 

  11. Statistisches Bundesamt (Destatis). Krankheitskosten. 2017.;sid=83E2497340D2A3965594FE6BE493ABB0.GO_1_4?operation=begriffsRecherche&suchanweisung_language=de&suchanweisung=krankheitskosten&x=8&y=6. Accessed 3 May 2017.

  12. Beesdom-Baum K, Wittchen H-U. Depressive Störungen: Major Depression und Dysthymie. In: Wittchen H-U, Hoyer J, editors. Klinische Psychologie & Psychotherapie. 2nd ed. Heidelberg: Springer-Medizin; 2011. p. 879–914.

    Chapter  Google Scholar 

  13. Kohn R, Saxena S, Levav I, Saraceno B. The treatment gap in mental health care. Bull World Health Organ. 2004;82:858–66.

    PubMed  PubMed Central  Google Scholar 

  14. Cuijpers P, Donker T, Johansson R, Mohr DC, van Straten A, Andersson G. Self-guided psychological treatment for depressive symptoms: a meta-analysis. PLoS One. 2011;6:e21274.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  15. Ebert DD, Erbe D, Berking M, Rief. Internetbasierte psychologische Interventionen (PSYNDEXshort). In: Berking M, Rief W, editors. Klinische Psychologie und Psychotherapie für Bachelor: Band II: Therapieverfahren Lesen, Hören, Lernen im Web. Berlin, Heidelberg: Springer; 2012. p. 131–140.

    Chapter  Google Scholar 

  16. Laux G. Online−/Internet-Programme zur Psychotherapie bei Depression eine Zwischenbilanz. Journal für Neurologie. Neurochirurgie und Psychiatrie. 2017;18:16–24.

    Google Scholar 

  17. Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry. 2017;74:351–9.

    Article  PubMed  Google Scholar 

  18. Paganini S, Teigelkötter W, Buntrock C, Baumeister H. Economic evaluations of internet- and mobile-based interventions for the treatment and prevention of depression: a systematic review. J Affect Disord. 2017;225:733–55.

    Article  PubMed  Google Scholar 

  19. Bolier L, Majo C, Smit F, Westerhof GJ, Haverman M, Walburg JA, et al. Cost-effectiveness of online positive psychology: randomized controlled trial. J Posit Psychol. 2014;9:460–71.

    Article  Google Scholar 

  20. Gerhards SAH, de GLE, Jacobs LE, Severens JL, Huibers MJH, Arntz A, et al. Economic evaluation of online computerised cognitive-behavioural therapy without support for depression in primary care: randomised trial. Br J Psychiatry. 2010;196:310–8.

    Article  CAS  PubMed  Google Scholar 

  21. Phillips R, Schneider J, Molosankwe I, Leese M, Foroushani PS, Grime P, et al. Randomized controlled trial of computerized cognitive behavioural therapy for depressive symptoms: effectiveness and costs of a workplace intervention. Psychol Med. 2014;44:741–52.

    Article  CAS  PubMed  Google Scholar 

  22. Klein JP, Berger T, Schröder J, Späth C, Meyer B, Caspar F, et al. Effects of a psychological internet intervention in the treatment of mild to moderate depressive symptoms: results of the EVIDENT study, a randomized controlled trial. Psychother Psychosom. 2016;85:218–28.

    Article  PubMed  Google Scholar 

  23. Klein JP, Berger T, Schröder J, Späth C, Meyer B, Caspar F, et al. The EVIDENT-trial: protocol and rationale of a multicenter randomized controlled trial testing the effectiveness of an online-based psychological intervention. BMC Psychiatry. 2013;13:239.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Meyer B, Berger T, Caspar F, Beevers CG, Andersson G, Weiss M. Effectiveness of a novel integrative online treatment for depression (Deprexis): randomized controlled trial. J Med Internet Res. 2009;11:e15.

    Article  PubMed  PubMed Central  Google Scholar 

  25. Twomey C, O'Reilly G, Meyer B. Effectiveness of an individually-tailored computerised CBT programme (Deprexis) for depression: a meta-analysis. Psychiatry Res. 2017;256:371–7.

    Article  PubMed  Google Scholar 

  26. Seidl H, Bowles D, Bock J-O, Brettschneider C, Greiner W, König H-H, Holle R. FIMA--Fragebogen zur Erhebung von Gesundheitsleistungen im Alter: Entwicklung und Pilotstudie. Gesundheitswesen. 2015;77:46–52.

    Article  CAS  PubMed  Google Scholar 

  27. Bock J-O, Christian B, Seidl H, Bowles D, Holle R, Greiner W, König H-H. Standardisierte Bewertungssätze aus gesellschaftlicher Perspektive für die gesundheitsökonomische Evaluation. Baden-Baden: Nomos Verlagsgesellschaft; 2015.

    Book  Google Scholar 

  28. Drummond MF, Sculpher M, Claxton K, Stoddart GL, Torrance GW. Methods for the economic evaluation of health care programmes. 4th ed. Oxford: Oxford University Press; 2015.

    Google Scholar 

  29. Statistisches Bundesamt (Destatis). Verbraucherpreisindex. 2017.;sid=3E45D8414B2375E728E053B8B12A0BDB.GO_1_2?operation=begriffsRecherche&suchanweisung_language=de&suchanweisung=Verbraucherpreisindex&x=8&y=10. Accessed 8 Jun 2017.

  30. Wissenschaftliches Institut der AOK. (Wido). StammdateiPlus: des GKV-Arzneimittelindex. Berlin: AOK Bundesverband GbR; 2014.

    Google Scholar 

  31. Bell ML, Fiero M, Horton NJ, Hsu C-H. Handling missing data in RCTs; a review of the top medical journals. BMC Med Res Methodol. 2014;14:118.

    Article  PubMed  PubMed Central  Google Scholar 

  32. Friemel S, Bernert S, Angermeyer MC, König H-H. Die direkten Kosten von depressiven Erkrankungen in Deutschland -- Ergebnisse aus dem European Study of the Epidemiology of Mental Disorders (ESEMeD) Projekt. Psychiatr Prax. 2005;32:113–21.

    Article  PubMed  Google Scholar 

  33. Salize HJ, Stamm K, Schubert M, Bergmann F, Härter M, Berger M, et al. Behandlungskosten von Patienten mit Depressionsdiagnose in haus- und fachärztlicher Versorgung in Deutschland. Psychiatr Prax. 2004;31:147–56.

    Article  PubMed  Google Scholar 

  34. Bouwmans C, de Jong K, Timman R, Zijlstra-Vlasveld M, van der Feltz-Cornelis C, Tan swan S, Hakkaart-van Roijen L. Feasibility, reliability and validity of a questionnaire on healthcare consumption and productivity loss in patients with a psychiatric disorder (TiC-P). BMC Health Serv Res. 2013;13:217.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Schneider A, Hörlein E, Wartner E, Schumann I, Henningsen P, Linde K. Unlimited access to health care--impact of psychosomatic co-morbidity on utilisation in German general practices. BMC Fam Pract. 2011;12:51.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Klein JP, Gamon C, Späth C, Berger T, Meyer B, Hohagen F, et al. Does recruitment source moderate treatment effectiveness? A subgroup analysis from the EVIDENT study, a randomised controlled trial of an internet intervention for depressive symptoms. BMJ Open. 2017;7:e015391.

    Article  PubMed  PubMed Central  Google Scholar 

  37. van den Brink M, van den Hout WB, Stiggelbout AM, Putter H, van de Velde CJH, Kievit J. Self-reports of health-care utilization: diary or questionnaire? Int J Technol Assess Health Care. 2005;21:298–304.

    Article  PubMed  Google Scholar 

  38. Goossens ME, MP-v M, Vlaeyen JW, van der Linden SM. The cost diary. J Clin Epidemiol. 2000;53:688–95.

    Article  CAS  PubMed  Google Scholar 

  39. Rockenbauer M, Olsen J, Czeizel AE, Pedersen L, Sørensen HT. Recall bias in a case-control surveillance system on the use of medicine during pregnancy. Epidemiology. 2001;12:461–6.

    Article  CAS  PubMed  Google Scholar 

  40. Genesis-Online. Bevölkerung (ab 15 Jahren): Deutschland, Jahre, Geschlecht, Altersgruppen, Allgemeine Schulausbildung. 2017. Accessed 30 Aug 2017.

  41. Genesis-Online. Bevölkerungsfortschreibung auf Grundlage des Zensus 2011. 2017. Accessed 30 Aug 2017.

  42. Späth C, Hapke U, Maske U, Schröder J, Moritz S, Berger T, et al. Characteristics of participants in a randomized trial of an internet intervention for depression (EVIDENT) in comparison to a national sample (DEGS1). Internet Interv. 2017;9:46–50.

    Article  PubMed  PubMed Central  Google Scholar 

  43. Oliver MI, Pearson N, Coe N, Gunnell D. Help-seeking behaviour in men and women with common mental health problems: cross-sectional study. Br J Psychiatry. 2005;186:297–301.

    Article  PubMed  Google Scholar 

  44. Brouwer W, Oenema A, Raat H, Crutzen R, de NJ, de VNK, Brug J. Characteristics of visitors and revisitors to an internet-delivered computer-tailored lifestyle intervention implemented for use by the general public. Health Educ Res. 2010;25:585–95.

    Article  PubMed  Google Scholar 

  45. SERVIER Deutschland GmbH. deprexis 24 - Ihr Online-Therapieprogramm bei Depressionen. 2018. Accessed 19 Apr 2018.

  46. Leggett LE, Khadaroo RG, Holroyd-Leduc J, Lorenzetti DL, Hanson H, Wagg A, et al. Measuring resource utilization: a systematic review of validated self-reported questionnaires. Medicine (Baltimore). 2016;95:e2759.

    Article  Google Scholar 

Download references


The authors wish to thank GAIA AG (Hamburg, Germany), which gave technical support and made the Internet intervention (deprexis) available at no cost to the participants in the trial. The full EVIDENT study team consists of the following: Sandra Nolte, Matthias Rose (local principal investigator), Anna Paulitschek, Leonie Gmöhling and Leonie Schickedanz (Berlin); Thomas Berger (Bern); Viola Gräfe and Wolfgang Greiner (local principal investigator; Bielefeld); Mirja Behrens, Cecile Hoermann, Anna J. Katharina Jahns, Thies Lüdtke, Björn Meyer, Steffen Moritz (local principal investigator), Johanna Schröder, Amit Gulati and Eik Vettorazzi (Hamburg); Carla Gamon, Fritz Hohagen (principal investigator), Philipp Klein (local principal investigator), Martin Kolbe, Antje Roniger and Christina Späth (Lübeck); Alice Arndt, Liv Glindemann, Wolfgang Lutz (local principal investigator), David Rosenbaum and Kathinka Wolter (Trier) and Flora Bach, Elisabeth Beck, Kristina Fuhr, Martin Hautzinger (local principal investigator), Katharina Krisch and Melanie Wahl (Tübingen).

We acknowledge support of the publication fee by Deutsche Forschungsgemeinschaft and the Open Access Publication Funds of Bielefeld University.


This study was funded by the German Federal Ministry of Health (II A 5–2512 FSB 052). The funding body had no role in the design of the study, data collection, analysis, or interpretation of the data. The corresponding author had full access to all the data in the study and had final responsibility for the decision to submit for publication.

Author information

Authors and Affiliations



The results of the present manuscript are based on a larg multicentric study conducted by the University of Luebeck (Department of Psychiatry and Psychotherapy), the University Medical Center Hamburg-Eppendorf (Department of Psychiatry and Psychotherapy), the Bielefeld University (Department of Health Economics and Health Care Management), the University of Bern (Department of Clinical Psychology and Psychotherapy), the Eberhard Karls University Tuebingen (Department of Psychology), the University of Trier (Department of Psychology), the Charité University Medical Center (Department of Psychosomatic Medicine) and Gaia AG. VG performed the data analyses and wrote the first draft of the paper. All authors provided their intellectual inputs; VG edited the paper. All the authors read and approved the final manuscript.

Corresponding author

Correspondence to Viola Gräfe.

Ethics declarations

Competing interests

Jan Philipp Klein received payment for presentations, workshops, and books on psychotherapy for chronic depression and psychiatric emergencies. Björn Meyer is employed as research director at GAIA AG, the company that developed, owns, and operates the Web intervention investigated in this trial. All other authors and members of the EVIDENT study team report no financial or other relationship relevant to this article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gräfe, V., Berger, T., Hautzinger, M. et al. Health economic evaluation of a web-based intervention for depression: the EVIDENT-trial, a randomized controlled study. Health Econ Rev 9, 16 (2019).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI:


  • Economic issues
  • Outcome studies
  • Health economic evaluation
  • E-mental-health
  • Deprexis
  • Depression
  • Randomized controlled trial