SciELO - Scientific Electronic Library Online

vol.50 issue2Scientific Production in Psychology of Members of the National Researchers System in Mexico author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand



Related links

  • On index processCited by Google
  • Have no similar articlesSimilars in SciELO
  • On index processSimilars in Google


Revista Latinoamericana de Psicología

Print version ISSN 0120-0534

rev.latinoam.psicol. vol.50 no.2 Bogotá May/Aug. 2018 


A Systematic Review and Meta-Analysis of Third-Wave Online Interventions for Depression

Revisión sistemática y meta-análisis de las intervenciones de tercera generación online para depresión

Marco A. Sierraa  *  , Francisco J. Ruiza  , Cindy L. Flóreza 

a Fundación Universitaria Konrad Lorenz, Bogotá, Colombia.


Online psychological interventions for the treatment of depression are increasing as an alternative to traditional face-to-face psychotherapy. Adaptations of cognitive behavioral therapy for the treatment of depression have been tested, with meta-analyses showing weighted effect sizes ranging from d = 0.40 to 0.56. However, there is less evidence on the effect of adaptations of third-wave behavioral therapies for depression. Accordingly, this study reviews the evidence of online applications of third-wave behavioral therapies for depression. Nine randomized clinical trials were found with a total of 1910 participants. Most of these trials implemented online versions of behavioral activation (BA) and acceptance and commitment therapy (ACT). All studies reported positive effects of third-wave therapies. A meta-analysis was conducted with the 6 studies (N = 1744) that compared an online intervention versus wait-list or treatment as usual conditions. Medium to large effect sizes were found with a weighted effect size of d = 0.61. In conclusion, online adaptations of third-wave therapies seem to be legitimate options for the treatment of depression.

Key words: third-wave behavioral therapies; online psychological interventions; depression; systematic review; meta-analysis


Las intervenciones psicológicas online para el tratamiento de la depresión están creciendo como una alternativa a la psicoterapia tradicional vis a vis. Se han evaluado adaptaciones de la terapia cognitivo conductual para el tratamiento de la depresión, señalando los meta-análisis tamaños del efecto promedio entre d = 0.40 y 0.56. Sin embargo, existe menor evidencia acerca de los efectos de adaptaciones de las terapias conductuales de tercera generación para la depresión. Consecuentemente, este estudio revisa la evidencia de las aplicaciones online de terapias conductuales de tercera generación para la depresión. Se encontraron 9 estudios clínicos aleatorizados con un total de 1910 participantes. La mayor parte de los estudios aplicaron versiones de la activación conductual y la terapia de aceptación y compromiso. Todos los estudios reportaron efectos positivos de las terapias de tercera generación. Se realizó un meta-análisis con los 6 estudios (N = 1744) que compararon una intervención online versus un control en lista de espera o tratamiento habitual. Se encontraron tamaños del efecto entre medianos y grandes, con un tamaño del efecto promedio de d = 0.61. En conclusión, las adaptaciones online de terapias de tercera generación parecen ser una opción legítima para el tratamiento de la depresión.

Palabras-clave: terapias de tercera generación; intervenciones psicológicas online; depresión; revisión sistemática; meta-análisis

According to the World Health Organization (WHO), at least one in every ten people suffer from unipolar depression (approximately 676 million), which makes depression the most prevalent mental disorder and the third most disabling health condition in the world (World Health Organization, 2008, 2016). Psychological treatment is the first and most recommendable intervention for depression, and its early implementation shows greater efficacy and significantly prevents chronicity and/or relapse (Cuijpers, Andersson, Donker, & Van Straten, 2011). Global estimations from the WHO's Mental Health Atlas (2011) show that only 0.38% of the population receives any kind of intervention for mental disorders. This contrasts with the high lifetime prevalence of depression, with global estimates from 10 to 15% of the general population (Moussavi et al., 2007).

The low level of use of mental-health services might be due to the relative difficulty to access them in some particular contexts (i.e., spatiotemporal, geographical, economical, and geopolitical issues). At the dawn of the digital era (i.e. the late 90's), online psychological interventions were proposed as a promising alternative for conventional interventions. Barak, Klein, and Proudfoot (2009) classified the existing research on this subject in four categories: (a) web-based interventions (self-help interventions with therapeutic support), (b) online counseling and therapy (one-to-one therapy), (c) Internet-operated therapeutic software (automatic self-help software), and (d) supplements to other interventions. These alternative interventions should be efficient, ethical, of high quality, evidence-based, broader, empowering, and encouraging for the users (Eysenbach, 2001).

General reviews on the efficacy of online psychological interventions show that they are a legitimate therapeutic activity and constitute a promising alternative to traditional psychotherapy (Barak, Hen, Boniel-Nissim, & Shapira, 2008) as well as a powerful tool for the prevention of mental disorders in general (Ebert, Cuijpers, Muñoz, & Baumeister, 2017). With regard to unipolar depression, most of the online interventions have been adaptations of cognitive behavioral therapy (CBT) and interpersonal therapy (IPT). Several reviews of the effect of CBT-oriented online interventions for depression have found significant reductions of symptomatology, high levels of satisfaction and cost-effectiveness among participants. Across the different me-ta-analyses (Andersson & Cuijpers, 2009; Richards & Richardson, 2012; Spek et al., 2007), effect sizes for depression were medium (d = 0.40 to 0.56). Spek et al. found that effect sizes differed depending on the support (e.g., feedback and reminders) provided by the intervention, with large effect sizes for interventions with support and small effect sizes for interventions without it.

The third wave of behavioral and cognitive psychotherapies, or contextual CBT (Hayes, Villatte, Levin, & Hildebrandt, 2011), is a diverse group of empirically supported treatment approaches (Dimidjian et al., 2016) that includes acceptance and commitment therapy (ACT; Hayes, Strosahl, & Wilson, 1999), functional analytic psychotherapy (FAP; Kohlenberg & Tsai, 1991), behavioral activation (BA; Martell, Addis, & Jacobson, 2001), dialectical behavioral therapy (DBT; Linehan, 1993), metacognitive therapy (MCT; Wells, 2009), mind-fulness-based cognitive therapy (MBCT; Segal, Williams, & Teasdale, 2002), and rumination-focused cognitive-behavioral therapy (RF-CBT; Watkins, 2016). These approaches focus on the functions of private experiences rather than their form, frequency or "rationality." Third-wave interventions differ from one another conceptually and methodologically, but they share at least three common therapeutic objectives: opening client towards her own experience, becoming aware of her own behavior, and promoting valued actions in the presence of any private experience (Hayes et al., 2011).

The development of online, third-wave interventions for depression has grown in recent years, albeit the research volume is still limited. Existing reviews (Brown, Glendenning, Hoon, & John, 2016; Cavanagh, Strauss, Forder, & Jones, 2014; Spijkerman, Pots, & Bohlmeijer, 2016) focused on a single kind of intervention (i.e., MBCT, ACT) as applied to multiple types of problems. However, the effect of online, third-wave interventions for depression has not been specifically reviewed. Accordingly, the present review/me-ta-analysis aims to analyze the current empirical evidence of online, third-wave treatments for depression.


Study Selection

Studies regarding the treatment of depression by means of third-wave approaches presented through virtual media were identified using the following strategies. Firstly, the bibliographic database Scopus was searched at the end of November 2016, using the following command: ("Internet" OR "Web-based" OR "online") AND ("depression") AND ("Acceptance and commitment therapy" OR "Behavioral Activation" OR "Behavioral Activation" OR "Mindfulness" OR "Meta-cognitive Therapy" OR "Dialectical Behavioral Therapy" OR "Rumination-Focused Cognitive-Behavioral Therapy"). Secondly, the first and third authors reviewed the search output and selected the articles that met the inclusion criteria (see below). Third, reference lists from articles that met inclusion criteria for full-text review were examined as well. Lastly, the reference lists of existing reviews and meta-analyses on the matter were also reviewed (i.e., Brown et al., 2016; Cavanagh et al., 2014; Spijkerman et al., 2016), as well as webpages related to third-wave therapies (e.g.,

Inclusion Criteria

This review included studies that present any kind of third-wave cognitive behavioral intervention designed for the treatment of depression through virtual media (i.e., Websites, email, mobile phone applications). Studies presenting depression measures as secondary outcomes (e.g., clinical studies on anxiety disorders, wellbeing, health issues, etc.) were excluded from this review. Studies that presented the development of the intervention protocol but did not report outcomes were also excluded. Due to limitations in the languages spoken by the authors of this research, only studies written in English or Spanish were taken into consideration.

Coding Procedures

Treatment, participant, methodological, and extrinsic variables were coded in order to analyze the characteristics of the studies that could be correlated with the effect size magnitude. The treatment characteristics coded were: (a) type of third-wave intervention implemented, (b) number of sessions/modules and overall duration of the interventions in weeks, (c) type of virtual media used to deliver the intervention. The participant characteristics coded for the sample of each study were: (d) mean age in years, (e) percentage of females, and (f) total sample size. The methodological characteristics were coded as follows: (g) design type, and (h) last follow-up in months. Finally, the extrinsic characteristics coded were: (i) year of publication, and (j) country and continent in which the study was conducted.

Effect Size Calculation

Controlled between-group effect size biases corrected for small samples (Hedges's g; Hedges, 1981) were computed on all outcome and process measures at pretreatment, posttreatment, and the last follow-up. The first author of the study was requested to provide the necessary raw data to compute g whenever the article did not contain them. Primary outcomes were used to established measures of depression (e.g., Beck Depression Inventory, Center for Epidemiologic Studies - Depression, etc.). Effect sizes were computed so that positive effects represent better results for the third-wave interventions and negative effects represent better results for the control conditions. Hedges's g effect sizes were interpreted using Cohen's rule-of-thumb of small (0.2), medium (0.5), and large (0.8) effects.

Statistical Analysis

The meta-analyses were conducted with Comprehensive Meta-Analysis Version 3.0 (CMA, Biostat). Since heterogeneity between the included studies was expected, the summary effect and 95% confidence intervals were calculated according to a random effects model, which assumed that studies differ from each other as a result both of random error within studies and of systematically true variation in effect sizes between studies (Borenstein, Hedges, Higgins, & Rothstein, 2009). Importantly, the random effects model yields the same results as the fixed effects model in the absence of heterogeneity, so that random effects models were used even in the cases in which heterogeneity was nonsignificant. The Q statistic was used to test for heterogeneity, and the I2 index to assess the degree of the effect size heterogeneity around the mean effect (Cooper, Hedges, & Valentine, 2009). Following the suggestion of Higgins, Thompson, Deeks, and Altman (2003), values of 0, 25, 50, and 75% in the /2 statistic were considered as indicative of no, low, moderate, and high heterogeneity, respectively.


Figure 1 shows the results of the search conducted. The search in databases yielded a list of 172 studies. Eighteen studies met the inclusion criteria for full text review. Nine studies were excluded during full text review: Four were open trials (Burns et al., 2011; Felder et al., 2016; Murray et al., 2015; Spates, Kalata, Ozeki, Stanton, & Peters, 2013), two referred to an online intervention for suicidal thoughts that included depression score as a secondary outcome (Van Spijker, Van Straten, & Kerkhof, 2014, 2015), one was designed for the treatment of comorbid depression symptoms in individuals already diagnosed with epilepsy (Thompson et al., 2010), one was meant to reduce residual symptomatology after psychological intervention (Dimidjian et al., 2014), and a last one assessed the efficacy of a MBCT online protocol on mixed depression and anxiety (Krüsche, Chylarova, & Williams, 2013).

Figure 1 Study Inclusion Flowchart. 

Nine randomized controlled trials (RCTs) met the inclusion criteria and were included in this review. Seven of them had two arms: Five included a wait-list control (WLC) group and two had another active intervention as comparison. The remaining two RCTs had three arms corresponding to two experimental groups and a WLC group. All of them were conducted in Europe: two in Sweden, two in Finland, two in the Netherlands, two in the UK, and one in Germany.

Ethical Considerations

The main ethical concerns about research in online psychological therapy relies on the difficulties associated with the information management and privacy, informed consent signing, verification of the participants' identity, and therapeutic alliance (Childress, 2000; Kotsopoulou, Melis, Kout-soumpou, & Karasarlidou, 2015). The nine RCT's included in the present review reported approval by an institutional Ethics Committee and the trials were registered. All studies protected their participant's identities by the creation of unique sets of exclusive usernames and passwords. Those security systems were safely programmed by professional engineers from every research group.

All studies obtained informed consent. One study conducted an evaluation and debriefing session before giving participants access to the intervention program (Lappalainen et al., 2014). In another study, the informed consent was sent to the participants through conventional mail and they returned it signed before having access to the intervention (Eisma et al., 2015). The remaining studies collected the informed consents through virtual media by simply clicking on a button on the platform. Participants could not contact the other participants, nor could they access their personal or progress information. None study reported how they excluded underage participants.

Depression Measurements

All studies included in this review measured depression by means of a well-established self-report measure (see Table 1): five studies used the Beck Depression Inventory - II (BDI-II; Beck, Steer & Brown, 1996); two studies used the Edinburgh Postnatal Depression Scale (EPDS; Cox, Holden, & Sagovsky, 1987); one study used the Center for Epidemiological Studies - Depression Scale (CES-D; Radloff, 1977), and one used the Inventory of Complicated Grief-Revised (ICG-R; Prigerson & Jacobs, 2001).

Description of the RCTs

Table 1 presents the main characteristics of the described studies; first author, year of publication, country of application, type of third-wave intervention used, delivery mode (i.e., website, smartphone app), primary outcome, general results, number of sessions or modules, duration in weeks of the intervention, sample size before randomization, attrition rates at posttreatment, mean age of the participants, and percentage of females among them.

Table 1 Main Characteristics of the Reviewed Studies. 

Note. * = Studies included on the meta-analysis; ACT = Acceptance and Commitment Therapy; BA = Behavioral Activation; BDI-II = Beck Depression Inventory - II; CBT = Cognitive Behavioral Therapy; CES-D Center for Epidemiological Studies - Depression; EPDS = Edinburgh Postnatal Depression Scale; ICG-R = Inventory of Complicated Grief-Revised; MBCT = Mindfulness-Based Cognitive Therapy.

Lappalainen et al. (2014) conducted a two-arm RCT comparing two experimental conditions that applied ACT: online therapy versus face-to-face therapy (N = 38). The online intervention consisted of six weekly modules featuring ACT-based exercises and content on a website. The screening process consisted of a structured interview delivered on the phone designed for the study that explored symptoms of depression. Participants in the online condition received extensive support (reminders and feedback) and two face-to-face sessions with a therapist at the start (general assessment and contextualization) and the end of the intervention (debriefing and experience evaluation). However, those two face-to-face sessions had no therapeutic content. The primary outcome was the BDI-II, and 6- and 18-month follow-ups were conducted. Furthermore, 97.3% of the participants completed the intervention (N = 37) and 92.1% provided 18-month follow-up data (N = 35). Depressive symptomatology significantly decreased in both groups at posttreatment with few differences between treatments (d = -0.15). The gains were maintained at the follow-ups, with the online interventions showing significantly better results in the reduction of depression (6-month follow-up: d = 0.78; 18-month follow-up: d = 0.51). The within-group effect sizes for the online condition were large (d = 1.19).

Lappalainen, Langrial, Oinas-Kukkonen, Tolvanen, and Lappalainen (2015) conducted a two-arm RCT comparing the online ACT intervention developed by Lappalainen et al. (2014) versus a WLC (N = 39). However, in this study, participants had minimal support consisting of automated generic reminders and feedback without further contact with the research team (i.e., the participants never had face-to-face contact with them). The screening process consisted of a structured interview based on the Diagnostic and Statistical Manual of Mental Disorders (DSM-IV-TR; APA, 2000). The outcome measure was the BDI-II. In this study, 97.4% of the participants completed the intervention (N = 38). There was a significant decrease in depressive symptoms at posttreatment (d = 0.63). In addition, 50% of participants met the criteria for remission according to Jacobson and Truax (1991).

Pots et al. (2016) conducted a three-arm RCT comparing ACT, Expressive Writing, and a WLC (N = 236). The interventions lasted up to 12 weeks and consisted of nine modules divided into three parts. The expressive writing condition consisted of a blog based on Pennebaker (1997), where participants had to write about emotional experiences for 1530 min on at least 3 days per week. The ACT intervention was based on the protocol developed by Kelders, Pots, Os-kam, Bohlmeijer, and Van Gemert-Pijnen (2013). Participants received reminders and feedback at the end of each module. The screening process consisted of (a) a battery of self-report psychometric instruments presented to the participants within the website after giving their virtual informed consent, and (b) the Mini International Neuropsychiatric Interview (MINI; Sheehan et al., 1998) delivered through a phone-call. The participants never had face-to-face contact with the research team. The CES-D was the outcome measure. In this case, 51.2% of the participants responded to CES-D at the end of the intervention (N = 121), 53.3% provided 6-month follow-up data (N = 126), and 50% provided 12-month follow-up data (N = 118). For the ACT condition, there was a significant decrease of the depressive symptomatology at posttreatment (ACT vs. EW: d = 0.35; ACT vs. WLC: d = 0.56) that was maintained at the 6- and 12-month follow-ups although differences among conditions were lower (ACT vs. EW at 6-month follow-up: d = 0.17; ACT vs. WLC at 6-month follow-up: d = 0.32; ACT vs. EW at 12-month follow-up: d = -0.01).

O'Mahen et al. (2013) conducted a two-armed RCT with a treatment-as-usual (TAU) control group (N = 910). The intervention was designed for women presenting depressive symptomatology after childbirth (only women who gave birth to children born alive were included). Women in the TAU condition received only the usual hospital care. The intervention consisted of 11 weekly modules on a virtual platform based on BA. The intervention focused on symptom reduction and the reinforcement of the mother-child bond. Participants received reminders of the activities but there was no feedback. The screening process consisted of the virtual delivery of the EPDS scale, after giving digital informed consent on the intervention website. The women never had face-to-face contact with the research team. The EPDS was the outcome measure. Attrition rates were high for this study, 62.3% of the participants did not provide post-treatment data. There was a significant decrease in the symptomatology at posttreatment favoring the BA condition (d = 0.54).

O'Mahen et al. (2014) conducted another two-arm RCT with women presenting depressive symptomatology after childbirth (only women who gave birth to children born alive were included) randomized to an experimental group and a TAU control group (N = 83). This study used the protocol developed by O'Mahen et al. (2013). Participants received extensive support consisting of weekly phone calls providing feedback on their activities and e-mail reminders. The screening process was identical to the latter study, but also included a structured interview based on the ICD-10 classification of mental and behavioral disorders (World Health Organization, 1992) delivered by phone-call. The women never had face-to-face contact with the research team. The EPDS was again the outcome measure. In this case, 85.5% of the participants completed the intervention (N = 71) and 71% provided follow-up data (N = 59). There was a significant decrease of the symptomatology at posttreatment (d = 0.65) that was maintained at the 6-month follow-up (d = 0.48).

Eisma et al. (2015) conducted a three-arm RCT with a WLC group and two experimental groups (Exposure and BA) (N = 47). Both interventions were designed for individuals presenting ruminative responses during grief, lasted 6 to 8 weeks, and consisted of six weekly e-mail-delivered assignments. The exposure condition was an online adaptation of the protocol by Boelen, De Keijser, Van Den Haut, and Van Den Bout (2007), focused on reducing avoidance by gradually exposing the participants to the aversive aspects of their loss. The screening process consisted of a semi-structured interview delivered by phone-call in which the inclusion criteria were re-assessed and another explicit informed consent was provided (besides the one sent by e-mail and regular mail). The participants never had face-to-face contact with the research team. The ICG-R was the primary outcome measure. Participants did not receive reminders but had feedback on their assignments. In this study, 76.5% of the participants completed the intervention (N = 36) and 70.2% provided follow-up data (N = 33). This study presented a methodological problem because the mean scores in depression at pretreatment were considerably higher for the BA condition. For this reason, it was not included in the meta-analysis. The authors computed a version of Cohen's d that controlled for this difference at pretreatment. There was a significant reduction of symptomatology at posttreatment for both treatments in comparison to the WLC (BA: d = 0.92; Exposure: d = 0.79) but there were no significant differences between the interventions. In the BA condition, the change was maintained at the 3-month follow-up.

Carlbring et al. (2013) conducted a two-arm RCT with a WLC (N = 80). The intervention included components both of BA and ACT and was implemented in 7 weekly modules. The participant could freely advance throughout the program. There was minimal support consisting of motivational feedback on the exercises conducted in each module. The screening process consisted of (a) a battery of self-report psychometric instruments presented to the participants within the website after giving their virtual informed consent, and (b) the A module of the Structured Clinical Interview for DSM-IV - Axis I disorders (SCID-I; First, Gibbon, Spitzer, & Williams, 1997) delivered through a phone-call. The participants never had face-to-face contact with the research team. The outcome measure was the BDI-II. The percentage of participants that competed the intervention and provided follow-up data was 97.5% (N = 78). Results showed a significant reduction of depressive symptomatology at posttreatment according to the BDI-II (d = 0.86).

Ly et al. (2014) conducted a two-arm RCT comparing BA and MBCT delivered through a mobile phone application (N = 81). Both interventions lasted 8 weeks and were administered sequentially (i.e., participants could not skip any parts of the program). Participants received reminders and feedback on their activities. The screening process consisted of (a) a battery of self-report psychometric instruments sent to the participants via e-mail after giving their virtual informed consent, and (b) the MINI (Sheehan et al., 1998) delivered through a phone-call. The participants never had face-to-face contact with the research team. The outcome measures were scores on the BDI-II and the Personal Health Questionnaire - 9 (PHQ-9; Kroenke, Spitzer, & William, 2001), however, only the results in the BDI-II were considered because it is a better-established measure of depression and four other studies also included it. In this work, 88.8% of the participants completed the intervention (N = 72) and 85.1% provided follow-up data (N = 69). Results at posttreatment (d = 0.24) and 6-month follow-up (d = 0.03) were in favor of the BA condition, but the difference was not statistically significant. The symptom level at pretreatment moderated the effect of the interventions. Specifically, the BA condition showed a greater symptom decrease for participants with higher scores at pretreatment (within-group effect size at posttreatment: d = 1.8; within-group effect size at the 6-month follow-up: d = 1.17), whereas the MBCT condition showed a greater symptom decrease for participants with lower symptom scores (within-group effect size at posttreatment: d = 1.19; within-group effect size at the 6-month follow-up: d = 1.07).

Meyer et al. (2009) conducted a two-arm RCT with a WLC (N = 396). The intervention lasted 9 to 10 weeks and consisted of 10 modules presented on a virtual platform based on various approaches (BA, MCBT, and CBT). The screening process consisted of a battery of self-report psychometric instruments presented to the participants within the website after giving their virtual informed consent. The participants never had face-to-face contact with the research team. The BDI-II was the outcome measure. Participants did not receive reminders or feedback. Attrition rates were high for this study (45.4% of the participants did not provide post-treatment data). Results showed a significant reduction of depressive symptomatology at posttreatment (d = 0.63).


For the meta-analysis, we computed the weighted effect sizes of the third-wave online interventions versus the WLC and TAU conditions. Table 2 presents statistical data for the studies included in the meta-analysis. Medium to large effect sizes favoring the third-wave online interventions were found in each study. Meta-analytic data show a statistically significant medium effect size (d = 0.61, SE = 0.07; 95% CI [0.47, 0.75], p < .001). Figure 2 shows a graphic representation of the effect sizes. Heterogeneity was null (Q = 1.61, p > .05), and there was no significant heterogeneity of the effect size around the mean effect (I 2 = 0%).

Table 2 Meta-Analysis Statistical Data. 

Study Comparison Outcome Time Point Std diff in means Standard error 95% Lower limit 95% Upper limit Z P
Lappalainen et al. (2015) ACT vs. WLC BDI-II POST 0.638 0.333 -0.015 1.291 1.916 0.055
Pots et al. (2016) ACT vs. WLC CES-D POST 0.560 0.167 0.233 0.888 3.351 0.001
O'Mahen et al. (2013) BA vs. TAU EPDS POST 0.548 0.110 0.332 0.764 4.976 0.000
O'Mahen et al. (2014) BA vs. TAU EPDS POST 0.654 0.244 0.176 1.132 2.684 0.007
Carlbring et al. (2013) BA+ACT vs. WLC BDI-II POST 0.862 0.237 0.398 1.327 3.641 0.000
Meyer et al. (2009) Deprexis vs. WLC BDI-II POST 0.639 0.157 0.330 0.947 4.058 0.000
0.609 0.070 0.471 0.747 8.659 0.000

Note. ACT = Acceptance and Commitment Therapy; BA = Behavioral Activation; BDI-II = Beck Depression Inventory - II; CES-D Center for Epidemiological Studies - Depression; EPDS = Edinburgh Postnatal Depression Scale; Std diff = Standard difference; TAU = Treatment as Usual; WLC = Wait-List Control.

Figure 2 Forest Plot Graphic for the Selected Studies. Note. CI = Confidence interval; Std diff = Standard difference. 


Nine RCTs that explored the efficacy of a third-wave online intervention for depression have been reviewed. All studies were conducted in northern Europe. Most of the studies tested ACT or BA interventions and used the BDI-II as primary outcome measure. The average duration of the interventions was 8.8 weeks and included a mean of 7.4 modules. The sample sizes varied widely: from 38 (Lappalainen et al., 2014) to 910 participants (O'Mahen et al., 2013). In all the studies included, participants remained anonymous in the virtual platform and their personal information was protected by a username-password system. Also, seven out of nine studies selected delivered the intervention program through a website, which seems to offer more flexibility to monitor the participants' progress and develop the intervention program itself.

All studies reported positive results in terms of the efficacy of third-wave interventions for depression. A meta-analysis was conducted with the six studies that compared the effect of a third-wave intervention for depression against a WLC or TAU. Two studies tested the efficacy of ACT interventions (Lappalainen et al., 2015 ; Pots et al., 2016) and another two studies tested BA (O'Mahen et al., 2013, 2014). The remaining two studies tested a combination of ACT and BA (Carlbring et al., 2013) and a combination of BA, MBCT and CBT (Meyer et al., 2009). Medium to large effect sizes were found across studies (from d = 0.55 to 0.86) and a weighted effect size of d = 0.61. There was very little variability across studies.


Some limitations of the current empirical evidence are worth mentioning. Firstly, previous research on CBT has shown that the type of support moderated the effect sizes for the online interventions. However, due to the limited amount of studies included in the meta-analysis, moderation analyses could not be conducted in this study. Further research might explore this issue and establish what type of support is more adequate for third-wave online interventions for depression. Secondly, few third-wave interventions have been implemented through the Internet, as most of the studies relied on BA and ACT. Further research might explore the feasibility and efficacy of other third-wave approaches and make empirical comparisons among them. Thirdly, all studies were conducted in northern Europe, which hinders the extrapolation of these results to other contexts with different cultures such as Latin Europe, Latin American, or Asian countries. Future research might explore whether third-wave online interventions are efficacious in these contexts, where social connectedness is usually more important (e.g., Allik & Realo, 2004).


The current empirical evidence is supportive of the efficacy of third-wave interventions implemented through the Internet (mostly BA and ACT). The Internet can be a very useful way of delivering psychological interventions due to its easy access and good cost-effectiveness relation. Thus, the design and application of online psychological interventions might contribute to increase mental health and quality of life on a global scale. Further research might explore the efficacy of online third-wave interventions in other geographic zones and cultures. Also, research might investigate the moderator and mediator variables of the third-wave interventions for depression delivered through virtual media.


Este artículo de investigación ha sido financiado a través del Proyecto SEJ 2004-07311/EDUC perteneciente al Plan Nacional de Investigación Científica, Desarrollo e Innovación Tecnológica del Ministerio de Educación y Ciencia, concedido al último autor.


Allik, J., & Realo, A. (2004). Individualism-collectivism and social capital. Journal of Cross-Cultural Psychology, 35, 29-49. [ Links ]

American Psychiatric Association. (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author. [ Links ]

Andersson, G., & Cuijpers, P. (2009). Internet-based and other computerized psychological treatments for adult depression: A meta-analysis. Cognitive Behavior Therapy, 38, 196-205. [ Links ]

Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008). A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. Journal of Technology in Human Services, 26, 109-160. [ Links ]

Barak, A., Klein, B., & Proudfoot, J. (2009). Defining internet-supported therapeutic interventions. Annals of Behavioral Medicine, 38, 4-17. [ Links ]

Beck, A. T., Steer, R. A., & Brown, G. K. (1996). Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation. [ Links ]

Boelen, P. A., De Keijser, J., Van Den Hout,M. A., & Van Den Bout, J. (2007). Treatment of complicated grief: A comparison between cognitive behaviour therapy and supportive counseling. Journal of Consulting and Clinical Psychology, 75, 277-284. [ Links ]

Borenstein, M., Hedges, L. V., Higgins, J. P., & Rothstein, H. R. (2009). Introduction to meta-analysis. Hoboken, NJ: John Wiley & Sons. [ Links ]

Brown, M., Glendenning, A., Hoon, A. E., & John, A. (2016). Effectiveness of web-delivered Acceptance and Commitment Therapy in relation to mental health and well-being: A systematic review and meta-analysis. Journal of Medical Internet Research, 18, e221. doi:10.2196/jmir.6200. [ Links ]

Burns, M. N., Begale, M., Duffecy, J., Gergle, D., Karr, C.J., Giangrande, E., & Mohr, D.C. (2011). Harnessing context sensing to develop a mobile intervention for depression. Journal of Medical Internet Research , 13, e55. doi:10.2196/jmir.1838. [ Links ]

* Carlbring, P., Hägglund, M., Luthström, A., Dahlin, M., Kadowaki, A., Vernmark, K., & Andersson, G. (2013). Internet-based behavioral activation and acceptance-based treatment for depression: A randomized controlled trial. Journal of Affective Disorders, 148, 331-337. doi:10.1016/j.jad.2012.12.020. [ Links ]

Cavanagh, K., Strauss, C., Forder, L., & Jones, F. (2014). Can mindfulness and acceptance be learnt by self-help?: A systematic review and meta-analysis of mindfulness and acceptance-based self-help interventions. Clinical Psychology Review, 34, 118-129. [ Links ]

Childress, C. A. (2000). Ethical Issues in Providing Online Psycho-therapeutic Interventions. Journal of Medical Internet Research , 2, e5. [ Links ]

Cooper, H., Hedges, L. V., & Valentine, J. C. (Eds.) (2009). The handbook of research synthesis and meta-analysis. New York, NY: Russell Sage Foundation. [ Links ]

Cox, J. L., Holden, J. M., & Sagovsky, R. (1987). Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. The British Journal of Psychiatry, 150, 782-786. [ Links ]

Cuijpers, P., Andersson, G., Donker, T., & Van Straten, A. (2011). Psychological treatment of depression: Results of a series of meta-analyses. Nordic Journal of Psychiatry, 65, 354-364. [ Links ]

Dimidjian, S., Arch, J. J., Schneider, R. L., Desormeau, P., Felder, J. N., & Segal, Z. V. (2016). Considering meta-Analysis, meaning, and metaphor: A systematic review and critical examination of "third wave" Cognitive and Behavioral Therapies. Behavior Therapy, 47, 886-905. [ Links ]

Dimidjian, S., Beck, A., Felder, J., Boggs, J., Gallop, R., & Segal, Z. (2014). Web-based Mindfulness-Based Cognitive Therapy for reducing residual depressive symptoms: An open trial and quasi-experimental comparison to propensity score matched controls. Behavior Research and Therapy, 63, 83-89. [ Links ]

Ebert, D. D., Cuijpers, P., Muñoz, R. F., & Baumeister, H. (2017). Prevention of mental health disorders using Internet- and mobile-based interventions: A narrative review and recommendations for future research. Frontiers in Psychiatry, 8, e116. [ Links ]

* Eisma, M., Boelen, P., VanDenBout, J., Stroebe, W., Schut, H., Lancee, J., & Stroebe, M. (2015). Internet-Based Exposure and Behavioral Activation for complicated grief and rumination: A randomized controlled trial. Behavior Therapy, 46, 729-748. [ Links ]

Eysenbach, G. (2001). What is e-health? Journal of Medical Internet Research , 3, e20. doi:10.2196/jmir.3.2.e20. [ Links ]

Felder, J., Segal, Z., Beck, A., Sherwood, N., Goodman, S., Boggs, J., ... Dimidjian, S. (2016). An open trial of web-based Mindfulness-Based Cognitive Therapy for perinatal women at risk for depressive relapse. Cognitive and Behavioral Practice, 24, 26-37. [ Links ]

First, M. B., Gibbon, M., Spitzer, R. L., Williams, J. B. W. (1997). Structured Clinical Interview for DSM-IV Axis I Disorders (SCID-I). Washington, D.C.: American Psychiatric Press. [ Links ]

Hayes, S. C., Strosahl, K. D., & Wilson, K. G. (1999). Acceptance and commitment therapy: An experiential approach to behavior change. New York, NY: Guilford Press. [ Links ]

Hayes, S. C., Villatte, M., Levin, M., & Hildebrandt, M. (2011). Open, aware, and active: Contextual approaches as an emerging trend in the behavioral and cognitive therapies. Annual Review of Clinical Psychology, 7, 141-168. [ Links ]

Hedges, L. V. (1981). Distribution theory for Glass's estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107-128. doi:10.2307/1164588. [ Links ]

Higgins, J., Thompson, S. G., Deeks, J. J., & Altman, D. G. (2003). Measuring inconsistency in meta. British Medical Journal, 327, 557-560. [ Links ]

Jacobson, N. S., & Truax, P. (1991). Clinical significance: A statistical approach to defining meaningful change in psychotherapy research. Journal of Consulting and Clinical Psychology , 59, 12-19. [ Links ]

Kelders, S. M., Pots, W. T., Oskam, M. J., Bohlmeijer, E. T., & van Gemert-Pijnen, J. E. (2013). Development of a web-based intervention for the indicated prevention of depression. BMC Medical Informatics and Decision Making, 13, 26. [ Links ]

Kohlenberg, R. J., & Tsai, M. (1991). Functional analytic psychotherapy: Creating intense and curative therapeutic relationships. New York, NY: Springer. [ Links ]

Kotsopoulou, A., Melis, A., Koutsompou, V. I., & Karasarlidou, C. (2015). E-therapy: The ethics behind the process. Procedia Computer Science, 65, 492-499. [ Links ]

Kroenke, K., Spitzer, R. L., & Williams, J. B. (2001). The PHQ-9. Journal of General Internal Medicine, 16, 606-613. [ Links ]

Krüsche, A., Chylarova, E., & Williams, J.M. (2013). Mindfulness online: An evaluation of the feasibility of a web-based mindfulness course for stress, anxiety and depression. British Medical Journal Open, 3, e003498. [ Links ]

* Lappalainen, P., Granlund, A., Siltanen, S., Ahonen, S., Vitikainen, M., Tolvanen, A., & Lappalainen, R. (2014). ACT Internet-based vs. face-to-face? A randomized controlled trial of two ways to deliver Acceptance and Commitment Therapy for depressive symptoms: An 18-month follow-up. Behavior Research and Therapy , 61, 43-54. [ Links ]

* Lappalainen, P., Langrial, S., Oinas-Kukkonen, H., Tolvanen, A., & Lappalainen, R. (2015). Web-Based Acceptance and Commitment Therapy for depressive symptoms with minimal support: A randomized controlled trial. Behavior Modification, 39, 805-834. [ Links ]

Linehan, M. (1993). Cognitive-behavioral treatment of borderline personality disorder. New York, NY: Guilford Press . [ Links ]

* Ly, H. K., Trüschel, A., Jarl, L., Magnusson, S., Windahl, T., Johansson, R., Andersson, G. (2014). Behavioral activation versus mindfulness-based guided self-help treatment administered through a smartphone application: A randomized controlled trial. British Medical Journal Open , 4, e003440. [ Links ]

Martell, C. R., Addis, M. E., & Jacobson, N. S. (2001). Depression in context: Strategies for guided action. New York, NY: Norton & Co. [ Links ]

* Meyer, B., Berger, T., Caspar, F., Beevers, C., Andersson, J., & Weiss, M. (2009). Effectiveness of a novel integrative online treatment for depression (Deprexis): Randomized controlled trial. Journal of Medical Internet Research , 11, e15. [ Links ]

Moussavi, S., Chatterji, S., Verdes, E., Tandon, A., Patel, V., & Ustun, B. (2007). Depression, chronic diseases, and decrements in health: Results from the World Health Surveys. The Lancet, 370, 851-858. [ Links ]

Murray, G., Leitan, N. D., Berk, M., Thomas, N., Michalak, E., Berk, L., … Kyrios, M. (2015). Online mindfulness-based intervention for late-stage bipolar disorder: Pilot evidence for feasibility and effectiveness. Journal of Affective Disorders , 178, 46-51. [ Links ]

* O'Mahen, H., Richards, D., Woodford, J., Wilkinson, E., McGinley, J., Taylor, R., & Warren, F. (2014). Netmums: A phase II randomized controlled trial of a guided Internet behavioral activation treatment for postpartum depression. Psychological Medicine, 44, 1675-1689. [ Links ]

* O'Mahen, H., Woodford, J., McGinley, J., Warren, F., Richards, D., Lynch, T., & Taylor, R. (2013). Internet-based behavioral activation-Treatment for postnatal depression (Netmums): A randomized controlled trial. Journal of Affective Disorders , 150, 814-822. [ Links ]

Pennebaker, J. W. (1997). Writing about emotional experiences as a therapeutic process. Psychological Science, 8, 162-166. [ Links ]

* Pots, W., Fledderus, M., Meulenbeek, P., Klooster, P., Schreurs, K., & Bohlmeijer, E. (2016). Acceptance and commitment therapy as a web-based intervention for depressive symptoms: Randomised controlled trial. The British Journal of Psychiatry , 208, 69-77. [ Links ]

Prigerson, H. G., & Jacobs, S. C. (2001). Traumatic grief as a distinct disorder: A rationale, consensus criteria, and a preliminary empirical test. In M. S. Stroebe, R. O. Hansson, W. Stroebe, & H. Schut (Eds.), Handbook of bereavement research: Consequences, coping and care (pp. 613-646). Washington, DC: American Psychological Association. [ Links ]

Radloff, L. S. (1977). The CES-D scale: A self-report depression scale for research in the general population. Applied Psychological Measurement, 1, 385-401. [ Links ]

Richards, D., & Richardson, T. (2012). Computer-based psychological treatments for depression: Asystematic review and meta-analysis. Clinical Psychology Review , 32, 329-342. [ Links ]

Segal, Z. V., Williams, M. G., & Teasdale, J. D. (2002). Mindfulness-Based Cognitive Therapy: A new approach to preventing relapse. New York, NY: Guilford Press . [ Links ]

Sheehan, D. V., Lecrubier, Y., Sheehan, K. H., Amorim, P., Janavs, J., Weiller, E., … Dunbar, G. C. L. (1998). The Mini-International Neuropsychiatric Interview (M.I.N.I.): The development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. Journal of Clinical Psychiatry, 59, 22-33. [ Links ]

Spates, C. R., Kalata, A. H., Ozeki, S., Stanton, C. E., & Peters, S. (2013). Initial open trial of a computerized behavioral activation treatment for depression. Behavior Modification , 37, 259-297. [ Links ]

Spek, V., Cuijpers, P., Nyklícek, I., Riper, H., Keyzer, J., & Pop, V. (2007). Internet-based cognitive behavior therapy for symptoms of depression and anxiety: A meta-analysis. Psychological Medicine , 37, 319-328. [ Links ]

Spijkerman, M. P. J., Pots, W., & Bohlmeijer, E. T. (2016). Effectiveness of online mindfulness-based interventions in improving mental health: A review and meta-analysis of randomized controlled trials. Clinical Psychology Review , 45, 102-114. [ Links ]

Thompson, N. J., Walker, E. R., Obolensky, N., Winning, A., Barmon, C., Dilorio, C., & Compton, M. T. (2010). Distance delivery of mindfulness-based cognitive therapy for depression: Project UPLIFT. Epilepsy & Behavior, 19, 247-254. [ Links ]

Van Spijker, B., Van Straten, A., & Kerkhof, J. (2014). Effectiveness of online self-help for suicidal thoughts: Results of a randomised controlled trial. PLOS One, 9, e90118. [ Links ]

Van Spijker, B., Van Straten, A., & Kerkhof, J. (2015). Online self-help for suicidal thoughts: 3-month follow-up results and participant evaluation. Internet Interventions, 2, 283-288. [ Links ]

Watkins, E (2016). Rumination-focused cognitive-behavioral therapy for depression. New York, NY: Guilford Press . [ Links ]

Wells, A. (2009). Metacognitive therapy for anxiety and depression. New York, NY: Guilford Press . [ Links ]

World Health Organization (1992). The ICD-10 classification of mental and behavioral disorders: Clinical descriptions and diagnostic guidelines. Geneva, Switzerland: World Health Organization. [ Links ]

World Health Organization (2008). The global burden of disease: 2004 update. Geneva, Switzerland: Author. [ Links ]

World Health Organization (2011). Mental Health Atlas 2011. Geneva, Switzerland: Author . [ Links ]

World Health Organization (2016). World Health Statistics 2016: Monitoring health for the SDGs, sustainable development goals. Geneva, Switzerland: Author . [ Links ]

Received: June 18, 2017; Accepted: January 19, 2018

* Autor para correspondencia. Correo electró

Creative Commons License This is an open-access article distributed under the terms of the Creative Commons Attribution License