You are on page 1of 13

Arch Womens Ment Health (2011) 14:465477

DOI 10.1007/s00737-011-0240-4

ORIGINAL ARTICLE

Efficacy of cognitive behavioral internet-based therapy


in parents after the loss of a child during pregnancy:
pilot data from a randomized controlled trial
Anette Kersting & Kristin Kroker & Sarah Schlicht &
Katja Baust & Birgit Wagner

Received: 24 February 2011 / Accepted: 25 September 2011 / Published online: 18 October 2011
# Springer-Verlag 2011

Abstract The loss of a child during pregnancy can be a help to improve the health care provision for mothers in this
traumatic event associated with long-lasting grief and traumatic loss situation.
psychological distress. This study examined the efficacy
of an internet-based cognitive behavioral therapy program Keywords Pregnancy loss . Posttraumatic stress .
for mothers after pregnancy loss. In a randomized con- Depression . Therapy . Randomized controlled trial
trolled trial with a waiting list control group, 83 participants
who had lost a child during pregnancy were randomly
allocated either to 5 weeks of internet therapy or to a 5- Introduction
week waiting condition. Within a manualized cognitive
behavioral treatment program, participants wrote ten essays Although often not openly discussed, the loss of a child
on loss-specific topics. Posttraumatic stress, grief, and during pregnancy is a relatively common experience.
general psychopathology, especially depression, were Various adverse pregnancy outcomes can lead to miscar-
assessed pretreatment, posttreatment, and at 3-month riage in early or later pregnancy to termination of
follow-up. Intention-to-treat analyses and completer analy- pregnancy due to fetal anomalies or to stillbirth. An
ses were performed. Relative to controls, participants in the estimated 15% of clinically recognized pregnancies and
treatment group showed significant improvements in up to 50% of all pregnancies end in miscarriage (Geller
posttraumatic stress, grief, depression, and overall mental et al. 2010; Gold et al. 2007), and stillbirth occurs in up to
health, but not in anxiety or somatization. Medium to large 1% of all births (Gold et al. 2007). Prenatal diagnosis of
effect sizes were observed, and the improvement was multiple fetal anomalies often results in the termination of
maintained at 3-month follow-up. This internet-based pregnancy (Kramer et al. 1998; Mansfield et al. 1999).
cognitive behavioral therapy program represents an effec- Many women experience severe psychological distress
tive treatment approach with stable effects for women after following pregnancy loss (Berth et al. 2008). Studies have
pregnancy loss. Implementation of the program can thus shown that the loss of a child during pregnancy or shortly
after birth can lead to long-lasting grief (Brier 2008;
Kersting et al. 2007) and manifest psychiatric disorders
Anette Kersting and Kristin Kroker contributed equally to this work (Kersting et al. 2007; Klier et al. 2000; Neugebauer et al.
and should both be considered first author.
1997). Women have an increased risk of an affective
A. Kersting (*) : B. Wagner disorder in the first 6 months after miscarriage (Klier et al.
Department of Psychosomatic Medicine, University of Leipzig,
2000; Neugebauer et al. 1997). In particular, women who
Semmelweisstr 10,
04103 Leipzig, Germany have experienced a late miscarriage are at higher risk for a
e-mail: anette.kersting@medizin.uni-leipzig.de depressive disorder than women with healthy children, even
years later (Cougle et al. 2003). Post-loss depression is
K. Kroker : S. Schlicht : K. Baust
often higher in mothers than in fathers (Klier et al. 2002),
Department of Psychiatry, University of Muenster,
Albert-Schweitzer Str 11, with fathers showing less intense reactions (Badenhorst
48145 Muenster, Germany et al. 2006; Vance et al. 1995). In terms of anxiety
466 A. Kersting et al.

disorders, the risk of posttraumatic stress disorder (PTSD) years, however, the internet has emerged as a useful source of
is particularly elevated in women after pregnancy loss information and support for parents in this situation
(Engelhard et al. 2001; Kersting et al. 2007); these women especially when guided search functions are available (Geller
show a high degree of traumatic symptoms, comparable et al. 2006). A wealth of internet-based mental health services
with those who experienced after other severe traumatic now exist, ranging from pure information sites to virtual self-
events (Kersting et al. 2009a; Korenromp et al. 2007) and, help groups, automatized self-help programs, counseling,
in some cases, persisting even years later (Kersting et al. and even psychotherapy for all kinds of mental health
2005; Korenromp et al. 2009). General symptoms of problems (Kersting et al. 2009b). In particular, internet-based
anxiety are also known to increase after pregnancy loss treatments for depression (Andersson and Cuijpers 2009) and
(Brier 2004; Geller et al. 2004). anxiety disorders (Andersson 2009) such as posttraumatic
Furthermore, the experience of pregnancy loss may stress disorder (Lange et al. 2000b, 2003; Litz et al. 2007)
affect subsequent pregnancies: in a prospective study, have been investigated in randomized controlled studies and
Bergner et al. (2008) found that early miscarriage was proved effective, with moderate to large effect sizes.
associated with increased anxiety and depressive symptoms In view of findings demonstrating the efficacy of an internet-
in the subsequent pregnancy. Another study showed that based treatment program for PTSD (Knaevelsrud and
29% of women developed a posttraumatic stress disorder in Maercker 2007; Lange et al. 2003), Wagner et al. (2006)
the pregnancy following a stillbirth (Turton et al. 2001). adapted a cognitive behavioral therapy program for compli-
Despite the increasing recognition that many women cated grief for the internet and evaluated its efficacy. Results
experience serious and lasting psychological problems after showed that participants benefited from the intervention, with
pregnancy loss, womens dissatisfaction with aspects of the significant decreases (of large effect sizes) in traumatic stress
health care received in this situation is less recognized. In response and grief as well as in depressive symptoms and
their recent review, Geller et al. (2010) focused on anxiety. A recent evaluation of a brief internet-based self-help
satisfaction with pregnancy loss aftercare, especially in writing intervention for bereaved people without therapist
women after early miscarriage. They found that the typical responses (van der Houwen et al. 2010) showed decreased
treatment does not include specific psychosocial aftercare feelings of emotional loneliness and increased positive mood,
and that many women reported insufficient emotional but no effects on grief or depressive symptoms.
acknowledgment of their loss, provision of information, Given the success of the internet-based cognitive behavioral
and involvement in treatment decisionsall factors that are treatment approaches for posttraumatic stress disorder (Lange
associated with higher levels of satisfaction with aftercare et al. 2000b) and complicated grief (Wagner et al. 2005,
(Geller et al. 2010). 2006), the treatment protocol for complicated grief (Wagner
To date, there have been few controlled studies of et al. 2006) was adapted for mothers after pregnancy loss,
psychological support and counseling services targeting which specifically addressed problems and needs of this
parents after pregnancy loss. In a randomized controlled trial, population. To evaluate its efficacy, we assessed a broad
Nikcevic et al. (2007) investigated the influence of medical range of symptoms: posttraumatic stress, grief, depression,
and psychological interventions on womens distress after and general psychopathology in terms of overall mental
miscarriage and found psychological counseling to have health, anxiety, and somatization. Our hypotheses were that
beneficial effects on grief and worry over and above medical mean posttraumatic stress, grief, depression, and overall
investigations and consultations. Swanson et al. (2009) mental health scores would (1) show a significantly greater
examined couples-focused interventions in a randomized decrease from pre- to posttest in the treatment group (TG) than
controlled trial. They compared the effects of three counsel- in the waiting list control group (WLC) and (2) remain stable
ing sessions with a nurse, self-caring, a combination of nurse from posttreatment to 3-month follow-up in the TG.
and self-caring, and a control condition with no intervention.
The nurse caring condition proved more effective than any
other condition in accelerating womens resolution of Method
depression. Interestingly, the nurse caring condition and the
no treatment condition proved more effective than the other Participants
conditions in resolving mens depression. Neugebauer et al.
(2007) investigated telephone-administered interpersonal The internet-based cognitive behavioral therapy was directed
counseling for women with subsyndromal depression after at mothers who had lost a child during pregnancy through
miscarriage; in this small open trial, they observed a decrease miscarriage, termination of pregnancy due to fetal anomaly, or
in depressive symptoms. stillbirth. All participants were self-referrals. Further inclusion
Hence, pregnancy loss is a neglected health care area in criteria for participating were: living in a German-speaking
which psychosocial support is often lacking. In recent country, being a German native speaker, having access to the
Internetbased-therapy after pregnancy loss 467

internet, and signing informed consent. We implemented an other exclusion criteria (current pregnancy, in psychotherapy,
extensive screening procedure using validated instruments to age under 18 years, lost the child after birth, and not living in
rule out serious mental health problems: applicants with a German-speaking country). A further 28 women (37%)
severely depressed mood and suicidal tendencies (BSI, declined participation without giving specific reasons or were
subscale depression of the Brief Symptom Inventory; Derogatis nonresponsive. From the excluded applicants, seven received
1993), dissociative tendencies (Somatoform Dissociation psychopharmacological medication (five antidepressants and
Questionnaire; Nijenhuis et al. 1997), risk of psychosis two benzodiazepines), whereas only one participant of the
(SDPD, German translation of the Dutch Screening Device study received benzodiazepines. A total of 83 women eligible
for psychotic disorder; Lange et al. 2000a), and substance for participation gave their informed consent and were
abuse and dependence (questions about consuming behavior included in the study. The study protocol was approved by
on alcohol and other drugs) were contacted via telephone and the respective local ethical committees and was conducted in
excluded when severity of symptoms was confirmed in the accordance with the Declaration of Helsinki ethical standards
relevant section of the Structured Clinical Interview for (Ethik-Kommission der rztekammer Westfalen-Lippe und
DSM-IV (First et al. 1997) interview. These applicants were der Medizinischen Fakultt der Westflischen Wilhelms
advised on appropriate treatment and given help to find Universitt Mnster: http://www.campus.uni muenster.de/
treatment, if requested. Further exclusion criteria were ethikkommission.html).
pregnancy at treatment allocation, psychotherapy at treatment
allocation, and age under 18 years. Between October 2007 Design
and July 2008, 159 women completed our screening ques-
tionnaires. Of these, 48 were excluded: 19 (25%) had serious The 83 participants were randomly allocated to either the
mental health problems (severely depressed mood, dissocia- treatment condition (TG) or the WLC (for demographic and
tive tendencies, and risk of psychosis) and 29 (38%) met the obstetric characteristics see Table 1). Outcome measures

Table 1 Demographic and obstetric details of the study sample with test statistics

Study sample Internet therapy TG WLC Test statistic p value


(N=78) (N=45) (N=33)

Mean age in years, M (SD) 34.3 (5.34) 34.1 (5.34) 34.5 (5.42) 0.270a 0.788, n.s.
Married/cohabiting, N (%) 75 (96.2) 43 (96) 32 (97) 0.103b 0.748, n.s.
Education, N (%) 2.821c 0.244, n.s.
Low 7 (9.0) 6 (13.3) 1 (3)
Medium 35 (44.9) 18 (40.0) 51.417 (51.5)
High 36 (46.2) 21 (46.7) 15 (45.5)
Years of education, M (SD) 16.3 (2.86) 16.0 (2.95) 16.8 (2.71) 1.111a 0.270, n.s.
Obstetric data
Kind of loss, N (%) 0.355d 0.949, n.s.
Early miscarriage 40 (51.3) 23 (51.1) 17 (51.5)
Late miscarriage 13 (16.7) 8 (17.8) 5 (15.1)
TOP due to fetal anomaly 10 (12.8) 5 (11.1) 5 (15.2)
Stillbirth 15 (19.2) 9 (20.0) 6 (18.2)
Gestational week, M (SD), [range] 17.8 (9.66), [240] 18.7 (9.80), [740] 16.7 (9.49), [238] 608.00e 0.312, n.s.
Time since loss in months, M (SD), [range] 15.4 (27.40), [1144] 9.6 (12.68), [160] 23.5 (38.84), [1144] 531.50e 0.103, n.s.
Miscarriage before, N (%) 26 (33.3) 14 (31.1) 12 (36.4) 0.236b 0.627, n.s.
TOP before, N (%) 4 (5.1) 2 (4.4) 2 (6.1) 0.102b 0.749, n.s.
Stillbirth before, N (%) 2 (2.6) 1 (2.2) 1 (3.0) 0.050b 0.823, n.s.
Having living children, N (%) 45 (57.7) 28 (62.2) 17 (51.5) 0.894b 0.344, n.s.

TOP termination of pregnancy, WLC waiting list control group, TG treatment group
a
Two-tailed t test
b
Pearson chi-square, 22 table, df=1
c
Pearson chi-square, 32 table, df=2
d
Pearson chi-square, 42 table, df=3
e
MannWhitney U test
468 A. Kersting et al.

were posttraumatic stress, grief, overall mental health, traumatic event has proven to be an important element of
depressive and anxious symptoms, and somatization. Data effective psychotherapy for PTSD. Confrontation has been
were collected pre- and posttreatment and 3 months after found to significantly reduce avoidance behavior. Given the
completion of the internet-based therapy. Subjects in the similarity of some symptoms of complicated grief disorder
waiting list condition were subsequently invited to participate to those of PTSD, it is conceivable that cognitive
in the internet-based intervention. behavioral treatments designed for PTSD (Foa and Jaycox
1999) might show similar symptom reductions among
Measures individuals with complicated grief. Based on this rationale,
an internet-based cognitive behavioral treatment program
The demographic and obstetric data collected included age, for complicated grief (Wagner et al. 2005, 2006) was
marital status, education, kind of loss, gestational week, specifically adapted to the needs of mothers after loss of a
time since loss, previous pregnancy outcomes, and having child during pregnancy (see Kersting et al. 2011 for further
living children. Posttraumatic stress reactions were assessed details of the treatment protocol.)
using the Impact of Event Scale (IES; Horowitz et al. The program comprised three phases, in which participants
1979). This instrument is widely used to assess two wrote a total of ten assignments. In the first phase of self-
categories of responses to major life events: intrusive confrontation, they wrote four assignments describing the
experiences and avoidance of thoughts and images associated traumatic loss and its circumstances. In the second phase of
with the event. The scales 15 items assess frequency of cognitive restructuring, they wrote a further four assign-
symptoms over the past 7 days on a four-point measurement ments, framed as a supportive letter to a hypothetical friend
scale (Horowitz et al. 1979). The IES is a reliable index that with the aim of providing new perspectives on the loss. The
indicates the degree of subjective distress associated with a third and final phase of social sharing focused on a symbolic
specific trauma and has good psychometric properties farewell letter (two assignments) that participants could
(Sundin and Horowitz 2002). In the present study, address to themselves, to a person connected with the loss,
participants were instructed to relate the IES items specifi- or to a loved one. Each writing assignment lasted 45 min and
cally to the loss of their child. Internal consistency in our took place at regular and scheduled times. Twice in each
sample was good (=0.87). phase, the therapist providedwithin one working day
The extent of grief was assessed using the Inventory of individual written feedback along with instructions on the
Complicated Grief (ICG; Prigerson et al. 1995). This scale next writing assignment.
is designed to assess a wide range of cognitions, emotions,
and behaviors describing a grief reaction. Participants Procedure
responded to the 15 items on a five-point measurement
scale. The ICG has been shown to have good psychometric Participants were informed through newspaper articles
properties (Cronbachs =0.94, testretest reliability=0.80, about the program, information posted on related
Prigerson et al. 1995). Internal consistency in our sample internet pages, and information published on our own
was good (=0.89). website. Information flyers on the program were
General psychopathology and depression were measured distributed in five cooperating centers and in associated
using the well-validated BSI (Derogatis 1993), a psycho- clinics and medical surgeries. The first contact was
logical self-report symptom scale. The 53-item scale initiated by applicants via our website or email contact;
records the experience of physical and psychological hence, all participants were self-referrals. The applicants
symptoms over the past 7 days. The BSI provides several were first asked to complete the screening question-
indices, including the Global Severity Index of overall naires, which assessed demographic and obstetric data
mental health and indices for the subscales of depression, as well as information about the exclusion criteria.
anxiety, and somatization. The internal consistency in our Applicants excluded for mental health reasons were
sample was excellent (=0.94). advised to attend psychiatric and/or psychotherapeutic
face-to-face treatment in their local region and were
Intervention delivered with information how and where to find
treatment. Women who were currently pregnant were
Interventions involving cognitive behavioral components in encouraged to contact the treatment team for specific
bereavement interventions have shown treatment efficacy advice. Applicants eligible for the program were
(Boelen et al. 2007; Shear et al. 2005; Wittouck et al. informed about the therapy concept and the study
2011). In parallel, the effectiveness of cognitive behavioral protocol. An informed consent was given prior to
therapy for PTSD has been well documented (Bradley et al. inclusion in the study. The participants were then
2005). Confrontation with difficult memories of the allocated to the TG or the WLC by means of block
Internetbased-therapy after pregnancy loss 469

randomization using a random number table retrieved Results


from http://ts.nist.gov/WeightsAndMeasures/Publications/
upload/h133_appenb.pdf. Attrition
Participants then completed the baseline (pretreatment)
questionnaires. The duration of both the treatment and the Of the 83 participants initially randomized, 5 had to be
waiting list condition was 5 weeks. All participants (TG excluded from the intervention after randomization4
and WLC) completed the posttreatment questionnaire, and because they became pregnant and 1 because of serious
participants in the TG additionally completed a 3-month illness. Of the remaining 78 participants, 59 (76%)
follow-up assessment. The participants in the WL condition completed the intervention and posttreatment assessment.
were invited to begin the internet-based writing therapy The response rates in the control group (WLC, 79%; n=26)
immediately after the posttest. and the intervention group (TG, 72%; n=33) did not differ
significantly, chi(1) = 0.307, p = 0.579. Of those who
Data analysis dropped out (n=19), 12 (63%) were nonresponsive, 2
(11%) withdrew because they no longer needed support, 2
We tested for group differences in demographic and (11%) did not have enough time, 2 (11%) described writing
obstetric information using Chi-square tests, t tests, or as the wrong approach, and 1 (5%) no longer had internet
nonparametric tests as appropriate. On the variables mean access. Of the treatment group, nine participants dropped
posttraumatic stress, grief, depression, anxiety, somatization out in the first phase of treatment and three in the second
and overall mental health (BSI sum score), we performed phase. The participants who dropped out did not differ from
2 2 repeated measures analysis of variances (RM- participants who completed the intervention and posttreat-
ANOVAs) with the within-subjects factor time (pre- vs. ment assessment on any of the demographic or obstetric
posttest) and the between-subjects factor treatment (therapy variables except time since loss, which was significantly
vs. waiting list). The focus of this analysis was on the longer for those who dropped out (M=33.2 months, SD=
interaction effect treatment time. Stability of mean 44.05) than for completers (M=10.1 months, SD=17.59),
posttraumatic stress, grief, depression, anxiety, somatiza- U(76) = 285.00, p= 0.008. In particular, no significant
tion, and overall mental health (BSI sum score) from differences were found between completers and drop outs
posttest to 3-month follow-up in the TG was tested with in any of the baseline measures: posttraumatic stress,
planned pairwise t tests. t(73)=0.604, p=0.548; grief, t(74)=0.111, p=0.912; over-
A priori power calculations performed with G*Power all mental health, t(75) = 0.394, p = 0.695; depression,
3.0.10 (Buchner et al. 1997) indicated that a sample size t(75) = 0.332, p = 0.741; somatization, t(75) = 0.386,
of 34 participants per group would provide a power of p=0.701; and anxiety, t(75)=0.678, p=0.500. Figure 1
0.85 to detect a moderate improvement of 0.5 in mean summarizes the study enrollment flow.
scores of posttraumatic stress after treatment at a signif-
icance level of 0.05. Taking an intention-to-treat (ITT) Demographic and obstetric data
approach, we conducted RM-ANOVAs and paired t tests
for all initial participants on the basis of the last Following randomization, there were no significant
observation carried forward principle; in case of non- differences between the two groups in any of the
completers, pretreatment scores were carried forward to demographic or obstetric data obtained (Table 1). In
replace the missing values (TG, n=45; WL, n=33). In particular, no significant baseline differences were found
addition, we performed a per protocol (PP) analysis, between TG and WLC in any of the symptom categories
conducting the same analyses on only those participants (Table 2, p values ranging from 0.324 to 0.765).
who completed the therapy program (TG, n=33; WL,
n=26). All analyses were conducted using SPSS (version Efficacy of treatment
17.0.0 for Windows) with a significance level of 0.05.
Effect sizes were calculated as Cohens d (Cohen 1992) To evaluate the efficacy of the internet-based therapy
considering dependent and independent group relations. program, we ran RM-ANOVAs on both an ITT dataset
We present effect sizes for changes within each group as and a PP dataset. Data on symptom levels are given in
well as effect sizes between the two groups, which reflect Table 2. Figure 2 illustrates findings for posttraumatic stress
the additive effect of the internet therapy relative to across time. Time had a significant main effect on all
waiting (Cohen 1992; Dunlap et al. 1996). Guidelines for symptom categories (in the following, we report the ITT
interpreting effect magnitude are as follows: 0.20 = small analyses): posttraumatic stress, F(1, 76)=28.084, p<0.001;
effect, 0.50 = medium effect, and 0.80 = large effect grief, F(1, 76)=22.330, p<0.001; and overall mental health
(Cohen 1992). (BSI sum score), F(1, 76)=20.152, p<0.001. Moreover,
470 A. Kersting et al.

Fig. 1 Study enrolment flow


159 potential participants
assessed for eligibility

76 excluded
19 mental health problems
29 met exclusion criteria
17 declined
11 non-responsive

83 Randomized

48 Randomized to receive 35 Randomized to receive


internet treatment (TG) waiting-list-control (WLC)
3 excluded because of pregnancy 1 excluded because of pregnancy
1 excluded because of serious
illness
45 started intervention 33 started intervention

12 Drop outs 7 Drop outs


9 non-responsive 3 non-responsive
1 no more time 2 no support needed
1 no internet-access 1 no more time
1 writing not adequate 1 writing not adequate

33 Completed 26 Completed
postassessment postassessment

4 Lost to
follow-up

29 Completed
3 months follow-up

time had a significant effect on all BSI subscales: depression, are given in Table 3. A significant group time interaction
F(1, 76)=15.502, p<0.001; somatization, F(1, 76)=6.181, p effect emerged for posttraumatic stress, indicating that
=0.015; and anxiety, F(1, 76)=6.203, p=0.015. In contrast, improvement from pretest to posttest was significantly
group did not have a significant main effect on any of the higher in the treatment group than in the waiting list control
symptom categories or subscales: posttraumatic stress, group, F(1, 76)=6.682, p=0.012. Only posttraumatic stress
F(1, 76)=2.781, p=0.099; grief, F(1, 76)=3.133, p=0.081, changed in the WLC group over the waiting period.
overall mental health, F(1, 76)=0.344, p=0.559; depression, Although the change failed to reach significance in the
F(1, 76)=0.284, p=0.596, somatization F(1, 76)=0.577, p= ITT analysis, it was significant in the PP analysis, as shown
0.450; and anxiety, F(1, 76)=0.042, p=0.839. In the by planned post hoc t tests (see Table 4). Nevertheless,
following, the interaction effects group time are presented changes in the treatment group were significantly higher
separately for all variables. than in the waiting list control group, as indicated by the
significant group time interaction effect in the
Posttraumatic stress The results of the group time RM-ANOVA and a medium effect size between the groups
interaction effects of the RM-ANOVAs for both datasets of dbetween =0.56.
Internetbased-therapy after pregnancy loss 471

Table 2 Means and standard


deviations on symptom levels Score range Pretreatment Posttreatment 3 months follow-up
(pre- and posttreatment and
3 months follow-up) Mean SD Mean SD Mean SD

Traumatic stress. 075


Therapy 33.1 13.21 17.9 12.36 19.1 14.54
Waiting 34.6 11.39 27.9 10.92
Grief 1575
Therapy 39.5 9.89 30.1 8.78 30.5 11.52
Waiting 38.2 9.30 36.5 9.30
Mental health 04
Therapy 0.99 0.59 0.44 0.40 0.39 0.40
Waiting 0.88 0.58 0.75 0.53
Depression 04
Therapy 1.28 0.85 0.47 0.49 0.52 0.74
Waiting 1.00 0.74 0.99 0.85
Somatization 04
Therapy 0.52 0.57 0.24 0.32 0.17 0.22
Waiting 0.71 0.93 0.53 0.59
Anxiety 04
Therapy 0.92 0.79 0.53 0.82 0.40 0.56
Waiting 0.92 0.90 0.70 0.63

Grief The reduction in grief was significantly higher in the significant improvements in anxiety and somatization
treatment group than in the waiting list control group, as (see Table 4), these changes did not differ significantly
indicated by the significant group time interaction effect from those seen in the WLC group, as reflected by the
on grief, F(1, 76)=11.329, p=0.001, dbetween =0.68. There nonsignificant group time interaction effects: anxiety,
was no significant change in grief in the waiting list F(1, 76)=0.834, p=0.364 and somatization, F(1, 76)=
condition (see Table 4). 0.570, p=0.453. The analyses of the PP dataset revealed an
identical pattern of results and almost identical outcomes
General psychopathology There were significant group for all symptom categories (see Table 3).
time interaction effects on overall mental health (BSI sum
score), F(1, 76)=8.635, p=0.004, dbetween =0.46, which is
attributable to a significant interaction effect on the BSI Covariates
subscale depression, F(1, 76)=16.621, p<0.001, dbetween =
0.53, with the treatment group showing a significant Of the demographic and obstetric variables, time since loss
improvement from pre- to posttreatment and significantly was the only variable that differed substantially, though not
higher changes than those observed in the waiting list significantly, across the two groups (TG and WLC). Hence,
control group. Although the treatment group showed the time since loss was included as a covariate in the
RM-ANOVA. All interaction effects on all symptom catego-
Traumatic stress TG
ries in both analyses (ITT and PP) remained significant when
WLC
50 time since loss was controlled (see Table 3).

40 Reliable change

30
The reliable change index (Jacobson and Truax 1991) was
calculated to statistically determine a reliable change in
20
response to the internet-based intervention. Compared to
the waiting list, the treatment group showed a reliable
10
improvement on the outcome measures posttraumatic stress
pre post follow-up
and the subscale depression of the BSI (ITT and PP) and on
Fig. 2 Psychopatholocial symptoms across time grief and overall mental health (PP only, see Table 5).
472 A. Kersting et al.

Table 3 Test statistics of interaction effects of group time (pre- and posttreatment) and estimated between-groups effect sizes on all symptom
categories

ITT RM-ANOVAa PP RM-ANOVAb ITT RM-ANCOVA PP RM-ANCOVA

F(1, 76) p value dbetweenc F(1, 57) p value dbetweenc F p value F p value

Traumatic stress 6.682 0.012* 0.56 6.472 0.014* 0.86 4.275 0.042* 5.751 0.020*
Grief 11.329 0.001** 0.69 13.020 0.001** 0.71 8.320 0.005** 11.287 0.001**
Mental health 8.635 0.004** 0.46 10.698 0.002** 0.66 6.202 0.015* 8.620 0.005**
Depression 16.621 <0.001** 0.53 20.727 <0.001** 0.75 13.396 <0.001** 17.752 <0.001**
Somatization 0.570 0.453, n.s. 0.416 0.520, n.s. 0.171 0.680, n.s. 0.196 0.660, n.s.
Anxiety 0.834 0.364, n.s. 0.664 0.419, n.s. 0.388 0.536, n.s. 0.420 0.520, n.s.

ITT intention-to-treat, PP per protocol, RM-ANOVA repeated measures analysis of variance, ANCOVA analysis of covariance
*p<0.05, **p<0.01, significance of change
a
Test statistic for interaction of time condition in the RM-ANOVAs on ITT data set
b
Test statistic for interaction of time condition in the RM-ANOVAs on the PP data set
c
Effect size dbetween for between groups (Dunlap et al. 1996)

Three-month follow-up symptoms of posttraumatic stress and grief were signifi-


cantly lower after 5 weeks of internet-based therapy,
Planned paired t tests showed that improvements persisted intraindividually compared with pretreatment symptoms
at 3-month follow-up: posttraumatic stress, t(44)=0.564, and interindividually compared with a waiting list condi-
p=0.576; grief, t(44)=0.241, p=0.811; overall mental tion. Furthermore, overall mental health and depression
health, t(44)=0.760, p=0.451; depression, t(44)=0.723, were significantly improved after the treatment. The
p=0.473; anxiety t(44)=1.141, p=0.260; and somatization, symptom categories of posttraumatic stress, grief, and
t(44)=0.942, p=0.351. The analyses of the PP dataset depression can be directly related to the experience of the
revealed an identical pattern of results and almost identical loss and are thus labeled core loss-related symptoms. As
outcomes for all symptom categories. Details are given in significantly higher improvements in all of these symptoms
Table 4. were observed in the treatment group than in the waiting
list control group, these effects can evidently not be
Effect sizes explained by spontaneous remission, but reflect treatment-
related effects. This finding is in line with prior studies,
In the treatment group, pre-/posttreatment effect sizes which have repeatedly found that these symptoms may
(Cohens d) for the core symptoms ranged from d=0.66 improve over time, but do not vanish completely without
to d=0.84 in the ITT dataset, indicating medium to high treatment. On the contrary, numerous studies have shown
effects, and from d=0.93 to d=1.15 in the PP dataset high persistence and clinical relevance of the symptoms of
(Table 4), indicating high effects. In the WLC group, only traumatic stress (Engelhard et al. 2001; Kersting et al. 2005;
posttraumatic stress showed a medium effect size of d=0.32 Korenromp et al. 2009), grief (Brier 2008; Kersting et al.
in the ITT dataset (PP, d=0.59). We calculated additive 2009a), depression, and anxiety (Brier 2004; Carter et al.
effect sizes of internet treatment relative to waiting that 2007; Klier et al. 2002).
ranged from d=0.66 to d=0.86 for the core symptoms, For the more general, not loss-related symptom categories,
indicating medium to large effects. The details are given in such as anxiety and somatization, there was no additive effect
Tables 3 and 4. of the treatment relative to waiting. Hence, the improvements
observed in core loss-related symptoms do not reflect general
treatment effects on psychological well-being, but can be
Discussion and conclusion interpreted as a differential effect of this cognitive behavioral
intervention program. The only symptom level that changed
In this pilot study, we investigated the efficacy of an significantly over the waiting time of 5 weeks was traumatic
internet-based cognitive behavioral therapy program for stress; this result was in line with prior findings (Carter et al.
mothers after the loss of a child during pregnancy. We 2007; Engelhard et al. 2001).
found significant improvements in posttraumatic stress and The improvements observed in core symptoms remained
grief as the main outcomes after treatment. Self-reported stable at 3-month follow-up, indicating at least short-term
Table 4 Planned post hoc tests on ITT sample and on PP sample pre- to posttreatment and posttreatment to follow-up and within-groups effect sizes

ITT pre- to posttreatmenta PP pre- to posttreatmentb ITT posttreatment to 3-months follow-up PP posttreatment to FU
Internetbased-therapy after pregnancy loss

t p value dwithinc t p value dwithinc t p value dwithinc t p value dwithinc

Traumatic stress Therapy 5.734 <0.001** 0.84 6.691 <0.001** 1.15 0.564 0.576, n.s. 0.05 0.561 0.580, n.s. 0.10
Waiting 1.951 0.06, n.s. 0.34 2.980 0.007** 0.59
Grief Therapy 5.253 <0.001** 0.72 5.954 <0.001** 0.95 0.241 0.811, n.s. 0.02 0.239 0.813, n.s. 0.05
Waiting 1.529 0.137, n.s. 0.11 1.704 0.103, n.s. 0.18
Mental health Therapy 5.410 <0.001** 0.64 6.201 <0.001** 0.93 0.760 0.451, n.s. 0.05 0.758 0.455, n.s. 0.12
Waiting 1.123 0.270, n.s. 0.07 1.308 0.203, n.s. 0.22
Depression Therapy 5.622 <0.001** 0.68 6.514 <0.001** 0.95 0.723 0.473, n.s. 0.05 0.721 0.477, n.s. 0.10
Waiting 0.111 0.913, n.s. 0.05 0.056 0.956, n.s. 0.01
Somatization Therapy 3.291 0.002* 0.25 3.435 0.002** 0.49 0.942 0.351, n.s. 0.04 0.942 0.354, n.s. 0.22
Waiting 0.901 0.375, n.s. 0.08 1.174 0.252, n.s. 0.19
Anxiety Therapy 2.402 0.021* 0.32 2.451 0.020* 0.49 1.141 0.260, n.s. 0.11 1.143 0.263, n.s. 0.16
Waiting 1.222 0.231, n.s. 0.10 1.697 0.103, n.s. 0.24

ITT Intention to treat, PP per protocol, FU follow-up


*p<0.05, **p<0.01, significance of change
a
Test statistic for planned post hoc t test on ITT data set
b
Test statistic for planned post hoc t test on the PP data set
c
Effect size dwithin for within groups (Cohen 1992)
473
474 A. Kersting et al.

Table 5 Percentage of participants showing reliable change (RC) at posttest on all symptom categories

ITT PP

Therapy Waiting Chi Therapy Waiting Chi

Traumatic stress 62 36 5.096* 82 42 9.903**


Grief 53 36 2.206 67 39 10.470**
Mental health 51 30 2.656 70 39 5.756*
Depression 51 24 5.739* 70 31 8.838**
Somatization 24 24 0.0 39 27 1.009
Anxiety 31 27 0.034 42 31 0.845

RC computed using the formula (x2 x1)/SDiff (Jacobson and Truax 1991)
ITT intention-to-treat, PP per protocol
*p<0.05, **p<0.01, significance of change

stability of treatment effects, although there was no further Note that the target population of women after pregnancy
therapeutic support apart from the follow-up assessment. loss does not share a diagnosis of a specific psychiatric
This finding is in line with previous results showing that disorder, but is a homogenous group of women across a rather
grief-related symptom reduction was maintained at 1.5-year broad age range with one shared experience: a traumatic
follow-up (Wagner and Maercker 2007). Hence, the pregnancy loss. As described in the Introduction section,
intervention program proved to be effective in decreasing many of these women experience severe psychological
symptoms and normalizing distress, and the short-term distress (Kersting et al. 2009a; Klier et al. 2002; Korenromp
stability of treatment effects indicates that this approach et al. 2007, 2009) and are at increased risk of psychiatric
may help to prevent the subsyndromal states that occur after disorders (Engelhard et al. 2001; Kersting et al. 2007;
pregnancy loss from developing into complicated grief or Neugebauer et al. 1997). The impact of the traumatic loss
other psychiatric disorders, as has been reported in several event in our sample was comparable to the values observed
studies (Engelhard et al. 2001; Kersting et al. 2007; in other study samples being confronted with an extraordi-
Neugebauer et al. 1997). Hence, the significant and stable nary traumatic life events, for instance sexual abuse, violence
decreases observed in core loss-related symptoms relative and assault, or natural disaster (Sundin and Horowitz 2002).
to the waiting list condition reflect differential, additive, According to Neal et al. (1994), the level of posttraumatic
and direct treatment effects of this internet-based cognitive stress in our sample can be interpreted as ranging between
behavioral treatment program. subclinical and clinical symptoms. The need for specific
The efficacy of this program to support women after treatment after pregnancy loss is unquestioned in the
pregnancy loss is emphasized by the large effect sizes (see literature. However, aftercare typically does not involve
Cohen 1992) observed for traumatic stress (d=0.84 in the therapeutic support and the treatment received is rarely
ITT dataset; d=1.15 in the PP dataset) in the treatment experienced as satisfying (Geller et al. 2010). Hence, it is
group from the within-groups perspective. The online important to provide these young women with specific
treatment approach evidently has great practical signifi- treatment options and to lower the utilization threshold.
cance for women in this difficult situation. The effect sizes Within a graded treatment approach, this effective and well-
found in our pilot study are comparable with those reported accepted internet-based approach could be a first-line
in studies of similar internet-based approaches for patients treatment option. Our findings suggest that its implementa-
with posttraumatic stress following traumatic events such as tion would enhance satisfaction with care, prevent longer-
interpersonal violence, the sudden or violent death of a term emotional maladaption to the loss in at least some
close person, or traffic accidents (Knaevelsrud and women, and lower the threshold for treatment seeking in
Maercker 2007; Lange et al. 2000b; Wagner et al. 2006). those with persistent symptoms.
Thus, there is converging evidence for the efficacy of Another advantage of this internet-based approach is its
cognitive behavioral writing therapy with intensive thera- geographical and temporal independence, which proved to
peutic feedback. Between-group effect sizes, which reflect be especially important for our target group of young
the additive effect of the treatment relative to waiting alone women after pregnancy loss. In our outpatient clinic, we
(Dunlap et al. 1996), ranged from 0.53 to 0.69 (ITT, and experienced that the inhibition threshold for these women
0.66 to 0.86 in PP), further corroborating the efficacy of the to use regular outpatient psychological services was high.
treatment. Because our clinic serves a large region, it proved difficult
Internetbased-therapy after pregnancy loss 475

for women to make time for regular appointments, differs from women, fathers also experience strong negative
particularly when young children had to be looked after. It emotional reactions (Puddifoot and Johnson 1997) and
was often difficult to provide these women with decentral- develop various coping strategies after pregnancy loss
ized therapeutic support because of lack of specialization or (Johnson and Baker 2004). Future research may therefore
lack of awareness of the need for psychotherapeutic benefit from using alternative recruitment methods to enroll
support. As acceptance of electronic communication is male participants.
high in this age group, internet-based therapy options can Treatment outcomes were assessed exclusively by self-
provide geographically and temporally independent and report instruments delivered via the internet. Structured inter-
specific supportand thus lower the treatment utilization views would have increased the validity of these measures and
threshold. provided further information on the diagnosis of disorders.
Finally, from a methodological perspective, it is a further
strength of this internet-based manualized treatment ap- Future research
proach that the therapeutic input is revisable and closely
connected to the manual. Future studies should monitor outcomes across a longer
follow-up period. Apart from examining the long-term
Limitations stability of symptom improvement, it is important for research
designs to cover anniversary dates of the pregnancy loss or the
The dropout rate of 24% is higher than reported for estimated delivery date. In our next project phase, we will
comparable internet-based programs for complicated grief therefore collect data 12 months after the end of the treatment.
(8%; Wagner et al. 2006), PTSD (17%, Knaevelsrud and It would also be valuable for future research to evaluate the
Maercker 2007), and prevention of complicated grief (20%; efficacy of this internet-based intervention across different
Wagner and Maercker 2008), which must be considered in loss situations: miscarriage, stillbirth, or termination of
terms of generalization of the results. Apart from time since pregnancy due to fetal anomalies. Further studies should
loss, which was significantly longer for those who dropped identify patients specific needs in these different situations.
out, no direct relationship was found between dropout and Future studies could also benefit from assessing treatment
other characteristics. Based on our clinical experience, we outcomes other than symptom reduction (e.g., integration of
can speculate that the higher dropout rates may be related to the loss into the patients life) and from monitoring the therapy
short-term change in the needs of this group of women. process to evaluate specific treatment process variables.
Women who have lost an unborn child but still want to Our results add to the accumulating body of evidence
have children often experience intense inner conflict demonstrating that internet-based approaches represent an
between mourning the loss of the child and going on with effective therapeutic option for a variety of psychiatric
the next pregnancy. This conflict situation may in turn disorders. Especially as part of a graded treatment approach,
contribute to this raised dropout rate; however, to the best internet-based interventions offer a low-threshold first-line
of our knowledge, empirical data in support of this treatment. Given the general lack of psychotherapeutic
explanation have yet to be published. support in place for women after pregnancy loss, this
The present study design with a waiting list control internet-based interventionwhich proved to be both effec-
group does not allow us to identify the specific mechanisms tive and accepted in the present sampleseems a promising
underlying the treatment effects observed. It would have and necessary approach. At the same time, it is important to
been unethical to deny treatment to those patients originally enhance awareness of existing services and capacity to cater
randomized to the waiting list for 3 months. Consequently, for this population.
there was no control group against which the outcomes of
the treated sample could be compared. Future studies Acknowledgments We are grateful to all the women who partici-
pated in this study. This project was fully funded by the German
should test the internet-based cognitive behavioral approach
Federal Ministry for Family Affairs, Senior Citizens, Women, and
against a placebo treatment condition or even against face- Youth.
to-face cognitive behavioral therapy based on the same
principles. It would also be worth examining which Conflict of interest The authors declare that they have no conflict of
interest.
components of the therapy program (confrontation phase,
restructuring phase, or social sharing phase) contribute
most to the improvement of symptoms.
Although they were explicitly addressed, no men took References
part in our study. Thus, we cannot draw any conclusions
about treatment effects in men. Although research has Andersson G (2009) Using the internet to provide cognitive behaviour
shown that mens emotional experience of miscarriage therapy. Behav Res Ther 47:175180
476 A. Kersting et al.

Andersson G, Cuijpers P (2009) Internet-based and other computerized Jacobson NS, Truax P (1991) Clinical significance: a statistical
psychological treatments for adult depression: a meta-analysis. approach to defining meaningful change in psychotherapy
Cogn Behav Ther 38(4):196205 research. J Consult Clin Psychol 59:1219
Badenhorst W, Riches S, Turton P, Hughes P (2006) The psycholog- Johnson MP, Baker SR (2004) Implications of coping repertoire as
ical effects of stillbirth and neonatal death on fathers: systematic predictors of mens stress, anxiety and depression following
review. J Psychosom Obstet Gynaecol 27(4):245256 pregnancy, childbirth and miscarriage: a longitudinal study. J
Bergner A, Beyer R, Klapp BF, Rauchfuss M (2008) Pregnancy after Psychosom Obstet Gynaecol 25(2):8798
early pregnancy loss: a prospective study of anxiety, depressive Kersting A, Dorsch M, Kreulich C, Reutemann M, Ohrmann P, Baez
symptomatology and coping. J Psychosom Obstet Gynaecol 29 E, Arolt V (2005) Trauma and grief 27 years after termination
(2):105113 of pregnancy because of fetal anomalies: a pilot study. J
Berth H, Puschmann AK, Dinkel A, Balck F (2008) Trauma Psychosom Obstet Gynecol 26(1):914
Fehlgeburt: Einflussfaktoren auf das Angsterleben nach dem Kersting A, Kroker K, Steinhard J, Ldorff K, Wesselmann U,
frhen Verlust eines Kindes [The trauma of miscarriage: Ohrmann P, Arolt V, Suslow T (2007) Complicated grief after
factors influencing the experience of anxiety after early traumatic loss: a 14-month follow up study. Eur Arch Psychiatry
pregnancy loss]. Psychother Psychosom Med Psychol 59 Clin Neurosci 257(8):437443
(8):314320 Kersting A, Kroker K, Steinhard J, Hoernig-Franz I, Wesselmann U,
Boelen PA, de Keijser J, van den Hout MA, van den Bout J (2007) Ldorff K, Ohrmann P, Arolt V, Suslow T (2009a) Psychological
Treatment of complicated grief: a comparison between cognitive impact on women after second and third trimester termination of
behavioral therapy and supportive counseling. J Consult Clin pregnancy due to fetal anomalies versus women after preterm
Psychol 75:277284 birtha 14-month follow-up study. Arch Womens Ment Health
Bradley R, Greene J, Russ E, Dutra L, Westen D (2005) A multi- 12(4):193201
dimensional meta-analysis of psychotherapy for PTSD. Am J Kersting A, Schlicht S, Kroker K (2009b) [Internet therapy.
Psychiatry 162:214227 Opportunities and boundaries]. Nervenarzt 80(7):797804, article
Brier N (2004) Anxiety after miscarriage: a review of the empirical in German
literature and implications for clinical practice. Birth 31(2):138 Kersting A, Kroker K, Schlicht S, Wagner B (2011) Internet-based
142 treatment after pregnancy loss: concept and case study. J
Brier N (2008) Grief following miscarriage: a comprehensive review Psychosom Obstet Gynaecol 32(2):7278
of the literature. J Womens Health (Larchmt) 17(3):451464 Klier CM, Geller PA, Neugebauer R (2000) Minor depressive disorder
Buchner A, Erdfelder E, Faul F (1997) How to use G*Power. in the context of miscarriage. J Affect Disord 59(1):1321
http://www.psycho.uni-duesseldorf.de/aap/projects/gpower/ Klier CM, Geller PA, Ritsher JB (2002) Affective disorders in the
how_to_use_gpower.html. Accessed 10 February 2010 aftermath of miscarriage: a comprehensive review. Arch Womens
Carter D, Misri S, Tomfohr L (2007) Psychologic aspects of early Ment Health 5(4):129149
pregnancy loss. Clin Obstet Gynecol 50(1):154165 Knaevelsrud C, Maercker A (2007) Internet-based treatment for
Cohen J (1992) A power primer. Psychol Bull 112:155159. PTSD reduces distress and facilitates the development of a
doi:10.1037/0033-2909.112.1.155 strong therapeutic alliance: a randomized controlled trial.
Cougle JR, Reardon DC, Coleman PK (2003) Depression associated BMC Psychiatry 7:13
with abortion and childbirth: a long-term analysis of the NLSY Korenromp MJ, Page-Christiaens GC, van den Bout J, Mulder EJ,
cohort. Med Sci Monit 9(4):105112 Hunfeld JA, Potters CM, Erwich JJ, van Binsbergen CJ, Brons
Derogatis LR (1993) Brief Symptom Inventory (BSI), administration, JT, Beekhuis JR, Omtzigt AW, Visser GH (2007) A prospective
scoring, and procedures manual. National Computer Services, study on parental coping 4 months after termination of pregnancy
Minneapolis for fetal anomalies. Prenat Diagn 27(8):709716
Dunlap WP, Cortina JM, Vaslo WJB, Burke MJ (1996) Meta-analysis Korenromp MJ, Page-Christiaens GC, van den Bout J, Mulder EJ,
of experiments with matched groups or repeated measures Visser GH (2009) Adjustment to termination of pregnancy for
designs. Psychol Methods 1:170177 fetal anomaly: a longitudinal study in women at 4, 8, and
Engelhard IM, van den Hout MA, Arntz A (2001) Posttraumatic stress 16 months. Am J Obstet Gynecol 201(2):160.e1160.e7
disorder after pregnancy loss. Gen Hosp Psychiatry 23(2):6266 Kramer PRL, Jarve RK, Yaron YK (1998) Determinants of parental
First MB, Spitzer RL, Williams JB, Gibbon M (1997) Structured decision after prenatal diagnosis of Down syndrome. Am J Med
clinical interview for DSM-IV clinical version (SCID-I/CV). Genet 79:172174
American Psychiatric Association, Washington DC Lange A, Schrieken B, Blankers M, van de Ven J-P, Slot M (2000a)
Foa EB, Jaycox LH (1999) Cognitive-behavioral theory and treatment [Construction and validation of the screening device for
of posttraumatic stress disorder. In: Spiegel D (ed) Efficacy and psychotic disorder]. Dir Ther 20:162173, Netherlands
cost effectiveness of psychotherapy. Amercian Psychiatric Press, Lange A, Schrieken B, van de Ven J, Bredeweg B, Emmelkamp PMG,
Washington DC, pp 2361 van der Kolk J et al (2000b) Interapy: the effects of a short
Geller PA, Kerns D, Klier CM (2004) Anxiety following miscarriage protocolled treatment of posttraumatic stress and pathological
and the subsequent pregnancy: a review of the literature and grief through the internet. Behav Cogn Psychother 28:175192
future directions. J Psychosom Res 56(1):3545 Lange A, Rietdijk D, Hudcovicova M, van de Ven J, Schrieken B,
Geller PA, Psaros C, Kerns D (2006) Web-based resources for health Emmelkamp PMG (2003) Interapy: a controlled randomized trial
care providers and women following pregnancy loss. J Obstet of the standardized treatment of posttraumatic stress through the
Gynecol Neonatal Nurs 35(4):523532 internet. J Consult Clin Psychol 71:901909
Geller PA, Psaros C, Kornfield SL (2010) Satisfaction with pregnancy Litz B, Engel C, Bryant R, Papa A (2007) A randomized, controlled
loss aftercare: are women getting what they want? Arch Womens proof-of-concept trial of an internet-based, therapist-assisted self-
Ment Health 13(2):111124 management treatment for posttraumatic stress disorder. Am J
Gold KJ, Dalton VK, Schwenk TL (2007) Hospital care for parents Psychiatry 164:16761683
after perinatal death. Obstet Gynecol 109(5):11561166 Mansfield C, Hopfer S, Mareau TM (1999) Termination rates after
Horowitz MJ, Wilner NR, Alvarez W (1979) Impact of event scale: a prenatal diagnosis of Down syndrome, spina bifida, anencephaly,
measure of subjective stress. Psychosom Med 41:209218 and Turner and Klinefelter syndromes: a systematic literature
Internetbased-therapy after pregnancy loss 477

review. European Concerted Action: DADA (decision-making Swanson KM, Chen HT, Graham JC, Wojnar DM, Petras A (2009)
after the diagnosis of a fetal abnormality). Prenat Diagn 19:808 Resolution of depression and grief during the first year after
812 miscarriage: a randomized controlled clinical trial of couples-
Neal LA, Walter B, Rollins J, Herepath R, Strike P, Turnbull G (1994) focused interventions. J Womens Health (Larchmt) 18(8):1245
Convergent validity of measures of post-traumatic stress disorder 1257
in a mixed military and civilian population. J Trauma Stress Turton P, Hughes P, Evans CDH, Fainman D (2001) Incidents,
7:447455 correlates and predictors of posttraumatic stress disorder in the
Neugebauer R, Kline J, Shrout P, Skodol A, OConnor P, Geller P, pregnancy after stillbirth. Br J Psychiatry 178:556560
Stein Z, Susser M (1997) Major depressive disorder in the van der Houwen K, Schut H, van den Bout J, Stroebe M, Stroebe
6 months after miscarriage. JAMA 277:383388 W (2010) The efficacy of a brief internet-based self-help
Neugebauer R, Kline J, Bleiberg K, Baxi L, Markowitz JC, Rosing M, intervention for the bereaved. Behav Res Ther 48(5):359
Levin B, Keith J (2007) Preliminary open trial of interpersonal 367
counseling for subsyndromal depression following miscarriage. Vance JC, Boyle FM, Najman JM, Thearle MJ (1995) Gender
Depress Anxiety 24(3):219222 differences in parental psychological distress following perinatal
Nijenhuis ERS, Spinhoven P, van Dyck R, van der Hart O, death of sudden infant death syndrome. Brit J Psychiatr 167:806
Vanderlinden J (1997) The development of the Somatoform 811
Dissociation Questionnaire (SDQ-5) as a screening instrument Wagner B, Maercker A (2007) A 1.5-year follow-up of an internet-
for dissociative disorders. Acta Psychiatr Scand 96:311318 based intervention for complicated grief. J Trauma Stress 20
Nikcevic AV, Kuczmierczyk AR, Nicolaides KH (2007) The influence (4):625629
of medical and psychological interventions on womens distress Wagner B, Maercker A (2008) An internet-based preventive interven-
after miscarriage. J Psychosom Res 63:283290 tion (CBT) for complicated grief: a pilot study. Psicologia
Prigerson HG, Maciejewski PK, Reynolds CF, Bierhals AJ, Newsom Applicata alla Medicina del Lavoro e della Riabilitazione 30:
JT, Fasiczka A, Frank E, Doman J, Miller M (1995) Inventory of B43B47
Complicated Grief: a scale to measure maladaptive symptoms of Wagner B, Knaevelsrud C, Maercker A (2005) Complicated grief and
loss. Psychiatry Res 59(12):6579 internet-based treatment for complicated grief: concepts and case
Puddifoot JE, Johnson MP (1997) The legitimacy of grieving: the study. J of Loss and Trauma 10:124
partners experience at miscarriage. Soc Sci Med 45(6):837845 Wagner B, Knaevelsrud C, Maercker A (2006) Internet-based
Shear K, Frank E, Houck PR, Reynolds CF III (2005) Treatment of cognitive-behavioral therapy for complicated grief: a randomized
complicated grief: a randomized controlled trial. JAMA controlled trial. Death Stud 30(5):429453
293:26012608 Wittouck C, Van Autreve S, De Jaegere E, Portzky G, van Heeringen
Sundin EC, Horowitz MJ (2002) Impact of Event Scale: psychometric K (2011) The prevention and treatment of complicated grief: a
properties. Br J Psychiatry 180:205209 meta-analysis. Clin Psychol Rev 1:6978

You might also like