Intervention Protocol

You have free access to this content

Antidepressants versus placebo for panic disorder in adults

  1. Giuseppe Guaiana1,*,
  2. Corrado Barbui2,
  3. Debbie Chiodo3,
  4. Andrea Cipriani2,
  5. Simon JC Davies4,
  6. Markus Koesters5

Editorial Group: Cochrane Depression, Anxiety and Neurosis Group

Published Online: 31 JUL 2013

DOI: 10.1002/14651858.CD010676


How to Cite

Guaiana G, Barbui C, Chiodo D, Cipriani A, Davies SJC, Koesters M. Antidepressants versus placebo for panic disorder in adults (Protocol). Cochrane Database of Systematic Reviews 2013, Issue 7. Art. No.: CD010676. DOI: 10.1002/14651858.CD010676.

Author Information

  1. 1

    Western University, Department of Psychiatry, St Thomas, Ontario, Canada

  2. 2

    University of Verona, Department of Public Health and Community Medicine, Section of Psychiatry, Verona, Italy

  3. 3

    King's University College at the University of Western Ontario, Department of Psychology, London, Ontario, Canada

  4. 4

    University of Bristol, School of Social and Community Medicine, Bristol, UK

  5. 5

    Ulm University, Department of Psychiatry ll, Guenzburg, Germany

*Giuseppe Guaiana, Department of Psychiatry, Western University, Saint Thomas Elgin General Hospital, 189 Elm Street, St Thomas, Ontario, N5R 5C4, Canada. Giuseppe.Guaiana@sjhc.london.on.ca. gguaiana@stegh.on.ca.

Publication History

  1. Publication Status: New
  2. Published Online: 31 JUL 2013

SEARCH

 

Background

  1. Top of page
  2. Background
  3. Objectives
  4. Methods
  5. Acknowledgements
  6. Contributions of authors
  7. Declarations of interest
  8. Notes
 

Description of the condition

A panic attack is a discrete period of fear or anxiety that has a rapid onset, reaches a peak within 10 minutes and in which at least 4 of 13 characteristic symptoms are experienced. Many of these symptoms involve bodily systems, such as racing heart, chest pain, sweating, shaking, dizziness, flushing, stomach churning, faintness and breathlessness. Further recognised panic attack symptoms involve fearful cognitions, such as the fear of collapse, going mad or dying, and derealisation (APA 1994).

Panic disorder first entered diagnostic classification systems in 1980 with the publication of DSM-III, following observations that patients with panic attacks responded to treatment with the tricyclic antidepressant (TCA) imipramine (Klein 1964). To diagnose panic disorder, further conditions must be met relating to the frequency of attacks, the need for some to come on ‘out of the blue’ rather than in a predictable, externally-triggered situation, and exclusions where attacks are attributable solely to medical causes or panic-inducing substances, notably caffeine. DSM-IV requires additionally that at least one attack has been followed by either a) persistent concern about having additional attacks, b) worry about the implications of the attack or its consequences or c) a significant change in behaviour related to the attacks (APA 1994).

Panic disorder is common in the general population with a lifetime prevalence of 1% to 4% (Eaton 1994; Bijl 1998). In primary care settings, panic syndromes have been reported to have a prevalence of around 10% (King 2008). Its aetiology is not fully understood and is probably heterogeneous. Biological theories incorporate the faulty triggering of an inbuilt anxiety response, possibly a suffocation alarm. Evidence for this comes from biological challenge tests (lactate and carbon dioxide trigger panic in those with the disorder) and from animal experiments and neuroimaging studies in humans that show activation of fear circuits, such as that involving the periaqueductal grey matter (Gorman 2000).

Agoraphobia is anxiety about being in places or situations from which escape might be difficult or embarrassing, or in which help may not be available in the event of having a panic attack (APA 1994). Agoraphobia can occur with panic disorder (APA 1994). About one-fourth of people suffering from panic disorder also have agoraphobia (Kessler 2006). The presence of agoraphobia is associated with increased severity and worse outcome (Kessler 2006). There are several risk factors that predict the development of agoraphobia in people suffering from panic disorder: female gender, more severe dizziness during panic attacks, cognitive factors, dependent personality traits and social anxiety disorder (Starcevic 2009).

Panic disorder, with or without agoraphobia, is highly comorbid with other psychiatric disorders, such as drug dependence, major depression, bipolar I disorder, social phobia, specific phobia, and generalised anxiety disorder (Grant 2006). It is estimated that generalised anxiety disorder co-occurs in 68% of people with panic disorder, whilst major depression has a prevalence of 24% to 88% among people with panic disorder (Starcevic 2009).

 

Description of the intervention

The treatment of panic disorder includes psychological and pharmacological interventions, often used in combination (Furukawa 2007). Historically, pharmacological interventions for panic disorder have been based on the use of mono-amino oxidase inhibitors (MAOIs) and tricyclic antidepressants (TCAs) (Bruce 2003). However, MAOIs and TCAs are burdened by severe adverse effects, such as dietary restrictions (to avoid hypertensive crisis) for MAOIs, and anticholinergic, arrhythmogenic and overall poor tolerability for TCAs (Wade 1999). Benzodiazepines (BDZs), particularly high potency ones, have been used as a safer alternative in panic disorder (Stein 2010), although the long-term outcome may be less good (NICE 2011). Recent guidelines (APA guideline: APA 2009; BAP guideline: BAP 2005; NICE Guideline: NICE 2011) consider antidepressants, mainly selective serotonin reuptake inhibitors (SSRIs), as the first-line treatment for panic disorder, due to their more favourable adverse effect profile over MAOIs and TCAs. A meta-analysis comparing SSRIs and TCAs in panic disorder (Bakker 2002) showed that SSRIs are as effective as TCAs, and are better tolerated, although other studies showed a possible overestimation of the efficacy of SSRIs over older antidepressants in panic disorder (Anderson 2000; Otto 2001). It appears that TCAs can still have a role in the treatment of panic disorder.

 

How the intervention might work

The main classes with evidence of efficacy in panic disorder are antidepressant drugs that augment the function of the monoamines serotonin and/or noradrenaline. Considering the serotonergic antidepressants (SSRIs such as fluoxetine, paroxetine, sertraline and citalopram) – these drugs promote the transmission of the neurotransmitter serotonin across brain synapses; most notably in the dorsal raphe nucleus (Briley 1993). They prevent reuptake of serotonin into nerve terminals by inhibiting serotonin transporters, thus allowing more to be available for neurotransmission. In panic disorder, imaging studies have revealed reduced expression of the 5H1A receptor (Nash 2008) which has an inhibitory function, so the increased serotonin throughput may in part serve to overcome this deficit of inhibition. Noradrenergic antidepressants can similarly increase transmission of the catecholamine noradrenaline. Some antidepressants such as the serotonin-norepinephrine reuptake inhibitor (SNRI) drugs (e.g. venlafaxine, duloxetine) and TCAs can enhance both serotonin and noradrenaline transmission by inhibiting both transporters.

 

Why it is important to do this review

Antidepressants are widely used in panic disorder. Published randomised controlled trials have shown some evidence of efficacy. However, no systematic study on all antidepressants in panic disorder has been conducted recently. A meta-analysis published in 2007 focused on combined psychotherapy and antidepressants in panic disorder (Furukawa 2007), and another more recent systematic review focused on psychological treatments only (Sanchez-Meca 2010). Furukawa and colleagues (Furukawa 2007) found that either combined psychotherapy or psychotherapy alone may be chosen as first line treatment for panic disorder. Sanchez-Meca and colleagues (Sanchez-Meca 2010) found that exposure, relaxation training and breathing retraining have the most robust evidence. To our knowledge, the last meta-analysis specifically focused on antidepressants in panic disorder was published in 2002 (Bakker 2002). This was a study comparing SSRIs and TCAs. The authors concluded that SSRIs and TCAs are of equal efficacy in the treatment of panic disorder, with a better tolerability profile for SSRIs. An up-to-date review is needed to help prescribers identify the effect size of active treatment compared to placebo in panic disorder for short- and long-term treatment, in order to be better guided in the choice of the pharmacological agent. Another Cochrane review on benzodiazepines versus placebo for panic disorder is in progress, which will be of further help to identify the effective treatments in this disabling condition (Guaiana 2013).

 

Objectives

  1. Top of page
  2. Background
  3. Objectives
  4. Methods
  5. Acknowledgements
  6. Contributions of authors
  7. Declarations of interest
  8. Notes

To assess the effects of antidepressants for panic disorder in adults, specifically:

  1. To determine the efficacy of antidepressants in alleviating symptoms of panic disorder, with or without agoraphobia, in comparison to placebo;
  2. To review the acceptability of antidepressants in panic disorder, with or without agoraphobia, in comparison with placebo; and
  3. To investigate the adverse effects of antidepressants in panic disorder, with or without agoraphobia, including the general prevalence of adverse effects, compared to placebo.

 

Methods

  1. Top of page
  2. Background
  3. Objectives
  4. Methods
  5. Acknowledgements
  6. Contributions of authors
  7. Declarations of interest
  8. Notes
 

Criteria for considering studies for this review

 

Types of studies

Randomised, double-blind, controlled trials using a parallel group design that compare antidepressants with placebo as monotherapy.

We will include cross-over trials, randomised placebo-controlled trials with more than two arms, and cluster randomised placebo-controlled trials.

We will exclude quasi-randomised trials, such as those allocated by using alternate days of the week.

 

Types of participants

Participants aged 18 years or older with a primary diagnosis of panic disorder, with or without agoraphobia, diagnosed according to any of the following criteria: Feighner criteria, Research Diagnostic Criteria, DSM-III, DSM-III-R, DSM-IV or ICD-10. In case study eligibility focused on agoraphobia, rather than panic disorder, studies will be included if operationally diagnosed according to the above-named criteria and when it can be safely assumed that at least 30% of the participants were suffering from panic disorder as defined by the above criteria. There is evidence that over 95% of patients with agoraphobia seen clinically suffer from panic disorder as well (Goisman 1995). However, the effect of the inclusion of these studies will be examined in a sensitivity analysis.

We will exclude participants with serious comorbid physical disorders (e.g. myocardial infarction, chronic obstructive pulmonary disorder, uncontrolled diabetes, electrolyte disturbances) as they may confound treatment effectiveness and tolerability.

We will include participants with comorbid mental disorders, but the effect of including these participants will be examined in sensitivity analyses.

 

Types of interventions

Any trial comparing antidepressants as monotherapy with placebo in the treatment of panic disorder, with or without agoraphobia.

Only acute treatment studies treating participants for less than six months will be included. We will exclude relapse prevention studies.

We will include the following antidepressants.

  • Tricyclic antidepressants (TCAs): amitriptyline, amoxapine, clomipramine, desipramine, dosulepin/dothiepin, doxepin, impiramine, lofepramine, maprotiline, nortriptyline, proptriptyline, trimipramine. 
  • Selective Serotonin Reuptake Inhibitors (SSRIs) : fluoxetine, fluvoxamine, sertraline, citalopram, paroxetine, escitalopram.
  • Monomine oxidase inhibitors (MAOIs): phenelzine, isocarboxazide, tranylcypromine, moclobemide, brofaromine.
  • Serotonin-Noradrenaline Reuptake Inhibitors (SNRIs): venlafaxine, desvenlafaxine, duloxetine, milnacipran.
  • Noradrenergic and Specific Serotonergic Antidepressants (NaSSAs): mirtazapine.
  • Noradrenergic and Dopaminergic Reuptake Inhibitors (NDRIs): bupropion.
  • Noradrenergic Reuptake Inhibitors (NRIs): reboxetine.
  • Others: agomelatine, trazodone, nefazodone, mianserin, maprotiline, non-conventional herbal products (e.g Hypericum).

We will include studies in which irregular (i.e. not daily) use of benzodiazepines took place. Excluding such studies would be meaningless because it has been documented that a minority of patients take benzodiazepines surreptitiously when they are prohibited by the protocol (Clark 1990). We will exclude studies in which benzodiazepines were regularly administered at a constant dosage for a long time or as part of the study medication. Possible differences in co-interventions (such as differential usage of benzodiazepines in antidepressant trials) will be noted and their influence will be examined in sensitivity analyses.

No restriction on dose, frequency, intensity or duration will be applied.  

We will exclude studies administering psychosocial therapies targeted at panic disorder concurrently.

 

Types of outcome measures

 

Primary outcomes

1. Rate of 'response', i.e. substantial improvement from baseline as defined by the original investigators. Examples would be “very much or much improved” according to the Clinical Global Impression Change Scale, more than 40% reduction in the Panic Disorder Severity Scale score, and more than 50% reduction in the Fear Questionnaire Agoraphobia Subscale.

2. Total number of dropouts for any reason as a proxy measure of treatment acceptability.

 

Secondary outcomes

3. 'Remission', i.e. satisfactory end-state as defined by global judgment of the original investigators. Examples would be “panic free” and “no or minimal symptoms” according to the Clinical Global Impression Severity Scale.

4. Panic symptom scales and global judgment on a continuous scale. Examples include Panic Disorder Severity Scale total score (0 to 28), Clinical Global Impression Severity Scale (1 to 7), and Clinical Global Impression Change Scale (1 to 7). When multiple measures are used, preference will be given in the order as above, with preference given to panic symptom scales. The actual measure entered into meta-analyses will be indicated at the top of the listings in the Table of Included Studies.

5. Frequency of panic attacks, as recorded, for example, by a panic diary.

6. Agoraphobia, as measured, for example, by the Fear Questionnaire, Mobility Inventory, or behavioural avoidance test.

7. General anxiety, as measured, for example, by the Hamilton Rating Scale for Anxiety, Beck Anxiety Inventory, State-Trait Anxiety Index, Sheehan Patient-Rated Anxiety Scale, or Anxiety Subscale of SCL-90-R.

8. Depression, as measured, for example, by the Hamilton Rating Scale for Depression, Beck Depression Inventory, or Depression Subscale of SCL-90-R.

9. Social functioning, as measured, for example, by the Sheehan Disability Scale, Global Assessment Scale, or Social Adjustment Scale-Self Report.

10. Quality of life, as measured for example by SF-36 or SF-12.

11. Patient satisfaction with treatment.

12. Economic costs.

13. Number of dropouts due to adverse effects.

14. Number of patients experiencing at least one adverse effect.

 

Timing of outcome assessment

All outcomes are short term which we define as acute phase treatment which normally would last two to six months.

When studies report response rates at different time points within two to six months, the time point closest to 12 weeks will be given preference.

 

Search methods for identification of studies

 

Electronic searches

 

1. The Cochrane Depression, Anxiety and Neurosis Review Group's Specialised Register (CCDANCTR)

The Cochrane Depression, Anxiety and Neurosis Group (CCDAN) maintain two clinical trials registers at their editorial base in Bristol, UK: a references register and a studies-based register. The CCDANCTR-References Register contains over 31,500 reports of RCTs in depression, anxiety and neurosis. Approximately 65% of these references have been tagged to individual, coded trials. The coded trials are held in the CCDANCTR-Studies Register and records are linked between the two registers through the use of unique Study ID tags. Coding of trials is based on the EU-Psi coding manual, using a controlled vocabulary; please contact the CCDAN Trials Search Coordinator for further details. Reports of trials for inclusion in the Group's registers are collated from routine (weekly), generic searches of MEDLINE (1950-), EMBASE (1974-) and PsycINFO (1967-); quarterly searches of the Cochrane Central Register of Controlled Trials (CENTRAL) and review-specific searches of additional databases. Reports of trials are also sourced from international trials registers c/o the World Health Organization's trials portal (the International Clinical Trials Registry Platform (ICTRP)), pharmaceutical companies, the handsearching of key journals, conference proceedings and other (non-Cochrane) systematic reviews and meta-analyses.

Details of CCDAN's generic search strategies (used to identify RCTs) can be found on the Group's website.

The CCDAN registers will be searched using the following terms:

CCDANCTR-Studies
Diagnosis = "panic disorder" and Intervention = placebo*
Records will be screened for placebo-controlled antidepressant trials.

CCDANCTR-References
The References Register will be searched using the free-text term 'panic*' to identify additional untagged references. Abstracts will be screened for antidepressant trials and full-text articles will be retrieved, where necessary, to check for placebo controls.

 

2. National and international trials registers

Complementary searches will also be conducted on the WHO International Clinical Trials Registry Platform (ICTRP) and ClinicalTrials.gov.

 

Searching other resources

Review authors will check the reference lists of all included studies, non-Cochrane systematic reviews and major textbooks of affective disorders (written in English), for published reports and citations of unpublished research. A citation search will also be conducted via the Web of Science (included studies only) to identify additional works. We will also contact experts in the field.

 

Data collection and analysis

 

Selection of studies

The selection of trials for inclusion in this systematic review will be done independently by two of the authors: GG (clinical expertise) and MK (methodological expertise).

GG and MK will inspect the search hits by reading the titles and abstracts to see if they meet the inclusion criteria. Doubts will be resolved by consultation with the other co-authors. Each potentially-relevant study located in the search will be obtained as a full article and independently assessed for inclusion by two review authors and, in the case of discordance, resolution will be sought by discussion between the review authors. The discordance in the selection of studies will be calculated using Cohen's Kappa (k) (Cohen 1960), a more robust measure than a simple per cent agreement calculation since it takes into account the agreement between review authors that occurs by chance. Where it will not be possible to evaluate the study because of language problems or missing information, the study will be classified as 'study awaiting assessment' until a translation or further information can be obtained. The reasons for the exclusion of potentially-relevant trials will be reported in the 'Characteristics of excluded studies' table.

All decisions made during selection process, with numbers of studies and references, will be recorded and presented in a PRISMA flow diagram (Moher 2009) at the end of the review.

 

Data extraction and management

Two review authors will use a data extraction form to independently extract the data from included studies concerning participant characteristics (age, sex, severity of panic disorder, study setting), intervention details (dosage, duration of study, sponsorship), study characteristics (blinding, allocation etc) and outcome measures of interest. The extraction sheet will be piloted on a sample of 10% of the included studies. Again, any disagreement will be resolved by consensus or by the third member of the review team. If necessary, we will contact authors of studies to obtain clarification.

 

Main comparisons

  1. Antidepressants as a whole versus placebo.
  2. TCAs versus placebo.
  3. SSRIs versus placebo.
  4. MAOIs versus placebo.
  5. SNRIs versus placebo.
  6. NaSSAs versus placebo.
  7. NDRIs versus placebo.
  8. NRIs versus placebo.
  9. Other antidepressants versus placebo.

 

Assessment of risk of bias in included studies

Two authors will independently assess the risk of bias in included studies using the tool described in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2011). This tool encourages consideration of how the sequence was generated, how allocation was concealed, the integrity of blinding at outcome assessment, the completeness of outcome data, selective reporting and other biases. We will also consider sponsorship bias.

The risk of bias, in each domain and overall, will be assessed and categorised into:

  • low risk of bias, plausible bias unlikely to seriously alter the results;
  • high risk of bias, plausible bias that seriously weakens confidence in the results;
  • unclear risk of bias, plausible bias that raises some doubt about the results.

If the assessors disagree, the final rating will be made by consensus or with the involvement of another member of the review group. Where inadequate details of randomisation and other characteristics of trials are provided, we will contact authors of the studies in order to obtain further information. Non-concurrence in quality assessment will also be reported.

 

Measures of treatment effect

The main outcome result will be reduction of severity of panic and agoraphobia symptoms. The improvement will usually be presented as a change in a panic disorder scale(s) (mean and standard deviation) or as a dichotomous outcome (responder or non-responder, remitted or not-remitted), or both.

 

Binary or dichotomous data

For binary outcomes we will calculate a standard estimation of the random-effects model risk ratio (RR) and its 95% confidence interval (CI). It has been shown that a random-effects model has a good generalisability (Furukawa 2002) and that RR is more intuitive (Boissel 1999) than odds ratio. Furthermore, odds ratios tend to be interpreted as RR by clinicians (Deeks 2000). This may lead to an overestimation of the impression of the effect (Higgins 2011). For all primary outcomes we will calculate the number needed to treat to benefit or harm statistic (NNTb or NNTh) and its 95% CI using Visual Rx (http://www.nntonline.net/), taking account of the event rate in the control group.

 

Continuous data

(a) Summary statistics

It is likely that different studies have used varied panic rating scales; therefore we will use standardised mean difference (SMD). If all included studies have used the same instrument, we will use mean difference (MD).

(b) Endpoint versus change data

Trials usually report results either using endpoint means and standard deviation of scales or using change in mean values from baseline of assessment rating scales. We prefer to use scale endpoint data, which typically cannot have negative values and are easier to interpret from a clinical point of view. If endpoint data are unavailable, we will use the change data in separate analyses. In case we use MD, we will pool results based on change data and endpoint data in the same analysis.

 

Unit of analysis issues

 

Crossover trials

Crossover trials are trials in which all participants receive both the control and intervention treatment but in a different order. The major problem is a carryover effect from the first phase to the second phase of the study, especially if the condition of interest is unstable (Elbourne 2002). As this is the case with panic disorder, randomised crossover studies will be included but only data up to the point of first crossover will be used.

 

Studies with multiple treatment groups

Where a study involves more than two treatment arms, especially two appropriate dose groups of the same drug, the different dose arms will be pooled and considered to be one. If the arms involve one placebo arm and two or more arms of different classes of antidepressants, we will compare each arm with placebo separately. In this case, a possibility of unit-of-analysis error can occur, due to the unaddressed between the estimated intervention effects from multiple comparisons (Higgins 2011), resulting in double counting. In order to avoid that, we will include each pair-wise comparison separately, according to the recommendations in the Cochrane Handbook for Systematic Reviews of Interventions, section 16.5.4 (Higgins 2011). If the variable is dichotomous, we will divide the shared intervention group evenly among the comparisons. If the variable is continuous, only the total number of participants will be divided up, and the means and standard deviations will be left unchanged.

 

Cluster randomised trials

In cluster randomised trials groups of individuals rather than individuals are randomised to different interventions. If we identify cluster placebo-controlled randomised trials, we plan to use the generic inverse variance technique, if such trials have been appropriately analysed taking into account intraclass correlation coefficients to adjust for cluster effects. Where trialists have not adjusted for the effects of clustering, we will attempt to do this by obtaining an intracluster correlation coefficient and then following the guidance given in chapter 16.3.4 of the Cochrane Handbook (Higgins 2011).

 

Dealing with missing data

We will try to contact the study authors for all relevant missing data.

(1) Dichotomous outcomes

Response, or remission on treatment, will be calculated using an intention-to-treat analysis (ITT). We will follow the principle 'once randomised always analysed'. Where participants left the study before the intended endpoint, it will be assumed that they would have experienced the negative outcome. The validity of the above assumption will be tested by sensitivity analysis, applying worst and best case scenarios. When dichotomous outcomes are not reported but the baseline mean and standard deviation on a panic disorder scale are reported, we will calculate the number of responding or remitted participants according to a validated imputation method (Furukawa 2005). The validity of the above approach will be analysed by sensitivity analysis. If necessary, authors of studies will be contacted to obtain data and/or clarification.

(2) Continuous outcomes

Concerning continuous data, the Cochrane Handbook recommends avoiding imputation of continuous data and suggests using the data as presented by the original authors. Where ITT data are available they will be preferred to 'per-protocol analysis'. If necessary, authors of studies will be contacted to obtain data and/or clarification.

(3) Skewed or qualitative data

Skewed and qualitative data will be presented descriptively.

Several strategies will be considered for skewed data. If papers report a mean and standard deviation and there is also an absolute minimum possible value for the outcome, we will divide the mean by the standard deviation. If this is less than two then we will conclude that there is some indication of skewness. If it is less than one (that is the standard deviation is bigger than the mean) then there is almost certainly skewness. If papers have not reported the skewness and simply report means, standard deviations and sample sizes, these numbers will be used. Because there is a possibility that these data may not have been properly analysed, and can also be misleading, analyses will be conducted with and without these studies. If the data have been log-transformed for analysis, and the geometric means are reported, skewness will be reduced. This is the recommended method of analysis of skewed data (Higgins 2011). If papers use non-parametric tests and describe averages using medians, they cannot be formally pooled in the analysis. We will follow the recommendation made in the Cochrane Handbook that results of these studies be reported in a table in our review, along with all other papers. This means that the data will not be lost from the review and the results can be considered when drawing conclusions, even if they cannot be formally pooled in the analyses.

(4) Missing statistics

When only P or standard error (SE) values are reported, we will calculate standard deviations (SDs) (Altman 1996). In the absence of supplementary data after requests to the authors, the SDs will be calculated according to a validated imputation method (Furukawa 2006). We will examine the validity of these imputations in the sensitivity analyses.

 

Assessment of heterogeneity

Following the Cochrane Handbook recommendations, we will quantify heterogeneity using the I2 statistic. The Cochrane Handbook recommends overlapping intervals for I2 interpretation (section 9.5.2, Higgins 2011) , as follows:

  • 0% to 40%: might not be important;
  • 30% to 60%: may represent moderate heterogeneity;
  • 50% to 90%: may represent substantial heterogeneity; and
  • 75% to 100%: considerable heterogeneity.

We will also use the Chi2 test and its P value to determine the direction and magnitude of the treatment effects. In a meta-analysis of few trials Chi2 will be underpowered to detect heterogeneity, if it exists. P = 0.10 will be used as a threshold of statistical significance.

 

Assessment of reporting biases

Reporting biases arise when the dissemination of research findings is influenced by the nature and direction of results. These are described in section 10 of the Cochrane Handbook (Higgins 2011). A funnel plot is usually used to investigate publication bias. However, it has a limited role when there are only few studies of similar size. Secondly, asymmetry of a funnel plot does not always reflect publication bias. Visual inspection of funnel plots will be used to assess publication bias as well as the statistical test for funnel plot asymmetry proposed by Eggers or Rücker (Higgins 2011). We will not use funnel plots for outcomes if there are 10 or fewer studies, or if all studies are of similar size.

 

Data synthesis

We will use a random-effects model to calculate the treatment effects. We prefer the random-effects model as it takes into account differences between studies even when there is no evidence of statistical heterogeneity. It gives a more conservative estimate than the fixed-effect model. We note that the random-effects model gives added weight to small studies, which can either increase or decrease the effect size. We will apply a fixed-effect model, on primary outcomes only, to see whether it markedly changes the effect size.

 

Subgroup analysis and investigation of heterogeneity

Subgroup analyses are often exploratory in nature and should be interpreted cautiously: firstly, because they often involve multiple analyses leading to false positive results; and secondly, these analyses lack power and are more likely to result in false positive results. Keeping in mind these reservations, we will perform the following subgroup analyses.

  1. For classes of antidepressants, such as TCAs, SSRIs, and others.
  2. For participants with agoraphobia and for participants without agoraphobia, because the same treatment may have differential effectiveness with regard to panic and agoraphobia.
  3. If groups within any of the subgroups are found to be significantly different from one another, we will run meta-regression for exploratory analyses of additive or multiplicative influences of the variables in question.
  4. We will compare acute phase treatment studies that last for less than four months versus acute phase treatment studies that last for four months or more.

 

Sensitivity analysis

The following sensitivity analyses are planned. We will examine if the results change and check for the robustness of the observed findings by:

  1. Excluding trials with high risk of bias (i.e. trials with inadequate allocation concealment and blinding, with incomplete data reporting and/or with high probability of selective reporting);
  2. Excluding trials with dropout rates greater than 20%;
  3. Excluding studies funded by the pharmaceutical company marketing each antidepressant. This sensitivity analysis is particularly important in view of the repeated findings that funding strongly affects outcomes of research studies (Als-Nielsen 2003; Lexchin 2003; Bhandari 2004) and because industry sponsorship and authorship of clinical trial reports have increased over the last 20 years (Buchkowsky 2004);
  4. Excluding studies whose protocols do not explicitly prohibit concomitant use of BDZ. According to Clark et al (Clark 1990), 10% to 20% of those assigned to placebo or imipramine arms in a randomised controlled trial took explicitly-prohibited anxiolytic medication; and
  5. Excluding studies whose participants clearly have significant psychiatric co-morbidities including primary or secondary depressive disorders.

Our routine application of random-effects and fixed-effect models as well as our secondary outcomes of remission rates and continuous severity measures might be considered additional forms of sensitivity analyses.

 

'Summary of findings' table

We will summarise the findings using a 'Summary of findings' table, applying the GRADE approach (Higgins 2011).

 

Acknowledgements

  1. Top of page
  2. Background
  3. Objectives
  4. Methods
  5. Acknowledgements
  6. Contributions of authors
  7. Declarations of interest
  8. Notes
 
CRG funding acknowledgement:

The National Institute for Health Research (NIHR) is the largest single funder of the Cochrane Depression, Anxiety and Neurosis Review Group. 

 
Disclaimer:

The views and opinions expressed herein are those of the authors and do not necessarily reflect those of the NIHR, NHS or the Department of Health.

 

Contributions of authors

  1. Top of page
  2. Background
  3. Objectives
  4. Methods
  5. Acknowledgements
  6. Contributions of authors
  7. Declarations of interest
  8. Notes

GG devised the idea for the review. GG, CB and AC worked on the first draft of the protocol. MK, SJC, and DC provided suggestions. All authors reviewed and approved the final version of the protocol.

 

Declarations of interest

  1. Top of page
  2. Background
  3. Objectives
  4. Methods
  5. Acknowledgements
  6. Contributions of authors
  7. Declarations of interest
  8. Notes

GG, CB, DC, AC, SJD, MK: none

 

Notes

  1. Top of page
  2. Background
  3. Objectives
  4. Methods
  5. Acknowledgements
  6. Contributions of authors
  7. Declarations of interest
  8. Notes

This protocol is one of a number of separate reviews examining the efficacy and tolerability of pharmacological and non-pharmacological treatments for panic disorders. These individual reviews will then be combined in a multiple-treatment meta-analysis using multiple-treatments model methodology (protocol to be published in the Cochrane Database of Systematic Reviews). Please note that the majority of the text in the Methods sections for these protocols is identical since the full reviews will be following the same methodology.

References

Additional references

  1. Top of page
  2. Abstract
  3. Background
  4. Objectives
  5. Methods
  6. Acknowledgements
  7. Contributions of authors
  8. Declarations of interest
  9. Notes
  10. Additional references
Als-Nielsen 2003
  • Als-Nielsen B, Chen W, Gluud C, Kjaergard LL. Association of funding and conclusions in randomized drug trials: a reflection of treatment effect or adverse events?. JAMA 2003;290:921-8.
Altman 1996
  • Altman DG, Bland MJ. Detecting skewness for summary information. BMJ 1996;313:1200.
Anderson 2000
APA 1994
  • American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 4th Edition. American Psychiatric Publishing, 1994.
APA 2009
  • American Psychiatric Association. American Psychiatric Association Practice Guidelines for the Treatment of Panic Disorder. American Psychiatric Association Practice Guideline for the Treatment of Panic Disorder. American Psychiatric Publishing, 2009.
Bakker 2002
BAP 2005
  • Baldwin DS, Anderson IM, Nutt DJ, Bandelow B, Bond A, Davidson JR, et al. Evidence-based guidelines for the pharmacological treatment of anxiety disorders: recommendations from the British Association for Psychopharmacology. Journal of Psychopharmacology 2005;19:567-96.
Bhandari 2004
  • Bhandari M, Busse JW, Jackowski D, Montori VM, Schünemann H, Sprague S, et al. Association between industry funding and statistically significant pro-industry findings in medical and surgical randomized trials. Canadian Medical Association Journal 2004;170:477-80.
Bijl 1998
  • Bijl RV, Ravelli A, van Zessen G. Prevalence of psychiatric disorder in the general population: results of The Netherlands Mental Health Survey and Incidence Study (NEMESIS). Social Psychiatry and Psychiatric Epidemiology 1998;33:587-95.
Boissel 1999
  • Boissel JP, Cucherat M, Li W, Chatellier G, Gueyffier F, Buyse M, et al. The problem of therapeutic efficacy indices. Comparison of the indices and their use. Therapie 1999;54:405-11.
Briley 1993
Bruce 2003
  • Bruce SE, Vasile RG, Goisman RM, Salzman C, Spencer M, Machan JT, et al. Are benzodiazepines still the medication of choice for patients with panic disorder with or without agoraphobia?. American Journal of Psychiatry 2003;160:1432-8.
Buchkowsky 2004
Clark 1990
  • Clark DB, Taylor CB, Roth WT, Hayward C, Ehlers A, Margraf J, et al. Surreptitious drug use by patients in a panic disorder study. American Journal of Psychiatry 1990;147:507-9.
Cohen 1960
Deeks 2000
  • Deeks J. Issues in the selection for meta-analyses of binary data. Proceedings of the 8th International Cochrane Colloquium; Cape Town, South Africa. 2000 Oct 25-28th.
Eaton 1994
Elbourne 2002
  • Elbourne DR, Altman DG, Higgins JP, Curtin F, Worthington HV, Vail A. Meta-analyses involving cross-over trials: methodological issues. International Journal of Epidemiology 2002;31:140-9.
Furukawa 2002
  • Furukawa TA, Guyatt GH, Griffith LE. Can we individualize the 'number needed to treat'? An empirical study of summary effect measures in meta-analyses. International Journal of Epidemiology 2002;31:72-6.
Furukawa 2005
  • Furukawa TA, Cipriani A, Barbui C, Brambilla P, Watanabe N. Imputing response rates from means and standard deviations in meta-analysis. International Clinical Psychopharmacology 2005;20:49-52.
Furukawa 2006
  • Furukawa TA, Barbui C, Cipriani A, Brambilla P, Watanabe N. Imputing missing standard deviations in meta-analyses can provide accurate results. Journal of Clinical Epidemiology 2000;59:7-10.
Furukawa 2007
Goisman 1995
  • Goisman RM, Warshaw MG, Steketee GS, Fierman EJ, Rogers MP, Goldenberg I, et al. DSM-IV and the disappearance of agoraphobia without a history of panic disorder: new data on a controversial diagnosis. American Journal of Psychiatry 1995;152:1438-43.
Gorman 2000
Grant 2006
  • Grant BF, Hasin DS, Stinson FS, Dawson DA, Goldstein RB, Smith S, et al. The epidemiology of DSM-IV panic disorder and agoraphobia in the United States: results from the National Epidemiologic Survey on Alcohol and Related Conditions. Journal of Clinical Psychiatry 2006;67:363-74.
Guaiana 2013
  • Guaiana G, Barbui C, Chiodo D, Cipriani A, Davies SJC, Koesters M. Benzodiazepines versus placebo for panic disorder in adults. Cochrane Database of Systematic Reviews 2013, Issue [in progress].
Higgins 2011
  • Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions. Chichester: John Wiley & Sons, 2011.
Kessler 2006
  • Kessler RC, Chiu WT, Jin R, Ruscio AM, Shear K, Walters EE. The epidemiology of panic attacks, panic disorder, and agoraphobia in the National Comorbidity Survey Replication. Archives of General Psychiatry 2006;63:415-24.
King 2008
  • King M, Nazareth I, Levy G, Walker C, Morris R, Weich S, et al. Prevalence of common mental disorders in general practice attendees across Europe. British Journal of Psychiatry 2008;192:362-7.
Klein 1964
Lexchin 2003
Moher 2009
  • Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLOS Medicine 2009;6(6):e1000097.
Nash 2008
  • Nash JR, Sargent PA, Rabiner EA, Hood SD, Argyropoulos SV, Potokar JP, et al. Serotonin 5-HT1A receptor binding in people with panic disorder: positron emission tomography study. British Journal of Psychiatry 2008;1993:229-34.
NICE 2011
  • National Institute for Health and Care Excellence. Generalised anxiety disorder and panic disorder (with or without agoraphobia) in adults [CG113]. London: National Institute for Health and Care Excellence, 2011.
Otto 2001
  • Otto MW, Tuby KS, Gould RA, McLean RY, Pollack MH. An effect-size analysis of the relative efficacy and tolerability of serotonin selective reuptake inhibitors for panic disorder. American Journal of Psychiatry 2000;158:1989-92.
Sanchez-Meca 2010
  • Sánchez-Meca J, Rosa-Alcázar AI, Marín-Martínez F, Gómez-Conesa A. Psychological treatment of panic disorder with or without agoraphobia: a meta-analysis. Clinical Psychology Review 2010;30:37-50.
Starcevic 2009
  • Starcevic V. Anxiety Disorders in Adults: A Clinical Guide. Oxford University Press, 2009.
Stein 2010
  • Stein M, Steckler T, Lightfoot JD, Hay E, Goddard AW. Pharmacologic treatment of panic disorder. Current Topics in Behavioral Neurosciences 2010;2:469-85.
Wade 1999
  • Wade AG. Antidepressants in panic disorder. International Clinical Psychopharmacology 1999;14(Suppl 2):13-17.