Article Text

PDF

Original article
Quality of Life Questionnaire-Bronchiectasis: final psychometric analyses and determination of minimal important difference scores
  1. Alexandra L Quittner1,
  2. Anne E O'Donnell2,
  3. Matthias A Salathe3,
  4. Sandra A Lewis4,
  5. Xiaoming Li4,
  6. A Bruce Montgomery5,
  7. Thomas G O'Riordan4,
  8. Alan F Barker6
  1. 1Department of Psychology & Pediatrics, University of Miami, and Behavioral Health Sciences Research, Coral Gables, Florida, USA
  2. 2Division of Pulmonary, Critical Care & Sleep Medicine, Department of Medicine, Georgetown University, Washington, District of Columbia, USA
  3. 3Division of Pulmonary, Allergy, Critical Care and Sleep Medicine, Department of Medicine, University of Miami, Miami, Florida, USA
  4. 4Gilead Sciences Inc., Seattle, Washington, USA
  5. 5Cardeas Pharma Corp., Seattle, Washington, USA
  6. 6Department of Medicine, Division of Pulmonary and Critical Care, Oregon Health & Science University, Portland, Oregon, USA
  1. Correspondence to Dr Alexandra L Quittner, University of Miami, 5665 Ponce de Leon Blvd., Coral Gables, FL 33146, USA; AQuittner{at}Miami.edu

Abstract

Background The Quality of Life-Bronchiectasis (QOL-B), a self-administered, patient-reported outcome measure assessing symptoms, functioning and health-related quality of life for patients with non-cystic fibrosis (CF) bronchiectasis, contains 37 items on 8 scales (Respiratory Symptoms, Physical, Role, Emotional and Social Functioning, Vitality, Health Perceptions and Treatment Burden).

Methods Psychometric analyses of QOL-B V.3.0 used data from two double-blind, multicentre, randomised, placebo-controlled, phase III trials of aztreonam for inhalation solution (AZLI) in 542 patients with non-CF bronchiectasis and Gram-negative endobronchial infection.

Results Excellent internal consistency (Cronbach's α ≥0.70) and 2-week test–retest reliability (intraclass correlation coefficients ≥0.72) were demonstrated for each scale. Convergent validity with 6 min walk test was observed for Physical and Role Functioning scores. No floor or ceiling effects (baseline scores of 0 or 100) were found for the Respiratory Symptoms scale (primary endpoint of trials). Baseline Respiratory Symptoms scores discriminated between patients based on baseline FEV1% predicted in only one trial. The minimal important difference score for the Respiratory Symptoms scale was 8.0 points. AZLI did not show efficacy in the two phase III trials. QOL-B responsivity to treatment was assessed by examining changes from baseline QOL-B scores at study visits at which protocol-defined pulmonary exacerbations were reported. Mean Respiratory Symptoms scores decreased 14.0 and 14.2 points from baseline for placebo-treated and AZLI-treated patients with exacerbations, indicating that worsening respiratory symptoms were reflected in clinically meaningful changes in QOL-B scores.

Conclusions Previously established content validity, reliability and responsivity of the QOL-B are confirmed by this final validation study. The QOL-B is available for use in clinical trials and routine clinical practice.

  • Respiratory Measurement
  • Respiratory Infection
  • Perception of Asthma/Breathlessness
  • Bronchiectasis

Statistics from Altmetric.com

Key messages

What is the key question?

  • To compute the psychometric properties of the first disease-specific health-related quality of life measure for non-cystic fibrosis (CF) bronchiectasis.

What is the bottom line?

  • The Quality of Life-Bronchiectasis (QOL-B) has demonstrated excellent psychometric properties in two large-scale clinical trials and minimal important difference values have been calculated for each scale to aid researchers and clinicians in interpreting QOL-B data; the measure is ready for research and clinical use.

Why read on?

  • There is an unmet clinical need for approved therapies in non-CF bronchiectasis; however, these efforts have been hampered by the lack of reliable, disease-specific outcomes.

Introduction

Bronchiectasis is a lung disease characterised by chronic cough and sputum production, often accompanied by airway bacterial infection.1–6 Treatments for non-cystic fibrosis (CF) bronchiectasis are limited and the assessment of new treatments is limited by lack of validated clinical trial endpoints.7 Unlike CF, large decreases in bacterial density in non-CF bronchiectasis placebo-controlled studies did not lead to improvements in clinical symptoms or FEV1,8 although improvement on the St George's Respiratory Questionnaire (SGRQ) was observed in exploratory analyses of treatment-adherent patients in a colistin study.9 Without reliable surrogates for clinical efficacy (e.g., FEV1), accurate measures of symptom frequency and severity are needed for bronchiectasis drug development. Furthermore, developing an endpoint assessing functioning of non-CF bronchiectasis patients in their daily lives would complement an exacerbation endpoint.

The Quality of Life-Bronchiectasis (QOL-B), a self-administered patient-reported outcome (PRO) measure, was developed in response to the need for such new measurement tools. It assesses symptoms, functioning and health-related quality of life (HRQoL) for non-CF bronchiectasis patients and includes 37 items on 8 scales (Respiratory Symptoms, Physical, Role, Emotional and Social Functioning, Vitality, Health Perceptions and Treatment Burden).10 ,11 Development followed the procedures and analyses recommended by the Food and Drug Administration (FDA) guidance on PROs.12 Previously reported content validity, cognitive testing and psychometric analyses conducted on interim versions supported QOL-B concepts and items.10

This manuscript presents psychometric analyses of QOL-B Version (V) 3.0 computed using data from two double-blind, multicentre, randomised, placebo-controlled, phase III trials of aztreonam for inhalation solution (AZLI) in patients with non-CF bronchiectasis and Gram-negative endobronchial infection. While these two studies did not demonstrate clinical efficacy,13 the use of a prespecified protocol-defined criteria for acute bronchiectasis exacerbations facilitated using the QOL-B for quantifying changes in respiratory symptoms during exacerbations. The minimal important difference (MID) scores for each scale were also estimated.

Methods

Study design

QOL-B psychometric analyses presented herein used data from two phase III clinical trials: AIR-BX1 (47 sites; Australia, Canada and the USA; April 2011–March 2013; clinicaltrials.gov: NCT01313624) and AIR-BX2 (65 sites; Australia, Belgium, Canada, France, Germany, Italy, the Netherlands, Spain, UK and the USA; April 2011–July 2013; clinicaltrials.gov: NCT01314716). Both trials had the same design. The trial design, inclusion and exclusion criteria and results are described elsewhere.13 Briefly, patients received double-blind treatment with AZLI 75 mg or placebo (1:1 randomisation; code generated by Gilead designee; randomisation occurred at baseline using an interactive voice/web response system) administered 3 times daily for 28 days, with each of 2 double-blind treatment courses followed by 28-day off-treatment. Procedures to generate QOL-B translations followed internationally accepted and regulatory guidelines, using formal backward and forward translation methodologies.12 ,14 ,15 Translations and cultural adaptations (e.g., using American English QOL-B in the UK) were tested with patients who were native speakers of the translated/adapted language. A complex, multistep process ensured cultural equivalence and each new translation was piloted in the new language with ≥5 patients with non-CF bronchiectasis.

Studies were conducted in accordance with principles of the Declaration of Helsinki, International Conference on Harmonisation guidelines and good clinical practice principles. Institutional Review Boards/Ethics Committees approved the study for each site. Patients provided written informed consent prior to study participation.

Patients

Inclusion/exclusion criteria are described elsewhere.13 Eligible patients (≥18 years of age) had bronchiectasis confirmed by CT chest scan, a positive sputum culture for target Gram-negative organism(s) at screening, chronic sputum production on ≥4 days/week during prior 4 weeks and FEV1 ≥20% predicted at screening. Target Gram-negative respiratory pathogens included species of Achromobacter, Burkholderia, Citrobacter, Enterobacter, Escherichia, Klebsiella, Moraxella, Proteus, Pseudomonas, Serratia and Stenotrophomonas. Patients with CF or with only Haemophilus influenzae respiratory infections were excluded.

Study measures

Three measures of clinical response were specified in the protocol and used to measure discriminant and/or convergent validity, including FEV1, the 6 min Walk Test (6MWT)16 and the Euro Quality of Life-5 Dimensions (EQ-5D).17

Spirometry was performed at each visit, after administration of a short acting inhaled bronchodilator.

The 6MWT, measuring distance walked in 6 min, was administered at every visit. No MID has been reported for non-CF bronchiectasis. In patients with COPD, a change of 54–80 m is perceived as a small improvement/worsening in walking ability18; another study suggests that a change of 10% from baseline is clinically important.19

The EQ-5D, a standardised self-reported measure of global health status, was administered at the beginning and at the end of each treatment course. Results for the EQ-5D visual analogue scale (VAS) are presented. General health states were assessed by responses on a vertical scale from 0 (worst imaginable) to 100 (best imaginable). No MID has been reported for non-CF bronchiectasis.

QOL-B V.3.0 was administered at every study visit; V.3.0 differs only very slightly from the final V.3.1 (an example was provided and a ‘not applicable’ category was added to 1 item on the V.3.1 Social Functioning scale).10 ,20 Each of the 37 items is scored from 1 to 4, and each of the 8 scale scores is standardised on a 0-100 point scale, with higher scores representing fewer symptoms or better functioning and HRQoL. A total score is not calculated. Scales contain between 3 and 9 items, thus changing 1 answer category will correspond to a change of 11.1 to 3.7 points.

The Global Rating of Change Questionnaire (GRCQ) V.2.2 (15 point Likert-like scale) and V.3.0 (7 point scale) were administered at day 14, immediately after the QOL-B. Each GRCQ item corresponded to 1 of the 8 QOL-B scales and patients responded to each GRCQ item using a VAS. Changes from baseline at day 14 were evaluated from −7 (a very great deal worse) to +7 (a very great deal better) for items on GRCQ V.2.2 and from −3 (a great deal worse) to +3 (a great deal better) for GRCQ V.3.0 (the Respiratory Symptoms GRCQ V.2.2 and V.3.0 are provided in online supplementary figure S1). Zero indicated no change. A switch from the 15-point to the 7-point GRCQ scoring system was made following a suggestion from a regulatory agency while these two trials were ongoing. Scores are presented based on GRCQ V.3.0. GRCQ V.2.2 scores (−7 to 7) were converted to the V.3.0 scale (−3 to 3) by multiplying by 3/7.

Protocol-defined exacerbations were defined as acute worsening of respiratory disease meeting ≥3 major criteria (increased sputum production, sputum discolouration, dyspnoea and cough) or 2 major criteria and ≥2 minor criteria (fever >38°C at a clinic visit, increased malaise or fatigue, FEV1 [L] or FVC decreased >10% from baseline and new/increased haemoptysis).13

Analyses

Statistical analyses were performed with SAS V.9.2 (SAS Institute, Cary, North Carolina, USA). Internal consistency was measured using Cronbach's α.21 Test score reproducibility over 14 days (i.e., test–retest reliability) was calculated with intraclass correlation coefficients (ICCs).22 Spearman's correlations were calculated. The protocols specified that AIR-BX1 and AIR-BX2 study results were to be analysed separately; pooled data were used for some exploratory analyses. MIDs were calculated for each scale.23–25 For patients in the minimal change GRCQ category (>0.5–1.5 improvement or worsening from baseline on the 3-point scale), their mean change from baseline QOL-B scores at day 14 was the anchor-based MID. Two distribution-based MIDs were calculated: 1/2 SD of the change from baseline QOL-B scores at day 14 and 1 SE of measurement (SEM) for baseline scores (SEM=SD√(1−α)). The 6 MIDs (3 methods across 2 studies) were averaged and rounded to the nearest integer to generate a final MID for each scale.

Results

In AIR-BX1, 266 patients were randomised and treated (AZLI: n=134; placebo: n=132). In AIR-BX2, 274 patients were randomised and 272 were treated (AZLI: 135; placebo: 137). Demographic and baseline characteristics were comparable for both treatment arms, except for a significant difference (p=0.017) in the distribution of patients within FEV1% predicted categories in AIR-BX1, with 38.8% of AZLI-arm patients having baseline FEV1 <50% predicted compared with 25.0% of placebo-arm patients (table 1). Additional baseline characteristics are described elsewhere.13

Table 1

Demographic and baseline characteristics

Floor and ceiling effects

Floor and ceiling effects were assessed by examining baseline QOL-B scores, to determine whether patients had room to both improve and worsen on each scale (table 2). Floor effects were not observed. One patient (0.4%) in each study had a Respiratory Symptoms score of 0 and ≤5.1% of patients on each study had scores of 0 on any of the other scales. Ceiling effects (baseline scores of 100) were not observed for the Respiratory Symptoms scale. Ceiling effects were observed on the Emotional Functioning (24.1% and 22.3% of patients on AIR-BX1 and AIR-BX2, respectively), and on the Treatment Burden scale (13.4% and 11.3% of patients).

Table 2

Floor and ceiling effects: QOL-B scores at baseline

Internal consistency

Internal consistency of QOL-B scales was assessed with Cronbach's α (table 3). Values were ≥0.70 for each scale, showing good reliability (i.e., items on each scale correlated with each other, forming a unitary construct).21

Table 3

Internal consistency of QOL-B scales

Discriminant validity

Mean baseline QOL-B scores were compared for patients differing by other health status indicators (table 4). The QOL-B Physical Functioning scale discriminated between patients on the basis of FEV1% predicted; in both studies, mean baseline Physical Functioning scores were approximately 20–30 points larger for patients with baseline FEV1 ≥80% predicted compared with <50% predicted. Discrimination was less robust for Respiratory Symptoms, Vitality, Role Functioning and Health Perception scales; mean scores at baseline were approximately 10 points larger for patients with baseline FEV1 ≥80% predicted compared with <50% predicted only in AIR-BX2. Statistically significant discrimination on the basis of median baseline 6MWT results was observed in both studies for Physical Functioning, Vitality, Role Functioning and Health Perception scores, and only in AIR-BX2 for Respiratory Symptoms and Emotional Functioning scores. Some of the statistically significant differences observed for 6MWT categories (p<0.05) were smaller than the MID values for these scales (see table 7) and thus were not considered clinically meaningful.

Table 4

Discrimination of QOL-B scores by other indices of health status

Convergent validity

Correlations between baseline QOL-B scores and other health status indicators are summarised (table 5). Moderate correlations were observed for baseline QOL-B Physical Functioning scores (AIR-BX2 only) and baseline FEV1% predicted, with weak or no correlations observed for other baseline QOL-B scores and FEV1% predicted. Moderate correlations were observed for Physical Functioning and Role Functioning scores and 6MWT results, with weak or no correlations observed for other scales. Moderate to strong correlations were observed between baseline QOL-B scores and most baseline EQ-5D VAS scores.

Table 5

Convergent validity: correlation between baseline QOL-B scores and other measures of health status

Test–retest reliability

QOL-B test–retest reliability was assessed by ICC values (table 6). Values were ≥0.70 for each scale, indicating good score reproducibility over the 14-day interval.22

Table 6

Test–retest reliability: intraclass correlation coefficients between screening (day 14) and baseline (day 0) for QOL-B scores

MID values

Changes from baseline QOL-B scores at day 14 were categorised by GRCQ responses. QOL-B scores were grouped for patients whose GRCQ scores indicated ‘no change’ or ‘minimal,’ ‘moderate’ or ‘large change’ from baseline to day 14. Each change from baseline category included improving and worsening scores. Data for the Respiratory Symptoms scale are presented (see online supplementary table S1). Mean change on the QOL-B scale for patients in the ‘minimal change’ GRCQ category was the anchor-based MID; values for the Respiratory Symptoms scale were 6.7 (AIR-BX1) and 11.4 (AIR-BX2) points (table 7). MIDs derived from 1/2 SD of baseline scores were 8.0 (AIR-BX1) and 7.7 (AIR-BX2) points for the Respiratory Symptoms scale and values derived from the SEM of baseline scores were 7.7 (AIR-BX1) and 8.2 (AIR-BX2) points. Averaging these 6 MID estimates generated a final MID of 8.0 points for the Respiratory Symptoms scale.

Table 7

MID Estimates for the QOL-B scales

Responsivity to treatment or change in health status

Clinically significant changes from baseline QOL-B Respiratory Symptoms scores were not observed after 14 days of AZLI or placebo treatment, because none of the mean changes exceeded the 8.0 point MID (see online supplementary table S2). Changes in FEV1 and 6MWT were also comparable between arms, as were changes on other QOL-B scales. In contrast, larger decreases from baseline sputum bacterial density after treatment were observed for the AZLI arm compared with placebo.

Because AZLI did not show clinically significant efficacy in the two phase III trials, an exploratory analysis was performed using change from baseline QOL-B Respiratory Symptoms scores for patients with a protocol-defined exacerbation reported at a study visit at which the QOL-B was also administered. These exacerbations occurred 6 days to approximately 4 months after baseline. Mean (SD) change from baseline QOL-B Respiratory Symptoms score was −14.2 (16.5) points for the 30 AZLI-treated patients with a protocol-defined exacerbation recorded at a study visit for which QOL-B scores were available (range: −50.5 to +18.5 points; figure 1A). Mean (SD) change from baseline was −14.0 (16.7) points for the corresponding 30 placebo-treated patients (range: −66.7 to +11.1 points; figure 1B). These mean values both exceeded the −8.0-point MID and were thus considered to represent clinically relevant worsening of respiratory symptoms in these study populations.

Figure 1

Change from baseline Quality of Life-Bronchiectasis (QOL-B) Respiratory Symptoms scores on the day of a protocol-defined exacerbation. A, AZLI-treated patients (n=30). B, Placebo-treated patients (n=30). Analysis included patients with QOL-B scores at baseline and at a study visit at which treatment was initiated with intravenous, inhaled, intramuscular or oral antibiotics for a protocol-defined exacerbation.

Discussion

Results of psychometric analyses of QOL-B V.3.0 data from 542 patients in two placebo-controlled AZLI trials support psychometric analyses reported for a preliminary version of the QOL-B (V.2.0), which included data from 89 patients in an open-label AZLI study.10 For QOL-B V.3.0, adequate internal consistency and test–retest reliability were demonstrated for all 8 scales. For the Respiratory Symptom scale, the primary endpoint of the two phase III trials, floor and ceiling effects were not observed. Analyses of discriminant validity on the basis of baseline FEV1% predicted values indicated that mean baseline Respiratory Symptoms scores were approximately 10 points larger (indicating fewer symptoms) for AIR-BX2 patients with baseline FEV1 ≥80% predicted compared with <50% predicted, but no statistically significant discrimination was observed in AIR-BX1. As was observed in the previous validation study of QOL-B V.2.0,10 the Physical Functioning scale discriminated well between levels of disease severity based on lung function measurements, with a statistically significant ≥20-point spread for patients differing by baseline lung function. This discriminant validity, both the ∼10-point spread in Respiratory Symptoms scores for AIR-BX2 and the ≥20-point spread in Physical Functioning scores for both studies, is larger than the corresponding MID values (8 and 10 points, respectively) and thus are also considered clinically meaningful. However, the lack of consistent significant discrimination for QOL-B Respiratory Symptoms scores and FEV1% predicted agrees with results from prior studies, in which FEV1 was not strongly associated with decreases in airway bacteria after treatment or with better health status.8 ,26 ,27

In the absence of demonstrable efficacy in the two phase III trials, responsivity to treatment was assessed for the QOL-B Respiratory Symptoms scale by examining mean changes from baseline for patients with a protocol-defined pulmonary exacerbation at a study visit at which the QOL-B had been administered. Mean scores decreased 14.2 and 14.0 points from baseline for AZLI-treated and placebo-treated patients with exacerbations, respectively, indicating that the patients’ worsening respiratory symptoms were reflected in changes in mean QOL-B Respiratory Symptoms scores.

For each scale, MID estimates from two distribution-based methods and one anchor-based method (using the GRCQ as an anchor) were averaged to determine the final MID. The anchor-based MID estimates showed more variation between studies than was observed for the distribution-based estimates, and some anchor-based estimates also differed substantially from the distribution-based estimates. These findings illustrate the complexity of determining MIDs using an anchor-based method and suggest that the final MIDs for scales with large differences (e.g, Role or Social Functioning) should be used with caution.

Each QOL-B item had 4 possible answer categories; e.g., the item ‘Have you been coughing during the day’ could be answered by selecting ‘a lot,’ ‘a moderate amount,’ ‘a little’ or ‘not at all.’ A change of one answer category for any of the nine items on the Respiratory Symptoms scale corresponded to 3.7 points; e.g., changing from ‘a lot’ to a ‘moderate amount’ of coughing during the day increased the Respiratory Symptoms score by 3.7 points. Thus, meeting the 8.0-point MID required an average overall improvement or worsening of 2.2 answer categories. The MID for the Physical Functioning scale was 10.0 points. Because a change of 1 answer category for any of 5 items on this scale corresponded to 6.7 points, meeting the Physical Functioning scale MID required an average overall improvement or worsening of 1.5 answer categories. For a group of patients to meet the MID for the other 6 scales required an average overall improvement or worsening of from 0.8 to 1.2 answer categories.

Limitations of other PRO or HRQoL measures that have been used in this patient population include minimal coverage of respiratory symptoms (Leicester Cough Questionnaire28; Chronic Respiratory Questionnaire29 (CRQ)), lengthy or variable recall intervals (SGRQ30) and substantial response burden (some SGRQ and CRQ forms). The QOL-B is the first PRO for non-CF bronchiectasis developed according to the FDA guidance.12

Some minor limitations to the QOL-B emerged from these analyses. In this study population, approximately one quarter of the patients had baseline scores of 100 on the Emotional Functioning scale, indicating that it would not be well suited to monitor improvements from baseline in a comparable study population. The discrepancies in MID values obtained by the different methods for some of the scales also suggest that MIDs should be reassessed in each population of patients in which this measure is used; this conclusion is in line with literature recommendations for using MID values.31 The lack of improvement on the QOL-B Respiratory Symptoms scale after treatment with AZLI is not considered a limitation of the measure, but more likely reflects the lack of clinical benefit of this treatment in this patient population.13 The analysis showing responsivity of the measure to protocol-defined exacerbations was exploratory in nature; it included only 60 of the 154 patients who had such exacerbations and did not take into account other changes in health status or QOL-B scores that may have occurred between baseline and the day of the exacerbation.

In conclusion, the QOL-B is a disease-specific questionnaire that measures symptoms, functioning and HRQoL relevant to patients with non-CF bronchiectasis. Content validity, reliability and responsivity have been established in a series of cognitive testing and interview studies and have been confirmed by the results of this final validation study. The QOL-B measure has been translated into more than 38 languages and is freely available20 for use in clinical trials and routine clinical practice.

Acknowledgments

Medical writing assistance was provided by Kate Loughney, under the sponsorship of Gilead Sciences.

References

View Abstract
  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Files in this Data Supplement:

Footnotes

  • Contributors ALQ, SAL, XL, ABM, TGO and AFB were involved in the initial design of the studies. AFB was the lead investigator for AR-BX1 and AEO was the lead investigator for AIR-BX2. MAS was a clinical investigator. SAL and XL analysed the data. ALQ, SAL and TGO drafted the initial manuscript and all authors contributed to its development and approved the final version.

  • Funding The two clinical trials, AIR-BX1 (clinicaltrials.gov: NCT01313624) and AIR-BX2 (clinicaltrials.gov: NCT01314716), were sponsored by Gilead Sciences.

  • Competing interests ALQ: received consulting income from Gilead Sciences in relation to development of the QOL-B. AEO: received funding to Georgetown University for participation in the clinical trial. MAS: received funding to University of Miami for participation in the clinical trial. SAL: is an employee and stockholder of Gilead Sciences. XL: is an employee and stockholder of Gilead Sciences. ABM: was formerly an employee of Gilead Sciences and remains a stockholder. TGO: is an employee and stockholder of Gilead Sciences. AFB: received research funding from Gilead Sciences.

  • Patient consent Obtained.

  • Ethics approval Institutional Review Boards/Ethics Committees approved the study for each site.

  • Provenance and peer review Not commissioned; externally peer reviewed.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.