Background Despite the significant morbidity and mortality related to pulmonary exacerbations in cystic fibrosis (CF), there remains no reliable predictor of imminent exacerbation.
Objective To identify blood-based biomarkers to predict imminent (<4 months from stable blood draw) CF pulmonary exacerbations using targeted proteomics.
Methods 104 subjects provided plasma samples when clinically stable and were randomly split into discovery (n=70) and replication (n=34) cohorts. Multiple reaction monitoring mass spectrometry (MRM-MS) was used to measure 117 peptides (79 proteins) from plasma. Plasma proteins with differential abundance between subjects who did versus did not develop an imminent exacerbation were analysed and proteins with fold difference >1.5 between the groups were included in an MRM-MS classifier model to predict imminent exacerbations. Performance characteristics were compared with clinical predictors and candidate plasma protein biomarkers.
Results Six proteins were included in the final MRM-MS protein panel. The area under the curve (AUC) for the prediction of imminent exacerbations was highest for the MRM-MS protein panel (AUC 0.74) in comparison to FEV1% predicted (AUC 0.55) and the top candidate plasma protein biomarkers, including C-reactive protein (AUC 0.61) and interleukin-6 (AUC 0.60). The MRM-MS protein panel performed similarly in the replication cohort (AUC 0.73).
Conclusions Using MRM-MS, a six-protein panel measured from plasma can distinguish individuals with versus without an imminent exacerbation. With further replication and assay development, this biomarker panel may be clinically applicable for prediction of exacerbations in individuals with CF.
- Cystic Fibrosis
Statistics from Altmetric.com
What is the key question?
Can targeted proteomics be used to discover blood-based biomarkers to predict imminent pulmonary exacerbations (<4 months) in cystic fibrosis (CF)?
What is the bottom line?
Using multiple reaction monitoring mass spectrometry, a six-protein biomarker panel was identified and validated to predict imminent CF pulmonary exacerbations, outperforming clinical predictors and candidate protein biomarkers.
Why read on?
A simple, minimally invasive blood test can be used to predict imminent CF pulmonary exacerbations and this biomarker might be applied clinically to develop pre-emptive strategies to prevent exacerbations or mitigate their potential impact.
Among the most significant clinical events for individuals with cystic fibrosis (CF) are pulmonary exacerbations. These are important life events because they can lead to permanent loss in lung function,1 ,2 reduced quality of life3 ,4 and increased risk of death.5 ,6 Despite notable improvements in other important health outcomes for individuals with CF over the past two decades (such as pulmonary function and nutritional status), exacerbations continue to be common. Based on the CF Foundation Patient Registry Report, 35% of patients experienced at least one exacerbation requiring intravenous antibiotics across the USA in 2012.7 Given the potential devastating consequences of exacerbations, preventing these events remains a management priority for CF physicians. Fortunately, many of the maintenance respiratory therapies including mucolytics, inhaled antibiotics and oral azithromycin approved for use in CF are beneficial in preventing exacerbations.8
Currently, CF clinicians do not have a reliable means to predict which of their patients will develop an exacerbation prior to their next clinic visit. With this uncertainty in predicting exacerbations, it remains challenging for physicians to decide if and when to intensify therapies. While previous studies have identified prior exacerbation history and current lung function as predictors of future exacerbation risk, these studies were focused on subgroups of patients harbouring multidrug-resistant organisms9 and those not receiving guideline recommended therapies.10 Furthermore, these clinical variables are unlikely to reflect the current biological status of the patient sufficiently to guide day-to-day treatment decisions for personalised medicine.
High-throughput ‘-omics’ technologies (eg, proteomics, transcriptomics) are now available that can measure the relative abundances of different molecular targets (eg, protein, RNA) for assessment as biomarkers to predict risk or disease.11 Multiple reaction monitoring mass spectrometry (MRM-MS) is a targeted proteomics technology that offers the advantage of precise and simultaneous measurement of at least 100 protein targets per sample.12 To our knowledge, MRM-MS has yet to be applied to biomarker discovery in CF. Blood represents an amenable tissue to apply proteomics technology for biomarker discovery in CF because it is relatively easy to obtain and represents the ‘pipeline’ of the immune system.13 The detection of a circulating protein profile indicative of an impending exacerbation (prior to a patient being symptomatic) has the potential to transform patient care as it might enable CF physicians to predict exacerbations. The objectives of this study were to (1) use MRM-MS to identify a novel biomarker panel of proteins in the blood to predict imminent pulmonary exacerbations in CF and (2) compare the performance of the MRM-MS protein panel to established clinical predictors of exacerbations and other candidate protein biomarkers previously investigated in the context of exacerbations.
We enrolled adults with an established diagnosis of CF based on standard criterion14 and without prior solid organ transplantation from the St. Paul's Hospital Adult Cystic Fibrosis Clinic (Vancouver, British Columbia, Canada) between April 2009 and April 2013. Consenting participants were included in this study if they had at least one plasma sample obtained when clinically stable during a routine clinic visit, defined by the absence of an exacerbation in the 4 weeks leading up to and including the enrolment clinic visit. Exacerbations were defined as a change in clinical parameters (based on the modified Fuchs criteria15) requiring additional treatment (oral or intravenous antibiotics), based on a consensus clinical trial definition recommended by the EuroCareCF Working Group.16 Patients who were receiving active treatment for non-tuberculous mycobacterial disease or allergic bronchopulmonary aspergillosis, or were taking systemic corticosteroids were excluded. In total, 104 of 185 potentially eligible patients with CF met our inclusion/exclusion criteria and provided informed consent for blood collection (figure 1). If multiple longitudinal stable plasma samples were available for individual patients, the first stable sample was included in this analysis.
Venous blood samples were collected in EDTA tubes from clinically stable participants using standard operating procedures. Samples were immediately stored on ice, processed for plasma and stored within 2 h at −80°C until thawing for batched analysis.
Clinical data collection
Chart review was performed to obtain baseline clinical characteristics to predict exacerbations. The following clinical variables were collected corresponding to the time of stable blood draw: age, gender, CF transmembrane regulator genotype (F508del homozygous, heterozygous or other), body mass index (BMI), FEV1% predicted, exacerbations requiring intravenous antibiotics in the prior year, CF-related diabetes, sputum microbiology and active use of chronic respiratory therapies (nebulised antibiotics and oral azithromycin). Spirometric data were obtained using standard techniques in accordance with guidelines from the American Thoracic Society.17 Charts were also reviewed to ascertain the timing of the first exacerbation (as defined above) following stable blood draw, and all participants had at least 6 months of follow-up data.
MRM-MS proteomic analysis
Plasma samples were sent to the University of Victoria (UVic) Genome BC Proteomics Centre (Victoria, British Columbia, Canada) for MRM-MS proteomic analysis. MRM-MS is a tandem MS (MS/MS) scan mode unique to triple quadruple MS instrumentation that monitors generation of a fragment ion by collision-induced dissociation (CID) from an isolated precursor ion.12 It is a highly sensitive and targeted proteomics approach that requires knowledge of the molecular weight of the analyte and its fragmentation behaviour under CID. The MRM-MS technique used by the UVic Proteomics Centre has been described in detail previously.18 ,19 Briefly, the plasma sample is trypsin-digested overnight and then known concentrations of stable isotope-labelled reference peptides (unique to each protein of interest) are spiked into the digested sample as internal standards to enhance analyte detection confidence and measurement precision. The mixture is then separated via liquid chromatography and the eluted peptide fragments are ionised with an electrospray emitter. Using tandem MS, peptide ions are selected for fragmentation and fragment ions are selected for detection based on a user-specified list of targeted precursor–product ion pairs (ie, transitions). Peptide concentrations are derived by measurement of the peak area ratios of one or more of the fragment ions from the labelled internal standard and the endogenous peptide. For this study, a bio-library consisting of 117 isotope-labelled reference peptides corresponding to 79 unique proteins (mostly involved in immunity, inflammation, coagulation and the acute phase response) were investigated (see online supplementary table S1).
Candidate protein biomarker assays
Candidate protein biomarkers were chosen based on a systematic review of the literature of blood-based biomarkers demonstrating promise for use in the context of CF pulmonary exacerbations20 and included plasma C-reactive protein (CRP), plasma interleukin-6 (IL-6), plasma soluble cluster of differentiation 14 (sCD14), serum myeloperoxidase (MPO) and plasma neutrophil elastase antiproteinase complex (NEAPC). All blood-based candidate protein biomarkers were quantified using commercially available ELISAs except CRP, which was examined with MRM-MS alone as prior pilot work involving 30 CF plasma samples demonstrated very strong correlation (Spearman's correlation=0.96, p<0.001) in CRP measurements between the two techniques. The coefficient of variation for the IL-6 (R&D Systems, Minneapolis, Minnesota, USA), sCD14 (R&D Systems), MPO (R&D Systems) and NEAPC (EMD Millipore, Billerica, Massachusetts, USA) ELISA kits were 3.1%, 2.8%, 1.9% and 4.5%, respectively.
Outcome of interest
A priori, our outcome of interest was the prediction of an imminent pulmonary exacerbation (as defined above) <4 months post-stable visit blood draw. A time frame of 4 months was chosen as this represents the average length of time between routine clinic visits for most patients attending our clinic. The ability of a biomarker to predict an exacerbation event prior to the next clinic visit provides the greatest opportunity to intervene to prevent these events. In total, 43 (41%) of 104 patients were diagnosed with an exacerbation <4 months following stable blood draw.
Discovery and replication cohorts
All 104 clinically stable patients with CF meeting our inclusion/exclusion criteria were included in the analysis. The 104 patients were randomly split 10 times into two cohorts, discovery cohort (70 patients) and replication cohort (34 patients) (figure 1). Of these 10 splits, only the one that was most balanced on the clinical variables (table 1) was used for statistical analysis.
Preprocessing of the MRM-MS data involved several steps as described previously.21 Peptides that did not pass quality control metrics and those present in <75% of the patient samples were eliminated from the analysis. If the peptide was not detected in a sample, it was replaced with half of the minimum detected peptide level. Relative ratios of endogenous to stable isotope-labelled peptide abundance were log2 transformed and summarised at the protein level to create protein abundance data.
Statistical analysis was performed using R (http://www.r-project.org), Bioconductor (http://www.bioconductor.org) and STATA V.12.0 (College Station, Texas, USA). Pearson's correlation analysis was conducted to examine the relationship between individual candidate protein biomarkers and proteins from the final MRM-MS protein panel. Candidate protein biomarker levels were compared between the groups of patients who did versus did not experience an exacerbation within 4 months of stable blood draw groups using the Student t test. MRM-MS proteomic data were analysed for differential abundance between the two groups using robust-LIMMA22 (limma Bioconductor package). A random forest model was then applied to the panel of proteins with fold difference >1.5 between the patients who did versus did not experience an exacerbation within 4 months of stable blood draw to build a MRM-MS classifier. A post hoc sensitivity analysis was conducted to evaluate the impact of altering the fold difference threshold to >1.25 and >1.75 for protein selection.
Univariable associations between clinical variables and the presence or absence of an exacerbation within 4 months were presented using logistic regression. In multivariable analysis, generalised linear models were applied including all clinical variables (regardless the strength or significance of the association in univariable analysis) to build a clinical classifier. The best-performing clinical classifier was the simplest model (ie, the fewest number of variables) with the highest area under the receiver operating characteristics (ROCs) curve (area under the curve (AUC)). A similar process was performed to identify the best-performing candidate protein biomarker classifier. Ensembling was used to combine classifiers by using average or minimum probabilities from the individual classifiers23 to determine whether ensembles improved upon the prognostic performance of the individual classifiers. The performance characteristics of the classifiers were evaluated by leave-one-out cross-validation as described previously24 and included AUC, sensitivity, specificity and net reclassification index (NRI). Biomarker score cut-offs were chosen to maximise sensitivity and Youden's index (sensitivity+specificity – 1) in the discovery cohort. Finally, the classifiers were evaluated in a replication cohort of 34 patients.
Characteristics and therapies of the discovery and replication cohorts were similar (table 1). In both cohorts, one-third of participants experienced an exacerbation requiring intravenous antibiotics in the year prior to stable blood draw. A total of 30 (43%) participants from the discovery cohort and 13 (38%) participants from the replication cohort were diagnosed with an imminent exacerbation (ie, <4 months post-stable blood draw).
Clinical variables to predict exacerbations within 4 months
In univariable analysis, Pseudomonas aeruginosa infection status was the only clinical variable that was significantly associated with the presence of a pulmonary exacerbation within 4 months of stable blood draw (table 2). There was also a trend towards lower FEV1% predicted, lower BMI and a history of at least one pulmonary exacerbation requiring intravenous antibiotics in the prior year among the group of individuals who experienced a pulmonary exacerbation within 4 months of stable blood draw. In multivariable analysis, the best-performing clinical classifier was FEV1% predicted alone, with an AUC of 0.55 for the prediction of a pulmonary exacerbation within 4 months (sensitivity 87%, specificity 20%) (table 3).
Candidate protein biomarkers to predict exacerbations within 4 months
Based on the discovery cohort, plasma CRP and IL-6 levels were significantly higher in the group of individuals who exacerbated within 4 months of stable blood draw compared with those who did not (table 4). The best-performing individual candidate protein biomarker classifiers were CRP with an AUC of 0.61 (sensitivity 90%, specificity 35%) and IL-6 with an AUC of 0.60 (sensitivity 93%, specificity 28%) (table 4). In multivariable analysis, various panel combinations of the five-candidate protein biomarkers (including CRP and IL-6 together) did not add to the prognostic performance of CRP and IL-6 individually (data not shown) as CRP and IL-6 were highly correlated with each other (r=0.68, p<0.01) (see online supplementary table S2).
MRM-MS proteomic biomarkers to predict exacerbations within 4 months
Based on the discovery cohort, 109 peptides (75 proteins) passed quality control and were present in >75% of the samples. A number of proteins were differentially abundant in the plasma of individuals who exacerbated within 4 months of stable blood draw compared with those who did not. The 12 proteins that were statistically different between the two groups (p<0.05) or differed by >1.5-fold are listed in table 5. The six proteins with plasma levels that differed by >1.5-fold between the two groups were included in the final MRM-MS protein panel that had an AUC of 0.74 (sensitivity 90%, specificity 45%) (table 3). The NRI of the MRM-MS protein panel compared with CRP alone was 10% and compared with FEV1% predicted alone was 28%. The correlation between individual candidate and MRM-MS protein biomarkers is presented in online supplementary table S2, and the association between biomarker score and known determinants of disease severity is presented in online supplementary tables S3, S4 and figure S1. A post hoc sensitivity analysis evaluating the impact of altering the fold difference for protein selection to >1.25-fold and >1.75-fold demonstrated that the 1.5-fold threshold resulted in the best performance (see online supplementary table S5).
The six-protein MRM-MS panel was combined with the best-performing clinical panel (ie, FEV1% predicted alone) and the best-performing candidate protein biomarkers not already included in the MRM-MS panel (ie, IL-6 alone) using ensemble classification. The best ensemble, which involved combining the MRM-MS panel with FEV1% predicted, resulted in an AUC of 0.71 (sensitivity 90%, specificity 35%) (table 3). Based on an analysis of data that is currently available to CF clinicians, the ensemble of CRP and FEV1 had an AUC of 0.61 (90% sensitivity, 13% specificity) (table 3). The ROC curves corresponding to the individual and combined panels are shown in figure 2A.
The six-protein MRM-MS biomarker panel was evaluated in the replication cohort and demonstrated an AUC of 0.73, similar to the discovery cohort (AUC 0.74) (table 3). The performance of CRP alone, FEV1% predicted alone, CRP+FEV1% predicted and MRM-MS+FEV1% was also evaluated using the replication cohorts, and the results were also similar to those obtained based on the discovery cohort (table 5). The ROC curves of these panels are shown in figure 2B.
This is the first study to apply MRM-MS to identify blood-based biomarkers to improve the prediction of impending CF pulmonary exacerbations. We identified a six-protein panel from plasma that was able to discriminate individuals who are versus are not at imminent (<4 months) risk of an exacerbation with reasonable confidence (AUC 0.74) and replicated our findings using an independent cohort. Importantly, the prognostic performance of the MRM-MS protein panel exceeded clinical variables (eg, FEV1% predicted) and individual candidate plasma protein biomarkers (eg, CRP, IL-6), permitting the reclassification of 10–28% of subjects into correct groups compared with reliance on CRP or FEV1% predicted alone. Furthermore, there was no incremental improvement in performance if traditional markers (eg, FEV1% predicted, CRP) were added to the MRM-MS protein panel, suggesting that it might have utility as a standalone test.
In contrast to most prior biomarker discovery studies in CF that have focused on single proteins or molecules to evaluate treatment response or predict/diagnose exacerbations,20 we have demonstrated that a panel of six proteins is required to predict a very complex and heterogeneous process such as a pulmonary exacerbation. Although some of the proteins in our panel are biologically plausible in the context of exacerbations, further research is required to follow-up on the significance of individual biomarkers (ie, haemoglobin subunit alpha and carbonic anhydrase 1). Interestingly, five out of six proteins in our panel were less abundant in the plasma of patients with impending exacerbations. While speculative, this raises the possibility that reduced levels of these proteins may confer susceptibility to an exacerbation. For example, the antioxidant enzyme peroxiredoxin-2 was lower in the plasma of individuals with an impending exacerbation. Imbalance between reactive oxygen species and antioxidant defence can predispose to oxidative stress, and studies have demonstrated that CF pulmonary exacerbations might be either caused or amplified by increased oxidative stress.25 ,26
The main strengths of our study include the use of a large discovery cohort with clinical characteristics that closely resemble our overall adult CF clinic population. We had very few exclusion criteria in our study design to enhance the generalisability of our findings. We also employed a novel targeted proteomics technology that was recently recognised as Nature's ‘Method of the Year’ due to its superior multiplexing capabilities.12 A distinct advantage of this platform is that it does not rely upon affinity-based measurement, which often limits the sensitivity and specificity of antibody-based assays. While there remains no gold standard definition of a pulmonary exacerbation, we used a clinical trial definition that has been endorsed by the EuroCareCF Working Group.16
There are a number of important study limitations that should be acknowledged. The peptide/protein library we interrogated with MRM-MS was not unbiased as we used a list of peptides that had been synthesised in prior studies performed in COPD and renal/cardiac allograft rejection. As a result, our biomarker panel cannot be considered truly comprehensive, but this proof-of-concept study provides the opportunity to find new biomarker targets potentially informed by unbiased proteomic techniques or transcriptomics. In this discovery study, we did not adjust our analysis for multiple testing to reduce the risk of missing promising biomarker targets, but this also increased our risk of a type I error. For our primary analysis, we chose to evaluate the biomarker score to predict pulmonary exacerbations within 4 months (ie, prior to the next clinic visit) because we felt this test would be more useful to the clinician. Alternatively, a time-to-event Cox proportional hazards analysis could have been performed to compare time to exacerbation between biomarker score groups and to adjust for potential confounders. While this additional analysis was performed post hoc, our results were generally consistent with our primary analysis and are presented in the online data supplement (see online supplementary table S6 and figure S2). We did not include paediatric patients in this study and therefore our results are not generalisable to this subset of the CF population that is in need for new biomarkers. While we have demonstrated that the MRM-MS panel can discriminate between groups of patients with versus without an imminent exacerbation, we will need to characterise intraindividual variability (ie, signal-to-noise ratio) in measurements over time as part of the test validation phase prior to this becoming a clinically validated tool. Lastly, we decided to maximise sensitivity when defining biomarker cut-off scores because a high sensitivity test can reduce the number of missed exacerbation prior to the next clinic visit. As the sensitivity of all three classifiers was excellent (≥90%), the MRM-MS panel outperformed the candidate protein and clinical classifiers mainly due to improved specificity. The higher specificity of the MRM-MS panel relative to the other classifiers is important clinically because it reduces the false positive rate or the proportion of patients that are predicted to experience an exacerbation when in fact they do not. False positive prognostic test results can lead to the unnecessary initiation of expensive and potentially harmful preventative treatments. With the inherent trade-off between test sensitivity and specificity, the false positive rate might still be considered unacceptably high for use in a clinical setting and therefore the biomarker panel score cut-off could be optimised to increase specificity. A biomarker test to predict exacerbation is unlikely to be perfect because some exacerbations represent stochastic events potentially triggered by an unexpected exposure to a respiratory virus (eg, influenza) for example and thus, may not be predictable.
In summary, we have demonstrated for the first time that MRM-MS can be applied for biomarker discovery in CF to predict imminent pulmonary exacerbations. While our discovery phase results are encouraging, the MRM-MS panel is not yet ready for use as a clinically validated tool as our findings must be placed within the scope of the biomarker development process as outlined by the Institute of Medicine.27 MRM-MS is a platform that has been used in the clinical lab to measure small molecules (eg, hormones, metabolites, drugs) but requires further research and optimisation prior to its application in the clinical lab for routine peptide/protein analysis.12 ,28 Future research directions will include replication in an external cohort, analytical and clinical/biological validation, and evaluation in a clinical utility study.
We thank our patients for their participation. We would also like to thank Lynda Lazosky, Eri Flores, Sheena Tam, Yeni Oh and David Ngan for their assistance with patient recruitment and sample processing.
Review history and Supplementary material
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Files in this Data Supplement:
- Data supplement 1 - Online supplement
A portion of the data was presented in abstract form at the 2014 North American Cystic Fibrosis Conference on 9–11 October 2014 in Atlanta, Georgia.
Contributors BSQ was involved in the study concept and design, data analysis and manuscript preparation. DLYD, ZH and RTN were involved in the data analysis and manuscript preparation. DDS, PGW, SFPM and SJT were involved in the study concept and design and revising it critically for important intellectual content. All authors are agreeable to the final version to be published and accept accountability for the integrity of all aspects of the work.
Funding The British Columbia Lung Association, Providence Health Care Research Institute and Cystic Fibrosis Canada provided grant support for this study.
Competing interests None.
Ethics approval University of British Columbia—Providence Health Care (UBC-PHC) Research Institute Ethics Board.
Provenance and peer review Not commissioned; internally peer reviewed.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.