Article Text

other Versions

Untargeted Molecular Analysis of Exhaled Breath as a Diagnostic Test for Ventilator-Associated Lower Respiratory Tract Infections (BreathDx)
  1. Pouline MP van Oort1,
  2. Tamara M Nijsen2,
  3. Iain R White3,4,
  4. Hugo H Knobel5,
  5. Timothy Felton4,
  6. Nicholas Rattray6,
  7. Oluwasola Lawal4,
  8. Murtaza Bulut2,
  9. Waqar Ahmed7,
  10. Antonio Artigas8,
  11. Pedro R Povoa9,
  12. Ignacio Martin-Loeches10,
  13. Hans Weda11,
  14. Royston Goodacre12,
  15. Marcus J Schultz1,13,
  16. Paul M Dark14,
  17. Stephen J Fowler15,
  18. Lieuwe D Bos1,16
  19. on behalf of the BreathDx Consortium
    1. 1Intensive Care, Amsterdam UMC Location AMC, Amsterdam, The Netherlands
    2. 2Philips Research, Eindhoven, The Netherlands
    3. 3Laboratory for Environmental and Life Sciences, University of Nova Gorica, Nova Gorica, Slovenia
    4. 4Division of Infection, Immunity and Respiratory Medicine, University of Manchester, Manchester, UK
    5. 5Materials Analysis, Eurofins Materials Science Netherlands BV, Eindhoven, The Netherlands
    6. 6Department of Pharmacy, University of Strathclyde, Glasgow, UK
    7. 7Manchester Institute of Biotechnology, University of Manchester, Manchester, UK
    8. 8Critical Care Centre, Corporació Sanitària I Universitaria Parc Taulí-Hospital De Sabadell-Ciber Enfermedades Respiratorias, Sabadell, Barcelona, Spain
    9. 9Intensive Care, Centro Hospitalar de Lisboa Central, Lisbon, Portugal
    10. 10Department of Clinical Medicine, University of Dublin Trinity College, Dublin, Ireland
    11. 11Orikami, Nijmegen, The Netherlands
    12. 12Department of Biochemistry, University of Liverpool, Liverpool, UK
    13. 13Mahidol–Oxford Tropical Medicine Research Unit (MORU), Mahidol University, Bangkok, Thailand
    14. 14Intensive care, University of Manchester, Manchester, UK
    15. 15Respiratory Medicine, Lancashire Teaching Hospitals NHS Foundation Trust, Preston, UK
    16. 16Respiratory Medicine, Amsterdam UMC Location AMC, Amsterdam, Netherlands
    1. Correspondence to Dr Lieuwe D Bos, Intensive Care, Amsterdam UMC Location AMC, 1105 AZ Amsterdam, The Netherlands; l.d.bos{at}amc.uva.nl

    Abstract

    Patients suspected of ventilator-associated lower respiratory tract infections (VA-LRTIs) commonly receive broad-spectrum antimicrobial therapy unnecessarily. We tested whether exhaled breath analysis can discriminate between patients suspected of VA-LRTI with confirmed infection, from patients with negative cultures. Breath from 108 patients suspected of VA-LRTI was analysed by gas chromatography-mass spectrometry. The breath test had a sensitivity of 98% at a specificity of 49%, confirmed with a second analytical method. The breath test had a negative predictive value of 96% and excluded pneumonia in half of the patients with negative cultures. Trial registration number: UKCRN ID number 19086, registered May 2015.

    • pneumonia
    • assisted ventilation
    • critical care
    https://creativecommons.org/licenses/by/4.0/

    This is an open access article distributed in accordance with the Creative Commons Attribution 4.0 Unported (CC BY 4.0) license, which permits others to copy, redistribute, remix, transform and build upon this work for any purpose, provided the original work is properly cited, a link to the licence is given, and indication of whether changes were made. See: https://creativecommons.org/licenses/by/4.0/.

    Statistics from Altmetric.com

    Introduction

    Ventilator-associated lower respiratory tract infections (VA-LRTIs) are the most common nosocomial infections in the intensive care unit (ICU).1 Patients with suspected VA-LRTI usually receive broad-spectrum antibiotics before the diagnosis can be confirmed, since microbial cultures may take days to become positive.2 Volatile metabolites in exhaled breath can reflect changes in pathogen growth and/or the host response.3 Gas chromatography-mass spectrometry (GC-MS) is considered the gold standard for biomarker discovery from exhaled breath.4 Recent meta-analyses showed that the evidence is conflicting on the diagnostic value of volatile metabolites as biomarkers of VA-LRTI.3 5

    In the current study, we hypothesised that exhaled breath analysis can discriminate between patients suspected of VA-LRTI and treated with broad-spectrum antibiotics who had positive cultures versus those who have negative cultures with high sensitivity and at least a moderate specificity.

    Methods

    The ‘Molecular Analysis of Exhaled Breath as Diagnostic Test for Ventilator-Associated Pneumonia’ Study (BreathDx) was an international multicentre observational cohort study in ICU patients undergoing invasive ventilation and commencing antimicrobial therapy for suspected VA-LRTI. Patients were recruited across four ICUs of university hospitals in the Netherlands and the UK between February 2016 and February 2018. Since this study concerned patients lacking capacity, formal assent was sought with a designated consultee at time of inclusion. Deferred consent was obtained for patients who regained capacity. The study methods have been published.6

    Patients were recruited and samples collected within 24 hours of the clinical suspicion of VA-LRTI. Exhaled breath samples were collected at first, followed by lower respiratory tract fluid samples (bronchoalveolar lavage (BAL) or mini-BAL samples). Positive cultures with a colony forming unit (CFU) cut-off of >104 CFU/mL confirmed VA-LRTI. The specifications and origins of the equipment used for breath sampling have been described previously6 and met the criteria formulated in the European Respiratory Society technical statement on exhaled breath analysis.7 Breath metabolites were measured on two GC-MS machines with complementary properties. GC-MS-1 was targeted for more volatile metabolites, while GC-MS-2 targeted heavier and cyclic volatile metabolites. Data from GC-MS-1 were used for the primary analyses.

    The sample size of 153 patients was not met in the chosen time frame for recruitment, due to an unexpected low presentation of VA-LRTI suspected cases at all study sites. Despite this, we maintained all predefined cut-offs for clinically relevant test characteristics.6 Untargeted analysis was used to investigate the primary outcome of the study. Sparse partial least squares (SPLS) models were used to fit diagnostic models on log-transformed data8 (for more details, see the online supplemental file 1).

    Results

    One hundred eight patients were suspected of VA-LRTI and were included, of whom 52 (48%) had positive cultures. Most patients developed VA-LRTI after 4 days of mechanical ventilation (68 of 108; 63%). Table 1 shows baseline demographic characteristics of the study population (stratified per centre; online supplemental table S1). Fifteen samples on GC-MS-1 and 19 on GC-MS-2 were of insufficient quality to use for further analysis (figure 1; baseline data stratified for availability of GC-MS-1 or 2 sample; online supplemental tables S2 and S3. Online supplemental figures S1–S9 show influence of centre, storage time, analysis date and duration of mechanical ventilation on breath profiles.

    Table 1

    Patient demographics

    Figure 1

    One hundred eight patients were included in the study. Exhaled breath analysis was performed using GC-MS-1 and GC-MS-2. Several measurements failed and were not used for further analysis. The 2×2 tables in the bottom of the figure indicate the diagnostic performance of each analytical platform for culture positivity. GC-MS, gas chromatography-mass spectrometry.

    Five out of 184 unique volatile metabolites were significantly increased in patients suspected of VA-LRTI with positive cultures (table 2). SPLS analysis also identified these molecules, together with five additional volatile metabolites (table 2). The area under the receiver operating characteristics curve (AUROCC) for this model was 0.86 (95% CI: 0.79 to 0.94) with a specificity of 49% at the predefined sensitivity of 98% resulting in a negative predictive value (NPV) of 96% and a positive predictive value of 63% (figure 1). The addition of the clinical pulmonary infection score reduced the specificity to 41% at the same sensitivity with a marginal increase in AUROCC to 0.87 (95% CI: 0.80 to 0.94). This accuracy was reproduced in additional samples collected at the same time and analysed on the same platform and on GC-MS-2 (online supplemental table S4 and figure S11). No confounding variables were identified (online supplemental table S5). The association between the breath test and confirmed VA-LRTI was not moderated by the presence of pulmonary infiltrates (p=0.17) or if it concerned early or late VA-LRTI (p=0.40).

    Table 2

    VOCs included in the diagnostic model for GC-MS-1 for culture positivity

    Discussion

    In the present study, 53% of the included patients had negative cultures and may have received antibiotics unnecessarily. Exhaled breath analysis correctly suggested the absence of a bacterial growth in half of these patients. A high sensitivity accompanied by an acceptable specificity is required to allow for withholding of antibiotics for VA-LRTI. The presented results need to be further triangulated with additional biomarker data and comparison of composition of the lung microbiome. Compared with previous studies that focused on breath analysis, this is the first to predefine these diagnostic cut-offs in an analysis plan and commit to a standardised analysis methodology.

    A variety of volatile organic compounds contributed to the diagnostic model purposed to exclude respiratory infection. Ten of the 21 molecules have been described previously in relation to bacterial growth or host response, increasing the biological plausibility of our findings. Formaldehyde and dimethylsulfide were predictive biomarkers for respiratory infection based on a systematic review of preclinical data.9 Additionally, several of the identified hydrocarbons have been linked to oxidative stress. For example, 3-methylheptane has been associated with acute respiratory distress syndrome,10 11 is associated with lipid peroxidation12 and has also been detected in the bacterial headspace samples of Escherichia coli.12

    The major strength of this study is that we followed a predefined methodology and statistical analysis plan as published in the study protocol.6 Another strength was the multicentre design of the study, enhancing the chances of reaching the required sample size, sampling patients in a broader range of clinical settings and promoting the subsequent generalisation of the study results. The BreathDx Study faced a slower recruitment rate than expected, which is a weakness of the study. The calculated required sample size of 153 patients was not reached. An unexpected low incidence of VA-LRTI suspicion was seen at all sites. A larger sample size would have resulted in more confidence in the estimated sensitivities and specificities. An independent validation of the found accuracies is required, preferably using a bedside technology that can be used in clinical practice. It would be preferable to collect samples before antibiotic administration rather than within 24 hours as we did in this study. Incorporation with other clinical and biological markers is encouraged and should be part of future studies.

    To conclude, exhaled breath analysis can differentiate between patients with confirmed VA-LRTI and those with negative cultures with high NPV. The identified biomarkers are supported by preclinical evidence.

    Ethics statements

    Ethics approval

    The study was approved by the institutional review boards.

    References

    Supplementary materials

    • Supplementary Data

      This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    • Supplementary Data

      This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Footnotes

    • Twitter @PoulineVanOort, @waqar___, @imloeches, @StephenJ_Fowler, @Acute_pulmo_med

    • SJF and LDB contributed equally.

    • Collaborators BreathDx Consortium: Jonathan Bannard-Smith, Marta Camprubi, Luis Coelho, Alan Davie, Emili Diaz, Gemma Goma, Craig Johnson, Jan-Hendrik Leopold, Guus Rijnders, Ruud Steenwelle, Peter J Sterk, Jordi Valles, Fred Verhoeckx, Anton Vink, Tineke Winters, Tetyana Zakharkina.

    • Contributors LDB, SJF, PMD and MJS designed the study. LDB, TMN and SJF wrote the study protocol. PvO, TMN, HHK, PMD, TF, IRW, NR, OL, WA, HW, IM-L, PRP, AA, RG, MJS, SJF and LDB advised on study design and participated in the study protocol. All authors approved the study design. LDB performed the power calculation. WA and MB performed data preprocessing. HW, RG and SJF designed the statistical analysis plan. LDB performed the statistical analysis. PvO, MJS and LDB prepared the initial draft of this manuscript. All authors approved the submitted version of this manuscript.

    • Funding The project was funded by the European Union FP7 Marie Curie Actions, under the Industry-Academia Partnerships and Pathways (IAPP) programme (MC-IAPP BreathDx 611951). IRW, TF, PMD and SJF were supported by the NIHR Manchester Biochemical Research Centre.

    • Competing interests None declared.

    • Provenance and peer review Not commissioned; externally peer reviewed.

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.