Background Failure to detect respiratory compromise can lead to emergency healthcare use and fatal asthma attacks. The purpose of this study was to examine the effect of predicting peak expiratory flow (PEF) and receiving feedback on perception of pulmonary function and adherence to inhaled corticosteroids (ICS).
Methods The sample consisted of 192 ethnic minority, inner-city children (100 Puerto Rican, 54 African-American, 38 Afro-Caribbean) with asthma and their primary caregivers recruited from outpatient clinics in Bronx, New York. Children's PEF predictions were entered into an electronic spirometer and compared with actual PEF across 6 weeks. Children in one study were blinded to PEF (n=88; no feedback) and children in a separate study were able to see PEF (n=104; feedback) after predictions were locked in. Dosers were attached to asthma medications to monitor use.
Results Children in the feedback condition displayed greater accuracy (p<0.001), less under-perception (p<0.001) and greater over-perception (p<0.001) of respiratory compromise than children in the no feedback condition. This between-group difference was evident soon after baseline training and maintained across 6 weeks. The feedback condition displayed greater adherence to ICS (p<0.01) and greater quick-relief medication use (p<0.01) than the no feedback condition.
Conclusions Feedback on PEF predictions for ethnic minority, inner-city children may decrease under-perception of respiratory compromise and increase adherence to controller medications. Children and their families may shift their attention to asthma perception and management as a result of this intervention.
Statistics from Altmetric.com
What is the key question?
Do children with asthma who receive feedback on predictions of peak expiratory flow (PEF) have better perception of pulmonary function and greater adherence to inhaled corticosteroids (ICS) than children who do not receive feedback?
What is the bottom line?
Children who received feedback on predictions of PEF were less likely to under-perceive respiratory compromise and were more adherent to ICS than children who did not receive feedback.
Why read on?
Prediction of PEF values followed by feedback may assist children with asthma in improving the accuracy of disease perception and ICS adherence.
Under-perception of respiratory compromise is a risk factor for emergency department (ED) visits, hospitalisations, near-fatal and fatal asthma attacks in children.1 Children with severe bronchial hyperresponsiveness are particularly at risk for missing the early stage of bronchoconstriction during asthma exacerbations.2 A window of opportunity exists when patients with asthma can use bronchodilator medications in the days leading up to a severe asthma exacerbation and prevent its onset.3 ,4 However, there has been very limited research on how to improve the perceptual accuracy of pulmonary function.
Peak expiratory flow (PEF) meters are recommended for asthma self-management in individuals with inaccurate asthma symptom perception.5 PEF monitoring typically involves measurement and recording of PEF twice per day prior to taking asthma medications. PEF prediction with feedback requires children to guess their PEF, which is locked in, and then see their actual PEF. This protocol can be more interactive and engaging for children than simply monitoring PEF, as they strive to see how close their guesses match their actual PEF. A small, uncontrolled study of PEF prediction-feedback showed that children and adults demonstrated accurate PEF predictions soon after baseline training, which was maintained across 3 weeks.6 Receiving feedback on PEF using electronic devices is linked with better adherence to inhaled corticosteroid (ICS) medications and less asthma morbidity in adults.7 Immediate, objective feedback following PEF prediction may alter an individual's attention and increase the perceived threat level, which may play a key role in asthma symptom perception.8 Motivational interviewing is based upon self-perception theory9 and posits that objective feedback showing low PEF values can be used to elicit motivational statements from the client related to the benefits of long-term asthma control and adherence to ICS medications. These verbalisations by the patient in turn predict attitudinal and behavioural changes toward these goals.10
The Bronx, New York is one of the poorest counties in the USA, and paediatric asthma prevalence and hospitalisation rates are among the highest in the country.11 Puerto Rican and non-Latino black children have the highest paediatric asthma prevalence rates compared with other racial/ethnic groups.12 Perception of pulmonary function13 ,14 and adherence to ICS medications15 ,16 is worse in Puerto Rican and African-American children versus Caucasian children. Underestimation of asthma severity by providers and under-prescription of ICS medications contribute to poor adherence rates among inner-city children.17 We hypothesised that children who receive feedback on PEF predictions would have less under-perception of respiratory compromise, better ICS adherence and less quick-relief medication use than children who do not receive feedback.
A convenience sample of children with asthma and their primary caregivers in the Bronx, New York was recruited from asthma and primary care clinics, the ED and mailings. Children in the first study received PEF feedback following PEF prediction and ranged in age from 7 to 15 years old. Children in the second study did not receive PEF feedback following PEF prediction and ranged in age from 7 to 12 years old. All other inclusion criteria were identical between the two studies. A physician diagnosis of asthma was confirmed by medical chart review and children were required to report breathing difficulties within the past year. Only Puerto Rican, African-American and Afro-Caribbean children were included and one child per family was eligible to participate. Children were excluded for cognitive learning disability, vocal cord dysfunction (assessed by chart review and spirometry) or inability to conduct spirometry. Families were financially compensated for completing the training session and measures at baseline, and returning devices 6 weeks later. The institutional review board at Albert Einstein College of Medicine approved the study protocol and consent process.
Pulmonary function perception
Children and their primary caregivers were trained extensively during a baseline session on use of the AM2 electronic spirometer and diary (ERT, Philadelphia, Pennsylvania, USA). A colourful sticker was placed on the AM2 with the child's predicted PEF values corresponding to the three traffic light zones ranging from a happy face to a sad face. Children entered their prediction of PEF into the AM2 and then conducted a forced vital capacity manoeuvre. Although parents were encouraged to enforce the child's use of the AM2, the actual prediction of PEF was from the child. All children practiced maximal effort blows until they consistently displayed correct technique. Each use of the AM2 required three consecutive manoeuvres and the best of the three blows was retained. Participants were instructed to use the AM2 device before taking any asthma medications each morning and evening for 6 weeks at home. An acoustic alarm served as a reminder to use the device at consistent times each day. Children in the PEF feedback condition were able to see their PEF values. However, their predictions of PEF were locked in before conducting the blow and could not be changed. Children in the no feedback condition were blinded to PEF during the 6 weeks and only saw their PEF during the baseline session.
The Asthma Risk Grid18 (figure 1) was developed to measure perception of lung function. Children's PEF prediction and actual PEF (both in litres/min) are converted to percent of objective personal best for each individual child. The personal best PEF for each child is based on the highest PEF achieved during 6 weeks of data collection after outliers are removed. The percentage of predictions in the accurate zone (close match between subjective and objective), danger zone (under-perception of respiratory compromise) and magnification zone (over-perception of respiratory compromise) are the measures of perception. For example, a child's prediction of PEF that corresponds to 85% personal best, but actual PEF value was 55% personal best would be categorised in the danger zone. The smallest margin of error allowed is 10%, as depicted in the ±10% wedge of the accurate zone in figure 1. Each blow is categorised into only one of these three zones. A child is not categorised as an ‘under perceiver’ or ‘over perceiver’. For example, a child might be categorised 50% of the time in the accurate zone and 25% in the danger and magnification zones. Percentages are treated as continuous variables in each zone for each child.
This methodology for perception of pulmonary function has been used in several studies, although children were not blinded to PEF.13 ,19 Greater perceptual accuracy of pulmonary function using this methodology is associated with lower levels of asthma morbidity during the past year13 ,19 and prospectively across a 1-year follow-up.20
Adherence to ICS and quick-relief medication use during the perception task
Doser devices (MediTrack Products, Hudson, Massachusetts, USA) were attached to the top of ICS and quick-relief metered dose inhalers. Dosers are more reliable for monitoring medication use than self-report or pharmacy records.21 These devices record the number of actuations taken per day across the past 30 days. Adherence to ICS medications was calculated by dividing the number of puffs taken by the number of puffs prescribed. Data reduction steps eliminated any extra puffs recorded to avoid artificial inflation of adherence to ICS or quick-relief medication use. Dosers were assigned for ICS medications to 95 of 192 children, and for quick-relief medication to 181 of 192 children. Dosers for ICS and quick-relief medications were lost by 10 and 16 children, respectively.
Asthma severity, asthma control and asthma morbidity at baseline
Asthma severity ratings were based on national guidelines and incorporated asthma symptoms/impairment (eg, nocturnal awakenings, quick-relief medication use), current asthma medication regimen and pulmonary function (% forced expiratory volume in 1 s (FEV1)) at baseline.5 Asthma control ratings were based on symptoms/impairment and pulmonary function. Severity and control were based on the most severe level reached in each individual category. Spirometry was conducted using a clinical spirometer (nSpire Health, Longmont, Colorado, USA) according to American Thoracic Society standards.22 The Asthma Functional Severity Scale23 assessed caregiver report of asthma symptoms/impairment during the month prior to the study. The scale has good reliability and validity,23 and was translated and adapted into Spanish for Latinos.13 Caregiver reports of ED visits and hospitalisations for asthma were based on the past year.
Language preference and poverty threshold
The language of the interview was conducted in English or Spanish based on the caregiver's preference. Families were categorised as living above or below the federal poverty line.24
Analyses of covariance were conducted to assess differences between the PEF feedback and no feedback conditions on each of the perception zones and medication use. The child's age was entered as a covariate due to the difference in age range between the two conditions, and older children are more accurate on perception of pulmonary function13 but less adherent to controller medications.25 Main analyses were repeated by restricting the age range to 7–12 years old for the entire sample to ensure that any between-group differences were not explained by age. A growth model with individually varying times of observation examining accuracy over time was conducted using MPlus V6.1. This analysis examined whether a learning effect across the 6-week period was associated with the PEF feedback versus no feedback condition. Ethnicity and child's age were included as covariates. The perceptual accuracy protocol requires a minimum of 20 data points to provide reliable estimates of perceptual ability.13 Tukey-Kramer adjustment was specified when multiple comparison tests were conducted. Analyses were conducted with PASW Statistics V.18 and SAS V.9.2.
A total of 192 children completed the study (see figure 2). The rate of completion (88.1% for PEF feedback vs 78.6% for no feedback) was not significantly different between the two conditions. Children who completed the study were not different according to ethnicity, age or sex versus children who did not complete the study, across both conditions (PEF feedback, no feedback). The primary reasons for ineligibility included ethnicity and learning disability in the child. Participants were recruited via asthma clinics (51.8%), mailings (22.6%), primary care clinics (12.8%), ED (6.7%) and other sources (6.1%). Table 1 shows that children in the PEF feedback condition were older than the no feedback condition, which was the result of the wider age range in the feedback condition. No other between-group differences were found on demographics, recruitment site, asthma control or asthma severity. Asthma severity was mostly in the moderate and severe persistent categories, which is consistent with asthma clinics being the primary source of recruitment.
Perception of pulmonary function, demographics and asthma severity
Older children had a greater percentage of PEF predictions in the accurate zone (r=0.26, p<0.001) and a lower percentage in the danger zone (r=−0.30, p<0.001). Age was not associated with the magnification zone (r=0.06, p=0.392). Table 2 shows that children's sex, ethnicity, and poverty level were not associated with perception of pulmonary function. Children of caregivers born in the USA had a higher percentage of predictions in the accurate zone than children of caregivers who were not born in the USA. Asthma severity was not associated with the accurate or danger zones.
Perception of pulmonary function with and without PEF feedback
Children who received PEF feedback were more likely to have predictions in the accurate zone than children in the no feedback group (F(1, 189)=12.72; see table 3). Children who received PEF feedback were less likely to under-perceive respiratory compromise than children in the no feedback group (F(1, 189)=65.63). Children who did not receive PEF feedback were in the danger zone 42% of the time versus 15% for the PEF feedback group. Over-perception of respiratory compromise was more common in the PEF feedback group than the no feedback group (F(1, 189)=18.28). Use of the AM2 device was identical (M=48.7 valid prediction PEF values) in both groups.
These analyses were repeated by excluding 29 children in the PEF feedback group who were between 13 and 15 years old to create the same age range in both conditions. Children who received feedback (n=75) were still less likely to under-perceive (F(1, 160)=58.29, p<0.001) and more likely to over-perceive (F(1, 160)=18.91, p<0.001) respiratory compromise, and had higher accurate zone scores (F(1, 160)=10.29, p=0.002) than children without feedback (n=88).
The results of the growth model showed that there was no evidence of an incremental learning effect across time in either the feedback or no feedback condition. The data demonstrated good fit with the model: root mean square error approximation (RMSEA)=0.03, comparative fit index (CFI)=0.94 and Tucker-Lewis index (TLI)=0.94. The results revealed that there were statistically significant differences in initial perception zone classifications (eg, accurate zone) based on PEF feedback group (β=0.36, p=0.001). Examination of the slope results indicated no effect for ethnicity or child's age on perception zone classification. There were no statistically significant changes over time for perception zone classifications in either group. These findings indicate that between-group differences on perception were evident very early during the course of the 6-week perception trial.
PEF feedback and medication use during the perception trial
Children who received PEF feedback (n=46) had greater adherence to ICS medications during the perception trial than children in the no feedback group (n=39), with age as a covariate in the model (F (1, 82)=10.08; see table 3). Children in the PEF feedback group (n=92) also used more puffs of quick-relief medication versus children in the no feedback group (n=73) after controlling for age (F (1, 161)=7.86). These findings did not change when only including children 7–12 years old.
Perception of pulmonary function and asthma morbidity at baseline
The danger zone was associated with greater caregiver report of functional morbidity, asthma-related ED visits and hospitalisations in the PEF feedback group (see table 4). This finding suggests that under-perception of respiratory compromise despite PEF prediction feedback is a risk factor linked to asthma morbidity. ED use was high in this sample, as 74.0% reported at least one ED visit for asthma and 17.3% reported at least one hospitalisation. No other perception zones were significantly associated with asthma morbidity in either group.
This study shows that inner-city, ethnic minority children are at risk for a dangerous combination of under-perception of respiratory compromise and very poor adherence to ICS medications when measured without PEF prediction feedback. Children who received the PEF prediction feedback intervention had a lower rate of under-perception and higher rates of perceptual accuracy and ICS adherence. This finding might reflect greater attention to asthma perception and management as a result of PEF prediction feedback. Children's attention skills are the strongest predictor of asthma perceptual accuracy.26 The surprising finding of greater over-perception and quick-relief use in the PEF feedback condition might also be attributed to higher levels of attention focused on asthma. Given that children who received feedback only used ICS medications slightly less than half of the time, frequent quick-relief medication use may have been the result of seeing low levels of PEF. This finding suggests that significant barriers to ICS medication use (eg, acute, episodic views of asthma) may persist despite improvements in asthma symptom perception. The low rates of under-perception in the PEF feedback group were similar to rates reported for Latino children using the same protocol.13 Therefore, previously reported higher rates of accurate perception measured with PEF prediction feedback13 ,19 might underestimate the problem of under-perception of respiratory compromise in more realistic settings that do not involve prediction feedback.
The current study suggests that PEF prediction feedback may be one useful self-management tool in clinical interventions to improve perceptual accuracy and adherence. The act of predicting PEF prior to the manoeuvre may play a critical role, as it requires children to assess their breathing status before receiving the results. Children may view PEF prediction feedback as a game to see how closely their predictions match their actual PEF. The protocol was not simply an exercise in PEF monitoring. Therefore, a system that combines prediction with a PEF monitor might be required to increase perceptual accuracy and ICS adherence. The growth model analyses indicated that children in the feedback condition performed better than the no feedback group in the accurate and danger zones soon after they took the AM2 devices home. The lack of an incremental learning effect across time is consistent with prior studies6 ,13 and suggests that children may show rapid improvement in perceptual accuracy, which is maintained across time. This finding might reflect a ceiling effect that occurs with PEF prediction feedback without additional components, such as asthma education or weekly feedback meetings to discuss perceptual accuracy. Lack of attention to asthma management was demonstrated in the no feedback condition. The absence of significant correlations between children's under-perception of asthma symptoms and parent report of asthma morbidity in the no feedback group might reflect a dangerous situation in which both child and parent are unaware of asthma symptoms, and not seeking healthcare services.
Limitations of this study include the lack of a randomised controlled trial and the difference in age range between the feedback (7–15 years) and no feedback (7–12 years) conditions. However, the only between-group difference on demographics was the child's age. Restricting the age range to 7–12 years in both conditions did not change any results, and the child's age was a covariate in the models. The study relied on convenience samples and community samples should be used in future studies. It is possible that children who were blinded to PEF might have used less effort. However, objective PEF values were not different between the two conditions. Parent report of asthma morbidity was based on retrospective recall. Prospective, longitudinal studies are needed to assess the relationship between children's asthma symptom perception (with and without PEF feedback) and asthma morbidity.
There is great potential to adapt PEF prediction with feedback using the internet, text messaging27 ,28 and smartphone applications, which would create a stimulating and motivating reinforcer. Motivational interviewing with inner-city adolescents to increase adherence to controller medications29 might be a complementary intervention to provide additional feedback and increase the rate of ICS adherence. It will also be critical to incorporate caregivers into interventions designed to increase perception of pulmonary function in children to improve asthma management.
We would like to acknowledge the cooperation from the New York City Health and Hospitals Corporation, Jacobi Medical Center and North Central Bronx Hospital.
Contributors All authors meet the criteria for authorship set forth by the International Committee for Medical Journal Editors. JMF supervised field activities, conducted the literature review and statistical analyses, and drafted initial versions of the manuscript. HK, LM, ML, DS, DS and KW assisted with quality assurance and control and helped direct the implementation of the study. KSA participated in statistical analyses and data interpretation. All authors provided extensive feedback on the entire manuscript.
Funding This study was funded by the American Lung Association (SB-204740N; PI: J Feldman) and National Institute of Child Health and Human Development (1R03HD053355; PI: J Feldman).
Disclaimer The study sponsors had no involvement in study design, data collection, analysis, interpretation of data or the decision to submit the paper for publication.
Competing interests Dr. Serebrisky has received lecture fees from TEVA Respiratory.
Ethics approval Institutional Review Board at Albert Einstein College of Medicine.
Provenance and peer review Not commissioned; externally peer reviewed.