Article Text

other Versions

PDF

Original article
Proactive tobacco treatment offering free nicotine replacement therapy and telephone counselling for socioeconomically disadvantaged smokers: a randomised clinical trial
  1. Steven S Fu1,2,
  2. Michelle van Ryn3,
  3. David Nelson1,2,
  4. Diana J Burgess1,2,
  5. Janet L Thomas2,
  6. Jessie Saul4,
  7. Barbara Clothier1,
  8. John A Nyman5,
  9. Patrick Hammett2,
  10. Anne M Joseph2
  1. 1VA HSR&D Center for Chronic Disease Outcomes Research, Minneapolis, Minnesota, USA
  2. 2Department of Medicine, University of Minnesota Medical School, Minneapolis, Minnesota, USA
  3. 3Division of Health Care Policy & Research, Mayo Clinic, Rochester, Minnesota, USA
  4. 4North American Quitline Consortium, Phoenix, Arizona, USA
  5. 5Division of Health Policy and Management, University of Minnesota School of Public Health, Minneapolis, Minnesota, USA
  1. Correspondence to Dr Steven S Fu, Center for Chronic Disease Outcomes Research (CCDOR), Minneapolis VA Health Care System, 1 Veterans Drive (152), Minneapolis, MN 55417, USA; Steven.Fu{at}va.gov

Abstract

Background Evidenced-based tobacco cessation treatments are underused, especially by socioeconomically disadvantaged smokers. This contributes to widening socioeconomic disparities in tobacco-related morbidity and mortality.

Methods The Offering Proactive Treatment Intervention trial tested the effects of a proactive outreach tobacco treatment intervention on population-level smoking abstinence and tobacco treatment use among a population-based sample of socioeconomically disadvantaged smokers. Current smokers (n=2406), regardless of interest in quitting, who were enrolled in the Minnesota Health Care Programs, the state's publicly funded healthcare programmes for low-income populations, were randomly assigned to proactive outreach or usual care. The intervention comprised proactive outreach (tailored mailings and telephone calls) and free cessation treatment (nicotine replacement therapy and intensive, telephone counselling). Usual care comprised access to a primary care physician, insurance coverage of Food and Drug Administration-approved smoking cessation medications, and the state's telephone quitline. The primary outcome was self-reported 6-month prolonged smoking abstinence at 1 year and was assessed by follow-up survey.

Findings The proactive intervention group had a higher prolonged abstinence rate at 1 year than usual care (16.5% vs 12.1%, OR 1.47, 95% CI 1.12 to 1.93). The effect of the proactive intervention on prolonged abstinence persisted in selection models accounting for non-response. In analysis of secondary outcomes, use of evidence-based tobacco cessation treatments were significantly greater among proactive outreach participants compared with usual care, particularly combination counselling and medications (17.4% vs 3.6%, OR 5.69, 95% CI 3.85 to 8.40).

Interpretation Population-based proactive tobacco treatment increases engagement in evidence-based treatment and is effective in long-term smoking cessation among socioeconomically disadvantaged smokers. Findings suggest that dissemination of population-based proactive treatment approaches is an effective strategy to reduce the prevalence of smoking and socioeconomic disparities in tobacco use.

Trial registration number NCT01123967.

  • Smoking cessation
  • Tobacco control

This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/

Statistics from Altmetric.com

Key messages

  • What is the key question?

  • What is the effect of population-based proactive tobacco treatment on use of evidence-based smoking cessation treatments and long-term quit rates compared with usual care among socioeconomically disadvantaged smokers?

  • What is the bottom line?

  • Population-based proactive tobacco treatment is effective in increasing engagement in evidence-based tobacco cessation treatments and for increasing long-term population quit rates among hard to reach, socioeconomically disadvantaged smokers.

  • Why read on?

  • Taken together with prior research, these findings suggest that the dissemination and large-scale adoption of proactive tobacco treatment approaches may reduce smoking prevalence and socioeconomic disparities in tobacco use.

Background

Smoking rates are much higher in socioeconomically disadvantaged populations in the majority of developed countries.1 Among those experiencing multiple forms of disadvantage (eg, single-parent households, public housing, no access to a car, etc), smoking rates can be as high as 60%, while rates among the most affluent can be as low as 15%.2 ,3 In the USA, 28% of adults living below the federal poverty line smoke cigarettes compared with 17% of adults at or above the poverty level.4 Among adults younger than 65, 16% of those with private health insurance are current smokers, compared with 34% of Medicaid (a government public health insurance programme) recipients and 32% of the uninsured.5 Because socioeconomically disadvantaged populations smoke more than their more advantaged counterparts, they also suffer disproportionately from smoking-caused diseases.

With respect to smoking cessation, socioeconomically disadvantaged smokers are less likely to use evidence-based smoking cessation treatments (pharmacotherapy including nicotine replacement therapy (NRT), bupropion and varenicline and/or counselling either in-person or by telephone) than the general population of smokers.6–9 Contributing factors to the disparity in evidence-based treatment use include greater life stressors that reduce motivation to quit, lack of knowledge about the benefits of using pharmacotherapy and lack of awareness regarding Medicaid coverage for smoking cessation treatment.10 ,11 Other barriers include a lower likelihood of receiving preventive care services, difficulty taking time from work for cessation services, travel time and costs and an inability to pay out-of-pocket expenses for pharmacotherapy.12 Providers are also less likely to offer smoking cessation treatment to low-income smokers, perhaps related to provider bias or negative assumptions about interest in quitting.13 ,14

The objective of this randomised controlled trial was to test whether a proactive tobacco treatment intervention, designed to overcome these critical barriers to access and delivery of evidence-based smoking cessation treatment, would improve smoking cessation outcomes relative to usual care among a population-based sample of publicly insured smokers. We chose a population-based approach to fully examine effects among all smokers in the cohort, not just those who expressed interest in quitting.

Methods

Study design and participants

The Offering Proactive Treatment Intervention (OPT-IN) study was approved by the Institutional Review Boards at the University of Minnesota and the Minnesota Department of Human Services (DHS). As previously described,15 the study was a two-group randomised controlled trial conducted among clients of the Minnesota Health Care Programs (MHCP) (Medicaid or MinnesotaCare). Medicaid is a joint federal-state programme that provides payment for medical care for people falling into certain categories, including poverty and certain disabilities. MinnesotaCare is for Minnesota residents without access to affordable healthcare coverage, but who have higher income than those covered by Medicaid/Medical Assistance. The sampling frame consisted of a random sample of non-institutionalised MHCP clients that was stratified by age group (18–24, 25–34, and 35–64), by gender and by MHCP. If two or more individuals had the exact same address, one individual was randomly selected to be in the sample. Study participants were recruited using a mailed, baseline tobacco use screening survey packet that included an informed consent statement and notice of privacy practices. Participants were informed that if they were currently smoking and returned a completed baseline survey they would be participating in a research study and would have a 50% chance of being offered a new smoking cessation programme.

Randomisation and masking

Individuals who returned a completed baseline survey and reported current cigarette smoking (defined as having smoked a cigarette in the past 30 days, even a puff) were randomised, with equal likelihood within each of the 12 age, gender and MHCP strata (Medicaid or MinnesotaCare), to receive either (1) proactive outreach intervention or (2) usual care. The target recruitment goal was 2500 current cigarette smokers. In contrast to aid-to-cessation trials testing the efficacy of an intervention in smokers interested in quitting, this population impact trial of smoking cessation outreach and treatment included all identified smokers, regardless of their interest in quitting.16–18 Participants were not blinded. However, study staff who administered the questionnaires to collect primary outcome data were blinded to participant's treatment allocation.

Procedures

Usual care

All MHCP enrolees are assigned a primary care provider and usual care participants could contact their provider to access smoking cessation treatment. However, tobacco treatment was variable and depended on the primary care provider's willingness and capacity to adhere to guidelines. Usual care participants also had access to smoking cessation medications (NRT, sustain-released bupropion or varenicline) at substantially reduced cost ($1–$5 co-pay) through MHCP insurance coverage by obtaining a prescription from their provider. Alternatively, participants could purchase over-the-counter NRT at retail costs. In addition, they could access free telephone counselling by calling the Minnesota state quitline (1-888-354-PLAN).

Proactive outreach intervention

Intervention participants were able to receive the same MHCP provider smoking cessation treatment components as usual care participants. Additionally, the proactive outreach tobacco treatment intervention included two primary elements: (1) personalised mailings and telephone calls and (2) facilitated access to a free, comprehensive, evidence-based treatment for tobacco dependence (NRT and intensive, telephone-based behavioural counselling). We designed the intervention to overcome both access barriers and psychosocial barriers experienced by socioeconomically disadvantaged smokers, which was delivered by study telephone counsellors trained in motivational interviewing and smoking cessation counselling.

Personalised mailings included invitation materials: a letter and brochure describing the University of Minnesota Choose to Quit Smoking cessation programme and the services available to help MHCP enrolees quit smoking. Approximately 3 weeks later, study counsellors called participants with up to 12 contact attempts made at different times of the day over 4 weeks. The choice of 12 contact attempts was based on experience of our pilot of intervention, which was an increase from six call attempts in the original protocol. The purpose of the outreach call was to (1) deliver motivational advice to quit smoking, (2) promote self-efficacy, (3) encourage participants to engage in smoking cessation treatment and (4) provide information on the safety, efficacy and functional benefits of pharmacotherapy, particularly NRT. Employing motivational interviewing techniques, counsellors tailored the content of the call to the participant's readiness to quit and concerns about quitting.19 Motivational interviewing is patient-centred and an evidence-based counselling practice directed at identifying ambivalence and enhancing intrinsic motivation for behavioural change.20 ,21

After the outreach call, telephone care comprised free proactive telephone counselling, free NRT and a self-help quit smoking manual. Specifically, study counsellors used an adaptation of the evidence-based California Helpline protocol which consisted of seven calls initiated by the counsellor, scheduled in a relapse-sensitive fashion over a 2-month period for those ready to set a quit date (pre-quit, quit day, then 3 days, 1 week, 2 weeks, 1 months and 2 months after the quit date).22 Given variability in participants’ readiness to quit and prior experience with quitting, counselling calls were individually tailored to address the participant's needs. For example, participants who were thinking about quitting but not ready to set a quit date right away received motivational interviewing to enhance their readiness to quit and the call schedule was based on participant preferences. In addition, participants who relapsed to smoking were encouraged to set new quit dates and repeat the counselling programme. In total, a participant was eligible to receive up to 14 counselling calls.

Participants were also provided a free 8-week course of NRT (patch, gum or lozenge). NRT was mailed directly to participants in anticipation of their quit date using a protocol based on the US Public Health Service Guideline recommendations.9 ,23 NRT was purchased from the GlaxoSmithKline Consumer Health Care Government Customer Direct Purchase Program. All participants who received telephone counselling were offered NRT unless they had one of the following contraindications: (1) recent (within 2 weeks) heart attack or severe arrhythmia, (2) unstable angina or (3) pregnancy. Participants were not required to participate in telephone counselling in order to receive NRT, although this practice was not promoted. Participants interested in bupropion or varenicline were referred to their primary care provider. Participants who relapsed and attempted to quit again were able to receive an additional 4 weeks of NRT.

Data collection

There were two episodes of data collection: baseline and 1 year following randomisation (participant surveys and DHS administrative data). The baseline and follow-up surveys used modified Dillman mail survey procedures and have been previously described.15 The 1-year follow-up survey followed similar procedures as the mailed baseline survey and included additional procedures to reduce attrition. These included a $10.00 incentive with the first mailing, telephone administration (mixed-mode protocol) for non-respondents to the mailed protocol, and tracking procedures for non-respondents including receipt of updated contact information from the Minnesota DHS.

Outcomes

The primary outcome was self-reported 6-month prolonged smoking abstinence at 1 year following randomisation. A person who smoked at least once on seven consecutive days or who smoked at least once on two consecutive weekends in the 6-month period was defined as a treatment failure. The choice and definition of the primary outcome follows recommendations of the Society for Research on Nicotine and Tobacco Measures Workgroup to report multiple measures of abstinence in which prolonged abstinence is the preferred measure.18 Since OPT-IN was a cessation-induction trial (ie, evaluation of an intervention to encourage cessation among a population-based sample of smokers, including those not currently trying to quit), follow-up was tied to the onset of the intervention (ie, time of randomisation). Secondary outcomes included self-reported 30-day point prevalence abstinence and 7-day point prevalence abstinence, use of behavioural counselling, use of smoking cessation medications and use of combination counselling and medication.

Statistical analysis

As previously described,15 the goal sample size for this study was 2500 participants (1250 per group), which accounted for attrition in order to have observed smoking abstinence outcomes on 1500 respondents (750 per group). This sample size provides approximately 85% power or greater with a two-sided α of 0.05 to detect differences if the intervention raises quit rates by 4%.

Baseline data were obtained for all participants (n=2406) using a baseline survey and DHS administrative records. The usual care (n=1206) and proactive outreach (n=1200) groups were compared across the stratification variables of age, sex and insurance type, as well as socio-demographic and smoking-related clinical variables presented in table 1 using Pearson's χ2 tests and two-sample t tests. Logistic regressions, adjusted for the stratification variables of age, sex and insurance type, modelled the odds of treatment use over the year of follow-up (table 2). Separate regression models were used for each treatment use outcome within the medication, counselling and combination categories.

Table 1

Baseline demographic and smoking characteristics, according to treatment group

Table 2

Treatment usage by treatment group over the 1-year follow-up period

For the analysis of our primary outcome, we fit a stratified logistic regression equation modelling the odds that a participant reported 6-months prolonged abstinence at 1-year follow-up using intervention group, age, gender and MHCP strata as explanatory variables (table 3). Similar analyses assessed the effect of the proactive intervention on reported 30-day and 7-day abstinence. The initial analyses used data from those who responded to the follow-up survey. To address potential informative non-response bias in these initial analyses, we fit a series of selection model analyses. Two common, related, approaches for addressing informative missing data comprise selection models and pattern mixture models.25 Selection models jointly model the study outcomes and the missing of the outcomes, for all participants, by modelling (1) how outcomes are related to the available predictors and (2) modelling how whether the outcome measure is missing is related to the value of the outcome measure and the available predictors. We posited different assumptions for how follow-up survey response would be related to abstinence, the sampling strata and selected covariates. A given selection model analysis jointly fit the two models:

Table 3

Smoking abstinence by treatment group at 1 year

Embedded ImageEmbedded Imagefor a specified function g and selected set of covariatesEmbedded Image for the ith participant, to the observed data for all participants using the expectation–maximisation algorithm process proposed by Ibrahim and Lipsitz.25 For the specification of the function g, the series of selection models considered (1) a simple additive model, (2) a model adding an interaction between intervention and abstinence to this simple additive model and (3) seven different models adding different combinations of interactions between abstinence and the sampling strata to the model with the interaction between abstinence and intervention. In addition to age, gender and healthcare coverage programme strata, the models incorporated patient demographics, smoking history, quit attempt history and motivation to quit and measures of general health, alcohol use and mental health including those measures that differed between respondents and non-respondents to the follow-up survey. (Additional details can be found in the online supplementary appendix.)

Role of the funding source

The funder of the study had no role in study design, data collection, data analysis, data interpretation or writing of the report. The corresponding author had full access to all the data in the study and had final responsibility for the decision to submit for publication.

Results

Study participants

Study participants were recruited from July 2011 to August 2012. We mailed recruitment and tobacco use screening surveys to 21 181 MHCP clients. There were 9362 respondents of whom 2406 were current smokers (25.7%) (see figure 1). The blocked randomisation, implemented separately within the 12 age, gender and MHCP strata, assigned 1200 participants to proactive care and 1206 participants to usual care. The overall follow-up survey response rate was 74% (69% proactive outreach vs 78% usual care). As illustrated in figure 1, complete primary outcome data were available for 820 participants in proactive outreach (68%) and 937 participants in usual care (78%) and were used for the respondent analysis. All randomised participants (n=2406) were included in the selection models accounting for non-response. There were no significant differences in baseline characteristics between the intervention and usual care arms (table 1).

Figure 1

Flow chart showing the enrolment, randomisation and follow-up of the study participants.

Proactive outreach engagement

Telephone outreach was successful in contacting 836 participants (70%) in the proactive treatment group. Among those who participated in the outreach call, 49 (6%) had already quit smoking, 397 (47%) expressed interest in participating in telephone coaching and 291 (34%) subsequently completed a counselling call. Among this latter group, 212 (73%) were ready to set a quit date, 79 (27%) wanted to talk more about their smoking before setting a quit date and the average number of total completed telephone counselling calls per participant was 4.7.

Tobacco treatment use

Table 2 details tobacco treatment use by the intervention and usual care arms. Proactive outreach participants were much more likely to use smoking cessation medications compared with usual care (40.6% vs 29.4%), particularly NRT. Telephone counselling for smoking cessation was higher in the proactive outreach intervention group compared with usual care (19.4% vs 2.9%). Furthermore, the rate of combined behavioural counselling and medication treatment was significantly higher in the proactive outreach intervention group (17.4% vs 3.6%, OR 5.69 (95% CI 3.85 to 8.40)).

Smoking abstinence

Participants in the proactive outreach intervention group were significantly more likely to quit smoking than usual care participants. The primary outcome, 6-month prolonged smoking abstinence rate at 1 year, was significantly higher for proactive outreach compared with usual care (16.5% vs 12.1%, OR 1.47 (95% CI 1.12 to 1.93)) (table 3). The number needed to treat (NNT) to gain one participant with 6-month prolonged abstinence was 23. In table 3, we present the selection model analyses which consist of a range of estimated ORs for intervention and estimated abstinence rates across the series of fitted models. The selection models with lower Akaike information criterion (AIC) statistics for modelling smoking abstinence yielded the more plausible estimated abstinence rates. Among these models, estimated prolonged abstinence rates were lower than in the observed data but the differences in rates between outreach and usual care were generally consistent with the observed difference with a range of 3.3%–5.2% while the estimated ORs ranged from 1.50 (1.15 to 1.96) to 1.68 (1.319 to 2.16). Among secondary outcomes, similar effects were found for 30-day abstinence favouring the proactive outreach intervention in analysis of observed data and selection models. However, results for 7-day point prevalence abstinence were insignificant.

Discussion

Proactive outreach was effective at markedly increasing the use of tobacco cessation treatments among socioeconomically disadvantaged smokers, particularly telephone counselling and the combination of counselling and medication. Furthermore, the proactive tobacco treatment intervention was effective at increasing long-term quit rates compared with usual care. This randomised controlled trial adds evidence supporting the effectiveness of proactive tobacco treatment for increasing the population impact of tobacco cessation treatment. An absolute increase in long-term smoking cessation rates of 4.4% is highly significant from a public health perspective. In the USA, the Medicaid programme provides health coverage for 11 million non-elderly low-income adults27 and assuming a 34% prevalence of current smoking an estimated population of 3.74 million smokers.5 ,28 If such results were generalised to the entire current smoking Medicaid population, there would be nearly 165 000 fewer cigarette smokers in Medicaid.

The current study contributes new evidence to support the use of population-based proactive approach to deliver tobacco cessation treatment and confirms that this approach is feasible, effective and applicable to diverse settings and populations. Rigotti et al found increased NRT use (OR 3.47) and short-term abstinence (7-day point prevalence abstinence at 3 months, 5.3% vs 1.1%, OR 5.35) using free telephone consultation with a tobacco coordinator providing 8 weeks of NRT and proactive referral to a state quitline.29 Fu et al found higher 6-month prolonged abstinence at 1 year (13.5% vs 10.9%, OR 1.27) compared with usual care among veteran smokers using proactive outreach programme offering telephone coaching and Veterans Health Administration smoking cessation services.30 Using interactive voice response technology to proactively offer telephone counselling, free NRT and community-based referrals among a disadvantaged population, Haas et al found increased 7-day abstinence at 9 months (17.8% vs 8.7%, OR 2.5).31

Those engaging in telephone counselling completed an average 4.7 counselling calls, which is substantially higher than the average number of calls reported by publicly funded quitlines.32 This is striking given that for most state-based quitlines, initial contact to the quitline requires action on the part of the tobacco user indicating a relatively high degree of interest in using the quitline's services. This study recruited tobacco users at all stages of readiness to quit. It may be that there was previously unmet demand for such services that the proactive outreach approach made more accessible or salient. It may also be that tobacco users who were not yet ready to make a quit attempt at the start of the study responded well to opportunities to discuss the quitting process and were willing to engage in a higher number of counselling interactions by phone. The increase in use of quitting medications is understandable given the perceived lack of access to free or low-cost medication alternatives for the study population. Despite state-wide media campaigns promoting the Minnesota QUITPLAN Helpline during the study period, it may be that the proactive approach used for the study was particularly effective at increasing awareness of, and interest in, using evidence-based cessation tools.

We observed significant intervention effects on 6-month prolonged abstinence, the primary outcome, and 30-day abstinence, a secondary outcome. However, we did not observe significant effects on 7-day point prevalence abstinence, which was another secondary outcome. Since 7-day point prevalence abstinence also includes participants who made a quit attempt after the intervention period, this measure may have underestimated the effectiveness of the proactive outreach intervention. Alternatively, this may suggest that usual care participants were able to achieve similar short-term abstinence but not sustained abstinence, perhaps related to the lower use of treatment by the usual care group.

This study has several limitations. First, smoking abstinence outcome relied on self-report and was not biochemically verified; however, this approach is similar to other population-based interventions.33 In addition, biochemical verification is not possible for 6-month prolonged abstinence, the study's primary outcome. Second, the follow-up survey response rate was 74%. While this is an excellent response rate considering the low socioeconomic characteristics of the population, there was differential response by intervention and usual care arms and potential for non-response bias. We conducted a series of selection model analyses to account for non-response and observed similar effects, suggesting that our findings are robust. Third, the intervention consisted of a discrete episode of care and it is possible a longitudinal or chronic disease model of care for tobacco use would be more effective. Further research is needed to assess the effects of proactive treatment as part of chronic disease management. Fourth, it is possible that there could have been a Hawthorne effect for usual care participants due to their awareness of and participation in the study as a result of completing the baseline survey. In the unlikely event that the baseline survey did exert a therapeutic effect, it would have been conservative and attenuated the observed effects. Finally, our study did not include high socioeconomic groups and it is unknown if the intervention would have differential effects between income population groups. According to the ‘fundamental cause’ perspective on health disparities, public health interventions that reduce morbidity and mortality can create health disparities because advantaged groups are often better poised to take advantage of opportunities afforded by the intervention. In light of evidence supporting the fundamental cause perspective, it might be advisable to target interventions such as the current proactive outreach intervention to socioeconomically disadvantaged groups to reduce tobacco-related health disparities.

In conclusion, this population-based clinical trial demonstrates the effectiveness of proactive tobacco treatment for increasing engagement in evidence-based tobacco cessation treatments and for increasing long-term population quit rates among hard to reach, socioeconomically disadvantaged smokers. Results of this trial may be of particular interest for public insurance agencies, European quitlines and the North American Quitline Consortium, a membership organisation for all publicly funded quitlines in the USA and Canada, whose goals are to maximise the effectiveness, broaden the reach and increase service capacity of quitlines. Administrators of publicly funded quitlines, public insurance agencies (eg, Medicaid) and other health-related organisations should consider adopting a proactive outreach strategy for tobacco users in addition to mass media promotions as a way of effectively recruiting and enrolling socioeconomically disadvantaged tobacco users to smoking cessation services.

Acknowledgments

The authors would like to gratefully acknowledge the support and assistance of Alan Rodgers and the Minnesota Department of Human Services (DHS). The views expressed in this article are those of the authors and do not necessarily reflect the position or policy of the Department of Veterans Affairs or the US government.

References

View Abstract

Footnotes

  • Contributors SSF, MvR, DN, DJB, JLT, JAN and AMJ designed the study. SSF, MvR and DN supervised the collection of the data. DN, BC and PH analysed the data. SSF, MvR, DN, DJB, JLT, JAN and AMJ interpreted the data. JS, PH and SSF did the literature search. JS, PH and SSF prepared the figures, tables and wrote the first draft of the manuscript. All authors critically reviewed and edited the manuscript.

  • Funding This study was funded by the National Cancer Institute (5R01CA141527), NIH. This material is the result of work supported with resources and the use of facilities at the Minneapolis VA HSR&D Center for Chronic Disease Outcomes Research.

  • Disclaimer The authors declare that this manuscript is an honest, accurate and transparent account of the study being reported, that no important aspects of the study have been omitted and that any discrepancies from the study as planned have been explained.

  • Competing interests None declared.

  • Ethics approval University of Minnesota institutional review board (IRB) and Minnesota DHS IRB.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement A dataset stripped of identifiers will be made available on reasonable request for sharing under a data sharing agreement that provides for: (1) a commitment to use the data only for research purposes; (2) a commitment to secure the data using appropriate computer and server technologies, and (3) a commitment to destroy or return the data after analyses are completed. Depending on the data requested, the data sharing agreement and the specific details of the agreement would have to be approved by the Minnesota DHS.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Linked Articles

  • Airwaves
    Nicholas Hart Gisli Jenkins Alan Smyth