The purpose of this systematic review was to determine the effect of inspiratory muscle training (IMT) (alone or combined with exercise and/or pulmonary rehabilitation) compared to other rehabilitation interventions such as: exercise, education, other breathing techniques or exercise and/or pulmonary rehabilitation among adults with chronic obstructive pulmonary disease (COPD). A systematic review of the literature on IMT and COPD was conducted according to the Cochrane Collaboration protocol. Inclusion criteria for the review included randomized controlled trials, published in English, comparing IMT or combined IMT and exercise/pulmonary rehabilitation with other rehabilitation interventions such as general exercise, education, other breathing techniques or exercise/pulmonary rehabilitation among adults with COPD. 274 articles were retrieved, and 16 met the inclusion criteria. Seven meta-analyses were performed that compared targeted or threshold IMT to exercise (n = 3) or to education (n = 4). Results showed significant improvements in inspiratory muscle strength and endurance, and in the dyspnea scale on a quality of life measure, for participants in the IMT versus education group. In other instances where meta-analyses could not be performed, a qualitative review was performed. IMT results in improved inspiratory muscle strength and endurance compared to education. Further trials are required to investigate the effect of IMT (or combined IMT) compared to other rehabilitation inventions for outcomes such as dyspnea, exercise tolerance, and quality of life.