NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ957312
Record Type: Journal
Publication Date: 2011
Pages: 9
Abstractor: As Provided
ISSN: ISSN-0894-1912
Evaluation of a Collaborative Program on Smoking Cessation: Translating Outcomes Framework into Practice
Shershneva, Marianna B.; Larrison, Christopher; Robertson, Sheila; Speight, Mike
Journal of Continuing Education in the Health Professions, v31 nS1 pS28-S36 Aut 2011
Introduction: Although evaluating at multiple outcome levels has been proposed for continuing education activities and programs, it is a complex undertaking and is not done routinely, especially in collaborative, multicomponent programs. This article reports on strategies used and results obtained in an evaluation project that examined multiple outcomes of a US-based collaborative, multicomponent smoking cessation educational program for clinicians. Methods: Evaluation was organized conceptually around the 6 levels of an outcomes-based evaluation model and was conducted using registration data, postactivity evaluations, clinical vignettes with questions assessing knowledge and competence in participants and in a comparison group, a commitment to change approach, data from patient charts to assess clinician compliance on 8 performance measures, and tobacco cessation rates. Additional methods included a success case method study of 9 practices participating in performance improvement (PI) activities and assessment of partner collaboration using a written survey and interviews. Results: The program reached more than 43,000 clinicians who participated in a variety of activities. Participants indicated a high level of satisfaction with the program's educational activities and demonstrated higher scores than a comparison group on 6 of 7 competencies. The majority of participants who responded to commitment to change questions reported intended and implemented practice changes consistent with desired outcomes. Performance outcomes of 3 PI activities varied, with greater improvements observed in 1 activity (9.0% to 36.2% improvement across 8 measures). Lower performance outcomes, but a smoking quit rate of 46.8%, was observed in 2 other PI activities. Discussion: The program had an overall positive impact on the measured variables for clinicians and their patients. Use of 1 outcomes assessment framework acceptable to all members of the collaborative, common measures and evaluation techniques, and centralized data repositories contributed to the success of the program evaluation reported here and is recommended to others who are considering a collaborative program evaluation. (Contains 2 tables, 2 figures and 3 footnotes.)
John Wiley & Sons, Inc. Subscription Department, 111 River Street, Hoboken, NJ 07030-5774. Tel: 800-825-7550; Tel: 201-748-6645; Fax: 201-748-6021; e-mail:; Web site:
Publication Type: Journal Articles; Reports - Evaluative
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A
Identifiers - Location: United States