The Process of Implementing Evidence in Practice
5). Evaluating and planning
After implementation has occurred, a re-evaluation is required. Think of the process like continuous quality improvement. It is important to determine if change has occurred, and if so, how large the change has been. The same methods and measures used at baseline should be repeated for comparison. If a survey was used at baseline, this can be readministered. If a file audit was completed, this should be repeated.
Kramer and Burns (2008) use medical record review and qualitative interviews to determine the extent to which CBT had been implemented and the factors contributing to partial or full implementation. Key informant interviews were conducted at the close of the study with all intervention clinicians, two clinical managers at each clinic, four clinicians providing usual care, and three clinicians who dropped out prior to formal consenting. Interviews, which lasted approximately 30 to 45 minutes, were audio taped, transcribed, reviewed for accuracy, and a software package used to help with data management. In order to assess the extent to which CBT was provided, trained research assistants reviewed all sessions in each adolescent's medical record to determine whether CBT was mentioned as the primary treatment.