Treatment Fidelity: Its Importance and Reported Frequency in Aphasia Treatment Studies
Publication: American Journal of Speech-Language Pathology
Volume 22, Number 2
Pages S279-S284
Abstract
Purpose
Treatment fidelity is a measure of the reliability of the administration of an intervention in a treatment study. It is an important aspect of the validity of a research study, and it has implications for the ultimate implementation of evidence-supported interventions in typical clinical settings.
Method
Aphasia treatment studies published in the last 10 years in 3 journals were reviewed using coding techniques that were adapted from Gresham, Gansle, Noell, Cohen, and Rosenblum (1993). The following items were noted: identifying information, study design, description of both the dependent and independent variables, and whether a measure of treatment fidelity was explicitly included.
Results
Of the aphasia treatment studies published in the last 10 years, 14% explicitly reported treatment fidelity. Most studies reporting treatment fidelity used checking of videotaped sessions by independent raters. Of the reviewed studies, 45% provided sufficient treatment description to support replication.
Conclusion
Treatment fidelity is widely acknowledged as being critical to research validity and is a foundation for the implementation of evidence-based practices, but only a small percentage of aphasia treatment studies published in the last 10 years explicitly reported treatment fidelity. Recommendations for research practices include increased attention to matters of treatment fidelity in the peer review process and explicit incorporation of 3 levels of treatment fidelity in treatment research.
Supplemental Material
Get full access to this article
View all available purchase options and get full access to this article.
References
American Speech-Language-Hearing Association n.d.). Compendium of EBP guidelines and systematic reviews Retrieved from http://www.asha.org/members/ebp/compendium
Bhar, S. S., & Beck, A. T. (2009). Treatment integrity of studies that compare short-term psychodynamic psychotherapy with cognitive-behavior therapy. Clinical Psychology: Science and Practice, 16, 370–378.
Burgio, L., Corcoran, M., Lichstein, K. L., Nichols, L., Czaja, S., Gallagher-Thompson, D., & Schulz, R. (2001). Judging outcomes in psychosocial interventions for dementia caregivers: The problem of treatment implementation. The Gerontologist, 41((4)) 481–489.
Cherney, L. R., Patterson, J. P., Raymer, A., & Frymark, T. Schooling, T 2008). Evidence-based systematic review: Effects of intensity of treatment and constraint-induced language therapy for individuals with stroke-induced aphasia. Journal of Speech, Language, and Hearing Research, 51, 1282–1299.
Des Jarlais, D. C., Lyles, C., & Crepaz, N. the TREND Group 2004). Improving the reporting quality of nonrandomized evaluations of behavioral and public health interventions: The TREND statement. American Journal of Public Health, 94, 361–366.
Dobson, D., & Cook, T. J. (1980). Avoiding Type III error in program evaluation: Results from a field experiment. Evaluation and Program Planning, 3, 269–276.
Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., & Wallace, F. (2005). Implementation research: A synthesis of the literature (FMHI Publication #231). Tampa, FL: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network.
Frances, A., Sweeney, J., & Clarkin, J. (1985). Do psychotherapies have specific effects? American Journal of Psychotherapy, 39, 159–174.
Gearing, R. E., El-Bassel, N., Ghesquiere, A., Baldwin, S., Gillies, J., & Ngeow, E. (2011). Major ingredients of fidelity: A review and scientific guide to improving quality of intervention research implementation. Clinical Psychology Review, 31((1)) 79–88.
Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S., & Rosenblum, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980–1990. School Psychology Review, 22, 254–273.
Hickey, E., Bourgeois, M., & Olswang, L. (2004). Effects of training volunteers to converse with nursing home residents with aphasia. Aphasiology, 18(5–7) 625–637.
Hinckley, J. J. (2007). Treatment integrity and problem-solving. In Guilford, A. M., Graham, S., & Scheuerle, J. The speech-language pathologist: From novice to expert (pp. 64–75). Upper Saddle River, NJ: Pearson.
Kadaravek, J. N., & Justice, L. M. (2010). Fidelity: An essential component of evidence-based practice in speech-language pathology. American Journal of Speech-Language Pathology, 19, 369–379.
Kazdin, A. E. (1986). Comparative outcome studies of psychotherapy: Methodological issues and strategies. Journal of Consulting and Clinical Psychology, 54, 95–105.
Lichstein, K. L., Riedel, B. W., & Grieve, R. (1994). Fair tests of clinical trials: A treatment implementation model. Advances in Behaviour Research and Therapy, 16, 1–29.
Linnan, L., & Steckler, A. (2002). Process evaluation for public health interventions and research: An overview. In Linnan, L., & Steckler, A. Process evaluation for public health interventions and research (pp. 1–23). San Francisco, CA: Jossey-Bass.
McEvoy, M. A., Shores, R. E., Wehby, J. H., Johnson, S. M., & Fox, J. J. (1990). Special education teachers' implementation of procedures to promote social interaction: Reported treatment fidelity among children in integrated settings. Education and Training in Mental Retardation, 25, 267–276.
Melton, A., & Bourgeois, M. (2005). Training compensatory memory strategies via the telephone for persons with TBI. Aphasiology, 19(3–5) 353–364.
Moncher, F. J., & Prinz, R. J. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247–266.
Perepletchikova, F., Treat, T. A., & Kazdin, A. E. (2007). Treatment integrity in psychotherapy research: Analysis of the studies and examination of the associated factors. Journal of Consulting and Clinical Psychology, 75, 829–841.
Peterson, L., Homer, A. L., & Wonderlich, S. A. (1982). The integrity of independent variables in behavior analysis. Journal of Applied Behavior Analysis, 15, 477–492.
Salter, K., Teasell, R., Bhogal, S., Zettler, L., & Foley, N. (2011). Aphasia. EBRSR: Evidence-based review of stroke rehabilitation Retrieved from http://www.ebrsr.com/reviews_details.php?Aphasia-3
Sanetti, L. M. H., Gritter, K. L., & Dobey, L. M. (2011). Treatment integrity of school interventions with children in the school psychology literature from 1995 to 2008. School Psychology Review, 40, 72–84.
Schlosser, R. W. (2002). On the importance of being earnest about treatment integrity. Augmentative and Alternative Communication, 18, 36–44.
Schulz, K. F., Altman, D. G., & Moher, D. (2010). CONSORT 2010 statement: Updated guidelines for reporting parallel group randomized trials. Annals of Internal Medicine, 152, 1–6.
Smith, M. L., Glass, G. V., & Miller, T. I. (1980). The benefits of psychotherapy. Baltimore, MD: Johns Hopkins University Press.
Vermilyea, B. B., Barlow, D. H., & O'Brien, G. T. (1984). The importance of assessing treatment integrity: An example in the anxiety disorders. Journal of Behavioral Assessment, 6, 1–11.
Waller, G. (2009). Evidence-based treatment and therapist drift. Behaviour Research and Therapy, 47, 119–127.
Wheeler, J. J., Baggett, B. A., Fox, J., & Blevins, L. (2006). Treatment integrity: A review of intervention studies conducted with children with autism. Focus on Autism and Other Developmental Disabilities, 21, 45–54.
Yeaton, W. H., & Sechrest, L. (1981). Critical dimensions in the choice and maintenance of successful treatment: Strength, integrity, and effectiveness. Journal of Consulting and Clinical Psychology, 49, 156–167.
Information & Authors
Information
Published In
American Journal of Speech-Language Pathology
Volume 22 • Number 2 • May 2013
Pages: S279-S284
PubMed: 23695904
Copyright
Copyright © 2013 American Speech-Language-Hearing Association.
History
- Received: Jul 30, 2012
- Accepted: Dec 22, 2012
- Published in issue: May 1, 2013
Keywords
Authors
Metrics & Citations
Metrics
Article Metrics
View all metricsCitations
Download article citation data for:
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
Citing Literature
- Amy Glaspey, Andrea A. N. MacLeod, Pyper Trumble, Megan Andersen, Dynamic assessment, more than a diagnostic tool? Uses for goals, teaching moments, and procedural issues during intervention of speech sound disorder, Clinical Linguistics & Phonetics, 10.1080/02699206.2024.2431926, (1-22), (2024).
- Aysha Almas, Romaina Iqbal, Abdul Ghani, Zainab Samad, Sania Sabir, Khawar Kazmi, School Health Education Program in Pakistan (SHEPP): findings from a feasibility trial in pre-adolescent school children from a lower middle-income country, Pilot and Feasibility Studies, 10.1186/s40814-023-01344-9, 9, 1, (2023).
- Zali Hall, Elise Elbourn, Leanne Togher, Marcella Carragher, Co‐constructed communication therapy for individuals with acquired brain injury: A systematic review, International Journal of Language & Communication Disorders, 10.1111/1460-6984.12841, (2023).
- Stephanie Karidas, Jacqueline J. Hinckley, Izabelle Brekher, Replication in Evidence-Based Aphasia Treatments, Journal of Speech, Language, and Hearing Research, 10.1044/2022_JSLHR-21-00688, 66, 6, (1958-1966), (2023).
- References, Principles of Cognitive Rehabilitation, 10.1016/B978-0-443-18750-6.00028-6, (253-354), (2023).
- Elise Baker, Sarah Masso, Kylie Huynh, Ellie Sugden, Optimizing Outcomes for Children With Phonological Impairment: A Systematic Search and Review of Outcome and Experience Measures Reported in Intervention Research, Language, Speech, and Hearing Services in Schools, 10.1044/2022_LSHSS-21-00132, 53, 3, (732-748), (2022).
- Sarah E. Wallace, Janet Patterson, Mary Purdy, Kelly Knollman-Porter, Patrick Coppens, Auditory Comprehension Interventions for People With Aphasia: A Scoping Review, American Journal of Speech-Language Pathology, 10.1044/2022_AJSLP-21-00297, 31, 5S, (2404-2420), (2022).
- Claudia Peñaloza, Michael Scimeca, Angelica Gaona, Erin Carpenter, Nishaat Mukadam, Teresa Gray, Shilpa Shamapant, Swathi Kiran, Telerehabilitation for Word Retrieval Deficits in Bilinguals With Aphasia: Effectiveness and Reliability as Compared to In-person Language Therapy, Frontiers in Neurology, 10.3389/fneur.2021.589330, 12, (2021).
- Ayse Zengul, Eric Evans, Allyson Hall, Haiyan Qu, Amanda Willig, Andrea Cherrington, Mohanraj Thirumalai, Telehealth Behavioral Intervention for Diabetes Management in Adults With Physical Disabilities: Intervention Fidelity Protocol for a Randomized Controlled Trial, JMIR Research Protocols, 10.2196/31695, 10, 9, (e31695), (2021).
- Louise C. Burgess, Thomas W. Wainwright, Khara A. James, Johan von Heideken, Maura D. Iversen, The quality of intervention reporting in trials of therapeutic exercise for hip osteoarthritis: a secondary analysis of a systematic review, Trials, 10.1186/s13063-021-05342-1, 22, 1, (2021).
View Options
Sign In Options
ASHA member? If so, log in with your ASHA website credentials for full access.
Member Login