Spoken Discourse Assessment and Analysis in Aphasia: An International Survey of Current Practices
Publication: Journal of Speech, Language, and Hearing Research
Volume 64, Number 11
Pages 4366-4389
Abstract
Purpose
Spoken discourse analysis is commonly employed in the assessment and treatment of people living with aphasia, yet there is no standardization in assessment, analysis, or reporting procedures, thereby precluding comparison/meta-analyses of data and hindering replication of findings. An important first step is to identify current practices in collecting and analyzing spoken discourse in aphasia. Thus, this study surveyed current practices, with the goal of working toward standardizing spoken discourse assessment first in research settings with subsequent implementation into clinical settings.
Method
A mixed-methods (quantitative and qualitative) survey was publicized to researchers and clinicians around the globe who have collected and/or analyzed spoken discourse data in aphasia. The survey data were collected between September and November 2019.
Results
Of the 201 individuals who consented to participate, 189 completed all mandatory questions in the survey (with fewer completing nonmandatory response questions). The majority of respondents reported barriers to utilizing discourse including transcription, coding, and analysis. The most common barrier was time (e.g., lack of time). Respondents also indicated that there was a lack of, and a need for, psychometric properties and normative data for spoken discourse use in the assessment and treatment of persons with aphasia. Quantitative and qualitative results are described in detail.
Conclusions
The current survey study evaluated spoken discourse methods in aphasia across research and clinical settings. Findings from this study will be used to guide development of process standardization in spoken discourse and for the creation of a psychometric and normative property database.
Supplemental Material
Get full access to this article
View all available purchase options and get full access to this article.
References
Alyahya, R. S. W., Halai, A. D., Conroy, P., & Lambon Ralph, M. A. (2020). A unified model of post-stroke language deficits including discourse production and their neural correlates. Brain, 143(5), 1541–1554.
Armstrong, E. (2000). Aphasic discourse analysis: The story so far. Aphasiology, 14(9), 875–892.
Beeke, S., Maxim, J., & Wilkinson, R. (2007). Using conversation analysis to assess and treat people with aphasia. Seminars in Speech and Language, 28(2), 136–147.
Boersma, P., & Van Heuven, V. (2001). Speak and unSpeak with PRAAT. Glot International, 5(9/10), 341–347.
Boyle, M. (2011). Discourse treatment for word retrieval impairment in aphasia: The story so far. Aphasiology, 25(11), 1308–1326.
Boyle, M. (2014). Test–retest stability of word retrieval in aphasic discourse. Journal of Speech, Language, and Hearing Research, 57(3), 966–978.
Boyle, M. (2015). Stability of word-retrieval errors with the aphasia bank stimuli. American Journal of Speech-Language Pathology, 24(4), S953–S960.
Boyle, M. (2020). Choosing discourse outcome measures to assess clinical change. Seminars in Speech and Language, 41(1), 1–9.
Brady, M. C., Kelly, H., Godwin, J., Enderby, P., & Campbell, P. (2016). Speech and language therapy for aphasia following stroke. Cochrane Database of Systematic Reviews, 2016(6), CD000425.
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101.
Brookshire, R. H., & Nicholas, L. E. (1994). Speech sample size and test–retest stability of connected speech measures for adults with aphasia. Journal of Speech and Hearing Research, 37(2), 399–407.
Brown, C., Snodgrass, T., & Covington, M. (2007). Computerized Propositional Idea Density Rater 3 (CPIDR 3). CASPR Project, Artificial Intelligence Center.
Bryant, L., Ferguson, A., & Spencer, E. (2016). Linguistic analysis of discourse in aphasia: A review of the literature. Clinical Linguistics & Phonetics, 30(7), 489–518.
Bryant, L., Spencer, E., & Ferguson, A. (2017). Clinical use of linguistic discourse analysis for the assessment of language in aphasia. Aphasiology, 31(10), 1105–1126.
Cahana-Amitay, D., & Jenkins, T. (2018). Working memory and discourse production in people with aphasia. Journal of Neurolinguistics, 48, 90–103.
Casilio, M., Rising, K., Beeson, P. M., Bunton, K., & Wilson, S. M. (2019). Auditory-perceptual rating of connected speech in aphasia. American Journal of Speech-Language Pathology, 28(2), 550–568.
Cherney, L. R., Coelho, C. A., & Shadden, B. B. (1998). Analyzing discourse in communicatively impaired adults. Aspen Publishers.
Covington, M. A., Riedel, W. J., Brown, C., He, C., Morris, E., Weinstein, S., Semple, J., & Brown, J. (2007). Does ketamine mimic aspects of schizophrenic speech? Journal of Psychopharmacology, 21(3), 338–346.
Cruice, M., Botting, N., Marshall, J., Boyle, M., Hersh, D., Pritchard, M., & Dipper, L. (2020). UK speech and language therapists' views and reported practices of discourse analysis in aphasia rehabilitation. International Journal of Language & Communication Disorders, 55(3), 417–442.
Damico, J. S., Oelschlaeger, M., & Simmons-Mackie, N. (1999). Qualitative methods in aphasia research: Conversation analysis. Aphasiology, 13(9–11), 667–679.
Davidson, B., Worrall, L., & Hickson, L. (2003). Identifying the communication activities of older people with aphasia: Evidence from naturalistic observation. Aphasiology, 17(3), 243–264.
Dietz, A., & Boyle, M. (2018). Discourse measurement in aphasia research: Have we reached the tipping point? Aphasiology, 32(4), 459–464.
Doedens, W. J., & Meteyard, L. (2020). Measures of functional, real-world communication for aphasia: A critical review. Aphasiology, 34(4), 492–514.
Doyle, P. J., Goda, A. J., & Spencer, K. A. (1995). The communicative informativeness and efficiency of connected discourse by adults with aphasia under structured and conversational sampling conditions. American Journal of Speech-Language Pathology, 4(4), 130–134.
Doyle, P. J., Tsironas, D., Goda, A. J., & Kalinyak, M. (1996). The relationship between objective measures and listeners' judgments of the communicative informativeness of the connected discourse of adults with aphasia. American Journal of Speech-Language Pathology, 5(3), 53–60.
Eysenbach, G. (2004). Improving the quality of web surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES). Journal of Medical Internet Research, 6(3), e34.
Fergadiotis, G., & Wright, H. H. (2011). Lexical diversity for adults with and without aphasia across discourse elicitation tasks. Aphasiology, 25(11), 1414–1430.
Fergadiotis, G., Wright, H. H., & Capilouto, G. J. (2011). Productive vocabulary across discourse types. Aphasiology, 25(10), 1261–1278.
Fromm, D., Forbes, M., Holland, A., Dalton, S. G., Jessica, R., & MacWhinney, B. (2017). Discourse characteristics in aphasia beyond the Western Aphasia Battery cutoff. American Journal of Speech-Language Pathology, 26(3), 762–768.
Galski, T., Tompkins, C., & Johnston, M. V. (1998). Competence in discourse as a measure of social integration and quality of life in persons with traumatic brain injury. Brain Injury, 12(9), 769–782.
Goodglass, H., Kaplan, E., & Barresi, B. (2000). Boston Diagnostic Aphasia Examination (3rd ed.). Pearson.
Harris, P. A., Taylor, R., Minor, B. L., Elliott, V., Fernandez, M., O'Neal, L., McLeod, L., Delacqua, G., Delacqua, F., Kirby, J., Duda, S. N., & REDCap Consortium. (2019). The REDCap consortium: Building an international community of software platform partners. Journal of Biomedical Informatics, 95, 103208.
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009). Research electronic data capture (REDCap)—A metadata-driven methodology and workflow process for providing translational research informatics support. Journal of Biomedical Informatics, 42(2), 377–381.
Herbert, R., Hickin, J., Howard, D., Osborne, F., & Best, W. (2008). Do picture-naming tests provide a valid assessment of lexical retrieval in conversation in aphasia? Aphasiology, 22(2), 184–203.
Hula, W. D., & McNeil, M. R. (2008). Models of attention and dual-task performance as explanatory constructs in aphasia. Seminars in Speech and Language, 29(3), 169–187.
IBM Corporation. (2019). IBM SPSS Statistics for Windows Version 26.
Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124.
Jacks, A., Haley, K. L., Bishop, G., & Harmon, T. G. (2019). Automated speech recognition in adult stroke survivors: Comparing human and computer transcriptions. Folia Phoniatrica et Logopaedica, 71(5–6), 286–296.
Kagan, A., Simmons-Mackie, N., Rowland, A., Huijbregts, M., Shumway, E., McEwen, S., Threats, T., & Sharp, S. (2008). Counting what counts: A framework for capturing real-life outcomes of aphasia intervention. Aphasiology, 22(3), 258–280.
Kertesz, A. (2007). Western Aphasia Battery–Revised. The Psychological Corporation.
Kim, H., & Wright, H. H. (2020). Concurrent validity and reliability of the core lexicon measure as a measure of word retrieval ability in aphasia narratives. American Journal of Speech-Language Pathology, 29(1), 101–110.
Kintz, S., & Wright, H. H. (2017). Discourse measurement in aphasia research. Aphasiology, 32(4), 472–474.
Kong, A. P. H., & Law, S. P. (2009). A linguistic communication measure for monitoring changes in Chinese aphasic narrative production. Clinical Linguistics & Phonetics, 23(4), 255–269.
Le, D., Licata, K., & Mower Provost, E. (2018). Automatic quantitative analysis of spontaneous aphasic speech. Speech Communication, 100, 1–12.
Le, D., & Provost, E. M. (2016). Improving automatic recognition of aphasic speech with AphasiaBank. Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, 2681–2685.
Leaman, M. C., & Edmonds, L. A. (2019). Revisiting the correct information unit: Measuring informativeness in unstructured conversations in people with aphasia. American Journal of Speech-Language Pathology, 28(3), 1099–1114.
Linnik, A., Bastiaanse, R., & Höhle, B. (2016). Discourse production in aphasia: A current review of theoretical and methodological challenges. Aphasiology, 30(7), 765–800.
MacWhinney, B. (2000). The CHILDES Project: Tools for analysing talk (3rd ed.). Lawrence Erlbaum Associates Inc.
MacWhinney, B., Forbes, M., & Holland, A. (2011). AphasiaBank: Methods for studying discourse. Aphasiology, 25(11), 1286–1307.
Miller, J., & Chapman, R. (1983). SALT: Systematic Analysis of Language Transcripts, User's Manual. University of Wisconsin Press.
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010). CONSORT 2010 explanation and elaboration: Updated guidelines for reporting parallel group randomised trials. BMJ, 340, c869.
Murray, L. L. (1999). Review attention and aphasia: Theory, research and clinical implications. Aphasiology, 13(2), 91–111.
Nicholas, L. E., & Brookshire, R. H. (1993). A system for quantifying the informativeness and efficiency of the connected speech of adults with aphasia. Journal of Speech and Hearing Research, 36(2), 338–350.
Nichols, T. E., Das, S., Eickhoff, S. B., Evans, A. C., Glatard, T., Hanke, M., Kriegeskorte, N., Milham, M. P., Poldrack, R. A., Poline, J.-B., Proal, E., Thirion, B., Van Essen, D. C., White, T., & Yeo, B. T. T. (2017). Best practices in data analysis and sharing in neuroimaging using MRI. Nature Neuroscience, 20(3), 299–303.
Olness, G. S. (2006). Genre, verb, and coherence in picture‐elicited discourse of adults with aphasia. Aphasiology, 20(2–4), 175–187.
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716.
Osborne, F., Hickin, J., Best, W., & Howard, D. (1998). Treating word-finding difficulties - Beyond picture naming. International Journal of Language & Communication Disorders, 33(Suppl. 1), 208–213.
Pak-Hin, A. K., & Law, S.-P. (2004). A Cantonese linguistic communication measure for evaluating aphasic narrative production: Normative and preliminary aphasic data. Journal of Multilingual Communication Disorders, 2(2), 124–146.
Prins, R., & Bastiaanse, R. (2004). Review. Aphasiology, 18(12), 1075–1091.
Pritchard, M., Hilari, K., Cocks, N., & Dipper, L. (2017). Reviewing the quality of discourse information measures in aphasia. International Journal of Language & Communication Disorders, 52(6), 689–732.
Pritchard, M., Hilari, K., Cocks, N., & Dipper, L. (2018). Psychometric properties of discourse measures in aphasia: Acceptability, reliability, and validity. International Journal of Language & Communication Disorders, 53(6), 1078–1093.
Prutting, C. A., & Kirchner, D. M. (1987). A clinical appraisal of the pragmatic aspects of language. Journal of Speech and Hearing Disorders, 52(2), 105–119.
Roberts, A., & Orange, J. (2013). Discourse in Lewy body spectrum disorder. In B. Davis & J. Guendouzi (Eds.), Pragmatics in dementia discourse (pp. 153–211). Cambridge Scholars Publishing.
Roberts, A., & Post, D. (2018). Information content and efficiency in the spoken discourse of individuals with Parkinson's disease. Journal of Speech, Language, and Hearing Research, 61(9), 2259–2274.
Rousseaux, M., Daveluy, W., & Kozlowski, O. (2010). Communication in conversation in stroke patients. Journal of Neurology, 257(7), 1099–1107.
Salis, C., Murray, L., & Bakas, K. (2018). An international survey of assessment practices for short-term and working memory deficits in aphasia. American Journal of Speech-Language Pathology, 27(2), 574–591.
Shadden, B. (1998). Obtaining the discourse sample. In L. Cherney, B. Shadden, & C. Coelho (Eds.), Analyzing Discourse in Communicatively Impaired Adults (pp. 9–34). Aspen Publishers.
Shadden, B. B., Burnette, R. B., Eikenberry, B. R., & DiBrezzo, R. (1991). All discourse tasks are not created equal. Clinical Aphasiology Conference. Pro-Ed. http://aphasiology.pitt.edu/153/
Sim, P., Power, E., & Togher, L. (2013). Describing conversations between individuals with traumatic brain injury (TBI) and communication partners following communication partner training: Using exchange structure analysis. Brain Injury, 27(6), 717–742.
Simmons-Mackie, N., Worrall, L., Murray, L. L., Enderby, P., Rose, M. L., Paek, E. J., & Klippi, A. (2017). The top ten: Best practice recommendations for aphasia. Aphasiology, 31(2), 131–151.
Stark, B. C. (2019). A comparison of three discourse elicitation methods in aphasia and age-matched adults: Implications for language assessment and outcome. American Journal of Speech-Language Pathology, 28(3), 1067–1083.
Stark, B. C., Dutta, M., Murray, L., Bryant, L., Fromm, D., MacWhinney, B., Ramage, A., Simmons-Mackie, N., Roberts, A., Fergadiotis, G., den Ouden, D.-B., Brock, K., Harmon, T., Paek, E. J., Themistokleous, C., MicKinney-Bock, K., Yoo, H., Yoon, S. O., Sharma, S., … Gutierrez, S. (2020). Standardizing assessment of spoken discourse in aphasia: A working group with deliverables. American Journal of Speech-Language Pathology, 30(1S), 491–502.
Stark, B. C., & Fukuyama, J. (2020). Leveraging big data to understand the interaction of task and language during monologic spoken discourse in speakers with and without aphasia. Cognition and Neuroscience, 36(5), 562–585.
Tetnowski, J. T., Tetnowski, J. A., & Damico, J. S. (2021). Patterns of conversation trouble source and repair as indices of improved conversation in aphasia: A multiple-case study using conversation analysis. American Journal of Speech-Language Pathology, 30(1S), 326–343.
Thompson, C. K. (n.d.). Northwestern Narrative Language Analysis (NNLA) theory and methodology.
Ulatowska, H. K., Allard, L., Reyes, B. A., Ford, J., & Chapman, S. (1992). Conversational discourse in aphasia. Aphasiology, 6(3), 325–330.
Ulatowska, H. K., North, A. J., & Macaluso-Haynes, S. (1981). Production of narrative and procedural discourse in aphasia. Brain and Language, 13(2), 345–371.
Wallace, S. J., Worrall, L. E., Rose, T., & Le Dorze, G. (2018). Discourse measurement in aphasia research: Have we reached the tipping point? A core outcome set … or greater standardisation of discourse measures? Aphasiology, 32(4), 479–482.
Wallace, S. J., Worrall, L., Rose, T., Le Dorze, G., Breitenstein, C., Hilari, K., Babbitt, E., Bose, A., Brady, M., Cherney, L. R., Copland, D., Cruice, M., Enderby, P., Hersh, D., Howe, T., Kelly, H., Kiran, S., Laska, A.-C., Marshall, J., … Webster, J. (2019). A core outcome set for aphasia treatment research: The ROMA consensus statement. International Journal of Stroke, 14(2), 180–185.
Webster, J., & Morris, J. (2019). Communicative informativeness in aphasia: Investigating the relationship between linguistic and perceptual measures. American Journal of Speech-Language Pathology, 28(3), 1115–1126.
Whitworth, A., Leitao, S., Cartwright, J., Webster, J., Hankey, G. J., Zach, J., Howard, D., & Wolz, V. (2015). NARNIA: A new twist to an old tale. A pilot RCT to evaluate a multilevel approach to improving discourse in aphasia. Aphasiology, 29(11), 1345–1382.
Wilkinson, R. (2014). Intervening with conversation analysis in speech and language therapy: Improving aphasic conversation. Research on Language and Social Interaction, 47(3), 219–238.
Wright, H. H., & Capilouto, G. J. (2009). Manipulating task instructions to change narrative discourse performance. Aphasiology, 23(10), 1295–1308.
Information & Authors
Information
Published In
Journal of Speech, Language, and Hearing Research
Volume 64 • Number 11 • November 2021
Pages: 4366-4389
PubMed: 34554878
Copyright
Copyright © 2021 American Speech-Language-Hearing Association.
History
- Received: Dec 10, 2020
- Revised: Mar 25, 2021
- Accepted: Jun 8, 2021
- Published online: Sep 23, 2021
- Published in issue: Nov 8, 2021
Authors
Metrics & Citations
Metrics
Article Metrics
View all metricsCitations
Download article citation data for:
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
Citing Literature
- Sarah Grace Dalton, Javad Anjum, Davida Fromm, Brian MacWhinney, The curious case of the Cat Rescue: can picture narrative description inform visuospatial processing in aphasia?, Frontiers in Human Neuroscience, 10.3389/fnhum.2025.1574453, 19, (2025).
- Junhua Ding, Daniel Mirman, Data-driven classification of narrative speech characteristics in stroke aphasia distinguishes neurological and strategic contributions, Cortex, 10.1016/j.cortex.2025.03.006, 186, (61-73), (2025).
- Pieter De Clercq, Jill Kries, Ramtin Mehraram, Jonas Vanthornhout, Tom Francart, Maaike Vandermosten, Neural tracking of natural speech: an effective marker for post-stroke aphasia, Brain Communications, 10.1093/braincomms/fcaf095, 7, 2, (2025).
- Viktória Kevická, Lucia Kaščáková, Daniel Dančík, Petra Brandoburová, Jana Marková, Adaptation of main concept analysis for Slovak SLPs: a Pilot study, Aphasiology, 10.1080/02687038.2025.2473035, (1-18), (2025).
- Mellissa Bortz, Mira Goral, Translanguaging in conversations for people with aphasia living in Greater Johannesburg, South Africa, South African Journal of Communication Disorders, 10.4102/sajcd.v72i1.1082, 72, 1, (2025).
- Brielle C. Stark, Sarah Grace Dalton, Alyssa M. Lanzi, Access to context-specific lexical-semantic information during discourse tasks differentiates speakers with latent aphasia, mild cognitive impairment, and cognitively healthy adults, Frontiers in Human Neuroscience, 10.3389/fnhum.2024.1500735, 18, (2025).
- Jessica M. Lammert, Angela C. Roberts, Ken McRae, Laura J. Batterink, Blake E. Butler, Early Identification of Language Disorders Using Natural Language Processing and Machine Learning: Challenges and Emerging Approaches, Journal of Speech, Language, and Hearing Research, 10.1044/2024_JSLHR-24-00515, 68, 2, (705-718), (2025).
- M. Gobbo, A. Marini, Advances in Neuropsychology and Speech and Language Pathology in Patients with Stroke, Translational Neurorehabilitation, 10.1007/978-3-031-63604-2_4, (39-61), (2024).
- Davida Fromm, Sarah Grace Dalton, Alexander Brick, Gbenuola Olaiya, Sophia Hill, Joel Greenhouse, Brian MacWhinney, The Case of the Cookie Jar: Differences in Typical Language Use in Dementia, Journal of Alzheimer’s Disease, 10.3233/JAD-230844, 100, 4, (1417-1434), (2024).
- Marika Gobbo, Andrea Marini, Transcranial alternating current stimulation applied to language recovery in persons with aphasia: a scoping review, Aphasiology, 10.1080/02687038.2024.2373135, 39, 5, (684-709), (2024).
- See more
View Options
Sign In Options
ASHA member? If so, log in with your ASHA website credentials for full access.
Member Login