Abstract
Purpose
When we speak, we gesture, and indeed, persons with aphasia gesture more frequently. The reason(s) for this is still being investigated, spurring an increase in the number of studies of gesture in persons with aphasia. As the number of studies increases, so too does the need for a shared set of best practices for gesture research in aphasia. After briefly reviewing the importance and use of gesture in persons with aphasia, this viewpoint puts forth methodological and design considerations when evaluating gesture in persons with aphasia.
Method & Results
We explore several different design and methodological considerations for gesture research specific to persons with aphasia, such as video angle specifications, data collection techniques, and analysis considerations. The goal of these suggestions is to develop transparent and reproducible methods for evaluating gesture in aphasia to build a solid foundation for continued work in this area.
Conclusions
We have proposed that it is critical to evaluate multimodal communication in a methodologically robust way to facilitate increased knowledge about the relationship of gesture to spoken language, cognition, and to other aspects of living with aphasia and recovery from aphasia. We conclude by postulating future directions for gesture research in aphasia.

References
-
Ahlsén, E. (1991). Body communication as compensation for speech in a Wernicke's aphasic-A longitudinal study.Journal of Communication Disorders, 24(1), 1–12. https://doi.org/10.1016/0021-9924(91)90029-I -
Akhavan, N., Göksun, T., & Nozari, N. (2018). Integrity and function of gestures in aphasia.Aphasiology, 32(11), 1310–1335. https://doi.org/10.1080/02687038.2017.1396573 -
Béland, R., & Ska, B. (1992). Interaction between verbal and gestural language in progressive aphasia: A longitudinal case study.Brain and Language, 43(3), 355–385. https://doi.org/10.1016/0093-934X(92)90107-P -
Borod, J. C., Fitzpatrick, P. M., Helm-Estabrooks, N., & Goodglass, H. (1989). The relationship between limb apraxia and the spontaneous use of communicative gesture in aphasia.Brain and Cognition, 10(1), 121–131. https://doi.org/10.1016/0278-2626(89)90079-1 -
Braddock, B. A. (2007). Links between language, gesture and motor skill: A longitudinal study of communication recovery in Broca's aphasia. University of Missouri-Columbia. -
Buxbaum, L. J., Shapiro, A. D., & Coslett, H. B. (2014). Critical brain regions for tool-related and imitative actions: A componential analysis.Brain, 137(7), 1971–1985. https://doi.org/10.1093/brain/awu111 -
Capirci, O., Contaldo, A., Caselli, M. C., & Volterra, V. (2005). From action to language through gesture.Gesture, 5(1–2), 155–177. https://doi.org/10.1075/gest.5.1.12cap -
Cattani, A., Bonifacio, S., Fertz, M., Iverson, J. M., Zocconi, E., & Caselli, M. C. (2010). Communicative and linguistic development in preterm children: A longitudinal study from 12 to 24 months.International Journal of Language & Communication Disorders, 45(2), 162–173. https://doi.org/10.3109/13682820902818870 -
Chu, M., Meyer, A., Foulkes, L., & Kita, S. (2014). Individual differences in frequency and saliency of speech-accompanying gestures: The role of cognitive abilities and empathy.Journal of Experimental Psychology: General, 143(2), 694–709. https://doi.org/10.1037/a0033861 -
Church, R. B., & Goldin-Meadow, S. (1986). The mismatch between gesture and speech as an index of transitional knowledge.Cognition, 23(1), 43–71. https://doi.org/10.1016/0010-0277(86)90053-3 -
Clough, S., & Duff, M. C. (2020). The role of gesture in communication and cognition: Implications for understanding and treating neurogenic communication disorders.Frontiers in Human Neuroscience, 14, 323. https://doi.org/10.3389/fnhum.2020.00323 -
Cocks, N., Byrne, S., Pritchard, M., Morgan, G., & Dipper, L. (2018). Integration of speech and gesture in aphasia.International Journal of Language & Communication Disorders, 53(3), 584–591. https://doi.org/10.1111/1460-6984.12372 -
Cocks, N., Dipper, L., Middleton, R., & Morgan, G. (2011). What can iconic gestures tell us about the language system? A case of conduction aphasia.International Journal of Language & Communication Disorders, 46(4), 423–436. https://doi.org/10.3109/13682822.2010.520813 -
Congdon, E. L., Novack, M. A., & Goldin-Meadow, S. (2018). Gesture in experimental studies.Organizational Research Methods, 21(2), 489–499. https://doi.org/10.1177/1094428116654548 -
Dargue, N., Sweller, N., & Jones, M. P. (2019). When our hands help us understand: A meta-analysis into the effects of gesture on comprehension.Psychological Bulletin, 145(8), 765–784. https://doi.org/10.1037/bul0000202 -
de Beer, C., de Ruiter, J. P., Hielscher-Fastabend, M., & Hogrefe, K. (2019). The production of gesture and speech by people with aphasia: Influence of communicative constraints.Journal of Speech, Language, and Hearing Research, 62(12), 4417–4432. https://doi.org/10.1044/2019_JSLHR-L-19-0020 -
De Beugher, S., Brône, G., & Goedemé, T. (2018). A semi-automatic annotation tool for unobtrusive gesture analysis.Language Resources and Evaluation, 52(2), 433–460. https://doi.org/10.1007/s10579-017-9404-9 -
de Ruiter, J. P. (2017). The asymmetric redundancy of gesture and speech.InR. B. Church, M. W. Alibali, & S. D. Kelly (Eds.), Why gesture? How the hands function in speaking, thinking, and communicating (pp. 59–75). John Benjamins. https://doi.org/10.1075/gs.7.04der -
Dipper, L., Pritchard, M., Morgan, G., & Cocks, N. (2015). The language-gesture connection: Evidence from aphasia.Clinical Linguistics & Phonetics, 29(8–10), 748–763. https://doi.org/10.3109/02699206.2015.1036462 -
Duff, M. C., Mutlu, B., Byom, L., & Turkstra, L. S. (2012). Beyond utterances: Distributed cognition as a framework for studying discourse in adults with acquired brain injury.Seminars in Speech and Language, 33(1), 44–54. https://doi.org/10.1055/s-0031-1301162 -
Eggenberger, N., Preisig, B. C., Schumacher, R., Hopfner, S., Vanbellingen, T., Nyffeler, T., Gutbrod, K., Annoni, J. M., Bohlhalter, S., Cazzoli, D., & Müri, R. M. (2016). Comprehension of co-speech gestures in aphasic patients: An eye movement study.PLOS ONE, 11(1), Article e0146583. https://doi.org/10.1371/journal.pone.0146583 -
Feyereisen, P. (1983). Manual activity during speaking in aphasic subjects.International Journal of Psychology, 18, 545–556. https://doi.org/10.1080/00207598308247500 -
Feyereisen, P., & Havard, I. (1999). Mental imagery and production of hand gestures while speaking in younger and older adults.Journal of Nonverbal Behavior, 23(2), 153–171. https://doi.org/10.1023/A:1021487510204 -
Fridriksson, J., Yourganov, G., Bonilha, L., Basilakos, A., Den Ouden, D.-B., & Rorden, C. (2016). Revealing the dual streams of speech processing.Proceedings of the National Academy of Sciences, 113(52), 15108–15113. https://doi.org/10.1073/pnas.1614038114 -
Gillespie, M., James, A. N., Federmeier, K. D., & Watson, D. G. (2014). Verbal working memory predicts co-speech gesture: Evidence from individual differences.Cognition, 132(2), 174–180. https://doi.org/10.1016/j.cognition.2014.03.012 -
Gleichgerrcht, E., Fridriksson, J., Rorden, C., & Bonilha, L. (2017). Connectome-based lesion-symptom mapping (CLSM): A novel approach to map neurological function.NeuroImage: Clinical, 16, 461–467. https://doi.org/10.1016/j.nicl.2017.08.018 -
Göksun, T., Lehet, M., Malykhina, K., & Chatterjee, A. (2013). Naming and gesturing spatial relations: Evidence from focal brain-injured individuals.Neuropsychologia, 51(8), 1518–1527. https://doi.org/10.1016/j.neuropsychologia.2013.05.006 -
Göksun, T., Lehet, M., Malykhina, K., & Chatterjee, A. (2015). Spontaneous gesture and spatial language: Evidence from focal brain injury.Brain and Language, 150, 1–13. https://doi.org/10.1016/j.bandl.2015.07.012 -
Goldin-Meadow, S., & Alibali, M. W. (2013). Gesture's role in speaking, learning, and creating language.Annual Review of Psychology, 64(1), 257–283. https://doi.org/10.1146/annurev-psych-113011-143802 -
Goldin-Meadow, S., Nusbaum, H., Kelly, S. D., & Wagner, S. (2001). Explaining math: Gesturing lightens the load.Psychological Science, 12(6), 516–522. https://doi.org/10.1111/1467-9280.00395 -
Hadar, U., & Butterwork, B. (1997). Iconic gestures, imagery, and word retrieval in speech.Semiotica, 115(1–2), 147–172. https://doi.org/10.1515/semi.1997.115.1-2.147 -
Hengst, J. A., & Duff, M. C. (2007). Clinicians as communication partners.Topics in Language Disorders, 27(1), 37–49. https://doi.org/10.1097/00011363-200701000-00005 -
Hickok, G., & Poeppel, D. (2004). Dorsal and ventral streams: A framework for understanding aspects of the functional anatomy of language.Cognition, 92(1–2), 67–99. https://doi.org/10.1016/j.cognition.2003.10.011 -
Hilliard, C., & Cook, S. W. (2016). Bridging gaps in common ground: Speakers design their gestures for their listeners.Journal of Experimental Psychology: Learning Memory and Cognition, 42(1), 91–103. https://doi.org/10.1037/xlm0000154 -
Hilverman, C., Cook, S. W., & Duff, M. C. (2016). Hippocampal declarative memory supports gesture production: Evidence from amnesia.Cortex, 85, 25–36. https://doi.org/10.1016/j.cortex.2016.09.015 -
Hilverman, C., Cook, S. W., & Duff, M. C. (2018). Hand gestures support word learning in patients with hippocampal amnesia.Hippocampus, 28(6), 406–415. https://doi.org/10.1002/hipo.22840 -
Hogrefe, K., Goldenberg, G., & Ziegler, W. (2020). Nonverbal assessment of semantic processing capacities in persons with aphasia after stroke: Application of the Nonverbal Semantics Test (NVST)[Paper presentation]. 58th annual meeting of the Academy of Aphasia . -
Hogrefe, K., Ziegler, W., Weidinger, N., & Goldenberg, G. (2012). Non-verbal communication in severe aphasia: Influence of aphasia, apraxia, or semantic processing?.Cortex, 48(8), 952–962. https://doi.org/10.1016/j.cortex.2011.02.022 -
Hogrefe, K., Ziegler, W., Weidinger, N., & Goldenberg, G. (2017). Comprehensibility and neural substrate of communicative gestures in severe aphasia.Brain and Language, 171, 62–71. https://doi.org/10.1016/j.bandl.2017.04.007 -
Holler, J. (2014). Experimental methods in co-speech gesture research.InC. Mueller, A. Cienki, D. McNeill, & E. Fricke (Eds.), Body-language-communication: An international handbook on multimodality in human interaction (pp. 837–857). de Gruyter. -
Holler, J., & Wilkin, K. (2011). An experimental investigation of how addressee feedback affects co-speech gestures accompanying speakers' responses.Journal of Pragmatics, 43(14), 3522–3536. https://doi.org/10.1016/j.pragma.2011.08.002 -
Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis.Psychological Bulletin, 137(2), 297–315. https://doi.org/10.1037/a0022128 -
Humphries, S., Holler, J., Crawford, T., & Poliakoff, E. (2020). Co-speech gestures are a window into the effects of Parkinson's disease on action representations.Journal of Experimental Psychology: General, 1–46. https://doi.org/10.31234/osf.io/hjmry -
Jacobs, N., & Garnham, A. (2007). The role of conversational hand gestures in a narrative task.Journal of Memory and Language, 56(2), 291–303. https://doi.org/10.1016/j.jml.2006.07.011 -
Kagan, A. (1998). Supported conversation for adults with aphasia: Methods and resources for training conversation partners.Aphasiology, 12(9), 816–830. https://doi.org/10.1080/02687039808249575 -
Kalenine, S., Buxbaum, L. J., & Coslett, H. B. (2010). Critical brain regions for action recognition: Lesion symptom mapping in left hemisphere stroke.Brain: A Journal of Neurology, 133, 3269–3280. https://doi.org/10.1093/brain/awq210 -
Kistner, J., Dipper, L. T., & Marshall, J. (2019). The use and function of gestures in word-finding difficulties in aphasia.Aphasiology, 33(11), 1372–1392. https://doi.org/10.1080/02687038.2018.1541343 -
Kistner, J., Marshall, J., & Dipper, L. T. (2019). The influence of conversation parameters on gesture production in aphasia.Clinical Linguistics & Phonetics, 34(8), 693–717. https://doi.org/10.1080/02699206.2019.1692075 -
Kita, S. (2009). Cross-cultural variation of speech-accompanying gesture: A review.Language and Cognitive Processes, 24(2), 145–167. https://doi.org/10.1080/01690960802586188 -
Kita, S., Alibali, M. W., & Chu, M. (2017). How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis.Psychological Review, 124(3), 245–266. https://doi.org/10.1037/rev0000059 -
Kita, S., & Davies, T. S. (2009). Competing conceptual representations trigger co-speech representational gestures.Language and Cognitive Processes, 24(5), 761–775. https://doi.org/10.1080/01690960802327971 -
Kita, S., & Lausberg, H. (2008). Generation of co-speech gestures based on spatial imagery from the right-hemisphere: Evidence from split-brain patients.Cortex, 44(2), 131–139. https://doi.org/10.1016/j.cortex.2006.04.001 -
Kong, A. P.-H., Law, S.-P., & Chak, G. W.-C. (2017). A comparison of coverbal gesture use in oral discourse among speakers with fluent and nonfluent aphasia.Journal of Speech, Language, and Hearing Research, 60(7), 2031–2046. https://doi.org/10.1044/2017_JSLHR-L-16-0093 -
Kong, A. P.-H., Law, S. P., Wat, W. K. C., & Lai, C. (2015). Co-verbal gestures among speakers with aphasia: Influence of aphasia severity, linguistic and semantic skills, and hemiplegia on gesture employment in oral discourse.Journal of Communication Disorders, 56, 88–102. https://doi.org/10.1016/j.jcomdis.2015.06.007 -
Krauss, R. M., Chen, Y., & Gottesman, R. F. (2000). Lexical gestures and lexical access: A process model.InM. McNeill (Ed.), Language and gesture (pp. 261–283). Cambridge University Press. https://doi.org/10.1017/CBO9780511620850.017 -
Kroenke, K. M., Kraft, I., Regenbrecht, F., & Obrig, H. (2013). Lexical learning in mild aphasia: Gesture benefit depends on patholinguistic profile and lesion pattern.Cortex, 49(10), 2637–2649. https://doi.org/10.1016/j.cortex.2013.07.012 -
Lanyon, L., & Rose, M. L. (2009). Do the hands have it? The facilitation effects of arm and hand gesture on word retrieval in aphasia.Aphasiology, 23(7–8), 809–822. https://doi.org/10.1080/02687030802642044 -
Lausberg, H., & Sloetjes, H. (2009). Coding gestural behavior with the NEUROGES-ELAN system.Behavior Research Methods, 41(3), 841–849. https://doi.org/10.3758/BRM.41.3.841 -
MacWhinney, B., Forbes, M., & Holland, A. (2011). AphasiaBank: Methods for studying discourse.Aphasiology, 25(11), 1286–1307. https://doi.org/10.1080/02687038.2011.589893 -
Mayberry, R. I., & Nicoladis, E. (2000). Gesture reflects language development.Current Directions in Psychological Science, 9(6), 192–196. https://doi.org/10.1111/1467-8721.00092 -
McNeill, D. (1992). Hand and mind: What gestures reveal about thought. University of Chicago Press. -
Melinger, A., & Kita, S. (2007). Conceptualisation load triggers gesture production.Language and Cognitive Processes, 22(4), 473–500. https://doi.org/10.1080/01690960600696916 -
Özer, D., & Göksun, T. (2020). Visual-spatial and verbal abilities differentially affect processing of gestural vs. spoken expressions.Language, Cognition and Neuroscience, 35(7), 896–914. https://doi.org/10.1080/23273798.2019.1703016 -
Özer, D., Göksun, T., & Chatterjee, A. (2019). Differential roles of gestures on spatial language in neurotypical elderly adults and individuals with focal brain injury.Cognitive Neuropsychology, 36(5−6), 282–299. https://doi.org/10.1080/02643294.2019.1618255 -
Pouw, W., & Dixon, J. A. (2020). Gesture networks: Introducing dynamic time warping and network analysis for the kinematic study of gesture ensembles.Discourse Processes, 57, 301–319. https://doi.org/10.1080/0163853X.2019.1678967 -
Preisig, B. C., Eggenberger, N., Cazzoli, D., Nyffeler, T., Gutbrod, K., Annoni, J.-M., Meichtry, J. R., Nef, T., & Glize, B. (2018). Multimodal communication in aphasia: Perception and production of co-speech gestures during face-to-face conversation.Frontiers in Human Neuroscience, 12, 200. https://doi.org/10.3389/fnhum.2018.00200 -
Pritchard, M., Cocks, N., & Dipper, L. (2013). Iconic gesture in normal language and word searching conditions: A case of conduction aphasia.International Journal of Speech-Language Pathology, 15(5), 524–534. https://doi.org/10.3109/17549507.2012.712157 -
Pritchard, M., Dipper, L., Morgan, G., & Cocks, N. (2015). Language and iconic gesture use in procedural discourse by speakers with aphasia.Aphasiology, 29(7), 826–844. https://doi.org/10.1080/02687038.2014.993912 -
Rauscher, F. H., Krauss, R. M., & Chen, Y. (1996). Gesture, speech, and lexical access: The role of lexical movements in speech production.Psychological Science, 7(4), 226–231. https://doi.org/10.1111/j.1467-9280.1996.tb00364.x -
Ripperda, J., Drijvers, L., & Holler, J. (2020). Speeding up the detection of non-iconic and iconic gestures (SPUDNIG): A toolkit for the automatic detection of hand movements and gestures in video data.Behavior Research Methods, 52(4), 1783–1794. https://doi.org/10.3758/s13428-020-01350-2 -
Roby-Brami, A., Hermsdörfer, J., Roy, A. C., & Jacobs, S. (2012). A neuropsychological perspective on the link between language and praxis in modern humans.Philosophical Transactions of the Royal Society B: Biological Sciences, 367(1585), 144–160. https://doi.org/10.1098/rstb.2011.0122 -
Rose, M. L. (2006). The utility of arm and hand gestures in the treatment of aphasia.Advances in Speech Language Pathology, 8(2), 92–109. https://doi.org/10.1080/14417040600657948 -
Rose, M., Douglas, J., & Matyas, T. (2002). The comparative effectiveness of gesture and verbal treatments for a specific phonologic naming impairment.Aphasiology, 16(10–11), 1001–1030. https://doi.org/10.1080/02687030143000825 -
Sekine, K., & Rose, M. L. (2013). The relationship of aphasia type and gesture production in people with aphasia.American Journal of Speech-Language Pathology, 22(4), 662–672. https://doi.org/10.1044/1058-0360(2013/12-0030) -
Sekine, K., Rose, M. L., Foster, A. M., Attard, M. C., & Lanyon, L. E. (2013). Gesture production patterns in aphasic discourse: In-depth description and preliminary predictions.Aphasiology, 27(9), 1031–1049. https://doi.org/10.1080/02687038.2013.803017 -
Siegel, J. S., Seitzman, B. A., Ramsey, L. E., Ortega, M., Gordon, E. M., Dosenbach, N. U. F., Petersen, S. E., Shulman, G. L., & Corbetta, M. (2018). Re-emergence of modular brain networks in stroke recovery.Cortex, 101, 44–59. https://doi.org/10.1016/J.CORTEX.2017.12.019 -
Stark, B. C., & Cofoid, C. (n.d.). Task-specific iconic gesturing during spoken discourse in aphasia.American Journal of Speech-Language Pathology. Advanced online publication. https://doi.org/10.1044/2021_AJSLP-20-00271 -
Vanbellingen, T., Kersten, B., Van Hemelrijk, B., Van De Winckel, A., Bertschi, M., Müri, R., De Weerdt, W., & Bohlhalter, S. (2010). Comprehensive assessment of gesture production: A new test of upper limb apraxia (TULIA).European Journal of Neurology, 17(1), 59–66. https://doi.org/10.1111/j.1468-1331.2009.02741.x -
van Nispen, K., van de Sandt-Koenderman, M., Sekine, K., Krahmer, E., & Rose, M. L. (2017). Part of the message comes in gesture: How people with aphasia convey information in different gesture types as compared with information in their speech.Aphasiology, 31(9), 1078–1103. https://doi.org/10.1080/02687038.2017.1301368 -
Willems, R. M., & Hagoort, P. (2007). Neural evidence for the interplay between language, gesture, and action: A review.Brain and Language, 101(3), 278–289. https://doi.org/10.1016/j.bandl.2007.03.004 -
Wittenburg, P., Brugman, H., Russel, A., Klassmann, A., & Sloetjes, H. (2006). ELAN: A professional framework for multimodality research.In Proceedings of the 5th International Conference on Language Resources and Evaluation, LREC 2006 (pp. 1556–1559). European Language Resources Association.