Evaluating the Modified-Shortened Token Test as a Working Memory and Language Assessment Tool
Publication: Journal of Speech, Language, and Hearing Research
Volume 65, Number 3
Pages 1145-1158
Abstract
Purpose:
Working memory and linguistic knowledge are highly intertwined in language tasks. Verbal working memory in particular has been studied as a potential constraint on language performance. This, in turn, highlights the need for a clinical assessment tool that will assist clinicians in understanding individual children's performance in relation to working memory and language. In this study, we investigated whether performance on the Token Test could capture differences in verbal working memory and linguistic knowledge given its manipulation of length and syntactic complexity.
Method:
In Experiment 1, 257 children ages 4–7 years completed our Modified-Shortened Token Test, in which they carried out commands of increasing length and complexity. Experiment 2 was an exploratory study that included a separate group of 24 kindergarten-age children who completed our Modified-Shortened Token Test as well as other memory and language measures.
Results:
The factor analysis in Experiment 1 revealed a three-factor solution with factors corresponding to verbal working memory, linguistic, and basic attention constructs. In Experiment 2, we conducted exploratory correlations between composite scores formed based on identified factors (from Experiment 1) and related measures. Recalling sentences and formulating sentences correlated with the working memory demands of the Token Test, whereas following directions and word structure correlated with Token Test linguistic factor.
Conclusions:
A modified Token Test has the potential to be used clinically to understand language performance. In particular, differential performance across sentences could reveal relative verbal working memory and linguistic knowledge abilities.
Supplemental Material:
Get full access to this article
View all available purchase options and get full access to this article.
References
Alloway, T., Gathercole, S., & Pickering, S. (2006). Verbal and visuospatial short-term and working memory in children: Are they separable? Child Development, 77(6), 1698–1716.
Archibald, L. M. D. (2013). The language, working memory, and other cognitive demands of verbal tasks. Topics in Language Disorders, 33(3), 190–207.
Archibald, L. M. D., & Gathercole, S. E. (2006). Short-term and working memory in specific language impairment. International Journal of Language & Communication Disorders, 41(6), 675–693.
Archibald, L. M. D., & Gathercole, S. E. (2007). The complexities of complex memory span: Storage and processing deficits in specific language impairment. Journal of Memory and Language, 57(2), 177–194.
Archibald, L. M. D., & Joanisse, M. (2009). On the sensitivity and specificity of nonword repetition and sentence recall to language and memory impairments in children. Journal of Speech, Language, and Hearing Research, 52(4), 899–914.
Archibald, L. M. D., Oram Cardy, J., Joanisse, M. F., & Ansari, D. (2013). Language, reading, and math learning profiles in an epidemiological sample of school age children. PLOS ONE, 8(10), Article e77463.
Arvedson, C. J., McNeil, M., & West, T. (1985). Prediction of Revised Token Test overall, subtest, and linguistic unit scores by two shortened versions. Clinical Aphasiology, 15, 57–63.
Baddeley, A. D., & Hitch, G. (1974). Working memory. In G. A. Bower (Ed.), Recent advances in learning and motivation (pp. 647–667). Academic Press.
Bastiaanse, R., Raaijmakers, S., Satoer, D., & Visch-Brink, E. (2016). The Multilingual Token Test. Aphasiology, 30(4), 508–508.
Bohm, B., Smedler, A. C., & Forssberg, H. (2004). Impulse control, working memory and other executive functions in preterm children when starting school. Acta Paediatrica, 93(10), 1363–1371.
Brysbaert, M., & Biemiller, A. (2017). Test-based age-of-acquisition norms for 44 thousand English word meanings. Behavior Research Methods, 49(4), 1520–1523.
Brysbaert, M., Warriner, A. B., & Kuperman, V (2014). Concreteness ratings for 40 thousand generally known English word lemmas. Behavior Research Methods, 46(3), 904–911.
Cohen-Mimran, R., & Sapir, S. (2007). Deficits in working memory in young adults with reading disabilities. Journal of Communication Disorders, 40(2), 168–183.
Cole, K., & Fewell, R. (1983). A quick language screening test for young children: The Token Test. Journal of Psychoeducational Assessment, 1(2), 149–153.
De Renzi, E., & Faglioni, P. (1978). Normative data and screening power of a shortened version of the Token Test. Cortex, 14(1), 41–49.
De Renzi, E., & Vignolo, L. A. (1962). The Token Test: A sensitive test to detect receptive disturbances in aphasics. Brain, 85(4), 665–678.
Dunn, T. J., Baguley, T., & Brunsden, V. (2014). From alpha to omega: A practical solution to the pervasive problem of internal consistency estimation. The British Journal of Psychology, 105(3), 399–412.
Ellis Weismer, S., Evans, J., & Hesketh, L. (1999). An examination of verbal working memory capacity in children with specific language impairment. Journal of Speech, Language, and Hearing Research, 42(5), 1249–1260.
Farrar, M. J., Ashwell, S., & Maag, L. (2005). The emergence of phonological awareness: Connections to language and theory of mind development. First Language, 25(2), 157–172.
Fidler, L. J., Plante, E., & Vance, R. (2011). Identification of adults with developmental language impairments. American Journal of Speech-Language Pathology, 20(1), 2–13.
Frizelle, P., Thompson, P., Duta, M., & Bishop, D. V. M. (2019). Assessing children's understanding of complex syntax: A comparison of two methods. Language Learning, 69(2), 255–291.
Gallardo, G., Guardia, J., Villasenor, T., & McNeil, M. R. (2011). Psychometric data for the Revised Token Test in normally developing Mexican children ages 4–12 years. Archives of Clinical Neuropsychology, 26(3), 225–234.
Gillam, R., Montgomery, J., Evans, J., & Gillam, S. (2019). Cognitive predictors of sentence comprehension in children with and without developmental language disorder: Implications for assessment and treatment. International Journal of Speech Language Pathology, 21(3), 240–251.
Gillam, R., & Pearson, N. (2017). Test of Narrative Language (2nd ed.). Pro-Ed.
Gray, S., Fox, A., Green, S., Alt, M., Hogan, T., Petscher, Y., & Cowan, N. (2019). Working memory profiles of children with dyslexia, developmental language disorder, or both. Journal of Speech, Language, and Hearing Research, 62(6), 1839–1858.
Isaki, E., Spaulding, T., & Plante, E. (2008). Contributions of language and memory demands to verbal memory performance in language-learning disabilities. Journal of Communication Disorders, 41(6), 512–530.
JASP Team. (2020). JASP (Version 0.14.1) [Computer software].
Jeffreys, H. (1961). The theory of probability. Oxford University Press.
Jolliffe, I. T. (1972). Discarding variables in a principal component analysis, I. Artificial data. Applied Statistics, 21, 160–173.
Kapantzoglou, M., Restrepo, M., Gray, S., & Thompson, M. (2015). Language ability groups in bilingual children: A latent profile analysis. Journal of Speech, Language, and Hearing Research, 58(5), 1549–1562.
Khan, K. S., Logan, J., Justice, L. M., Bowles, R. P., & Piasta, S. B. (2021). The contribution of vocabulary, grammar, and phonological awareness across a continuum of narrative ability levels in young children. Journal of Speech, Language, and Hearing Research, 64(9), 3489–3503.
Magimairaj, B. M., & Montgomery, J. W. (2012). Children's verbal working memory: Role of processing complexity in predicting spoken sentence comprehension. Journal of Speech, Language, and Hearing Research, 55(3), 669–682.
Majerus, S. (2013). Language repetition and short-term memory: An integrative framework. Frontiers in Human Neuroscience, 7, 357.
Manning, C. D., Surdeanu, M., Bauer, J., Finkel, J., Bethard, S. J., & McClosky, D. (2014). The Stanford CoreNLP natural language processing toolkit. In Proceedings of 52nd annual meeting of the association for computational linguistics: System demonstrations (pp. 55–60).
Marton, K., & Schwartz, R. G. (2003). Working memory capacity and language processes in children with specific language impairment. Journal of Speech, Language, and Hearing Research, 46(5), 1138–1153.
McNeil, M., Pratt, S., Szuminsky, N., Sung, J., Fossett, T., Fassbinder, W., & Lim, K. (2015). Reliability and validity of the computerized Revised Token Test: comparison of reading and listening versions in persons with and without aphasia. Journal of Speech, Language, and Hearing Research, 58(2), 311–324.
Montgomery, J. W., Gillam, R. B., & Evans, J. L. (2021). A new memory perspective on the sentence comprehension deficits of school-age children with developmental language disorder: Implications for theory, assessment, and intervention. Language, Speech, and Hearing Services in Schools, 52(2), 449–466.
Noonan, N. B., Redmond, S. M., & Archibald, L. M. (2014). Contributions of children's linguistic and working memory proficiencies to their judgments of grammaticality. Journal of Speech, Language, and Hearing Research, 57(3), 979–989.
Paek, E. J., & Murray, L. L. (2018). A novel cognitive-linguistic approach to addressing developmental reading disorders: A pilot study. Communication Sciences & Disorders, 23(3), 609–628.
Paquier, P., Van Mourik, M., Van Dongen, H., Catsman-Berrevoets, C., Creten, W., & & Van Borsel, J. (2007). Normative data of 300 Dutch-speaking children on the Token Test. Aphasiology, 23(4), 427–437.
Park, G. H., McNeil, M. R., & Tompkins, C. A. (2000). Reliability of the Five-Item Revised Token Test for individuals with aphasia. Aphasiology, 14(5–6), 527–535.
Schmoeger, M., Deckert, M., Eisenwort, B., Loader, B., Hofmair, A., Auff, E., & Willinger, U. (2020). Evaluating Part V of the German version of the Token Test as a screening of specific language impairment in preschoolers. Applied Psycholinguistics, 41(1), 237–258.
Schwering, S. C., & Macdonald, M. C. (2020). Verbal working memory as emergent from language comprehension and production. Frontiers in Human Neuroscience, 14, 68.
Semel, E., Wiig, E. H., & Secord, W. A. (2003). Clinical Evaluation of Language Fundamentals–Fourth Edition (CELF-4). The Psychological Corporation.
Sheslow, D., & Adams, W. (2003). Wide range assessment of memory and learning (2nd ed.). Wide Range, Inc.
Spellacy, F. J., & Spreen, O. (1969). A short form of the Token Test. Cortex: A Journal Devoted to the Study of the Nervous System and Behavior, 5(4), 390–397.
Strauss, E., Sherman, E. M., & Spreen, O. (2006). A compendium of neuropsychological tests: Administration, norms, and commentary. American Chemical Society.
Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha. International Journal of Medical Education, 2, 53–55.
Torgensen, J. K., Wagner, R. K., & Rashotte, C. A. (1999). Test of Word Reading Efficiency. Pro-Ed.
Vugs, B., Cuperus, J., Hendriks, M., & Verhoeven, L. (2013). Visuospatial working memory in specific language impairment: A meta-analysis. Research in Developmental Disabilities, 34(9), 2586–2597.
Wagenmakers, E. J., Love, J., Marsman, M., Jamil, T., Ly, A., Verhagen, J., Selker, A., Gronau, Q. F., Dropmann, D., Boutin, B., Meerhoff, F., Knight, P., Raj, A., van Kesteren, E.-J., van Doorn, J., Šmíra, M., Epskamp, S., Etz, A., Matzke, D., … Morey, R. D. (2018). Bayesian inference for psychology. Part II: Example applications with JASP. Psychonomic Bulletin and Review, 25, 58–76.
Wiig, E. H., Semel, E., & Secord, W. A. (2013). Test objectives and descriptions for CELF-5: Clinical Evaluation of Language Fundamentals–Fifth Edition. Pearson. https://www.pearsonclinical.ca/content/dam/school/global/clinical/canada/programs/celf/CELF-5-objectives-descriptions_cdn_lr.pdf
Yngve, V. H. (1960). A model and a hypothesis for language structure. Proceedings of the American Philosophical Society, 104, 444–466.
Information & Authors
Information
Published In
Journal of Speech, Language, and Hearing Research
Volume 65 • Number 3 • March 2022
Pages: 1145-1158
PubMed: 35179992
Copyright
Copyright © 2022 American Speech-Language-Hearing Association.
History
- Received: Jul 1, 2021
- Revised: Oct 27, 2021
- Accepted: Nov 19, 2021
- Published online: Feb 18, 2022
- Published in issue: Mar 8, 2022
Authors
Metrics & Citations
Metrics
Article Metrics
View all metricsCitations
Download article citation data for:
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
Citing Literature
- Theresa Pham, Lisa M. D. Archibald, Are Children Performing Better on the Digit Span Backward Task Than the Digit Span Forward Task? An Exploratory Analysis, American Journal of Speech-Language Pathology, 10.1044/2023_AJSLP-22-00394, 32, 5, (2311-2321), (2023).
View Options
Sign In Options
ASHA member? If so, log in with your ASHA website credentials for full access.
Member Login