The Stability and Validity of Automated Indices of Vocal Development in Infants With Autistic and Non-Autistic Siblings
Publication: Journal of Speech, Language, and Hearing Research
Volume 66, Number 12
Pages 4934-4948
Abstract
Purpose:
This study evaluates the extent to which automated indices of vocal development are stable and valid for predicting language in infants at increased familial likelihood for autism and/or language impairment and relatively lower likelihood infants.
Method:
A group of infants with autistic siblings (Sibs-autism; 20 infants) and a comparison group of infants with non-autistic siblings (Sibs-NA; 20 infants) wore Language ENvironment Analysis (LENA) recording devices for 16 hr on 2 days within a 1-week period. Extant software was used to derive several putative indices of vocal development from these recordings. Stability of these variables was examined across and within groups. Expressive and receptive language aggregates were calculated for each participant. Multiple regression analyses were used to (a) evaluate zero-order correlations for variables derived from LENA recordings with concurrent and future language and (b) test whether those associations were moderated by group status.
Results:
Both stability and validity differed by variable and group status. All variables reached acceptable stability in the Sibs-autism group within two to three observations, whereas stability of most variables was attenuated in the Sibs-NA group. No variables were associated with concurrent language in the theoretically motivated direction across groups, but two variables were strongly associated with concurrent expressive language in only the Sibs-NA group. Additionally, two variables were associated with later expressive language, though these correlations were again stronger in the Sibs-NA versus Sibs-autism group.
Conclusions:
Although selected automated indices of vocal development were stable in Sibs-autism and/or valid for predicting expressive language within Sibs-NA, no scores showed strong, theoretically motivated associations with language within the Sibs-autism group. Automated indices of vocal development may, thus, have limited validity or clinical utility for predicting language development in infants at elevated familial likelihood for autism.
Supplemental Material:
Get full access to this article
View all available purchase options and get full access to this article.
References
Bottema-Beutel, K., Kim, S. Y., Crowley, S., Augustine, A., Kecili-Kaysili, B., Feldman, J. I., & Woynaroski, T. G. (2019). The stability of joint engagement states in infant siblings of children with and without ASD: Implications for measurement practices. Autism Research, 12(3), 495–504.
Bredin-Oja, S. L., Fielding, H., Fleming, K. K., & Warren, S. F. (2018). Clinician vs. machine: Estimating vocalizations rates in young children with developmental disorders. American Journal of Speech-Language Pathology, 27(3), 1066–1072.
Chawarska, K., Paul, R., Klin, A., Hannigen, S., Dichtel, L. E., & Volkmar, F. (2007). Parental recognition of developmental problems in toddlers with autism spectrum disorders. Journal of Autism and Developmental Disorders, 37(1), 62–72.
Chericoni, N., de Brito Wanderley, D., Costanzo, V., Diniz-Gonçalves, A., Leitgel Gille, M., Parlato, E., Cohen, D., Apicella, F., Calderoni, S., & Muratori, F. (2016). Pre-linguistic vocal trajectories at 6–18 months of age as early markers of autism. Frontiers in Psychology, 7, Article 1595. https://www.frontiersin.org/articles/10.3389/fpsyg.2016.01595
Cristia, A., Bulgarelli, F., & Bergelson, E. (2020). Accuracy of the Language ENvironment Analysis system segmentation and metrics: A systematic review. Journal of Speech, Language, and Hearing Research, 63(4), 1093–1105.
Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. Harcourt.
Cronbach, L. J., Rajaratnam, N., & Gleser, G. C. (1963). Theory of generalizability: A liberalization of reliability theory. British Journal of Statistical Psychology, 16(2), 137–163.
Diemer, M. A., Mistry, R. S., Wadsworth, M. E., López, I., & Reimers, F. (2013). Best practices in conceptualizing and measuring social class in psychological research. Analyses of Social Issues and Public Policy, 13(1), 77–113.
Dykstra, J. R., Sabatos-DeVito, M. G., Irvin, D. W., Boyd, B. A., Hume, K. A., & Odom, S. L. (2013). Using the Language ENvironment Analysis (LENA) system in preschool classrooms with children with autism spectrum disorders. Autism, 17(5), 582–594.
Edmunds, S. R. (2019). The role of parent responsiveness and vocal complexity in expressive language outcome: Intervention effects in toddlers at risk for ASD and language impairment (Publication No. 22618443) [Doctoral dissertation, University of Washington]. ProQuest Dissertations and Theses Global.
Feldman, J. I., Raj, S., Bowman, S. M., Santapuram, P., Golden, A. J., Daly, C., Dunham, K., Suzman, E., Augustine, A. E., Garla, V., Muhumuza, A., Cascio, C. J., Williams, K. L., Kirby, A. V., & Keceli-Kaysili, B., & Woynaroski, T. G. (2021). Sensory responsiveness is linked with communication in infant siblings of children with and without autism. Journal of Speech, Language, and Hearing Research, 64(6), 1964–1976.
Fenson, L., Marchman, V. A., Thal, D. J., Dale, P. S., & Reznick, J. S. (2007). MacArthur–Bates Communicative Development Inventories: User's guide and technical manual. Brookes.
Gilkerson, J., & Richards, J. (2020). A guide to understanding the design and purpose of the LENA system (Technical Report LTR-12; LENA technical report). LENA Foundation. https://www.lena.org/wp-content/uploads/2020/07/LTR-12_How_LENA_Works.pdf
Gilkerson, J., Richards, J. A., Warren, S. F., Montgomery, J. K., Greenwood, C. R., Oller, D. K., Hansen, J. H. L., & Paul, T. D. (2017). Mapping the early language environment using all-day recordings and automated analysis. American Journal of Speech-Language Pathology, 26(2), 248–265.
Hampton, L. H., & Rodriguez, E. M. (2022). Preemptive interventions for infants and toddlers with a high likelihood for autism: A systematic review and meta-analysis. Autism, 26(6), 1364–1378.
Harbison, A. L., Woynaroski, T. G., Tapp, J., Wade, J. W., Warlaumont, A. S., & Yoder, P. J. (2018). A new measure of child vocal reciprocity in children with autism spectrum disorder. Autism Research, 11(6), 903–915.
Hoff, E., Burridge, A., Ribot, K. M., & Giguere, D. (2018). Language specificity in the relation of maternal education to bilingual children's vocabulary growth. Developmental Psychology, 54(6), 1011–1019.
Huttenlocher, J., Vasilyeva, M., Cymerman, E., & Levine, S. (2002). Language input and child syntax. Cognitive Psychology, 45(3), 337–374.
Jensen, T. S., Bøggild-Andersen, B., Schmidt, J., Ankerhus, J., & Hansen, E. (1988). Perinatal risk factors and first-year vocalizations: Influence on preschool language and motor performance. Developmental Medicine & Child Neurology, 30(2), 153–161.
Jones, R. M., Plesa Skwerer, D., Pawar, R., Hamo, A., Carberry, C., Ajodan, E. L., Caulley, D., Silverman, M. R., McAdoo, S., Meyer, S., Yoder, A., Clements, M., Lord, C., & Tager-Flusberg, H. (2019). How effective is LENA in detecting speech vocalizations and language produced by children and adolescents with ASD in different contexts? Autism Research, 12(4), 628–635.
Justice, L. M., Jiang, H., Bates, R., & Koury, A. (2020). Language disparities related to maternal education emerge by two years in a low-income sample. Maternal and Child Health Journal, 24(11), 1419–1427.
Lord, C., Rutter, M., DiLavore, P., Risi, S., Gotham, K., & Bishop, S. L. (2012). Autism Diagnostic Observation Schedule, Second Edition (ADOS-2) manual (Part I): Modules 1–4. Western Psychological Services.
Markfeld, J. E., Feldman, J., Bordman, S., Daly, C., Santapuram, P., Humphreys, K. L., Keceli-Kaysili, B., & Woynaroski, T. (2023). Associations between caregiver stress and language outcomes in infants with autistic and non-autistic siblings: An exploratory study. Journal of Speech, Language, and Hearing Research, 66(1), 190–205.
McDaniel, J., D'Ambrose Slaboch, K., & Yoder, P. (2018). A meta-analysis of the association between vocalizations and expressive language in children with autism spectrum disorder. Research in Developmental Disabilities, 72, 202–213.
McDaniel, J., Woynaroski, T., Keceli-Kaysili, B., Watson, L. R., & Yoder, P. (2019). Vocal communication with canonical syllables predicts later expressive language skills in preschool-aged children with autism spectrum disorder. Journal of Speech, Language, and Hearing Research, 62(10), 3826–3833.
McDaniel, J., Yoder, P., Estes, A., & Rogers, S. J. (2020). Predicting expressive language from early vocalizations in young children with autism spectrum disorder: Which vocal measure is best? Journal of Speech, Language, and Hearing Research, 63(5), 1509–1520.
McLaughlin, K. A., Sheridan, M. A., Humphreys, K. L., Belsky, J., & Ellis, B. J. (2021). The value of dimensional models of early experience: Thinking clearly about concepts and categories. Perspectives on Psychological Science, 16(6), 1463–1472.
Messinger, D., Young, G. S., Ozonoff, S., Dobkins, K., Carter, A., Zwaigenbaum, L., Landa, R. J., Charman, T., Stone, W. L., Constantino, J. N., Hutman, T., Carver, L. J., Bryson, S., Iverson, J. M., Strauss, M. S., Rogers, S. J., & Sigman, M. (2013). Beyond autism: A baby siblings research consortium study of high-risk children at three years of age. Journal of the American Academy of Child & Adolescent Psychiatry, 52(3), 300–308.e1.
Mullen, E. M. (1995). Mullen Scales of Early Learning. AGS.
Oetting, J. B. (2020). From my perspective/opinion: General American English as a dialect: A call for change. The ASHA LeaderLive.
Oller, D. K. (2000). The emergence of the speech capacity. Psychology Press.
Oller, D. K., Niyogi, P., Gray, S., Richards, J. A., Gilkerson, J., Xu, D., Yapanel, U., & Warren, S. F. (2010). Automated vocal analysis of naturalistic recordings from children with autism, language delay, and typical development. Proceedings of the National Academy of Sciences, 107(30), 13354–13359.
Ozonoff, S., Young, G. S., Belding, A., Hill, M., Hill, A., Hutman, T., Johnson, S., Miller, M., Rogers, S. J., Schwichtenberg, A. J., Steinfeld, M., & Iosif, A.-M. (2014). The broader autism phenotype in infancy: When does it emerge? Journal of the American Academy of Child & Adolescent Psychiatry, 53(4), 398–407.e2.
Patten, E., Belardi, K., Baranek, G. T., Watson, L. R., Labban, J. D., & Oller, D. K. (2014). Vocal patterns in infants with autism spectrum disorder: Canonical babbling status and vocalization frequency. Journal of Autism and Developmental Disorders, 44(10), 2413–2428.
Paul, R., Fuerst, Y., Ramsay, G., Chawarska, K., & Klin, A. (2011). Out of the mouths of babes: Vocal production in infant siblings of children with ASD. The Journal of Child Psychology and Psychiatry, 52(5), 588–598.
Plumb, A. M., & Wetherby, A. M. (2013). Vocalization development in toddlers with autism spectrum disorder. Journal of Speech, Language, and Hearing Research, 56(2), 721–734.
Putnam, O. C., Markfeld, J. E., Goldblum, J., Wright, S., Swanson, M. R., & Harrop, C. (2023). The use of LENA in autism research: A systematic review [Manuscript in preparation].
Rankine, J., Li, E., Lurie, S., Rieger, H., Fourie, E., Siper, P. M., Wang, A. T., Buxbaum, J. D., & Kolevzon, A. (2017). Language ENvironment analysis (LENA) in Phelan-McDermid syndrome: Validity and suggestions for use in minimally verbal children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 47(6), 1605–1617.
R Core Team. (2020). R: A language and environment for statistical computing (Version 4.0.2). https://www.R-project.org/
Richards, J. A., Xu, D., Gilkerson, J., Yapanel, U., Gray, S., & Paul, T. (2017). Automated assessment of child vocalization development using LENA. Journal of Speech, Language, and Hearing Research, 60(7), 2047–2063.
Rogers, S. J., Yoder, P., Estes, A., Warren, Z., McEachin, J., Munson, J., Rocha, M., Greenson, J., Wallace, L., Gardner, E., Dawson, G., Sugar, C. A., Hellemann, G., & Whelan, F. (2021). A multisite randomized controlled trial comparing the effects of intervention intensity and intervention style on outcomes for young children with autism. Journal of the American Academy of Child & Adolescent Psychiatry, 60(6), 710–722.
Rushton, J. P., Brainerd, C. J., & Pressley, M. (1983). Behavioral development and construct validity: The principle of aggregation. Psychological Bulletin, 94(1), 18–38.
Rutter, M., Bailey, A., & Lord, C. (2003). The Social Communication Questionnaire. Western Psychological Services.
Sandbank, M., & Yoder, P. (2014). Measuring representative communication in young children with developmental delay. Topics in Early Childhood Special Education, 34(3), 133–141.
Santapuram, P., Feldman, J. I., Bowman, S. M., Raj, S., Suzman, E., Crowley, S., Kim, S. Y., Keceli-Kaysili, B., Bottema-Beutel, K., Lewkowicz, D. J., Wallace, M. T., & Woynaroski, T. G. (2022). Mechanisms by which early eye gaze to the mouth during multisensory speech influences expressive communication development in infant siblings of children with and without autism. Mind, Brain, and Education, 16(1), 62–74.
Seidl, A., Cristia, A., Soderstrom, M., Ko, E. S., Abel, E. A., Kellerman, A., & Schwichtenberg, A. J. (2018). Infant–mother acoustic–prosodic alignment and developmental risk. Journal of Speech, Language, and Hearing Research, 61(6), 1369–1380.
Sheinkopf, S. J., Mundy, P., Oller, D. K., & Steffens, M. (2000). Vocal atypicalities of preverbal autistic children. Journal of Autism and Developmental Disorders, 30(4), 345–354.
Shumway, S., & Wetherby, A. M. (2009). Communicative acts of children with autism spectrum disorders in the second year of life. Journal of Speech, Language, and Hearing Research, 52(5), 1139–1156.
Sparrow, S. S., Cicchetti, D. V., & Bella, D. A. (2005). Vineland Adaptive Behavior Scales–Second Edition. Pearson.
Stekhoven, D. J., & Bühlmann, P. (2012). MissForest—Non-parametric missing value imputation for mixed-type data. Bioinformatics, 28(1), 112–118.
Sulek, R., Smith, J., Bent, C. A., Hudry, K., Trembath, D., Vivanti, G., & Dissanayake, C. (2022). The utility of LENA as an indicator of developmental outcomes for young children with autism. International Journal of Language & Communication Disorders, 57(1), 103–111.
Swanson, M. R., Shen, M. D., Wolff, J. J., Boyd, B., Clements, M., Rehg, J., Elison, J. T., Paterson, S., Parish-Morris, J., Chappell, J. C., Hazlett, H. C., Emerson, R. W., Botteron, K., Pandey, J., Schultz, R. T., Dager, S. R., Zwaigenbaum, L., Estes, A. M., Piven, J., & IBIS Network. (2018). Naturalistic language recordings reveal “hyper-vocal” infants at high familial risk for autism. Child Development, 89(2), e60–e73.
Tager-Flusberg, H., & Kasari, C. (2013). Minimally verbal school-aged children with autism spectrum disorder: The neglected end of the spectrum. Autism Research, 6(6), 468–478.
Tager-Flusberg, H., Paul, R., & Lord, C. (2005). Language and communication in autism. In F. Volkmar, R. Paul, A. Klin, & D. Cohen (Eds.), Handbook of autism and pervasive developmental disorders: Diagnosis, development, neurobiology, and behavior (3rd ed., Vol. 1, pp. 335–364). Wiley.
Trembath, D., Westerveld, M. F., Teppala, S., Thirumanickam, A., Sulek, R., Rose, V., Tucker, M., Paynter, J., Hetzroni, O., Keen, D., & Vivanti, G. (2019). Profiles of vocalization change in children with autism receiving early intervention. Autism Research, 12(5), 830–842.
Warren, S. F., Gilkerson, J., Richards, J. A., Oller, D. K., Xu, D., Yapanel, U., & Gray, S. (2010). What automated vocal analysis reveals about the vocal production and language learning environment of young children with autism. Journal of Autism and Developmental Disorders, 40(5), 555–569.
Wetherby, A. M., Cain, D. H., Yonclas, D. G., & Walker, V. G. (1988). Analysis of intentional communication of normal children from the prelinguistic to the multiword stage. Journal of Speech and Hearing Research, 31(2), 240–252.
Wetherby, A. M., Prizant, B. M., & Hutchinson, T. A. (1998). Communicative, social/affective, and symbolic profiles of young children with autism and pervasive developmental disorders. American Journal of Speech-Language Pathology, 7(2), 79–91.
Woynaroski, T. (2014). The stability and validity of automated vocal analysis in preschoolers with autism spectrum disorder in early stages of language development [Doctoral dissertation, Vanderbilt University]. http://hdl.handle.net/1803/14805
Woynaroski, T., Oller, D. K., Keceli-Kaysili, B., Xu, D., Richards, J. A., Gilkerson, J., Gray, S., & Yoder, P. (2017). The stability and validity of automated vocal analysis in preverbal preschoolers with autism spectrum disorder. Autism Research, 10(3), 508–519.
Woynaroski, T., Watson, L., Gardner, E., Newsom, C. R., Keceli-Kaysili, B., & Yoder, P. J. (2016). Early predictors of growth in diversity of key consonants used in communication in initially preverbal children with autism spectrum disorder. Journal of Autism and Developmental Disorders, 46(3), 1013–1024.
Xu, D., Richards, J. A., & Gilkerson, J. (2014). Automated analysis of child phonetic production using naturalistic recordings. Journal of Speech, Language, and Hearing Research, 57(5), 1638–1650.
Xu, D., Yapanel, U., & Gray, S. (2008). Reliability of the LENA language environment analysis system in young children's natural home environment [LENA Foundation Technical Report LTR-05-2]. LENA Foundation. https://www.lena.org/wp-content/uploads/2016/07/LTR-05-2_Reliability.pdf
Xu, D., Yapanel, U., Gray, S., & Baer, C. T. (2008). The LENA language environment analysis system: The interpretive time segments (ITS) file [LENA Foundation Technical Report LTR-04-2]. LENA Foundation. https://www.lena.org/wp-content/uploads/2016/07/LTR-04-2_ITS_File.pdf
Yankowitz, L. D., Petrulla, V., Plate, S., Tunc, B., Guthrie, W., Meera, S. S., Tena, K., Pandey, J., Swanson, M. R., Pruett, J. R., Cola, M., Russell, A., Marrus, N., Hazlett, H. C., Botteron, K., Constantino, J. N., Dager, S. R., Estes, A., Zwaigenbaum, L., … The IBIS Network. (2022). Infants later diagnosed with autism have lower canonical babbling ratios in the first year of life. Molecular Autism, 13(1), Article 28.
Yoder, P. J., Lloyd, B. P., & Symons, F. J. (2018). Observational measurement of behavior (2nd ed.). Brookes.
Yoder, P. J., Oller, D. K., Richards, J. A., Gray, S., & Gilkerson, J. (2013). Stability and validity of an automated measure of vocal development from day-long samples in children with and without autism spectrum disorder. Autism Research, 6(2), 103–107.
Yoder, P. J., Wade, J. W., Tapp, J., & Harbison, A. L. (2016). Contingencies from LENA data [Computer software]. https://github.com/HomeBankCode/LENA_contingencies
Information & Authors
Information
Published In
Journal of Speech, Language, and Hearing Research
Volume 66 • Number 12 • December 2023
Pages: 4934-4948
PubMed: 37889262
Copyright
Copyright © 2023 American Speech-Language-Hearing Association.
History
- Received: Jan 27, 2023
- Revised: Apr 27, 2023
- Accepted: Aug 25, 2023
- Published online: Oct 27, 2023
- Published in issue: Dec 11, 2023
Authors
Metrics & Citations
Metrics
Article Metrics
View all metricsCitations
Download article citation data for:
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
Citing Literature
- Jèssica Pérez-Moreno, Daniela Lerma-Arregocés, Marta Dosaiguas, Capturing family soundscapes for a deeper understanding and knowledge of early childhood music education: the contributions made by LENA® technology, European Early Childhood Education Research Journal, 10.1080/1350293X.2025.2481203, (1-12), (2025).
- Kristen Bottema-Beutel, Ruoxi Guo, Caroline Braun, Kacie Dunham-Carr, Jennifer E. Markfeld, Grace Pulliam, S. Madison Clark, Bahar Keçeli-Kaysılı, Jacob I. Feldman, Tiffany Woynaroski, Considerations for Measuring Caregiver Talk in Interactions With Infants at Elevated and Population-Level Likelihood for Autism: Deriving Stable Estimates, Journal of Speech, Language, and Hearing Research, 10.1044/2024_JSLHR-24-00312, 68, 1, (234-247), (2024).
- Jennifer E. Markfeld, Zoë Kiemel, Pooja Santapuram, Samantha L. Bordman, Grace Pulliam, S. Madison Clark, Lauren H. Hampton, Bahar Keçeli-Kaysili, Jacob I. Feldman, Tiffany G. Woynaroski, Links Between Early Prelinguistic Communication and Later Expressive Language in Toddlers With Autistic and Non-Autistic Siblings, Journal of Speech, Language, and Hearing Research, 10.1044/2024_JSLHR-23-00794, 68, 1, (178-192), (2024).
- Orla C Putnam, Jennifer E Markfeld, Sarah Towner Wright, Jacob I Feldman, Jessica Goldblum, Maia Karpinsky, Amanda J Neal, Meghan R Swanson, Clare Harrop, The use of Language ENvironment Analysis in autism research: A systematic review, Autism, 10.1177/13623613241290072, 29, 5, (1095-1117), (2024).
View Options
Sign In Options
ASHA member? If so, log in with your ASHA website credentials for full access.
Member Login