The Intelligibility in Context Scale: Validity and Reliability of a Subjective Rating Measure
Publication: Journal of Speech, Language, and Hearing Research
Volume 55, Number 2
Pages 648-656
Abstract
Purpose
To describe a new measure of functional intelligibility, the Intelligibility in Context Scale (ICS), and evaluate its validity, reliability, and sensitivity using 3 clinical measures of severity of speech sound disorder: (a) percentage of phonemes correct (PPC), (b) percentage of consonants correct (PCC), and (c) percentage of vowels correct (PVC).
Method
Speech skills of 120 preschool children (109 with parent-/teacher-identified concern about how they talked and made speech sounds and 11 with no identified concern) were assessed with the Diagnostic Evaluation of Articulation and Phonology (Dodd, Hua, Crosbie, Holm, & Ozanne, 2002). Parents completed the 7-item ICS, which rates the degree to which children’s speech is understood by different communication partners (parents, immediate family, extended family, friends, acquaintances, teachers, and strangers) on a 5-point scale.
Results
Parents' ratings showed that most children were always (5) or usually (4) understood by parents, immediate family, and teachers, but only sometimes (3) by strangers. Factor analysis confirmed the internal consistency of the ICS items; therefore, ratings were averaged to form an overall intelligibility score. The ICS had high internal reliability (α = .93), sensitivity, and construct validity. Criterion validity was established through significant correlations between the ICS and PPC (r = .54), PCC (r = .54), and PVC (r = .36).
Conclusions
The ICS is a promising new measure of functional intelligibility. These data provide initial support for the ICS as an easily administered, valid, and reliable estimate of preschool children’s intelligibility when speaking with people of varying levels of familiarity and authority.
Get full access to this article
View all available purchase options and get full access to this article.
References
Australian Bureau of Statistics. (2008). Socio-Economic Indexes for Areas (SEIFA)—Technical paper, 2006 (ABS Catalogue No. 2039.0.55.001). Retrieved from www.abs.gov.au/AUSSTATS/[email protected]/DetailsPage/2039.0.55.0012006?OpenDocument
Baker, E. (2010). The experience of discharging children from phonological intervention. International Journal of Speech-Language Pathology, 12, 325–328.
Baudonck, N. L. H., Buekers, R., Gillebert, S., & Lierde, K. M. V. (2009). Speech intelligibility of Flemish children as judged by their parents. Folia Phoniatrica et Logopaedica, 61, 288–295.
Campbell, T. F., Dollaghan, C. A., Rockette, H. E., Paradise, J. L., Feldman, H. M., Shriberg, L. D., & Kurs-Lasky, M. (2003). Risk factors for speech delay of unknown origin in 3-year-old children. Child Development, 74, 346–357.
Coplan, J., & Gleason, J. R. (1988). Unclear speech: Recognition and significance of unintelligible speech in preschool children. Pediatrics, 82, 447–452.
Dodd, B., Holm, A., Hua, Z., & Crosbie, S. (2003). Phonological development: A normative study of British English-speaking children. Clinical Linguistics & Phonetics, 17, 617–643.
Dodd, B., Hua, Z., Crosbie, S., Holm, A., & Ozanne, A. (2002). Diagnostic Evaluation of Articulation and Phonology. London, UK: The Psychological Corporation.
Doyle, P. C., Swift, E. R., & Haaf, R. G. (1989). Effects of listener sophistication on judgments of tracheoesophageal talker intelligibility. Journal of Communication Disorders, 22, 105–113.
Field, A. (2009). Discovering statistics using SPSS (3rd ed.). London, UK: Sage.
Flipsen, P., Jr (1995). Speaker–listener familiarity: Parents as judges of delayed speech intelligibility. Journal of Communication Disorders, 28, 3–19.
Flipsen, P., Jr (2006). Measuring the intelligibility of conversational speech in children. Clinical Linguistics & Phonetics, 20, 303–312.
Gay, L. R. (1985). Educational evaluation and measurement: Competencies for analysis and application (2nd ed.). Cleveland, OH: Charles E. Merrill.
Glascoe, F. P. (2000). Parents Evaluation of Developmental Status: Authorized Australian Version. Parkville, Victoria, Australia: Center for Community Child Health.
Gordan-Brannan, M., & Hodson, B. W. (2000). Intelligibility/severity measurements of prekindergarten children’s speech. American Journal of Speech-Language Pathology, 9, 141–150.
Hodge, M., & Daniels, J. (2007). Test of Children’s Speech Plus (Version 5.3). [Computer software]University of Alberta, Edmonton, Alberta, Canada.
Hodson, B. (2004). Hodson Assessment of Phonological Patterns (3rd ed.). Austin, TX: Pro-Ed.
Kent, R. D., Miolo, G., & Bloedel, S. (1994). The intelligibility of children’s speech: A review of evaluation procedures. American Journal of Speech-Language Pathology, 3, 81–95.
Kwiatkowski, J., & Shriberg, L. D. (1992). Intelligibility assessment in developmental phonological disorders: Accuracy of caregiver gloss. Journal of Speech and Hearing Research, 35, 1095–1104.
McGarr, N. S. (1983). The intelligibility of deaf speech to experienced and inexperienced listeners. Journal of Speech and Hearing Research, 26, 451–458.
McLeod, S., Harrison, L. J., & McAllister, L. L. (2007–2009). Children with speech impairment: A population study of prevalence, severity, impact and service provision (DP0773978). Australian Research Council Discovery Grant.
McLeod, S., Harrison, L. J., McAllister, L., & McCormack, J. (2011). Speech sound disorders in a community sample of preschool children. Manuscript submitted for publication
McLeod, S., & McCormack, J. (2007). Application of the ICF and ICF–Children and Youth in children with speech impairment. Seminars in Speech and Language, 28, 254–264.
McLeod, S., & Threats, T. (2008). The ICF-CY and children with communication disabilities. International Journal of Speech-Language Pathology, 10, 92–109.
Mencke, E. O., Ochsner, G. J., & Testut, E. W. (1983). Listener judges and the speech intelligibility of deaf children. Journal of Communication Disorders, 16, 175–180.
Messick, S. (1993). Validity. In Linn, R. L. (Ed.), Educational measurement (3rd ed., pp. 13–103). Phoenix, AZ: Oryx Press.
Mullen, R., & Schooling, T. (2010). The National Outcomes Measurement System for pediatric speech-language pathology. Language, Speech, and Hearing Services in Schools, 41, 44–60.
Osberger, M. J. (1992). Speech intelligibility in the hearing impaired: Research and clinical implications. In Kent, R. D. (Ed.), Speech intelligibility in speech disorders: Theory, measurement and management (pp. 233–264). Amsterdam, The Netherlands: John Benjamins.
Rhebergen, K. S., & Versfeld, N. J. (2005). A speech intelligibility index–based approach to predict the speech reception threshold for sentences in fluctuating noise for normal-hearing listeners. The Journal of the Acoustical Society of America, 117, 2181–2192.
Roulstone, S., Loader, S., Northstone, K., & Beveridge, M., The ALSPAC Team (2002). The speech and language of children aged 25 months: Descriptive data from the Avon Longitudinal Study of Parents and Children. Early Child Development and Care, 172, 259–268.
Ruben, R. J. (2000). Redefining the survival of the fittest: Communication disorders in the 21st century. Laryngoscope, 110, 241–245.
Shriberg, L. D., Austin, D., Lewis, B. A., McSweeny, J. L., & Wilson, D. L. (1997). The percentage of consonants correct (PCC) metric: Extensions and reliability data. Journal of Speech, Language, and Hearing Research, 40, 708–722.
Soloff, C., Lawrence, D., Misson, S., & Johnstone, R. (2006). Wave 1 weighting and non-response (LSAC Technical Paper No. 3). Canberra, Australia: Australian Institute of Family Studies.
Williams, A. L., McLeod, S., & McCauley, R. J. (Eds.), 2010). Interventions for speech sound disorders in children. Baltimore, MD: Brookes.
World Health Organization. (2007). International classification of functioning, disability and health: Children and youth version. Geneva, Switzerland: Author.
Information & Authors
Information
Published In
Copyright
Copyright © 2012 American Speech-Language-Hearing Association.
History
- Received: May 14, 2010
- Revised: Dec 11, 2010
- Accepted: Aug 25, 2011
- Published in issue: Apr 1, 2012
Key Words
Authors
Metrics & Citations
Metrics
Article Metrics
View all metricsCitations
Download article citation data for:
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
Citing Literature
- Valeria Caragli, Mirko Aldè, Romolo Daniele De Siati, Umberto Ambrosetti, Elisabetta Genovese, Auditory and language features in children with 18q deletion: Our experience and a brief review of the literature, Hearing Balance and Communication, 10.4103/HBC.HBC_10_24, 22, 2, (57-64), (2024).
- Kristina Klintö, Malin Schaar Johansson, Magdalena Andersson, Caroline Gällstedt, Cecilia Lindberg, Cecilia Nelli, Åsa Okhiria, Reliability of Variables of Consonant Production and Velopharyngeal Competence in 10-year-olds with Cleft Palate Using Multiple Raters, The Cleft Palate Craniofacial Journal, 10.1177/10556656241287761, (2024).
- Kathy L. Chapman, Thomas Sitzman, Adriane Baylis, Mary Hardin-Jones, Richard Kirschner, M'hamed (Hamy) Temkit, A Comparative Effectiveness Study of Speech and Surgical Outcomes: Study Overview, The Cleft Palate Craniofacial Journal, 10.1177/10556656241274242, (2024).
- Nicolette T. Bushman, Tyler Nguyen, Joseph Incorvia, John G. Meara, Ingrid M. Ganske, Carolyn Rogers-Vizena, Immediate Impact of a Patient-Reported Outcome Measure Visual Dashboard on Cleft lip and Palate Care Provision, The Cleft Palate Craniofacial Journal, 10.1177/10556656241272450, (2024).
- Lucy Rodgers, Nicola Botting, Sam Harding, Martin Cartwright, Meriem Amer-El-khedoud, Rosalind Herman, Shared characteristics of intervention techniques for oral vocabulary and speech comprehensibility in preschool children with co-occurring features of developmental language disorder and speech sound disorder: a systematic review with narrative synthesis, BMJ Open, 10.1136/bmjopen-2023-081571, 14, 8, (e081571), (2024).
- Joshua M. Wright, Molly F. MacIsaac, Jamilla Vieux, S. Alex Rottgers, Jordan N. Halsey, Demystifying Velopharyngeal Dysfunction for Plastic Surgery Trainees Part 2: Speech Fundamentals and Perceptual Speech Assessment, Journal of Craniofacial Surgery, 10.1097/SCS.0000000000010606, (2024).
- Anna Cronin, Sarah Verdon, Sharynne McLeod, Working with Toddlers with Cleft Palate, Journal of Clinical Practice in Speech-Language Pathology, 10.1080/22087168.2020.12370295, 22, 2, (101-110), (2024).
- Egill Magnússon, Kathryn Crowe, Harpa Stefánsdóttir, Mark Guiberson, Thora Másdóttir, Inga Ágústsdóttir, Ösp Vilberg Baldursdóttir, Representation of the ICF in research of speech intelligibility: A systematic review of literature describing deaf and hard-of-hearing children, International Journal of Speech-Language Pathology, 10.1080/17549507.2024.2409131, (1-14), (2024).
- Amna Samir Mira, Mary Elizabeth Wilkens, Karla Nadine Washington, Victoria Sue McKenna, Phonemic and pitch variability in bilingual preschoolers: A comparison of Jamaican Creole and English, International Journal of Speech-Language Pathology, 10.1080/17549507.2023.2287426, (1-16), (2024).
- Yu Hui Chen, Mary Lay Choo Lee, Susan J. Rickard Liow, Selena Ee-Li Young, Exploring the relationship between cleft type and speech outcome in 4-to-6-year-olds with non-syndromic cleft palate using different measures: A preliminary report, Clinical Linguistics & Phonetics, 10.1080/02699206.2024.2356035, (1-16), (2024).
- See more
View Options
Sign In Options
ASHA member? If so, log in with your ASHA website credentials for full access.
Member Login