ASHAWire
Advanced search
Skip main navigation
No AccessLanguage, Speech, and Hearing Services in SchoolsResearch Article1 Oct 2010

Internet-Based Telehealth Assessment of Language Using the CELF–4

    https://doi.org/10.1044/0161-1461(2009/08-0131)

    Abstract

    Purpose

    Telehealth has the potential to improve children’s access to speech-language pathology services. Validation of telehealth applications, including the assessment of childhood language disorders, is necessary for telehealth to become an accepted alternative mode of service provision. The aim of this study was to validate an Internet-based telehealth system for assessing childhood language disorders.

    Method

    Twenty-five children ages 5 to 9 years were assessed using the core language subtests of the Clinical Evaluation of Language Fundamentals—4th Edition (CELF–4; Semel, Wiig, & Secord, 2003). Each participant was simultaneously assessed online and face-to-face (FTF). Assessments were administered by either an online or an FTF speech-language pathologist (SLP), but were simultaneously rated by both SLPs.

    Results

    No significant difference was found between the online and FTF total raw scores and scaled scores for each subtest. Weighted kappas revealed very good agreement on the individual items, total raw scores, scaled scores, core language score, and severity level. Intra- and interrater reliability were determined for a sample of online ratings, with intraclass correlation analysis revealing very good agreement on all measures.

    Conclusion

    The results of this study support the validity and reliability of scoring the core language subtests of the CELF–4 via telehealth.

    REFERENCES

    • Altman, D. G. (1991). Practical statistics for medical research. London, England: Chapman & Hall.
      Google Scholar
    • American Speech-Language-Hearing Association. (1985, November). 1985 National Colloquium on Underserved Populations report.Asha, 27(11)31–35.
      Google Scholar
    • American Speech-Language-Hearing Association. (2005). Speech-language pathologists providing clinical services via telepractice: Position statement [Position Statement]. Available from www.asha.org/policy
      Google Scholar
    • American Speech-Language-Hearing Association. (2007). ASHA SLP Health Care Survey 2007: Workforce/work conditions. Rockville, MD: Author.
      Google Scholar
    • American Speech-Language-Hearing Association. (2008). Schools Survey report: Workforce and work conditions trends 2000–2008. Rockville, MD: Author.
      Google Scholar
    • Australian Bureau of Statistics. (2003). Australian social trends 2003 (Catalogue no. 4102.0). Canberra, Australia: AuthorRetrieved from http://www.ausstats.abs.gov.au/Ausstats/subscriber.nsf/0/70AC02A724F4033FCA256D3A0006B054/$File/41020_2003.pdf
      Google Scholar
    • Baker, L., & Cantwell, D. P. (1987). A prospective psychiatric follow-up of children with speech/language disorders.Journal of the American Academy of Child and Adolescent Psychiatry, 26, 546–553.
      CrossrefMedlineGoogle Scholar
    • Beitchman, J. H., Wilson, B., Brownie, E. B., Walters, H., Inglis, A., & Lancee, W. (1996). Long-term consistency in speech/language profiles: II. Behavioural, emotional, and social outcomes.Journal of the American Academy of Child and Adolescent Psychiatry, 36, 815–825.
      Google Scholar
    • Bishop, D. V. M., & Adams, C. (1990). A prospective study of the relationship between specific language impairment, phonological disorders and reading retardation.Journal of Child Psychology and Psychiatry and Allied Disciplines, 31, 1027–1050.
      CrossrefMedlineGoogle Scholar
    • Blum-Harasty, J. A., & Rosenthal, J. B. M. (1992). The prevalence of communication disorders in children: A summary and critical review.Australian Journal of Human Communication Disorders, 20, 63–80.
      Google Scholar
    • Brennan, D. M., Georgeadis, A. C., Baron, C. R., & Barker, L. M. (2004). The effect of videoconference-based telerehabilitation on story retelling performance by brain-injured subjects and its implications for remote speech-language therapy.Telemedicine Journal and e-Health, 10, 147–154.
      CrossrefMedlineGoogle Scholar
    • Broomfield, J., & Dodd, B. (2004). Children with speech and language disability: Caseload characteristics.International Journal of Language & Communication Disorders, 39, 303–324.
      CrossrefMedlineGoogle Scholar
    • Cantwell, D. P., & Baker, L. (1987). Clinical significance of childhood communication disorders: Perspectives from a longitudinal study.Journal of Child Neurology, 2, 257–264.
      Google Scholar
    • Chezik, K. H., Pratt, J. E., Stewart, J. L., & Deal, V. R. (1989, January). Addressing service delivery in remote/rural areas.Asha, 31(1)52–55.
      Google Scholar
    • Clegg, J., Hollis, C., Mawhood, L., & Rutter, M. (2005). Developmental language disorders: A follow-up in later adult life. Cognitive, language and psychosocial outcomes.Journal of Child Psychology and Psychiatry, 46, 128–149.
      Google Scholar
    • Cohen, J. (1960). A coefficient of agreement for nominal scales.Educational and Psychological Measurement, 20, 37–46.
      CrossrefGoogle Scholar
    • Cole, C., Martin, V., Moody, J., & Miller, B. (1986). Speech pathology at a distance.Australian Communication Quarterly, 2, 17–19.
      Google Scholar
    • Dunn, L. M., & Dunn, L. M. (1981). Peabody Picture Vocabulary Test—Revised. Circle Pines, MN: AGS.
      Google Scholar
    • Elford, R., White, H., Bowering, R., Ghandi, M., Maddigan, B., St John, K., … Battock, A. (2000). A randomized, controlled trial of child psychiatric assessments conducted using videoconferencing.Journal of Telemedicine and Telecare, 6, 73–82.
      Google Scholar
    • Eriks-Brophy, A., Quittenbaum, J., Anderson, D., & Nelson, T. (2008). Part of the problem or part of the solution? Communication assessments of Aboriginal children residing in remote communities using video-conferencing.Clinical Linguistics and Phonetics, 2, 589–609.
      Google Scholar
    • Fairweather, C., Parkin, M., & Rozsa, M. (2004). Speech and language assessment in school-aged children via videoconferencing.In B. E. Murdoch, J. Goozee, B. Whelan, & K. Docking (Eds.), Proceedings of the 26th World Congress of the International Association of Logopaedics and Phoniatrics (IALP) [CD-ROM]. Melbourne, Australia: Speech Pathology Australia.
      Google Scholar
    • Fisher, H. B., & Logemann, J. A. (1971). The Fisher-Logemann Test of Articulation Competence. Austin, TX: Pro-Ed.
      Google Scholar
    • Fitzgerald, K., Hornsby, D., & Hudson, L. (2000). A study of allied health professionals in rural and remote Australia. Bathurst, New South Wales, Australia: Services for Australian Rural and Remote Allied Health.
      Google Scholar
    • Fleiss, J. L. (1981). Statistical methods for rates and proportions. New York, NY: John Wiley & Sons.
      Google Scholar
    • Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability.Educational and Psychological Measurement, 33, 613–619.
      CrossrefGoogle Scholar
    • Forducey, P. G. (2006, August15). Speech telepractice program expands options for rural Oklahoma schools.The ASHA Leader, 11(10)12–13.
      ASHAWireGoogle Scholar
    • Goldman, R., & Fristoe, M. (2000). Goldman-Fristoe Test of Articulation (2nd ed.). Circle Pines, MN: AGS.
      Google Scholar
    • Haaf, R., Duncan, B., Skarakis-Doyle, E., Carew, M., & Kapitan, P. (1999). Computer-based language assessment software: The effects of presentation and response format.Language, Speech, and Hearing Services in Schools, 30, 68–74.
      ASHAWireGoogle Scholar
    • Hayes, J. M., & Pitsenbarger, T. H. (2003). Microsoft NetMeeting 3.0 security assessment and configuration guide. Retrieved from http://nsa2.www.conxion.com/support/guides/sd-6.pdf
      Google Scholar
    • Hill, A. J., & Theodoros, D. (2002). Research into telehealth applications in speech-language pathology.Journal of Telemedicine and Telecare, 8, 187–196.
      CrossrefMedlineGoogle Scholar
    • Hill, A. J., Theodoros, D., Russell, T., & Ward, E. (2008). Using telerehabilitation to assess apraxia of speech in adults.International Journal of Language & Communication Disorders, Advance online publication. doi:10.1080/13682820802350537
      Google Scholar
    • Hill, A. J., Theodoros, D. G., Russell, T. G., Cahill, L. M., Ward, E. C., & Clark, K. M. (2006). An Internet-based telerehabilitation system for the assessment of motor speech disorders: A pilot study.American Journal of Speech-Language Pathology, 15, 45–56.
      ASHAWireGoogle Scholar
    • Hill, A. J., Theodoros, D. G., Russell, T. G., Ward, E. C., & Wootton, R. (2009). The effects of aphasia severity on the ability to assess language disorders via telerehabilitation.Aphasiology, 23, 627–642.
      CrossrefGoogle Scholar
    • Humphreys, J., Hegney, D., Lipscombe, J., Gregory, G., & Chater, B. (2002). Whither rural health? Reviewing a decade of progress in rural health.Australian Journal of Rural Health, 10, 2–14.
      Google Scholar
    • Iacano, T., Johnson, H., Humphreys, J., & McAllister, L. (2007). Recruitment of speech pathologists into positions considered less attractive.Advances in Speech-Language Pathology, 9, 204–212.
      Google Scholar
    • Jessup, B., Ward, E., Cahill, L., & Keating, D. (2008). Prevalence of speech and/or language impairment in preparatory students in northern Tasmania.International Journal of Speech-Language Pathology, 10, 364–377.
      CrossrefMedlineGoogle Scholar
    • Johnson, C. J., Beitchman, J. H., Young, A., Escobar, M., Atkinson, L., Wilson, B., … Wang, M. (1999). Fourteen-year follow-up of children with and without speech/language impairments: Speech/language stability and outcomes.Journal of Speech, Language, and Hearing Research, 42, 744–760.
      ASHAWireGoogle Scholar
    • Kazdin, A. E. (2003). Research design in clinical psychology (4th ed.). Boston, MA: Allyn & Bacon.
      Google Scholar
    • Lambier, J., & Atherton, M. (2003). General membership survey: Speech Pathology Association of Australia 2003. Retrieved from http://www.speechpathologyaustralia.org.au/Content_Secure.aspx?p=165
      Google Scholar
    • Lemaire, E. D., Boudrias, Y., & Greene, G. (2001). Low-bandwidth, Internet-based videoconferencing for physical rehabilitation consultations.Journal of Telemedicine and Telecare, 7, 82–89.
      Google Scholar
    • Maclure, M., & Willett, W. C. (1987). Misinterpretation and misuse of the kappa statistic.American Journal of Epidemiology, 126, 161–169.
      Google Scholar
    • National Rural Health Alliance. (2004). Under pressure and under-valued: Allied health professionals in rural and remote areas. Retrieved from http://nrha.ruralhealth.org.au/?IntCatId=14
      Google Scholar
    • O’Callaghan, A. M., McAllister, L., & Wilson, L. (2005). Barriers to accessing rural paediatric speech pathology services: Health care consumers' perspectives.Australian Journal of Rural Health, 13, 162–171.
      Google Scholar
    • Pickering, M., McAllister, L., Hagler, P., Whitehill, T. L., Penn, C., Robertson, S. J., & McCready, V. (1998). External factors influencing the profession in six societies.American Journal of Speech-Language Pathology, 7(4)5–17.
      ASHAWireGoogle Scholar
    • Population Division of the Department of Economic and Social Affairs of the United Nations Secretariat. (2009). World urbanization prospects: The 2007 revision population database. Retrieved from http://esa.un.org/unup
      Google Scholar
    • Renfrew, C. E. (1971). Action Picture Test. Oxford, England: North Place, Headington.
      Google Scholar
    • Savard, L., Borstad, A., Tkachuck, J., Lauderdale, D., & Conroy, B. (2003). Telerehabilitation consultations for clients with neurologic diagnoses: Cases from rural Minnesota and American Samoa.NeuroRehabilitation, 18, 93–102.
      Google Scholar
    • Scheideman-Miller, C., Clark, P. G., Smeltzer, S. S., Carpenter, J., Hodge, B., & Prouty, D. (2002). Two year results of a pilot study delivering speech therapy to students in a rural Oklahoma school via telemedicine.In Proceedings of the 35th Annual Hawaii International Conference on System Sciences, 6, 161bLos Alamos, CA: IEEE Computer Society Press.
      Google Scholar
    • Semel, E. M., Wiig, E. H., & Secord, W. A. (1995). Clinical Evaluation of Language Fundamentals (3rd ed.). San Antonio, TX: The Psychological Corporation.
      Google Scholar
    • Semel, E. M., Wiig, E. H., & Secord, W. A. (2003). Clinical Evaluation of Language Fundamentals (4th ed.). San Antonio, TX: The Psychological Corporation.
      Google Scholar
    • Semel, E. M., Wiig, E. H., & Secord, W. A. (2006). Clinical Evaluation of Language Fundamentals (4th-Australian Standardised Edition). Marrickville, New South Wales, Australia: Harcourt Assessment.
      Google Scholar
    • Shrout, P. E., & Fleiss, J. L. (1979). Intraclass correlations: Uses in assessing rater reliability.Psychological Bulletin, 86, 420–428.
      CrossrefMedlineGoogle Scholar
    • Stothard, S. E., Snowling, M. J., Bishop, D. V. M., Chipchase, B. C., & Kaplan, C. A. (1998). Language-impaired preschoolers: A follow-up into adolescence.Journal of Speech, Language, and Hearing Research, 41, 407–418.
      ASHAWireGoogle Scholar
    • Theodoros, D., Hill, A., Russell, T., Ward, E., & Wootton, R. (2008). Assessing acquired language disorders in adults via the Internet.Telemedicine and e-Health, 14, 552–559.
      Google Scholar
    • Victorian Department of Human Services. (2004). Children’s speech and language services: Eastern metropolitan region. Melbourne, Victoria, Australia: Eastern Metropolitan Regional Office.
      Google Scholar
    • Waite, M. C., Cahill, L. M., Theodoros, D. G., Busuttin, S., & Russell, T. G. (2006). A pilot study of online assessment of childhood speech disorders.Journal of Telemedicine and Telecare, 12(Suppl. 3), 92–94.
      CrossrefMedlineGoogle Scholar
    • Ward, L., White, J., Russell, T., Theodoros, D., Kuhl, M., Nelson, K., & Peters, I. (2007). Assessment of communication and swallowing function post laryngectomy: A telerehabilitation trial.Journal of Telemedicine and Telecare, 13(Suppl. 3), 88–91.
      Google Scholar
    • Wilson, L., Lincoln, M., & Onslow, M. (2002). Availability, access, and quality of care: Inequities in rural speech pathology services for children and a model for redress.Advances in Speech-Language Pathology, 4, 9–22.
      Google Scholar
    • Wilson, L., McAllister, L., Atkinson, J., & Sefton, P. (2006). Internet based telehealth in speech pathology: Results of preliminary trials.In F. Pinciroli (Ed.), Proceedings of the Second IASTED International Conference on Telehealth (pp. 131–136). Anaheim, CA: ACTA.
      Google Scholar
    • Yoon, P. J., Starr, J. R., Perkins, J. A., Bloom, D., & Sie, K. C. Y. (2006). Interrater and intrarater reliability in the evaluation of velopharyngeal insufficiency within a single institution.Archives of Otolaryngology—Head and Neck Surgery, 132, 947–951.
      Google Scholar
    • Young, A. R., Beitchman, J. H., Johnson, C., Douglas, L., Atkinson, L., Escobar, M., & Wilson, B. (2002). Young adult academic outcomes in a longitudinal sample of early identified language impaired and control children.Journal of Child Psychology and Psychiatry, 43, 635–645.
      CrossrefMedlineGoogle Scholar

    Additional Resources