Abstract
Purpose
To review the content and psychometric characteristics of 6 published tests currently available to aid in the study, diagnosis, and treatment of motor speech disorders in children.
Method
We compared the content of the 6 tests and critically evaluated the degree to which important psychometric characteristics support the tests' use for their defined purposes.
Results
The tests varied considerably in content and methods of test interpretation. Few of the tests documented efforts to support reliability and validity for their intended purposes, often when relevant information was probably available during the test’s development.
Conclusions
Problems with the reviewed tests appear related to overly broad plans for test development and inadequate attention to relevant psychometric principles during the development process. Recommendations are offered for future test revisions and development efforts that can benefit from recent research in test development and in pediatric motor speech disorders.
References
-
Aase, D., Hovre, C., Krause, K., Schelfhout, S., Smith, J., & Carpenter, L. J. (2000). Contextual Test of Articulation. Eau Clair, WI: Thinking Publications. - American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). The standards for educational and psychological testing. Washington, DC: American Educational Research Association.
- American Speech-Language-Hearing Association. (2007). Childhood apraxia of speech [Position statement]. Available from www.asha.org/policy
-
Aronowitz, R. A. (2001). When do symptoms become a disease?.Annals of Internal Medicine, 134, 803–808. -
Bankson, N. W., & Bernthal, J. E. (1990). Bankson-Bernthal Test of Phonology. Austin, TX: Pro-Ed. -
Bennett, R. E. (1993). On the meanings of constructed response.InR. E. Bennett, & W. C. Ward (Eds.), Construction versus choice in cognitive measurement: Issues in constructed response, performance testing, and portfolio assessment (pp. 1–27). Hillsdale, NJ: Erlbaum. -
Blakeley, R. W. (2001). Screening Test for Developmental Apraxia of Speech—Second Edition. Austin, TX: Pro-Ed. -
Buckendahl, C. W., & Plake, B. S. (2006). Evaluating tests.InS. M. Downing, & T. M. Haladyna (Eds.), Handbook of test development (pp. 725–738). Mahwah, NJ: Erlbaum. - Buros Institute. (2006). Test Reviews Online. Retrieved February 11, 2006, from www.unl.edu/buros
-
Caruso, A. J., & Strand, E. A. (1999). Motor speech disorders in children: Definitions, background, and a theoretical framework.InA. J. Caruso, & E. A. Strand (Eds.), Clinical management of motor speech disorders in children (pp. 1–27). New York: Thieme. -
Cizek, S. (2006). Standard setting.InS. M. Downing, & T. M. Haladyna (Eds.), Handbook of test development (pp. 225–260). Mahwah, NJ: Erlbaum. -
Davis, B. L., Jakielski, K. J., & Marquardt, T. P. (1998). Developmental apraxia of speech: Determiners of differential diagnosis.Clinical Linguistics and Phonetics, 12(1)25–45. -
Davis, B. L., & Velleman, S. (2000). Differential diagnosis of developmental apraxia of speech in infants and toddlers.Infant Toddler Intervention: The Transdisciplinary Journal, 10(3)177–192. -
Dawson, J. I., & Tattersall, P. J. (2001). Structured Photographic Articulation Test II. DeKalb, IL: Janelle. -
Dollaghan, C. A. (2004). Evidence-based practice in communication disorders: What do we know, and when do we know it?.Journal of Communication Disorders, 37, 391–400. -
S. M. Downing, & T. M. Haladyna (Eds.), 2006). Handbook of test development. Mahwah, NJ: Erlbaum. -
Feinstein, A. R. (2001). The Blame-X syndrome: Problems and lessons in nosology, spectrum, and etiology.Journal of Clinical Epidemiology, 4, 433–439. -
Fisher, H., & Logemann, J. (1971). FisherLogemann Test of Articulation Competence. Austin, TX: Pro-Ed. -
Fletcher, R. W., & Fletcher, S. W. (2005). Clinical epidemiology: The essentials (4th ed.). Baltimore: Lippincott, Williams & Wilkins. -
Forrest, K. (2003). Diagnostic criteria for developmental apraxia of speech used by clinical speech-language pathologists.American Journal of Speech-Language Pathology, 12, 376–380. -
Fudala, J., & Reynolds, W. (2000). Arizona Articulation Proficiency Scale, Third Edition. Los Angeles: Western Psychological Services. -
Goldman, R., & Fristoe, M. (2000). Goldman Fristoe Test of Articulation—Second Edition. Circle Pines, MN: AGS. -
Guyette, T. W. (2001). Review of the Apraxia Profile.InB. S. Plake, & J. C. Impara (Eds.), The fourteenth mental measurements yearbook (pp. 57–58). Lincoln, NE: Buros Institute of Mental Measurements. -
Haladyna, T. M. (2006). Roles and importance of validity studies in test development.InS. M. Downing, & T. M. Haladyna (Eds.), Handbook of test development (pp. 739–755). Mahwah, NJ: Erlbaum. -
Hayden, D., & Square, P. (1999). Verbal Motor Production Assessment for Children. San Antonio, TX: The Psychological Corporation. -
Hickman, L. (1997). Apraxia Profile. San Antonio, TX: The Psychological Corporation. -
Hodson, B. W. (2003). Hodson Assessment of Phonological Patterns—Third Edition. Austin, TX: Pro-Ed. -
Jelm, J. M. (2001). Verbal Dyspraxia Profile. DeKalb, IL: Janelle. -
Kaufman, N. (1995). Kaufman Speech Praxis Test for Children. Detroit, MI: Wayne State University Press. -
Kent, R. D., Kent, J., & Rosenbek, J. (1987). Maximal performance tests of speech production.Journal of Speech and Hearing Disorders, 52, 367–387. -
Khan, L. M., & Lewis, N. P. (2002). KhanLewis Phonological Analysis—Second Edition. Circle Pines, MN: AGS. -
Lanphere, T. (1998). Test of Articulation in Context. Austin, TX: Pro-Ed. -
Lewis, B. A., Freebairn, L. A., Hansen, A. J., Iyengar, S. K., & Taylor, H. G. (2004). School-age follow-up for children with childhood apraxia of speech.Language, Speech, and Hearing Services in Schools, 35, 122–140. -
Linn, R. L. (2006). The standards for educational and psychological testing: Guidance in test development.InS. M. Downing, & T. M. Haladyna (Eds.), Handbook of test development (pp. 27–38). Mahwah, NJ: Erlbaum. -
Masterson, J., & Bernhardt, B. (2002). CAPES (Computerized Articulation and Phonological Evaluation). San Antonio, TX: The Psychological Corporation. -
McCabe, P., Rosenthal, J. B., & McLeod, S. (1998). Features of developmental dyspraxia in the general speech-impaired population?.Clinical Linguistics and Phonetics, 12(2)105–126. -
McCauley, R. J. (1996). Familiar strangers: Criterion-referenced measures in communication disorders.Language, Speech, and Hearing Services in Schools, 27, 122–131. -
McCauley, R. J. (2001). Assessment of language disorders in children. Mahwah, NJ: Erlbaum. -
McCauley, R. J. (2003). Review of Screening Test for Developmental Apraxia of Speech—Second Edition.InB. Plake, J. C. Impara, & R. A. Spies (Eds.), The fifteenth mental measurements yearbook (pp. 786–789). Austin, TX: Pro-Ed. -
Merrell, A. W., & Plante, E. (1997). Norm-referenced test interpretation in the diagnostic test process.Language, Speech, and Hearing Services in Schools, 28, 50–58. -
Messick, S. (1989). Validity.InR. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13–103). New York: American Council on Education and Macmillan. -
Messick, S. (1995). Validity of psychological assessment: Validity of inferences from person’s responses and performances as scientific inquiry into score meaning.American Psychologist, 50, 741–749. -
Pena, E. D., Spaulding, T. J., & Plante, E. (2006). The composition of normative groups and diagnostic decision making: Shooting ourselves in the foot.American Journal of Speech-Language Pathology, 15, 247–254. -
Pendergast, K., Dickey, S. E., Selmar, J. W., & Soder, A. L. (1997). Photo Articulation Test, Third Edition. San Antonio, TX: The Psychological Corporation. -
B. S. Plake, & J. C. Impara (Eds.), 2001). The fourteenth mental measurements yearbook. Lincoln, NE: Buros Institute of Mental Measurements. -
Riski, J. E., & Witzel, M. A. (2001). Oral Mechanism Exam for Children and Young Adults: Craniofacial and Oral Evaluation. Circle Pines, MN: AGS. -
Robbins, J., & Klee, T. (1987). Clinical assessment of oropharyngeal motor development in young children.Journal of Speech and Hearing Research, 52, 272–277. -
Rvachew, S., Hodge, M., & Ohberg, A. (2005). Obtaining and interpreting maximum performance tasks from children: A tutorial.Journal of Speech-Language Pathology and Audiology, 29(4)146–157. -
Sackett, D. L., Richardson, W. S., Rosenberg, W. M. C., & Haynes, R. B. (2000). Evidence-based medicine: How to practice and teach EBM (2nd ed.). London: Churchill-Livingstone. -
Salvia, J., & Ysseldyke, J. (with Bolt, S.)2007). Assessment (10th ed.). Boston: Houghton Mifflin. -
Secord, W. (1981). Test of Minimal Articulation Competence. San Antonio, TX: The Psychological Corporation. -
Secord, W., & Donohue, J. (1998). Clinical Assessment of Articulation and Phonology. Greenville, SC: Super Duper. -
Shriberg, L. D. (1993). Four new speech and prosody-voice measures for genetics research and other studies in developmental phonological disorders.Journal of Speech and Hearing Research, 36, 105–140. -
Shriberg, L. D. (2003). Diagnostic markers for child speech-sound disorders: Introductory comments.Clinical Linguistics and Phonetics, 17, 501–505. -
Shriberg, L. D., Aram, D. M., & Kwiatkowski, J. (1997a). Developmental apraxia of speech: I. Descriptive and theoretical perspectives.Journal of Speech, Language, and Hearing Research, 40, 273–285. -
Shriberg, L. D., Aram, D. M., & Kwiatkowski, J. (1997b). Developmental apraxia of speech: III. A subtype marked by inappropriate stress.Journal of Speech, Language, and Hearing Research, 40, 313–337. -
Shriberg, L. D., Ballard, K. J., Tomblin, J. B., Duffy, J. R., Odell, K. H., & Williams, C. A. (2006). Speech, prosody, and voice characteristics of a mother and daughter with a 7;13 translocation affecting FOXP2.Journal of Speech, Language, and Hearing Research, 49, 500–525. -
Shriberg, L. D., Campbell, T. F., Karlsson, H. B., Brown, R. L., Mcsweeny, J. L., & Nadler, C. J. (2003). A diagnostic marker for childhood apraxia of speech: The lexical stress ratio.Clinical Linguistics and Phonetics, 17, 549–574. -
Shriberg, L. D., Green, J. R., Campbell, T. F., Mcsweeny, J. L., & Scheer, A. R. (2003). A diagnostic marker for childhood apraxia of speech: The coefficient of variation ratio.Clinical Linguistics and Phonetics, 17, 575–595. -
Spaulding, T. J., Plante, E., & Farinella, K. A. (2006). Eligibility criteria for language impairment: Is the low end of normal always appropriate?.Language, Speech, and Hearing Services in Schools, 37, 61–72. -
St. Louis, K. O., & Ruscello, D. (2000). Oral Speech Mechanism Screening Examination, Third Edition. Austin, TX: Pro-Ed. -
Strand, E. A. (2002). Childhood apraxia of speech: Suggested diagnostic markers for the younger child.InL. Shriberg, & T. Campbell (Eds.), Proceedings of the 2002 childhood apraxia of speech research symposium (pp. 75–80). Carlsbad, CA: The Hendrix Foundation. -
Strand, E. A., & McCauley, R. J. (1999). Assessment procedures for treatment planning in children with phonologic and motor speech disorders.InA. J. Caruso, & E. A. Strand (Eds.), Clinical management of motor speech disorders in children (pp. 73–108). New York: Thieme. -
Straus, S. E., Richardson, W. S., Glasziou, P., & Haynes, R. B. (2005). Evidence-based medicine: How to practice and teach EBM (3rd ed.). New York: Elsevier/Churchill Livingston. -
Streiner, D. L., & Norman, G. R. (2003). Health measurement scales: A practical guide to their development and use (3rd ed.). New York: Oxford University Press. -
Thoonen, G., Maassen, B., Wit, J., Gabreels, F., & Schreuder, R. (1996). The integrated use of maximum performance tasks in differential diagnosis evaluations among children with motor speech disorders.Clinical Linguistics and Phonetics, 10, 311–336. -
Towne, R. L. (2001). Review of the Oral Speech Mechanism Screening Examination, Third Edition.InB. S. Plake, & J. C. Impara (Eds.), The fourteenth mental measurements yearbook (pp. 868–869). Lincoln, NE: Buros Institute of Mental Measurements. -
Vetter, D. (1988). Designing informal assessment procedures.InD. E. Yoder, & R. D. Kent (Eds.), Decision making in speech-language pathology (pp. 192–193). Toronto, Ontario, Canada: Decker. -
Weiss, C. E. (1980). Weiss Comprehensive Articulation Test. Austin, TX: Pro-Ed. -
Welch, C. (2006). Item and prompt development in performance testing.InS. M. Downing, & T. M. Haladyna (Eds.), Handbook of test development (pp. 303–327). Mahwah, NJ: Erlbaum. -
Wilcox, K., & Morris, S. (1999). Children’s Speech Intelligibility Measure. San Antonio, TX: The Psychological Corporation. -
Yorkston, K., Beukelman, D., Strand, E., & Bell, K. (1999). Management of motor speech disorders in children and adults (2nd ed.). Austin, TX: Pro-Ed.