ASHAWire
Advanced search
Skip main navigation
Close Drawer MenuOpen Drawer Menu
No AccessJournal of Speech, Language, and Hearing ResearchResearch Note15 Mar 2018

Speech Adaptation to Kinematic Recording Sensors: Perceptual and Acoustic Findings

    https://doi.org/10.1044/2017_JSLHR-S-17-0169

    Abstract

    Purpose

    This study used perceptual and acoustic measures to examine the time course of speech adaptation after the attachment of electromagnetic sensor coils to the tongue, lips, and jaw.

    Method

    Twenty native English speakers read aloud stimulus sentences before the attachment of the sensors, immediately after attachment, and again 5, 10, 15, and 20 min later. They read aloud continuously between recordings to encourage adaptation. Sentence recordings were perceptually evaluated by 20 native English listeners, who rated 150 stimuli (which included 31 samples that were repeated to assess rater reliability) using a visual analog scale with the end points labeled as “precise” and “imprecise.” Acoustic analysis began by segmenting and measuring the duration of the fricatives /s/ and /ʃ/ as well as the whole sentence. The spectral center of gravity and spectral standard deviation of the 2 fricatives were measured using Praat. These phonetic targets were selected because the standard placement of sensor coils on the lingual surface was anticipated to interfere with normal fricative production, causing them to become distorted.

    Results

    Perceptual ratings revealed a decrease in speech precision after sensor attachment and evidence of adaptation over time; there was little perceptual change beyond the 10-min recording. The spectral center of gravity for /s/ decreased, and the spectral standard deviation for /ʃ/ increased after sensor attachment, but the acoustic measures showed no evidence of adaptation over time.

    Conclusion

    The findings suggest that 10 min may be sufficient time to allow speakers to adapt before experimental data collection with Northern Digital Instruments Wave electromagnetic sensors.

    References

    • Aasland, W. A., Baum, S. R., & McFarland, D. H. (2006). Electropalatographic, acoustic, and perceptual data on adaptation to a palatal perturbation.The Journal of the Acoustical Society of America, 119, 2372–2381. https://doi.org/10.1121/1.2173520
      CrossrefMedlineGoogle Scholar
    • Ackermann, H., Gröne, B. F., Hoch, G., & Schönle, P. W. (1993). Speech freezing in Parkinson's disease: A kinematic analysis of orofacial movements by means of electromagnetic articulography.Folia Phoniatrica, 45(2), 84–89.
      CrossrefMedlineGoogle Scholar
    • Ackermann, H., Hertrich, I., Daum, I., Scharf, G., & Spieker, S. (1997). Kinematic analysis of articulatory movements in central motor disorders.Movement Disorders, 12(6), 1019–1027.
      CrossrefMedlineGoogle Scholar
    • Adams, S. G., Weismer, G., & Kent, R. D. (1993). Speaking rate and speech movement velocity profiles.Journal of Speech and Hearing Research, 36, 41–54. https://doi.org/10.1044/jshr.3601.41
      ASHAWireGoogle Scholar
    • Audacity (version 2.0) [Computer Software]. (1999–2018). Audacity Team.
      Google Scholar
    • Boersma, P., & Weenink, D. (2014). Praat: Doing phonetics by computer (version 5.4) [Computer software].Retrieved from http://www.praat.org/
      Google Scholar
    • Brunner, J., & Hoole, P. (2012). Motor equivalent strategies in the production of German /ʃ/ under perturbation.Language and Speech, 55, 457–476. https://doi.org/10.1177/0023830911434098
      CrossrefMedlineGoogle Scholar
    • Caruso, A. J., Abbs, J. H., & Gracco, V. L. (1988). Kinematic analysis of multiple movement coordination during speech in stutterers.Brain, 111, 439–455.
      CrossrefMedlineGoogle Scholar
    • Dagenais, P. A. (1995). Electropalatography in the treatment of articulation/phonological disorders.Journal of Communication Disorders, 28(4), 303–329.
      CrossrefMedlineGoogle Scholar
    • Dromey, C., Jang, G. O., & Hollis, K. L. (2013). Assessing correlations between lingual movements and formants.Speech Communication, 55, 315–328.
      CrossrefGoogle Scholar
    • Dromey, C., Nissen, S., Nohr, P., & Fletcher, S. G. (2006). Measuring tongue movements during speech: Adaptation of a magnetic jaw-tracking system.Speech Communication, 48, 463–473.
      CrossrefGoogle Scholar
    • Dromey, C., & Sanders, M. (2009). Intra-speaker variability in palatometric measures of consonant articulation.Journal of Communication Disorders, 42(6), 397–407.
      CrossrefMedlineGoogle Scholar
    • Folkins, J. W., & Linville, R. N. (1983). The effects of varying lower-lip displacement on upper-lip movements: Implications for the coordination of speech movements.Journal of Speech and Hearing Research, 26, 209–217.
      ASHAWireGoogle Scholar
    • Forrest, K., Weismer, G., & Turner, G. S. (1989). Kinematic, acoustic, and perceptual analyses of connected speech produced by Parkinsonian and normal geriatric adults.The Journal of the Acoustical Society of America, 85(6), 2608–2622.
      CrossrefMedlineGoogle Scholar
    • Fox, R. A., & Nissen, S. L. (2005). Sex-related acoustic changes in voiceless English fricatives.Journal of Speech, Language, and Hearing Research, 48(4), 753–765. https://doi.org/10.1044/1092-4388(2005/052)
      ASHAWireGoogle Scholar
    • Gentil, M. (1992). Variability of motor strategies.Brain and Language, 42, 30–37.
      CrossrefMedlineGoogle Scholar
    • Ghosh, S. S., Matthies, M. L., Maas, E., Hanson, A., Tiede, M., Menard, L., … Perkell, J. S. (2010). An investigation of the relation between sibilant production and somatosensory and auditory acuity.The Journal of the Acoustical Society of America, 128(5), 3079–3087. https://doi.org/10.1121/1.3493430
      CrossrefMedlineGoogle Scholar
    • Gracco, V. L., & Abbs, J. H. (1989). Sensorimotor characteristics of speech motor sequences.Experimental Brain Research, 75, 586–598.
      CrossrefMedlineGoogle Scholar
    • Guenther, F. H., & Perkell, J. S. (2004). A neural model of speech production and its application to studies of the role of auditory feedback in speech.In B. Maasen, R. D. Kent, H. F. M. Peters, P. H. H. M. van Lieshout, & W. Hulstijn (Eds.), Speech motor control in normal and disordered speech (pp. 29–49). Oxford, United Kingdom: Oxford University Press.
      Google Scholar
    • Haley, K. L., Ohde, R. N., & Wertz, R. T. (2000). Precision of fricative production in aphasia and apraxia of speech: A perceptual and acoustic study.Aphasiology, 14(5–6), 619–634.
      CrossrefGoogle Scholar
    • Hamlet, S. L. (1985). Speech adaptation: An aerodynamic study of adults with a childhood history of articulation defects.Journal of Prosthetic Dentistry, 53(4), 553–557. https://doi.org/10.1016/0022-3913(85)90647-X
      CrossrefMedlineGoogle Scholar
    • Henrich, N., Smith, J., & Wolfe, J. (2011). Vocal tract resonances in singing: Strategies used by sopranos, altos, tenors, and baritones.The Journal of the Acoustical Society of America, 129(2), 1024–1035. https://doi.org/10.1121/1.3518766
      CrossrefMedlineGoogle Scholar
    • Hertrich, I., & Ackermann, H. (2000). Lip-jaw and tongue-jaw coordination during rate-controlled syllable repetitions.The Journal of the Acoustical Society of America, 107(4), 2236–2247.
      CrossrefMedlineGoogle Scholar
    • Hughes, O. M., & Abbs, J. H. (1976). Labial-mandibular coordination in the production of speech: Implications for the operation of motor equivalence.Phonetica, 33, 199–221.
      CrossrefMedlineGoogle Scholar
    • Jongman, A., Wayland, R., & Wong, S. (2000). Acoustic characteristics of English fricatives.The Journal of the Acoustical Society of America, 108(3), 1252–1263.
      CrossrefMedlineGoogle Scholar
    • Katz, W. F., Bharadwaj, S. V., & Carstens, B. (1999). Electromagnetic articulography treatment for an adult with Broca's aphasia and apraxia of speech.Journal of Speech, Language, and Hearing Research, 42(6), 1355–1366.
      ASHAWireGoogle Scholar
    • Katz, W. F., Bharadwaj, S. V., & Stettler, M. P. (2006). Influences of electromagnetic articulography sensors on speech produced by healthy adults and individuals with aphasia and apraxia.Journal of Speech, Language, and Hearing Research, 49(3), 645–659. https://doi.org/10.1044/1092-4388(2006/047)
      ASHAWireGoogle Scholar
    • Kent, R. D. (1996). Hearing and believing: Some limits to the auditory-perceptual assessment of speech and voice disorders.American Journal of Speech-Language Pathology, 5(3), 7–23.
      ASHAWireGoogle Scholar
    • Klingholtz, F. (1990). Acoustic recognition of voice disorders: A comparative study of running speech versus sustained vowels.The Journal of the Acoustical Society of America, 87, 2218–2224.
      CrossrefMedlineGoogle Scholar
    • Kreiman, J., Gerratt, B. R., Kempster, G. B., Erman, A., & Berke, G. S. (1993). Perceptual evaluation of voice quality: Review, tutorial, and a framework for future research.Journal of Speech and Hearing Research, 36(1), 21–40.
      ASHAWireGoogle Scholar
    • Lametti, D. R., Nasir, S. M., & Ostry, D. J. (2012). Sensory preference in speech production revealed by simultaneous alteration of auditory and somatosensory feedback.The Journal of Neuroscience, 32, 9351–9358. https://doi.org/10.1523/JNEUROSCI.0404-12.2012
      CrossrefMedlineGoogle Scholar
    • MATLAB (version 2014b) [Computer Software]. (2014). Natick, MA: MathWorks.
      Google Scholar
    • McAuliffe, M. J., Robb, M. P., & Murdoch, B. E. (2007). Acoustic and perceptual analysis of speech adaptation to an artificial palate.Journal of Clinical Linguistics and Phonetics, 21, 885–894. https://doi.org/10.1080/02699200701576827
      CrossrefMedlineGoogle Scholar
    • McFarland, D. H., & Baum, S. R. (1995). Incomplete compensation to articulatory perturbation.The Journal of the Acoustical Society of America, 97(3), 1865–1873.
      CrossrefMedlineGoogle Scholar
    • McFarland, D. H., Baum, S. R., & Chabot, C. (1996). Speech compensation to structural modifications of the oral cavity.The Journal of the Acoustical Society of America, 100(2), 1093–1104. https://doi.org/10.1121/1.416286
      CrossrefMedlineGoogle Scholar
    • McGowan, R. S., & Berger, M. A. (2009). Acoustic-articulatory mapping in vowels by locally weighted regression.The Journal of the Acoustical Society of America, 126(4), 2011–2032. https://doi.org/10.1121/1.3184581
      CrossrefMedlineGoogle Scholar
    • McLeod, S., & Searl, J. (2006). Adaptation to an electropalatograph palate: Acoustic, impressionistic, and perceptual data.American Journal of Speech-Language Pathology, 15(2), 192–206. https://doi.org/10.1044/1058-0360(2006/018)
      ASHAWireGoogle Scholar
    • Mefferd, A. S., & Green, J. R. (2010). Articulatory-to-acoustic relations in response to speaking rate and loudness manipulations.Journal of Speech, Language, and Hearing Research, 53(5), 1206–1219.
      ASHAWireGoogle Scholar
    • Nissen, S. L., & Fox, R. A. (2005). Acoustic and spectral characteristics of young children's fricative productions: A developmental perspective.The Journal of the Acoustical Society of America, 118(4), 2570–2578. https://doi.org/10.1121/1.2010407
      CrossrefMedlineGoogle Scholar
    • Perkell, J. S., Cohen, M. H., Svirsky, M. A., Matthies, M. L., Garabieta, I., & Jackson, M. T. T. (1992). Electromagnetic midsagittal articulometer systems for transducing speech articulatory movements.The Journal of the Acoustical Society of America, 92(6), 3078–3096.
      CrossrefMedlineGoogle Scholar
    • Perkell, J. S., Matthies, M. L., Svirsky, M. A., & Jordan, M. I. (1993). Trading relations between tongue-body raising and lip rounding in production of the vowel /u/: A pilot “motor equivalence” study.The Journal of the Acoustical Society of America, 93(5), 2948–2961.
      CrossrefMedlineGoogle Scholar
    • Rudy, K., & Yunusova, Y. (2013). The effect of anatomic factors on tongue position variability during consonants.Journal of Speech, Language, and Hearing Research, 56(1), 137–149. https://doi.org/10.1044/1092-4388(2012/11-0218)
      ASHAWireGoogle Scholar
    • Stoel-Gammon, C., Williams, K., & Buder, E. (1994). Cross-language differences in phonological acquisition: Swedish and American /t/.Phonetica, 51(1–3), 146–158.
      CrossrefMedlineGoogle Scholar
    • Stone, M., & Lundberg, A. (1996). Three-dimensional tongue surface shapes of English consonants and vowels.The Journal of the Acoustical Society of America, 99(6), 3728–3737.
      CrossrefMedlineGoogle Scholar
    • Tasko, S. M., & Westbury, J. R. (2002). Defining and measuring speech movement events.Journal of Speech, Language, and Hearing Research, 45, 127–142.
      ASHAWireGoogle Scholar
    • Tjaden, K., & Turner, G. S. (1997). Spectral properties of fricatives in amyotrophic lateral sclerosis.Journal of Speech, Language, and Hearing Research, 40(6), 1358–1372.
      ASHAWireGoogle Scholar
    • van der Merwe, A. (1997). A theoretical framework for the characterization of pathological speech sensorimotor control.In M. R. McNeil (Ed.), Clinical management of sensorimotor speech disorders (pp. 1–25). New York, NY: Thieme.
      Google Scholar
    • Weismer, G., & Bunton, K. (1999). Influences of pellet markers on speech production behavior: Acoustical and perceptual measures.The Journal of the Acoustical Society of America, 105(5), 2882–2894.
      CrossrefMedlineGoogle Scholar
    • Whitfield, J. A., & Goberman, A. M. (2014). Articulatory–acoustic vowel space: Application to clear speech in individuals with Parkinson's disease.Journal of Communication Disorders, 51, 19–28. https://doi.org/10.1016/j.jcomdis.2014.06.005
      CrossrefMedlineGoogle Scholar

    Additional Resources