Speech Adaptation to Kinematic Recording Sensors: Perceptual and Acoustic Findings
Publication: Journal of Speech, Language, and Hearing Research
Volume 61, Number 3
Pages 593-603
Abstract
Purpose
This study used perceptual and acoustic measures to examine the time course of speech adaptation after the attachment of electromagnetic sensor coils to the tongue, lips, and jaw.
Method
Twenty native English speakers read aloud stimulus sentences before the attachment of the sensors, immediately after attachment, and again 5, 10, 15, and 20 min later. They read aloud continuously between recordings to encourage adaptation. Sentence recordings were perceptually evaluated by 20 native English listeners, who rated 150 stimuli (which included 31 samples that were repeated to assess rater reliability) using a visual analog scale with the end points labeled as “precise” and “imprecise.” Acoustic analysis began by segmenting and measuring the duration of the fricatives /s/ and /ʃ/ as well as the whole sentence. The spectral center of gravity and spectral standard deviation of the 2 fricatives were measured using Praat. These phonetic targets were selected because the standard placement of sensor coils on the lingual surface was anticipated to interfere with normal fricative production, causing them to become distorted.
Results
Perceptual ratings revealed a decrease in speech precision after sensor attachment and evidence of adaptation over time; there was little perceptual change beyond the 10-min recording. The spectral center of gravity for /s/ decreased, and the spectral standard deviation for /ʃ/ increased after sensor attachment, but the acoustic measures showed no evidence of adaptation over time.
Conclusion
The findings suggest that 10 min may be sufficient time to allow speakers to adapt before experimental data collection with Northern Digital Instruments Wave electromagnetic sensors.
Get full access to this article
View all available purchase options and get full access to this article.
References
Aasland, W. A., Baum, S. R., & McFarland, D. H. (2006). Electropalatographic, acoustic, and perceptual data on adaptation to a palatal perturbation. The Journal of the Acoustical Society of America, 119, 2372–2381.
Ackermann, H., Gröne, B. F., Hoch, G., & Schönle, P. W. (1993). Speech freezing in Parkinson's disease: A kinematic analysis of orofacial movements by means of electromagnetic articulography. Folia Phoniatrica, 45(2), 84–89.
Ackermann, H., Hertrich, I., Daum, I., Scharf, G., & Spieker, S. (1997). Kinematic analysis of articulatory movements in central motor disorders. Movement Disorders, 12(6), 1019–1027.
Adams, S. G., Weismer, G., & Kent, R. D. (1993). Speaking rate and speech movement velocity profiles. Journal of Speech and Hearing Research, 36, 41–54.
Audacity (version 2.0) [Computer Software]. (1999–2018). Audacity Team .
Boersma, P., & Weenink, D. (2014). Praat: Doing phonetics by computer (version 5.4) [Computer software]. Retrieved from http://www.praat.org/
Brunner, J., & Hoole, P. (2012). Motor equivalent strategies in the production of German /ʃ/ under perturbation. Language and Speech, 55, 457–476.
Caruso, A. J., Abbs, J. H., & Gracco, V. L. (1988). Kinematic analysis of multiple movement coordination during speech in stutterers. Brain, 111, 439–455.
Dagenais, P. A. (1995). Electropalatography in the treatment of articulation/phonological disorders. Journal of Communication Disorders, 28(4), 303–329.
Dromey, C., Jang, G. O., & Hollis, K. L. (2013). Assessing correlations between lingual movements and formants. Speech Communication, 55, 315–328.
Dromey, C., Nissen, S., Nohr, P., & Fletcher, S. G. (2006). Measuring tongue movements during speech: Adaptation of a magnetic jaw-tracking system. Speech Communication, 48, 463–473.
Dromey, C., & Sanders, M. (2009). Intra-speaker variability in palatometric measures of consonant articulation. Journal of Communication Disorders, 42(6), 397–407.
Folkins, J. W., & Linville, R. N. (1983). The effects of varying lower-lip displacement on upper-lip movements: Implications for the coordination of speech movements. Journal of Speech and Hearing Research, 26, 209–217.
Forrest, K., Weismer, G., & Turner, G. S. (1989). Kinematic, acoustic, and perceptual analyses of connected speech produced by Parkinsonian and normal geriatric adults. The Journal of the Acoustical Society of America, 85(6), 2608–2622.
Fox, R. A., & Nissen, S. L. (2005). Sex-related acoustic changes in voiceless English fricatives. Journal of Speech, Language, and Hearing Research, 48(4), 753–765.
Gentil, M. (1992). Variability of motor strategies. Brain and Language, 42, 30–37.
Ghosh, S. S., Matthies, M. L., Maas, E., Hanson, A., Tiede, M., Menard, L., … Perkell, J. S. (2010). An investigation of the relation between sibilant production and somatosensory and auditory acuity. The Journal of the Acoustical Society of America, 128(5), 3079–3087.
Gracco, V. L., & Abbs, J. H. (1989). Sensorimotor characteristics of speech motor sequences. Experimental Brain Research, 75, 586–598.
Guenther, F. H., & Perkell, J. S. (2004). A neural model of speech production and its application to studies of the role of auditory feedback in speech. In Maasen, B., Kent, R. D., Peters, H. F. M., van Lieshout, P. H. H. M., & Hulstijn, W. (Eds.), Speech motor control in normal and disordered speech (pp. 29–49). Oxford, United Kingdom: Oxford University Press.
Haley, K. L., Ohde, R. N., & Wertz, R. T. (2000). Precision of fricative production in aphasia and apraxia of speech: A perceptual and acoustic study. Aphasiology, 14(5–6), 619–634.
Hamlet, S. L. (1985). Speech adaptation: An aerodynamic study of adults with a childhood history of articulation defects. Journal of Prosthetic Dentistry, 53(4), 553–557.
Henrich, N., Smith, J., & Wolfe, J. (2011). Vocal tract resonances in singing: Strategies used by sopranos, altos, tenors, and baritones. The Journal of the Acoustical Society of America, 129(2), 1024–1035.
Hertrich, I., & Ackermann, H. (2000). Lip-jaw and tongue-jaw coordination during rate-controlled syllable repetitions. The Journal of the Acoustical Society of America, 107(4), 2236–2247.
Hughes, O. M., & Abbs, J. H. (1976). Labial-mandibular coordination in the production of speech: Implications for the operation of motor equivalence. Phonetica, 33, 199–221.
Jongman, A., Wayland, R., & Wong, S. (2000). Acoustic characteristics of English fricatives. The Journal of the Acoustical Society of America, 108(3), 1252–1263.
Katz, W. F., Bharadwaj, S. V., & Carstens, B. (1999). Electromagnetic articulography treatment for an adult with Broca's aphasia and apraxia of speech. Journal of Speech, Language, and Hearing Research, 42(6), 1355–1366.
Katz, W. F., Bharadwaj, S. V., & Stettler, M. P. (2006). Influences of electromagnetic articulography sensors on speech produced by healthy adults and individuals with aphasia and apraxia. Journal of Speech, Language, and Hearing Research, 49(3), 645–659.
Kent, R. D. (1996). Hearing and believing: Some limits to the auditory-perceptual assessment of speech and voice disorders. American Journal of Speech-Language Pathology, 5(3), 7–23.
Klingholtz, F. (1990). Acoustic recognition of voice disorders: A comparative study of running speech versus sustained vowels. The Journal of the Acoustical Society of America, 87, 2218–2224.
Kreiman, J., Gerratt, B. R., Kempster, G. B., Erman, A., & Berke, G. S. (1993). Perceptual evaluation of voice quality: Review, tutorial, and a framework for future research. Journal of Speech and Hearing Research, 36(1), 21–40.
Lametti, D. R., Nasir, S. M., & Ostry, D. J. (2012). Sensory preference in speech production revealed by simultaneous alteration of auditory and somatosensory feedback. The Journal of Neuroscience, 32, 9351–9358.
MATLAB (version 2014b) [Computer Software]. (2014). Natick, MA: MathWorks.
McAuliffe, M. J., Robb, M. P., & Murdoch, B. E. (2007). Acoustic and perceptual analysis of speech adaptation to an artificial palate. Journal of Clinical Linguistics and Phonetics, 21, 885–894.
McFarland, D. H., & Baum, S. R. (1995). Incomplete compensation to articulatory perturbation. The Journal of the Acoustical Society of America, 97(3), 1865–1873.
McFarland, D. H., Baum, S. R., & Chabot, C. (1996). Speech compensation to structural modifications of the oral cavity. The Journal of the Acoustical Society of America, 100(2), 1093–1104.
McGowan, R. S., & Berger, M. A. (2009). Acoustic-articulatory mapping in vowels by locally weighted regression. The Journal of the Acoustical Society of America, 126(4), 2011–2032.
McLeod, S., & Searl, J. (2006). Adaptation to an electropalatograph palate: Acoustic, impressionistic, and perceptual data. American Journal of Speech-Language Pathology, 15(2), 192–206.
Mefferd, A. S., & Green, J. R. (2010). Articulatory-to-acoustic relations in response to speaking rate and loudness manipulations. Journal of Speech, Language, and Hearing Research, 53(5), 1206–1219.
Nissen, S. L., & Fox, R. A. (2005). Acoustic and spectral characteristics of young children's fricative productions: A developmental perspective. The Journal of the Acoustical Society of America, 118(4), 2570–2578.
Perkell, J. S., Cohen, M. H., Svirsky, M. A., Matthies, M. L., Garabieta, I., & Jackson, M. T. T. (1992). Electromagnetic midsagittal articulometer systems for transducing speech articulatory movements. The Journal of the Acoustical Society of America, 92(6), 3078–3096.
Perkell, J. S., Matthies, M. L., Svirsky, M. A., & Jordan, M. I. (1993). Trading relations between tongue-body raising and lip rounding in production of the vowel /u/: A pilot “motor equivalence” study. The Journal of the Acoustical Society of America, 93(5), 2948–2961.
Rudy, K., & Yunusova, Y. (2013). The effect of anatomic factors on tongue position variability during consonants. Journal of Speech, Language, and Hearing Research, 56(1), 137–149.
Stoel-Gammon, C., Williams, K., & Buder, E. (1994). Cross-language differences in phonological acquisition: Swedish and American /t/. Phonetica, 51(1–3), 146–158.
Stone, M., & Lundberg, A. (1996). Three-dimensional tongue surface shapes of English consonants and vowels. The Journal of the Acoustical Society of America, 99(6), 3728–3737.
Tasko, S. M., & Westbury, J. R. (2002). Defining and measuring speech movement events. Journal of Speech, Language, and Hearing Research, 45, 127–142.
Tjaden, K., & Turner, G. S. (1997). Spectral properties of fricatives in amyotrophic lateral sclerosis. Journal of Speech, Language, and Hearing Research, 40(6), 1358–1372.
van der Merwe, A. (1997). A theoretical framework for the characterization of pathological speech sensorimotor control. In McNeil, M. R. (Ed.), Clinical management of sensorimotor speech disorders (pp. 1–25). New York, NY: Thieme.
Weismer, G., & Bunton, K. (1999). Influences of pellet markers on speech production behavior: Acoustical and perceptual measures. The Journal of the Acoustical Society of America, 105(5), 2882–2894.
Whitfield, J. A., & Goberman, A. M. (2014). Articulatory–acoustic vowel space: Application to clear speech in individuals with Parkinson's disease. Journal of Communication Disorders, 51, 19–28.
Information & Authors
Information
Published In
Journal of Speech, Language, and Hearing Research
Volume 61 • Number 3 • 15 March 2018
Pages: 593-603
PubMed: 29497744
Copyright
Copyright © 2018 American Speech-Language-Hearing Association.
History
- Received: May 4, 2017
- Revised: Jul 14, 2017
- Accepted: Nov 21, 2017
- Published in issue: Mar 15, 2018
Authors
Metrics & Citations
Metrics
Article Metrics
View all metricsCitations
Download article citation data for:
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
Citing Literature
- Christopher Dromey, Mendocino Peacock, Kinematics of Loud, Soft, and Whispered Speech, Folia Phoniatrica et Logopaedica, 10.1159/000536001, 76, 5, (491-500), (2024).
- Qiang Fang, On The Performance of EMA-Synchronized Speech and Stand-alone Speech in Speech Recognition and Acoustic-to-Articulatory Inversion, Proceedings of the 2024 International Conference on Generative Artificial Intelligence and Information Security, 10.1145/3665348.3665377, (162-166), (2024).
- Matthew Masapollo, Susan Nittrouer, Immediate auditory feedback regulates inter-articulator speech coordination in service to phonetic structure, The Journal of the Acoustical Society of America, 10.1121/10.0028725, 156, 3, (1850-1861), (2024).
- Muhammad Suhaib Shahid, Andrew P French, Michel F. Valstar, Gleb E. Yakubov, Research in Methodologies for Modelling the Oral Cavity, Biomedical Physics & Engineering Express, 10.1088/2057-1976/ad28cc, (2024).
- Matthew Masapollo, Ana Rodriguez, Rosalie Gendron, Kara Kent, Hannah Thomas, Susan Nittrouer, Generalization of Interarticulator Timing Control: Evidence From Tongue–Jaw and Lip–Jaw Kinematics Using Electromagnetic Articulography, Journal of Speech, Language, and Hearing Research, 10.1044/2024_JSLHR-24-00323, 68, 1, (129-147), (2024).
- Kim R. Bauerly, Eric S. Jackson, Influences of Attentional Focus on Across- and Within-Sentence Variability in Adults Who Do and Do Not Stutter, Journal of Speech, Language, and Hearing Research, 10.1044/2024_JSLHR-24-00256, 67, 12, (4676-4688), (2024).
- Hung-Shao Cheng, Matthew Masapollo, Christina Hagedorn, Adam Buchwald, Temporal Coordination of Articulatory Gestures in Nonnative Onset Clusters: Evidence From American English Speakers Using Electromagnetic Articulography, Journal of Speech, Language, and Hearing Research, 10.1044/2024_JSLHR-24-00025, 67, 10, (3549-3565), (2024).
- Lucie Ménard, Mark Tiede, Instrumental Analysis of Speech Production, The Handbook of Clinical Linguistics, Second Edition, 10.1002/9781119875949.ch34, (489-504), (2024).
- Franco Marinelli, Camila Venegas, Josefa Alarcón, Pablo Navarro, Ramón Fuentes, Chewing Analysis by Means of Electromagnetic Articulography: Current Developments and New Possibilities, Sensors, 10.3390/s23239511, 23, 23, (9511), (2023).
- Matthew Masapollo, Susan Nittrouer, Interarticulator Speech Coordination: Timing Is of the Essence, Journal of Speech, Language, and Hearing Research, 10.1044/2022_JSLHR-22-00594, 66, 3, (901-915), (2023).
- See more
View Options
Sign In Options
ASHA member? If so, log in with your ASHA website credentials for full access.
Member Login