Sensorimotor Adaptation of Speech I: Compensation and Adaptation
Publication: Journal of Speech, Language, and Hearing Research
Volume 45, Number 2
Pages 295-310
Abstract
When motor actions (e.g., reaching with your hand) adapt to altered sensory feedback (e.g., viewing a shifted image of your hand through a prism), the phenomenon is called sensorimotor adaptation (SA). In the study reported here, SA was observed in speech. In two 2-hour experiments (adaptation and control), participants whispered a variety of CVC words. For those words containing the vowel /ε/, participants heard auditory feedback of their whispering. A DSP-based vocoder processed the participants' auditory feedback in real time, allowing the formant frequencies of participants' auditory speech feedback to be shifted. In the adaptation experiment, formants were shifted along one edge of the vowel triangle. For half the participants, formants were shifted so participants heard /a/ when they produced /ε/; for the other half, the shift made participants hear /i/ when they produced /ε/. During the adaptation experiment, participants altered their production of /ε/ to compensate for the altered feedback, and these production changes were retained when participants whispered with auditory feedback blocked by masking noise. In a control experiment, in which the formants were not shifted, participants' production changes were small and inconsistent. Participants exhibited a range of adaptations in response to the altered feedback, with some participants adapting almost completely, and other participants showing very little or no adaptation.
Get full access to this article
View all available purchase options and get full access to this article.
References
Borden, G. J., Harris, K. S., & Raphael, L. J. (1994). Speech science primer: Physiology, acoustics, and perception of speech (3rd ed.). Baltimore: Williams & Wilkins.
Burnett, T. A., Freedland, M. B., Larson, C. R., & Hain, T. C. (1998). Voice f0 responses to manipulations in pitch feedback. Journal of the Acoustical Society of America, 103, 3153–3161.
Carre, R., & Chennoukh, S. (1995). Vowel-consonant-vowel modeling by superposition of consonant closure on vowel-to-vowel gestures. Journal of Phonetics, 23, 231–241.
Cooper, W. E. (1979). Speech perception and production: Studies in selective adaptation. Norwood, NJ: Ablex Publishing.
Cowie, R., & Douglas-Cowie, E. (1983). Speech production in profound post-lingual deafness. In M. Lutman & M. Haggard (Eds.), Hearing science and hearing disorders (pp. 183–231). New York: Academic Press.
Elman, J. L. (1981). Effects of frequency-shifted feedback on the pitch of vocal productions. Journal of the Acoustical Society of America, 70, 45–50.
Fairbanks, G. (1954). Systematic research in experimental phonetics: 1. A theory of the speech mechanism as a servosystem. Journal of Speech and Hearing Disorders, 19, 133–139.
Gracco, V. L., Ross, D., Kalinowski, J., & Stuart, A. (1994). Articulatory changes following spectral and temporal modifications in auditory feedback. Journal of the Acoustical Society of America, 95(5 Part 2), 2821.
Graf, P., & Schacter, D. L. (1985). Implicit and explicit memory for new associations in normal and amnesic subjects. Journal of Experimental Psychology: Learning, Memory, and Cognition, 11, 501–518.
Hein, A. V., & Held, R. (1962). A neural model for labile sensorimotor coordination. In E. Bernard & M. Hare (Eds.), Biological prototypes and synthetic systems (Vol. 1). New York: Plenum Press.
Held, R., & Hein, A. V. (1958). Adaptation of disarranged hand-eye coordination contingent upon re-afferent stimulation. Perceptual and Motor Skills, 8, 87–90.
Helmholtz, H. von. (1962). The direction of vison. In J. P. Southall (Ed. & Trans.), Helmholtz's treatise on physiological optics: Translated from the third German edition (Vol. 3, pp. 246–247). New York: Dover. (Original work published by the Optical Society of America in 1925.)
Houde, J. F. (1997). Sensorimotor adaptation in speech production. Unpublished doctoral dissertation, MIT.
Houde, J., & Jordan, M. (1998). Sensorimotor adaptation in speech production. Science, 279(5354), 1213–1216.
Jancke, L. (1991). The ‘audio-phonatoric coupling’ in stuttering and nonstuttering adults: Experimental contributions. In H. Peters, A. Hulstijn, & C. Starkweather (Eds.), Speech motor control and stuttering (pp. 171–180). Amsterdam: Elsevier Scientific Publishers.
Jones, J. A., & Munhall, K. G. (2000). Perceptual calibration of f0 production: Evidence from feedback perturbation. Journal of the Acoustical Society of America, 108(3 Part 1), 1246–1251.
Jordan, M. I., & Rumelhart, D. E. (1992). Forward models: Supervised learning with a distal teacher. Cognitive Science, 16, 307–354.
Kallail, K. J., & Emanuel, F. W. (1984). Formant-frequency differences between isolated whispered and phonated vowel samples produced by adult female subjects. Journal of Speech and Hearing Research, 27, 245–251.
Kalveram, K. T., & Jancke, L. (1989). Vowel duration and voice onset time for stressed and nonstressed syllables in stutterers under delayed auditory feedback condition. Folia Phoniatrica, 41, 30–42.
Kawahara, H. (1993). Transformed auditory feedback: Effects of fundamental frequency perturbation. Journal of the Acoustical Society of America, 94(3 Part 2), 1883.
Lane, H., & Tranel, B. (1971). The Lombard sign and the role of hearing in speech. Journal of Speech and Hearing Research, 14, 677–709.
Lane, H., & Webster, J. (1991). Speech deterioration in postlingually deafened adults. Journal of the Acoustical Society of America, 89, 859–856.
Lane, H., Wozniak, J., Matthies, M., Svirsky, M., Perkell, J., O'Connell, M., et al. (1997). Changes in sound pressure and fundamental frequency contours following changes in hearing status. Journal of the Acoustical Society of America, 101, 2244–2252.
Larson, C. R. (1998). Cross-modality influences in speech motor control: The use of pitch shifting for the study of f0 control. Journal of Communication Disorders, 31, 489–502.
Lee, B. S. (1950). Some effects of side-tone delay. Journal of the Acoustical Society of America, 22, 639–640.
Levitt, H., Stromberg, H., Smith, C., & Gold, T. (1980). The structure of segmental errors in the speech of deaf children. Journal of Communication Disorders, 13(6), 419–441.
Lombard, E. (1911). Le signe de l'elevation de la voix. Annales maladies oreille larynx nez pharynx, 37, 101–119.
Matthies, M. L., Svirsky, M., Perkell, J., & Lane, H. (1996). Acoustic and articulatory measures of sibilant production with and without auditory feedback from a cochlear implant. Journal of Speech and Hearing Research, 39, 936–946.
Oller, D. K., & Eilers, R. E. (1988). The role of audition in infant babbling. Child Development, 59, 441–449.
Osberger, M. J., & McGarr, N. S. (1982). Speech production characteristics of the hearing-impaired. In N. J. Lass (Ed.), Speech and language: Advances in basic research and practice (pp. 221–284). New York: Academic Press.
O'Shaughnessy, D. (1987). Speech communication: Human and machine. Reading, MA: Addison-Wesley.
Perkell, J. S. (1996). Articulatory processes. In W. J. Hardcastle & J. Laver (Eds.), The handbook of phonetic sciences (pp. 333–370). London: Blackwell.
Polit, A., & Bizzi, E. (1979). Characteristics of motor programs underlying arm movements in monkeys. Journal of Neurophysiology, 42(1 Part 1), 183–194.
Ross, M., & Giolas, T. G. (1978). Auditory management of hearing-impaired children: Principles and prerequisites for intervention. Baltimore: University Park Press.
Sainburg, R. L., Ghilardi, M. F., Poizner, H., & Ghez, C. (1995). Control of limb dynamics in normal subjects and patients without proprioception. Journal of Neurophysiology, 73, 820–835.
Schacter, D. L. (1995). Implicit memory: A new frontier for cognitive neuroscience. In M. S. Gazzaniga (Ed.), The cognitive neurosciences (pp. 815–824). Cambridge, MA: MIT Press.
Smith, C. R. (1975). Residual hearing and speech production in deaf children. Journal of Speech and Hearing Research, 18, 795–811.
Stevens, K. N. (1999). Acoustic phonetics. Cambridge, MA: MIT Press.
Titze, I. R. (1994). Principles of voice production. Englewood Cliffs, NJ: Prentice-Hall.
Welch, R. B. (1978). Perceptual modification: Adapting to altered sensory environments. New York: Academic Press.
Welch, R. B. (1986). Adaptation of space perception. In K. R. Boff, L. Kaufman, & J. P. Thomas (Eds.), Handbook of perception and human performance. Vol. 1: Sensory processes and perception (pp. 24-1 to 24-45). New York: John Wiley and Sons.
Yates, A. J. (1963). Delayed auditory feedback. Psychological Bulletin, 60, 213–232.
Information & Authors
Information
Published In
Copyright
Copyright © 2002 American Speech-Language-Hearing Association.
History
- Received: Sep 29, 2000
- Accepted: Dec 31, 2001
- Published in issue: Apr 1, 2002
Keywords
Authors
Metrics & Citations
Metrics
Article Metrics
View all metricsCitations
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
Citing Literature
- Meisam K. Arjmandi, Roozbeh Behroozmand, On the interplay between speech perception and production: insights from research and theories, Frontiers in Neuroscience, 10.3389/fnins.2024.1347614, 18, (2024).
- Ding-lan Tang, Using altered auditory feedback to study pitch compensation and adaptation in tonal language speakers, Frontiers in Human Neuroscience, 10.3389/fnhum.2024.1364803, 18, (2024).
- Chan-Young Park, Minsoo Kim, YongSoo Shim, Nayoung Ryoo, Hyunjoo Choi, Ho Tae Jeong, Gihyun Yun, Hunboc Lee, Hyungryul Kim, SangYun Kim, Young Chul Youn, Harnessing the Power of Voice: A Deep Neural Network Model for Alzheimer’s Disease Detection, Dementia and Neurocognitive Disorders, 10.12779/dnd.2024.23.1.1, 23, 1, (1), (2024).
- Megan Waller, Daniel Yurovsky, Nazbanou Nozari, Production training and contextual similarity hurt the comprehension of new vocabulary, Language, Cognition and Neuroscience, 10.1080/23273798.2024.2429127, (1-24), (2024).
- Shao-Hsuan Lee, Guo-She Lee, Influence of Voice Focus on Auditory Feedback Control of Speech Using Long-Term Average Spectrum, Phon Spectrum, and Accelerometry, Journal of Speech, Language, and Hearing Research, 10.1044/2024_JSLHR-24-00051, 67, 12, (4598-4613), (2024).
- Joji Tsunada, Xiaoqin Wang, Steven J. Eliades, Multiple processes of vocal sensory-motor interaction in primate auditory cortex, Nature Communications, 10.1038/s41467-024-47510-2, 15, 1, (2024).
- Holly K. Hamilton, Daniel H. Mathalon, Neurophysiological Models in Individuals at Clinical High Risk for Psychosis: Using Translational EEG Paradigms to Forecast Psychosis Risk and Resilience, Neurophysiologic Biomarkers in Neuropsychiatric Disorders, 10.1007/978-3-031-69491-2_14, (385-410), (2024).
- Carly Demopoulos, Sara A. Skiba, Brandon E. Kopald, Nitin Bangera, Kim Paulson, Jeffrey David Lewine, Associations between rapid auditory processing of speech sounds and specific verbal communication skills in autism, Frontiers in Psychology, 10.3389/fpsyg.2023.1223250, 14, (2023).
- Kwang S. Kim, Jessica L. Gaines, Benjamin Parrell, Vikram Ramanarayanan, Srikantan S. Nagarajan, John F. Houde, Mechanisms of sensorimotor adaptation in a hierarchical state feedback control model of speech, PLOS Computational Biology, 10.1371/journal.pcbi.1011244, 19, 7, (e1011244), (2023).
- Xiao Cai, Mingkun Ouyang, Yulong Yin, Qingfang Zhang, Sensorimotor Adaptation to Formant-Shifted Auditory Feedback Is Predicted by Language-Specific Factors in L1 and L2 Speech Production, Language and Speech, 10.1177/00238309231202503, 67, 3, (846-869), (2023).
- See more
View Options
Sign In Options
ASHA member? If so, log in with your ASHA website credentials for full access.
Member Login