Game-Based Augmented Visual Feedback for Enlarging Speech Movements in Parkinson's Disease
Publication: Journal of Speech, Language, and Hearing Research
Volume 60, Number 6S
Pages 1818-1825
Abstract
Purpose
The purpose of this pilot study was to demonstrate the effect of augmented visual feedback on acquisition and short-term retention of a relatively simple instruction to increase movement amplitude during speaking tasks in patients with dysarthria due to Parkinson's disease (PD).
Method
Nine patients diagnosed with PD, hypokinetic dysarthria, and impaired speech intelligibility participated in a training program aimed at increasing the size of their articulatory (tongue) movements during sentences. Two sessions were conducted: a baseline and training session, followed by a retention session 48 hr later. At baseline, sentences were produced at normal, loud, and clear speaking conditions. Game-based visual feedback regarding the size of the articulatory working space (AWS) was presented during training.
Results
Eight of nine participants benefited from training, increasing their sentence AWS to a greater degree following feedback as compared with the baseline loud and clear conditions. The majority of participants were able to demonstrate the learned skill at the retention session.
Conclusions
This study demonstrated the feasibility of augmented visual feedback via articulatory kinematics for training movement enlargement in patients with hypokinesia due to PD.
Supplemental Materials
Get full access to this article
View all available purchase options and get full access to this article.
References
Adamovich, S. V., Berkinblit, M. B., Hening, W., Sage, J., & Poizner, H. (2001). The interaction of visual and proprioceptive inputs in pointing to actual and remembered targets in Parkinson's disease. Neuroscience, 104(4), 1027–1041.
Adams, S., Page, D., & Jog, M. (2002). Summary feedback schedules and speech motor learning in Parkinson's disease. Journal of Medical Speech-Language Pathology, 10(4), 215–220.
Atkinson-Clement, C., Sadat, J., & Pinto, S. (2015). Behavioral treatments for speech in Parkinson's disease: Meta-analyses and review of the literature. Neurodegenerative Disease Management, 5, 233–248.
Ballard, K. J., Smith, H. D., Paramatmuni, D., McCabe, P., Theodoros, D. G., & Murdoch, B. E. (2012). Amount of kinematic feedback affects learning of speech motor skills. Motor Control, 16, 106–119.
Berry, J. (2011). Accuracy of the NDI Wave speech research system. Journal of Speech, Language, and Hearing Research, 54, 1295–1301.
Busk, P. L., & Serlin, R. C. (1992). Meta-analysis for single case research. In Kratochwill, T. R. & Levin, J. R. (Eds.), Single-case research design and analysis: New directions for psychology and education (pp. 187–212). Hillsdale, NJ: Erlbaum.
Caviness, J. N., Driver-Dunckley, E., Conor, D. J., Sabbagh, M. N., Henz, J. G., … Adler, C. H. (2007). Defying mild cognitive impairment in Parkinson's disease. Movement Disorders, 22, 1272–1277.
Chiviacowsky, S., Campos, T., & Domingues, M. R. (2010). Reduced frequency of knowledge of results enhances learning in persons with Parkinson's disease. Frontiers in Psychology, 1, 1–6.
Clemensen, J., Larsen, S. B., Kyng, M., & Kirkevold, M. (2007). Participatory design in health sciences: Using cooperative experimental methods in developing health services and computer technology. Qualitative Health Research, 17, 122–130.
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Erlbaum.
Connor, N. P., Ludlow, C. L., & Schultz, G. M. (1989). Stop consonant production in isolated and repeated syllables in Parkinson's disease. Neuropsychologica, 27, 829–838.
Darling, M., & Huber, J. E. (2011). Changes to articulatory kinematics in response to loudness cues in individuals with Parkinson's disease. Journal of Speech, Language, and Hearing Research, 54, 1247–1259.
Doyon, J., Bellec, P., Amsel, R., Penhune, V., Monchi, O., Carrier, J., … Benali, H. (2009). Contributions of the basal ganglia and functionally related brain structures to motor learning. Behavioural Brain Research, 199, 61–75.
Dromey, C. (2000). Articulatory kinematics in patients with Parkinson disease using different speech treatment approaches. Journal of Medical Speech-Language Pathology, 8, 155–161.
Ebersbach, G., Grust, U., Ebersbach, A., Wegner, B., Gandor, F., & Kühn, A. A. (2015). Amplitude-oriented exercise in Parkinson's disease: A randomized study comparing LSVT-BIG and a short training protocol. Journal of Neural Transmission, 122, 253–256.
Farley, B. G., Fox, C. M., Ramig, L. O., & McFarland, D. H. (2008). Intensive amplitude-specific therapeutic approaches for Parkinson's disease: Toward a neuroplasticity-principled rehabilitation model. Topics in Geriatric Rehabilitation, 24, 99–114.
Farley, B. G., & Koshland, G. F. (2005). Training BIG to move faster: The application of the speed–amplitude relation as a rehabilitation strategy for people with Parkinson's disease. Experimental Brain Research, 167, 462–467.
Fisk, J. D., & Doble, S. E. (2002). Construction and validation of a fatigue impact scale for daily administration (D-FIS). Quality of Life Research, 11, 263–272.
Forrest, K., & Weismer, G. (1995). Dynamic aspects of lower lip movement in Parkinsonian and neurologically normal geriatric speakers' production of stress. Journal of Speech and Hearing Research, 38, 260–272.
Golfinopoulos, E., Tourville, J. A., & Guenther, F. H. (2010). The integration of large-scale neural network modeling and functional brain imaging in speech motor control. Neuroimage, 52, 862–874.
Goozee, J. V., Shun, A. K., & Murdoch, B. E. (2011). Effects of increased loudness on tongue movements during speech in nondysarthric speakers with Parkinson's disease. Journal of Medical Speech-Language Pathology, 19, 42–53.
Guadagnoli, M. A., Leis, B., Van Gemmert, A. W., & Stelmach, G. E. (2002). The relationship between knowledge of results and motor learning in Parkinsonian patients. Parkinsonism & Related Disorders, 9, 89–95.
Hodges, N. J., & Franks, I. M. (2001). Learning a coordination skill: Interactive effects of instruction and feedback. Research Quarterly for Exercise and Sport, 72, 132–142.
Huang, H., Wolf, S. L., & He, J. (2006). Recent developments in biofeedback for neuromotor rehabilitation. Journal of Neuroengineering and Rehabilitation, 3(11).
Jacobs, J. V., & Horak, F. B. (2006). Abnormal proprioceptive-motor integration contributes to hypometric postural responses of subjects with Parkinson's disease. Neuroscience, 141, 999–1009.
Klockgether, T., Borutta, M., Rapp, H., Spieker, S., & Dichgans, J. (1995). A defect of kinesthesia in Parkinson's disease. Movement Disorders, 10, 460–465.
Krause, M., Smeddinck, J., & Meyer, R. (2013). A digital game to support voice treatment for Parkinson's disease. In CHI'13 extended abstracts on human factors in computing systems (pp. 445–450). New York, NY: ACM Press.
Logemann, J. A., Fisher, H. B., Boshes, B., & Blonsky, E. R. (1978). Frequency and cooccurrence of vocal tract dysfunctions in the speech of a large sample of Parkinson patients. Journal of Speech and Hearing Disorders, 43, 47–57.
Lohse, K., Shirzad, N., Verster, A., Hodges, N., & Van der Loos, H. M. (2013). Video games and rehabilitation: Using design principles to enhance engagement in physical therapy. Journal of Neurologic Physical Therapy, 37, 166–175.
MathWorks. (2014). MATLAB (R2014a) [Computer software]. R2014a. Retrieved from https://www.mathworks.com/help/releases/R2014a/matlab/index.html
McNaney, R., Othman, M., Richardson, D., Dunphy, P., Amaral, T., Miller, N., … Vines, J. (2016, May). Speeching: Mobile crowdsourced speech assessment to support self-monitoring and management for people with Parkinson's. In Proceedings of the 2016 ACM SIGCHI Conference on Human Factors in Computing Systems (pp. 7–12). New York, NY: ACM Press.
Microsoft Inc. (2014). SQL Server 2014 [Computer software]. Developer Reference for SQL Server 2014. Retrieved from https://msdn.microsoft.com/en-us/library/dd206988(v=sql.120).aspx
Miller, N., Deane, K. H. O., Jones, D., Noble, E. & Gibb, C. (2011). National survey of speech and language therapy provision for people with Parkinson's disease in the United Kingdom: Therapists' practices. International Journal of Language and Communication Disorders, 46, 189–201.
Miller, N., Noble, E., Jones, D., & Burn, D. (2006). Life with communication changes in Parkinson's disease. Age and Ageing, 35, 235–239.
Nackaerts, E., Heremans, E., Vervoort, G., Smits-Engelsman, B., Swinnen, S., Vandenberghe, W., … Nieuwboer, A. (2016). Relearning of writing skills in Parkinson's disease after intensive amplitude training. Movement Disorders, 31, 1209–1216.
Nasreddine, Z. S., Phillips, N. A., Beédirian, V., Charbonneaus, S., Whitehead, V., Collin, I., … Chertkow, H. (2005). The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of American Geriatric Society, 53, 695–699.
Proteau, L., Marteniuk, R. G., & Lévesque, L. (1992). A sensorimotor basis for motor learning: Evidence indicating specificity of practice. Quarterly Journal of Experimental Psychology, 44, 557–575.
Rickards, C., & Cody, F. W. (1997). Proprioceptive control of wrist movements in Parkinson's disease: Reduced muscle vibration-induced errors. Brain, 120, 977–990.
Sapir, S. (2014). Multiple factors are involved in the dysarthria associated with Parkinson's disease: A review with implications for clinical practice and research. Journal of Speech, Language, and Hearing Research, 57, 1330–1343.
Schneider, J. S., Diamond, S. G., & Markham, C. H. (1986). Deficits in orofacial sensorimotor function in Parkinson's disease. Annals of Neurology, 19, 275–282.
Scott, S., & Caird, F. I. (1983). Speech therapy for Parkinson's disease. Journal of Neurology, Neurosurgery & Psychiatry, 46, 140–144.
Shen, X., & Mak, M. K. (2014). Balance and gait training with augmented feedback improves balance confidence in people with Parkinson's disease: A randomized controlled trial. Neurorehabilitation and Neural Repair, 28, 524–535.
Shtern, M., Haworth, M. B., Yunusova, Y., Baljko, M., & Faloutsos, P. (2012). A game system for speech rehabilitation. Motion in Games, 7660, 43–54.
Smith, M. C., & Fucetola, R. (1995). Effects of delayed visual feedback on handwriting in Parkinson's disease. Human Movement Science, 14, 109–123.
Tjaden, K., Sussman, J. E., & Wilding, G. E. (2014). Impact of clear, loud, and slow speech on scaled intelligibility and speech severity in Parkinson's disease and multiple sclerosis. Journal of Speech, Language, and Hearing Research, 57, 779–792.
Unity Technologies, Inc. (2015). Unity 3D (Version 4.6.5p1) [Computer software]. Unity Manual. Retrieved from https://docs.unity3d.com/460/Documentation/Manual/index.html
Walsh, B., & Smith, A. (2012). Basic parameters of articulatory movements and acoustics in individuals with Parkinson's disease. Movement Disorders, 27, 843–850.
Weismer, G., Yunusova, Y., & Bunton, K. (2012). Measures to evaluate the effects of DBS on speech production. Journal of Neurolinguistics, 25, 74–94.
Wulf, G. (2007). Self-controlled practice enhances motor learning: Implications for physiotherapy. Physiotherapy, 93, 96–101.
Wulf, G., & Shea, C. (2004). Understanding the role of augmented feedback: The good, the bad, and the ugly. In Williams, A. M. & Hodes, N. J. (Eds.), Skill acquisition in sport: Research, theory, and practice (pp.121–144). London: Routledge.
Vaillancourt, D. E., Slifkin, A. B., & Newell, K. M. (2001). Visual control of isometric force in Parkinson's disease. Neuropsychologia, 39, 1410–1418.
Yorkston, K., Beukelman, D., Hakel, M., & Dorsey, M. (2007). Sentence Intelligibility Test. Lincoln, NE: Madonna Rehabilitation Hospital.
Yunusova, Y., Weismer, G., Kent, R. D., & Rusche, N. M. (2005). Breath-group intelligibility in dysarthria: Characteristics and underlying correlates. Journal of Speech, Language, and Hearing Research, 48, 1294–1310.
Yunusova, Y., Weismer, G., Westbury, J. R., & Lindstrom, M. J. (2008). Articulatory movements during vowels in speakers with dysarthria and healthy controls. Journal of Speech, Language, and Hearing Research, 51, 596–611.
Information & Authors
Information
Published In
Journal of Speech, Language, and Hearing Research
Volume 60 • Number 6S • 22 June 2017
Pages: 1818-1825
PubMed: 28655041
Copyright
Copyright © 2017 American Speech-Language-Hearing Association.
History
- Received: Jun 14, 2016
- Revised: Nov 3, 2016
- Accepted: Dec 8, 2016
- Published in issue: Jun 22, 2017
Authors
Metrics & Citations
Metrics
Article Metrics
View all metricsCitations
Download article citation data for:
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.
For more information or tips please see 'Downloading to a citation manager' in the Help menu.
Citing Literature
- Fiona Höbler, Tali Bitan, Luc Tremblay, Luc De Nil, Explicit benefits: Motor sequence acquisition and short-term retention in adults who do and do not stutter, Journal of Fluency Disorders, 10.1016/j.jfludis.2023.105959, 75, (105959), (2023).
- Inga-Lena Johansson, Christina Samuelsson, Nicole Müller, Consonant articulation acoustics and intelligibility in Swedish speakers with Parkinson’s disease: a pilot study, Clinical Linguistics & Phonetics, 10.1080/02699206.2022.2095926, 37, 9, (845-865), (2022).
- Tim Brackenbury, Lisa Kopf, Serious Games and Gamification: Game-Based Learning in Communication Sciences and Disorders, Perspectives of the ASHA Special Interest Groups, 10.1044/2021_PERSP-21-00284, 7, 2, (482-498), (2022).
- Nooralisa Mohd Tuah, Fatimah Ahmedy, Abdullah Gani, Lionelson Norbert Yong, A Survey on Gamification for Health Rehabilitation Care: Applications, Opportunities, and Open Challenges, Information, 10.3390/info12020091, 12, 2, (91), (2021).
- Johanna Nissinen, Severi Konttinen, Emmi-Lotta Rauhala, Charlotta Elo, Johanna Virkki, Tiina Ihalainen, The Possibilities of Smart Clothing in Adult Speech Therapy: Speech Therapists' Visions for the Future, 2021 IEEE 9th International Conference on Serious Games and Applications for Health(SeGAH), 10.1109/SEGAH52098.2021.9551851, (1-7), (2021).
- Annie J. Olmstead, Jimin Lee, Navin Viswanathan, The Role of the Speaker, the Listener, and Their Joint Contributions During Communicative Interactions: A Tripartite View of Intelligibility in Individuals With Dysarthria, Journal of Speech, Language, and Hearing Research, 10.1044/2020_JSLHR-19-00233, 63, 4, (1106-1114), (2020).
- Yasuhiro Tanaka, Tomoki Nanto, Ken Nakatani, Shinya Fukunaga, Rehabilitation for Patients with Dysarthriadysarthria患者に対するリハビリテーション, The Japan Journal of Logopedics and Phoniatrics, 10.5112/jjlp.60.190, 60, 3, (190-195), (2019).
- Marjoke Bakker, Lilian Beijer, Toni Rietveld, Considerations on Effective Feedback in Computerized Speech Training for Dysarthric Speakers, Telemedicine and e-Health, 10.1089/tmj.2018.0050, 25, 5, (351-358), (2019).
- Heli Vaartio-Rajalin, Auvo Rauhala, Lisbeth Fagerström, Person-centered home-based rehabilitation for persons with Parkinson’s disease: A scoping review, International Journal of Nursing Studies, 10.1016/j.ijnurstu.2019.103395, 99, (103395), (2019).
- B. Haworth, E. Kearney, P. Faloutsos, M. Baljko, Y. Yunusova, Electromagnetic articulography (EMA) for real-time feedback application: computational techniques, Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 10.1080/21681163.2018.1434423, 7, 4, (406-413), (2018).
View Options
Sign In Options
ASHA member? If so, log in with your ASHA website credentials for full access.
Member Login