International Journal of Modern Education and Computer Science (IJMECS)
IJMECS Vol. 7, No. 7, 8 Jul. 2015
Cover page and Table of Contents: PDF (size: 869KB)
English Pronunciation Practice Method with CG Animations Representing Mouth and Tongue Movements
Full Text (PDF, 869KB), PP.1-7
Views: 0 Downloads: 0
Author(s)
Kohei Arai
1,*
Mariko Oda
2
Index Terms
English pronunciations, CG animation, mouth movement, tongue movement
Abstract
Method for English pronunciation practice utilizing Computer Graphics: CG animation representing tongue movements together with mouse movements is proposed. Pronunciation practice system based on personalized CG animation of mouth movement model is proposed. The system enables a learner to practice pronunciation by looking at personalized CG animations of mouth movement model , and allows him/her to compare them with his/her own mouth movements. In order to evaluate the effectiveness of the system by using personalized CG animation of mouth movement model, Japanese vowel and consonant sounds were read by 8 infants before and after practicing with the proposed system, and their pronunciations were examined. Remarkable improvement on their pronunciations is confirmed through a comparison to their pronunciation without the proposed system based on identification test by subjective basis. In addition to the mouth movement, tongue movement is represented by CG animation. Experimental results show 20 to 40 % improvement is confirmed by adding tongue movements for pronunciations of “s” and “th”.
Cite This Paper
Kohei Arai, Mariko Oda, "English Pronunciation Practice Method with CG Animations Representing Mouth and Tongue Movements", International Journal of Modern Education and Computer Science (IJMECS), vol.7, no.7, pp.1-7, 2015. DOI:10.5815/ijmecs.2015.07.01
Reference
[1]R.Yamada, et al., Evaluation of the pronunciation of /r/, /l/ by Japanese: An effect of listening training, Proc. Of the Fall Conference of the Acoustic Society of Japan, 3, 3, 9, 397-398, 1995.
[2]T.Yamada, et al., How to improve English speaking scientifically, ATR Lab., BlueBacks, B-1263, 1999.
[3]W.Sumby and I.Pollali, Visual contribution to speech intelligibility in noise, Journal of Acoustic Society of America, 26, 2, 212-215, 1954.
[4]Q.Summerfield, Lip-reading and audio-visual speech recognition, Phil. Trans. Royal Society of London, 71-78, 1992.
[5]D. Reiseberg, et al., Easy to hear but hard to understand: A lip-reading advantage with impact auditory stimulus in hearing by eye, The Psychology of Lip Reading, Lowrence Erlbawin, 746-748, 1987.
[6]P.L. Silsbee, et al., Computer lip reading for improving accuracy in automatic speech recognition, IEEE Trans. Speech and Audio Processing, 4, 5, 337-350, 1996.
[7]M.Oda, S.Oda, K.Arai et al., Web based CAI system for /l/ and /r/ English pronunciation with voices and mouth movement pictures, Journal of Education System Society of Japan, 7, 6, 162-173, 2000.
[8]K.Arai, S.Matsuda, M.Oda, English Pronunciation System Using Voice and Video Recognition Based on Optical Flow, Proc. Of the 2nd International Conference on Information Technology Based Higher Education and Training, 1-6, 2001.
[9]Mariko Oda, Shun Ichinose, Seio Oda, Development of a Pronunciation Practice CAI System Based on Lip Reading Techniques for Deaf Children, Technical Report of the Institute of Electronics, Information, and Communication Engineers of Japan, vol.107， No.179 WIT2007-25(2007).
[10]Mariko Oda, Seio, Oda, and Kohei Arai, Effectiveness of an English /l/ -/r/ Pronunciation Practice CAI System Based on Lip Reading Techniques, Journal of Japan Society of Educational Technology, 26(2)，pp.65－75(2002).
[11]McGurk H, Hearing lips and seeing Voices, Nature, 264, 746-748, 1976.