映像情報メディア学会誌
Online ISSN : 1881-6908
Print ISSN : 1342-6907
ISSN-L : 1342-6907
論文
視聴覚情報間の遅延および文章の構成順序が内容の認識に与える影響
鹿島田 千帆長谷川 光司鎌田 一雄阿山 みよし
著者情報
ジャーナル フリー

2008 年 62 巻 12 号 p. 2005-2012

詳細
抄録

We investigated the effect of asynchronization between visual and auditory stimuli of speech movies upon the correct acquisition of the speech contents under various auditory-noise-conditions. We presented movies of a female announcer's face uttering short sentences to subjects who were asked to repeat the sentence aurally. All sentences consist of five words of the same word order (subject time location object verb). The utterance speed was 120 or 150 ms/mora. Audio-visual asynchronies were 0, ±1, ±2, ±4, ±8, ±16, and ±32 frames (1 frame = 1/30 s, +: visual preceding condition, -: audio preceding condition). Pink noise of -10 dB or -15 dB was imposed on the speech sound. The same procedure was done using the stimuli with no visual image (audio-only) as a control. Increase of word recognition rate compared with the level of audio-only was found within an asynchronization of ±4 frames delay indicating that the facilitation by visual information occurs within that period. On the other hand, a decrease of the recognition rate was observed when the delay is over ±8 frames, which indicates that visual information does not improve, or in some conditions, even disturbs the speech recognition. To examine the effect of word order, the same experiment was done using sentences but with a different word order. Subject performed best when presented with the order used in news reading i.e., time location subject object verb, and recognized the subject word more frequently than any others in all conditions. It is interesting that the time range of visual-facilitation is comparable with the time range of audiovisual simultaneity reported in psychophysical studies.

著者関連情報
© 2008 一般社団法人 映像情報メディア学会
前の記事 次の記事
feedback
Top