摘要
字幕作为电影和电视节目的重要组成部分,在视频观看中具有辅助加工的作用。先前的研究认为字幕是视频语言的直接转译,与声音信息具有很高的重叠性,关闭视频的声音不影响被试对字幕的加工。研究以电影视频作为刺激材料,通过控制视频的声音信息,采用眼动技术探讨了声音对字幕偏好性的影响。结果发现:视频的声音信息会对字幕的加工产生影响,关闭声音后字幕的加工时间和次数会增加,对字幕的注视次数和注视时间占总注视的比例超过了50%,说明声音和字幕对视频的理解具有相互辅助的作用。
Movies and television programs are generally dubbed or subtitled in the native language. Subtitle preference or obligation was found in studies of text and graphics integration, movie and television viewing. From previous studies, researchers found that the fixation of subtitle was not affected while the soundtrack was turned off （d＇Ydewalle et al., 1991; d’Ydewalle De Bruycker, 2007; d’Ydewalle et al., 1987）. They concluded that subtitle and sound was overlapped and sound was redundant while they prefer to watch subtitles. The purpose of this study was to investigate the sound effect on subtitle preference while viewing native language movies. Chinese and English subtitle movie clips were chosen as materials, one half with sound and the other half with sound turned off. Thirty two college students were recruited from a normal university as participants. The EyeLink 1000 eye tracker （SR Research, Canada） was used for data collecting. The sample rate was 250Hz, and 800×600 （pixel） resolution. The participants were asked to watch movies naturally and did not know the purpose of the study before the ending. After the eye movements’ data were collected, an inventory of the movie clip content was tested. Total eye movement, areas of interest of subtitle and video, and subtitle pieces were analyzed to find the effects of sound. The results of total eye movements showed that fixation number and saccades were higher, and mean fixation duration was shorter when the sound was turned off than turned on. The comparison between subtitle and video areas showed that participants fixated more on subtitle areas than video areas when the sound was turned off. Furthermore, subtitle pieces were also analyzed to explore the sound effect. The total fixation duration, fixation number, the ratio of fixation number and time were significantly higher when a movie went without sound than with sound. In this study, subtitles familiarity of Chinese and English were also compared. All the results revealed that Chinese subtitles received more fixations than English subtitles. Finally, the results of this study support the hypothesis that the sound of movies could influence subtitle preference while people are viewing movies though sound and subtitles are overlapped. Fixation number and time would get much higher with the movie’s sound turned off than with the sound truned on. The percentages of fixation number and duration were up to 50% in this study. In conclusion, the purpose of subtitle preference is mainly for reading and understanding, and the sound of video can be inactive and help subtitle for movie content processing.
出处
《心理科学》
CSSCI
CSCD
北大核心
2012年第1期44-49,共6页
Journal of Psychological Science
基金
十二五国家科技支撑计划项目"网络行为安全与青少年发展关键技术研究与示范"(2011BAK08B00)
教育部人文社科青年项目(10YJCXLX044)的资助
关键词
字幕偏好性
眼动
电影观看
声音
subtitle preference eye movements movie viewing sound
