AN ATTENTIONAL CORRESPONDENCE OF AUDIO-VISUAL EVENTS(International Workshop on Advanced Image Technology 2005)

概要

論文の詳細を見る
A human being understands the environment by integrating information obtained by the senses of sight, hearing and touch. We propose a method of integrating audio-visual information to determine correspondences between audiovisual signals in the real world where the illumination varies and background objects and/or noises exist. The method uses sound source direction as attentional cues and directs attention toward it to observe the scene where a moving object probably exist. After paying attention, the method extracts the visual movement and correspond with the other modalities : hand, sound signals. The model to perceive objects accurately by adjusting camera's iris in varying illumination place or difficult situation to extract the visual movement for an auto-iris. We implemented the method and conducted experiments. The results show the effectiveness of the proposed method in correct corresponding by attention.
社団法人電子情報通信学会の論文
2005-01-03