A Study of Image-sound Synchronization

概要

論文の詳細を見る
Synchronization between visual information and auditory information plays an important part in smoothly exchanging information in man-machine interface. In this paper, as a fundamental study on the correlation between visual information and auditory information, sensory evaluation of foot-step (electronic sound signal) together with human walking animation image computer-produced by means of the analysis by synthesis method is selected as an object to be studied, and the image-sound synchronization is evaluated quantitatively. Furthermore, in order to grasp the internal state of the subjects, ECG (electrocardiogram) is measured, and the relation between ECG variability and results of sensory evaluation is discussed. Consequently, it is made clear that ECG (variance of R-R interval (cardiac cycle)) is useful as one of the indices for the working control.
一般社団法人日本機械学会の論文