Effect of Consonance between Features and Voice Impression on the McGurk Effect
スポンサーリンク
概要
- 論文の詳細を見る
The McGurk effect is one of the typical phenomena caused by human multi-modal information processing between auditory and visual speech perception. In this paper, we investigated the relation between the degree of the McGurk effect and the perceived impression by speech sounds and moving images of the talker's face. As stimuli, uttered speech sounds were combined with moving images of a different talker's face. These stimuli were presented to observers, who were asked to respond to what the talker was saying. At the same time, they were asked to report their subjective impressions of these stimuli. Matching between the voice and moving image was used as the index of the judgment. Results showed that matching between a voice and a talker's facial movements affected the degree of the McGurk effect, suggesting that audio–visual kansei information affects phoneme perception.
著者
-
Suzuki Yoiti
Research Institute For Electrical Communication/graduate School Of Information Sciences Tohoku Unive
-
Sakamoto Shuichi
Research Institute Of Electrical Communication
-
MISHIMA Hiroshi
Research Institute of Electrical Communication and Graduate School of Information Sciences, Tohoku University
関連論文
- マルチモーダル感覚情報の時空間統合をめぐって(第27回大会シンポジウム2)
- A short noise burst can trigger the release of motion-induced blindness(Summaries of Awarded Presentation at the 28th Annual Meeting)
- Loudness and noisiness of a repeated impact sound : Results of round robin tests in Japan(II)
- Effects of dividing frequency in filtering for dichotic presentation to reduce masking to a consonant by the preceding vowel
- Effects of Contralateral Noise on the Measurement of Auditory Threshold
- A temporal integration model for loudness perception of repeated impulsive sounds
- Equal-loudness level contours for pure tone under free field listening conditions (I) : Some data and considerations on experimental conditions
- Sound Field Reproduction by Controlling the Transfer Functions from the Source to Multiple Points in Close Proximity
- Sound localization in headphone reproduction by simulating transfer functions from the sound source to the external ear
- Interpolation of Head-Related Transfer Functions based on the Common-Acoustical-Pole and Residue model
- Elementary real-time implementation of a virtual acoustic display based on ADVISE
- A new theory for high definition virtual acoustic display named ADVISE
- A database of Head-Related Transfer Functions in whole directions on upper hemisphere
- 正中面に置かれた二音源による音像定位
- Reduction of distributed data size in audio content fingerprinting (CoFIP)
- Blind detection of watermarks embedded by periodical phase shifts
- Comparison of sound localization performance between virtual and real three-dimensional immersive sound field
- The effect of linearly moving sound image on perceived self-motion with vestibular information
- The effects of linearly moving sound images on self-motion perception
- A further investigation into the method for active suppression of reflected sound waves based on the state feedback control
- はりの遠方場における振動インテンシティの能動制御
- Adaptive Control of Vibration Intensity in a Beam in the Frequency Domain (Special Section on Advanced Signal Processing Techniques for Analysis of Acoustical and Vibrational Signals)
- Time-spread echo digital audio watermarking tolerant of pitch shifting
- Calculation of transfer function of acoustic feedback path for in-the-ear hearing aids with a correction for specific acoustic impedance of a tubule
- Audio secret sharing for 1-bit audio
- Robust Watermarking Based on Time-spread Echo Method with Subband Decomposition(Information Security)
- Effects of visual information on auditory presence
- Psychological factors involved in auditory presence
- Sound Quality of Two-tone Complex Sounds with Different Overall Loudness
- Perception of the Quality of Sound Amplitude-modulated with Triangular Waves
- Information Hiding for G.711 Speech Based on Substitution of Least Significant Bits and Estimation of Tolerable Distortion
- A method for structural intensity measurement on a plate by using the spectral element method
- Effects of head movement on front-back error in sound localization
- Effects of auditory information change on the visible persistence of moving visual objects(Summary of Awarded Presentation at the 27th Annual Meeting)
- Evaluations of TS-BASE for speech enhancement and binaural benefits preservation (応用音響)
- Adaptive β-order Generalized Spectral Subtraction for Speech Enhancement
- Auditory search asymmetry between normal Japanese speech sounds and time-reversed speech sounds distributed on the frontal-horizontal plane
- A Two-Microphone Noise Reduction Method in Highly Non-stationary Multiple-Noise-Source Environments
- Audiovisual synchrony perception of simplified speech sounds heard as speech and non-speech
- An estimation method of interaural time differences from measured head-related impulse responses
- Comparison of loudness functions suitable for drawing equal-loudness-level contours
- Two-dimensional localization of a phantom sound image controlled by the level differences among four loudspeakers in a vertical plane facing a listener
- Complementary relationship between familiarity and SNR in word intelligibility test
- Effects of pause duration and speech rate on sentence intelligibility in younger and older adult listeners
- Loudspeaker distributions suitable for crosstalk cancellers robust to head rotation
- Effect of Consonance between Features and Voice Impression on the McGurk Effect
- Effective control point layout for boundary surface control method based on the eigenfunction of the internal Dirichlet problem
- Effect of Consonance between Features and Voice Impression on the McGurk Effect ( Fundamental Aspects and Recent Developments in Multimedia and VLSI Systems)