ANALYSIS AND INTEGRATION OF MULTIMODAL INPUTS IN INTERPRETING TELECOMMUNICATIONS

概要

論文の詳細を見る
The study reported here is an attempt to understand human verbal-gestural behavior in a multimodal bilingual setting. Specific questions addressed are : 1) What kind of deictic gestures people use in a machine-mediated condition, and how these differ from those used in a human-mediated condition, 2) How significant the use of gestures is in each condition. and 3) How verbal and gestural behaviors are interrelated, 4) What the implications of our findings are for a multimodal spoken language interpretation system. In this paper, we attempt to answer these questions, and introduce the architecture of a prototype multimodal user interface system. This system takes spoken language and deictic gestures and produces a semantic representation of the inputs.
一般社団法人情報処理学会の論文
1995-07-20