聴覚障害者向け情報保障のための講師発話内指示語および指示動作抽出手法の検討(高齢者の認知機能保障技術及び一般)

概要

論文の詳細を見る
Remote transcription system is one of the communication support methods for hearing impaired students in a lecture. A transcriber watches the lecture as captured by camera and microphone and transcribes what an instructor says using a PC. The transcription is then showed on a display screen in the classroom. A transcriber sometimes misses a pointing object when the instructor utters a demonstrative word. Therefore, he/she is not able to assign the demonstrative word with the pointing object. In order to solve this problem, we are developing a system to assign the demonstrative word with the pointing object using demonstrative words and pointing gestures, which are automatically extracted from the behavior of the instructor. In this paper, we propose a method to extract demonstrative words with gestures. Performance evaluation results show that the recall ratio is about 90% and the relevance ratio is about 83%.
社団法人電子情報通信学会の論文
2008-11-26