複合現実空間との新しいマルチモーダル・インタラクション方法の提案と実現(「複合現実感4」特集)

概要

論文の詳細を見る
In mixed reality (MR) space, there is the characteristic that the users can see their hands and the interactive device in their hand. In this study, we propose the novel interaction method with MR space using this characteristic. This multi-model interface was developed based on the traditional pointing device that can manipulate 2D plane or 3D space directly and its feedback uses sound event in the real world, and the visual feedback (and tactile feedback in some cases) in the MR space. More specifically, we attached the small liner microphone array onto a head mounted display (HMD), used the direction and position of sound source for input into MR space, and extended it from 2D to 3D pointing. This paper describes some implementation using our method such as the menu selection and the MR attraction.
2008-06-30