Design and Implementation of a Multimodal Interaction Description Language based on Data Modeling.

概要

論文の詳細を見る
It is necessary to establish a methodology of developing multimodal interactive systems as the spread of various input and output devices. Previous MMI (MultiModal Interaction) description language used a state transition model for defining interaction and that has low maintainability and extensibility. In this paper, we design and implement a new MMI description language named MrailsScript from the software engineering point of view. MrailsScript consists of the datamodel definition that can be inherited from semantic web class definition, and the annotations of interaction task and dialogue initiative. By expanding the existing web application development framework, our Mrails framework can automatically generate prototype codes of MMI application which is based on MVC (Model-View-Controller) model. We also developed a helper application of MMI system, MrailsBuilder, which assists coding of MrailsScript and realizes multilingual capability of the target MMI system.
一般社団法人人工知能学会の論文