人の認識処理に倣った指揮認識システム

概要

論文の詳細を見る
A conducting recognition system has been manufactured experimentally that follows human conducting and controls musical performance in real-time. Since most conducting elements can be directed with only the right hand, the system recognizes important and universal right-hand conducting elements conforming to the conducting grammar: i.e., beginning and ending of a musical piece, beat timing including Agogik (tempo rubato), the beat number in a measure, fermata, dynamics, some aspects of articulation. Actual orchestras produce sound with a specific delay after the corresponding conducted beat. The system, which simulates this delay, can be profitable for unskilled conducting students. The conducting gesture is captured by low cost accelerometers and recognized by HMM (Hidden Markov Models). Since HMM can cope with both time structure variance and the gesture parameter characteristics variance, it produces effects in conducting recognition. Furthermore, musical score information and playing performance information are also applied to the recognition on the fuzzy model of musician's recognition processes. Since there are analogies between conducting and speech recognition, a comparison between them is also explained. The system conforms to the basic conducting grammar which has been systematized through historical polish and is used by orchestras all over the world.